Assessing the Scalability of Biologically-Motivated Deep Learning Algorithms and Architectures

12 July 2018

Papers citing "Assessing the Scalability of Biologically-Motivated Deep Learning Algorithms and Architectures"

50 / 133 papers shown

Title
Navigating Local Minima in Quantized Spiking Neural Networks Jason Eshraghian Corey Lammie M. R. Azghadi Wei D. Lu 20 16 0 15 Feb 2022
Towards Scaling Difference Target Propagation by Learning Backprop Targets M. Ernoult Fabrice Normandin A. Moudgil Sean Spinney Eugene Belilovsky Irina Rish Blake A. Richards Yoshua Bengio 19 28 0 31 Jan 2022
Low-Pass Filtering SGD for Recovering Flat Optima in the Deep Learning Optimization Landscape Devansh Bisla Jing Wang A. Choromańska 25 34 0 20 Jan 2022
The brain as a probabilistic transducer: an evolutionarily plausible network architecture for knowledge representation, computation, and behavior J. Halpern A. Lotem 11 2 0 26 Dec 2021
Target Propagation via Regularized Inversion Vincent Roulet Zaïd Harchaoui BDL AAML 27 4 0 02 Dec 2021
How and When Random Feedback Works: A Case Study of Low-Rank Matrix Factorization Shivam Garg Santosh Vempala 28 3 0 17 Nov 2021
Latent Equilibrium: A unified learning theory for arbitrarily fast computation with arbitrarily slow neurons Paul Haider B. Ellenberger Laura Kriener Jakob Jordan Walter Senn Mihai A. Petrovici 27 24 0 27 Oct 2021
Convergence Analysis and Implicit Regularization of Feedback Alignment for Deep Linear Networks M. Girotti Ioannis Mitliagkas Gauthier Gidel 19 1 0 20 Oct 2021
Cascaded Compressed Sensing Networks: A Reversible Architecture for Layerwise Learning Weizhi Lu Mingrui Chen Kai Guo Weiyu Li 6 0 0 20 Oct 2021
Biologically Plausible Training Mechanisms for Self-Supervised Learning in Deep Networks Mufeng Tang Yibo Yang Y. Amit SSL 16 7 0 30 Sep 2021
Training Spiking Neural Networks Using Lessons From Deep Learning Jason Eshraghian Max Ward Emre Neftci Xinxin Wang Gregor Lenz Girish Dwivedi Bennamoun Doo Seok Jeong Wei D. Lu 40 433 0 27 Sep 2021
BioLCNet: Reward-modulated Locally Connected Spiking Neural Networks Hafez Ghaemi Erfan Mirzaei Mahbod Nouri Saeed Reza Kheradpisheh 16 2 0 12 Sep 2021
Benchmarking the Accuracy and Robustness of Feedback Alignment Algorithms Albert Jiménez Sanfiz Mohamed Akrout OOD AAML 14 8 0 30 Aug 2021
Tourbillon: a Physically Plausible Neural Architecture Mohammadamin Tavakoli Peter Sadowski Pierre Baldi 29 0 0 13 Jul 2021
Towards Biologically Plausible Convolutional Networks Roman Pogodin Yash Mehta Timothy Lillicrap P. Latham 26 22 0 22 Jun 2021
How to Train Your Wide Neural Network Without Backprop: An Input-Weight Alignment Perspective Akhilan Boopathy Ila Fiete 39 9 0 15 Jun 2021
Credit Assignment in Neural Networks through Deep Feedback Control Alexander Meulemans Matilde Tristany Farinha Javier García Ordónez Pau Vilimelis Aceituno João Sacramento Benjamin Grewe 31 35 0 15 Jun 2021
Decoupled Greedy Learning of CNNs for Synchronous and Asynchronous Distributed Learning Eugene Belilovsky Louis Leconte Lucas Caccia Michael Eickenberg Edouard Oyallon 14 7 0 11 Jun 2021
Convergence and Alignment of Gradient Descent with Random Backpropagation Weights Ganlin Song Ruitu Xu John D. Lafferty ODL 54 21 0 10 Jun 2021
Front Contribution instead of Back Propagation Swaroop Mishra Anjana Arunkumar 12 0 0 10 Jun 2021
Credit Assignment Through Broadcasting a Global Error Vector David G. Clark L. F. Abbott SueYeon Chung 25 23 0 08 Jun 2021
A brain basis of dynamical intelligence for AI and computational neuroscience J. Monaco Kanaka Rajan Grace M. Hwang AI4CE 26 6 0 15 May 2021
Learning in Deep Neural Networks Using a Biologically Inspired Optimizer Giorgia Dellaferrera Stanisław Woźniak Giacomo Indiveri A. Pantazi E. Eleftheriou 28 2 0 23 Apr 2021
Back to Square One: Superhuman Performance in Chutes and Ladders Through Deep Neural Networks and Tree Search Dylan R. Ashley Anssi Kanervisto Brendan Bennett 19 2 0 01 Apr 2021
Training Dynamical Binary Neural Networks with Equilibrium Propagation Jérémie Laydevant M. Ernoult D. Querlioz Julie Grollier 26 16 0 16 Mar 2021
Gradient-adjusted Incremental Target Propagation Provides Effective Credit Assignment in Deep Neural Networks Sander Dalm Nasir Ahmad L. Ambrogioni Marcel van Gerven 23 1 0 23 Feb 2021
Revisiting Locally Supervised Learning: an Alternative to End-to-end Training Yulin Wang Zanlin Ni Shiji Song Le Yang Gao Huang 9 82 0 26 Jan 2021
Training Deep Architectures Without End-to-End Backpropagation: A Survey on the Provably Optimal Methods Shiyu Duan José C. Príncipe MQ 38 3 0 09 Jan 2021
Training DNNs in O(1) memory with MEM-DFA using Random Matrices Tien Chu Kamil Mykitiuk Miron Szewczyk Adam Wiktor Z. Wojna 15 2 0 21 Dec 2020
Consequences of Slow Neural Dynamics for Incremental Learning Shima Rahimi Moghaddam Fanjun Bu C. Honey OOD AI4CE 25 0 0 12 Dec 2020
The Neural Coding Framework for Learning Generative Models Alexander Ororbia Daniel Kifer GAN 26 65 0 07 Dec 2020
Attention Aware Cost Volume Pyramid Based Multi-view Stereo Network for 3D Reconstruction Anzhu Yu Wenyue Guo Bing Liu Xin Chen Xin Wang Xuefeng Cao Bingchuan Jiang 3DV 26 64 0 25 Nov 2020
Align, then memorise: the dynamics of learning with feedback alignment Maria Refinetti Stéphane dÁscoli Ruben Ohana Sebastian Goldt 26 36 0 24 Nov 2020
Identifying Learning Rules From Neural Network Observables Aran Nayebi S. Srivastava Surya Ganguli Daniel L. K. Yamins 8 21 0 22 Oct 2020
Local plasticity rules can learn deep representations using self-supervised contrastive predictions Bernd Illing Jean-Paul Ventura G. Bellec W. Gerstner SSL DRL 54 69 0 16 Oct 2020
Investigating the Scalability and Biological Plausibility of the Activation Relaxation Algorithm Beren Millidge Alexander Tschantz A. Seth Christopher L. Buckley 22 0 0 13 Oct 2020
Differentially Private Deep Learning with Direct Feedback Alignment Jaewoo Lee Daniel Kifer FedML 9 9 0 08 Oct 2020
Finite Versus Infinite Neural Networks: an Empirical Study Jaehoon Lee S. Schoenholz Jeffrey Pennington Ben Adlam Lechao Xiao Roman Novak Jascha Narain Sohl-Dickstein 28 208 0 31 Jul 2020
Deriving Differential Target Propagation from Iterating Approximate Inverses Yoshua Bengio 10 24 0 29 Jul 2020
Biological credit assignment through dynamic inversion of feedforward networks William F. Podlaski C. Machens 13 19 0 10 Jul 2020
A Theoretical Framework for Target Propagation Alexander Meulemans Francesco S. Carzaniga Johan A. K. Suykens João Sacramento Benjamin Grewe AAML 27 77 0 25 Jun 2020
Direct Feedback Alignment Scales to Modern Deep Learning Tasks and Architectures Julien Launay Iacopo Poli Franccois Boniface Florent Krzakala 36 62 0 23 Jun 2020
Learning to Learn with Feedback and Local Plasticity Jack W Lindsey Ashok Litwin-Kumar CLL 34 32 0 16 Jun 2020
Equilibrium Propagation for Complete Directed Neural Networks Matilde Tristany S. Pequito P. A. Santos Mário A. T. Figueiredo 15 0 0 15 Jun 2020
Kernelized information bottleneck leads to biologically plausible 3-factor Hebbian learning in deep networks Roman Pogodin P. Latham 24 34 0 12 Jun 2020
GAIT-prop: A biologically plausible learning rule derived from backpropagation of error Nasir Ahmad Marcel van Gerven L. Ambrogioni AAML 15 25 0 11 Jun 2020
Scaling Equilibrium Propagation to Deep ConvNets by Drastically Reducing its Gradient Estimator Bias Axel Laborieux M. Ernoult B. Scellier Yoshua Bengio Julie Grollier D. Querlioz 8 69 0 06 Jun 2020
Towards On-Chip Bayesian Neuromorphic Learning Nathan Wycoff Prasanna Balaprakash Fangfang Xia 14 1 0 05 May 2020
Overcoming the Weight Transport Problem via Spike-Timing-Dependent Weight Inference Nasir Ahmad L. Ambrogioni Marcel van Gerven 13 2 0 09 Mar 2020
Two Routes to Scalable Credit Assignment without Weight Symmetry D. Kunin Aran Nayebi Javier Sagastuy-Breña Surya Ganguli Jonathan M. Bloom Daniel L. K. Yamins 31 31 0 28 Feb 2020