Direct Feedback Alignment Provides Learning in Deep Neural Networks

6 September 2016

Papers citing "Direct Feedback Alignment Provides Learning in Deep Neural Networks"

48 / 248 papers shown

Title
Accelerated CNN Training Through Gradient Approximation Ziheng Wang Sree Harsha Nelaturu 155 5 0 15 Aug 2019
Metalearned Neural Memory Tsendsuren Munkhdalai Alessandro Sordoni Tong Wang Adam Trischler KELM 17 60 0 23 Jul 2019
Fully Decoupled Neural Network Learning Using Delayed Gradients Huiping Zhuang Yi Wang Qinglai Liu Shuai Zhang Zhiping Lin FedML 25 30 0 21 Jun 2019
Associated Learning: Decomposing End-to-end Backpropagation based on Auto-encoders and Target Propagation Yu-Wei Kao Hung-Hsuan Chen BDL 20 5 0 13 Jun 2019
Principled Training of Neural Networks with Direct Feedback Alignment Julien Launay Iacopo Poli Florent Krzakala 27 35 0 11 Jun 2019
Learning to solve the credit assignment problem B. Lansdell P. Prakash Konrad Paul Kording 18 50 0 03 Jun 2019
SpikeGrad: An ANN-equivalent Computation Model for Implementing Backpropagation with Spikes Johannes C. Thiele O. Bichler A. Dupret 17 32 0 03 Jun 2019
Memorized Sparse Backpropagation Zhiyuan Zhang Pengcheng Yang Xuancheng Ren Qi Su Xu Sun 13 13 0 24 May 2019
Design of Artificial Intelligence Agents for Games using Deep Reinforcement Learning A. Roibu 29 1 0 10 May 2019
Biologically plausible deep learning -- but how far can we go with shallow networks? Bernd Illing W. Gerstner Johanni Brea 24 94 0 27 Feb 2019
DANTE: Deep AlterNations for Training nEural networks Vaibhav Sinha Sneha Kudugunta Adepu Ravi Sankar Surya Teja Chavali Purushottam Kar V. Balasubramanian 6 3 0 01 Feb 2019
Network Parameter Learning Using Nonlinear Transforms, Local Representation Goals and Local Propagation Constraints Dimche Kostadinov Behrooz Razdehi Slava Voloshynovskiy 20 0 0 31 Jan 2019
Direct Feedback Alignment with Sparse Connections for Local Learning Brian Crafton A. Parihar Evan Gebhardt A. Raychowdhury 14 56 0 30 Jan 2019
Surrogate Gradient Learning in Spiking Neural Networks Emre Neftci Hesham Mostafa Friedemann Zenke 21 1,211 0 28 Jan 2019
Biologically inspired alternatives to backpropagation through time for learning in recurrent neural nets G. Bellec Franz Scherr Elias Hajek Darjan Salaj Robert Legenstein Wolfgang Maass PINN 16 89 0 25 Jan 2019
Decoupled Greedy Learning of CNNs Eugene Belilovsky Michael Eickenberg Edouard Oyallon 11 115 0 23 Jan 2019
Training Neural Networks with Local Error Signals Arild Nøkland L. Eidnes 32 226 0 20 Jan 2019
Efficient Convolutional Neural Network Training with Direct Feedback Alignment Donghyeon Han H. Yoo 3DV 16 17 0 06 Jan 2019
Feedback alignment in deep convolutional networks Theodore H. Moskovitz Ashok Litwin-Kumar L. F. Abbott 27 60 0 12 Dec 2018
Synaptic Plasticity Dynamics for Deep Continuous Local Learning (DECOLLE) Jacques Kaiser Hesham Mostafa Emre Neftci 17 23 0 27 Nov 2018
Dendritic cortical microcircuits approximate the backpropagation algorithm João Sacramento Rui Ponte Costa Yoshua Bengio Walter Senn 16 308 0 26 Oct 2018
Continual Learning of Recurrent Neural Networks by Locally Aligning Distributed Representations Alexander Ororbia A. Mali C. Lee Giles Daniel Kifer 29 63 0 17 Oct 2018
Tangent: Automatic differentiation using source-code transformation for dynamically typed array programming B. V. Merrienboer D. Moldovan Alexander B. Wiltschko 17 31 0 25 Sep 2018
Error Forward-Propagation: Reusing Feedforward Connections to Propagate Errors in Deep Learning Adam A. Kohan E. Rietman H. Siegelmann 58 24 0 09 Aug 2018
Backprop Evolution Maximilian Alber Irwan Bello Barret Zoph Pieter-Jan Kindermans Prajit Ramachandran Quoc V. Le 16 9 0 08 Aug 2018
Backprop-Q: Generalized Backpropagation for Stochastic Computation Graphs Xiaoran Xu Songpeng Zu Yuan Zhang Hanning Zhou Wei Feng BDL 16 4 0 25 Jul 2018
Assessing the Scalability of Biologically-Motivated Deep Learning Algorithms and Architectures Sergey Bartunov Adam Santoro Blake A. Richards Luke Marris Geoffrey E. Hinton Timothy Lillicrap 26 240 0 12 Jul 2018
Training Neural Networks Using Features Replay Zhouyuan Huo Bin Gu Heng-Chiao Huang 33 69 0 12 Jul 2018
Guided evolutionary strategies: Augmenting random search with surrogate gradients Niru Maheswaranathan Luke Metz George Tucker Dami Choi Jascha Narain Sohl-Dickstein 25 20 0 26 Jun 2018
Unsupervised Learning by Competing Hidden Units Dmitry Krotov J. Hopfield SSL 9 166 0 26 Jun 2018
Contrastive Hebbian Learning with Random Feedback Weights Georgios Detorakis Travis Bartley Emre Neftci 34 26 0 19 Jun 2018
Multi-Layered Gradient Boosting Decision Trees Ji Feng Yang Yu Zhi-Hua Zhou AI4CE 22 120 0 31 May 2018
Biologically Motivated Algorithms for Propagating Local Target Representations Alexander Ororbia A. Mali 20 87 0 26 May 2018
Network Learning with Local Propagation Dimche Kostadinov Behrooz Razeghi Sohrab Ferdowsi Slava Voloshynovskiy 14 0 0 20 May 2018
Decoupled Parallel Backpropagation with Convergence Guarantee Zhouyuan Huo Bin Gu Qian Yang Heng-Chiao Huang 23 97 0 27 Apr 2018
Conducting Credit Assignment by Aligning Local Representations Alexander Ororbia A. Mali Daniel Kifer C. Lee Giles ODL 31 29 0 05 Mar 2018
Rapid Adaptation with Conditionally Shifted Neurons Tsendsuren Munkhdalai Xingdi Yuan Soroush Mehri Adam Trischler 21 13 0 28 Dec 2017
Learning in the Machine: the Symmetries of the Deep Learning Channel Pierre Baldi Peter Sadowski Zhiqin Lu 19 30 0 22 Dec 2017
Deep Neural Generative Model of Functional MRI Images for Psychiatric Disorder Diagnosis Takashi Matsubara T. Tashiro K. Uehara MedIm 24 42 0 18 Dec 2017
Learning to Adapt by Minimizing Discrepancy Alexander Ororbia P. Haffner David Reitter C. Lee Giles AI4TS 23 28 0 30 Nov 2017
Deep supervised learning using local errors Hesham Mostafa V. Ramesh Gert Cauwenberghs 41 113 0 17 Nov 2017
A learning framework for winner-take-all networks with stochastic synapses Hesham Mostafa Gert Cauwenberghs BDL 13 14 0 14 Aug 2017
CATERPILLAR: Coarse Grain Reconfigurable Architecture for Accelerating the Training of Deep Neural Networks Yuanfang Li A. Pedram 9 19 0 01 Jun 2017
An Accelerated Analog Neuromorphic Hardware System Emulating NMDA- and Calcium-Based Non-Linear Dendrites Johannes Schemmel Laura Kriener Paul Müller K. Meier 19 74 0 21 Mar 2017
Understanding Synthetic Gradients and Decoupled Neural Interfaces Wojciech M. Czarnecki G. Swirszcz Max Jaderberg Simon Osindero Oriol Vinyals Koray Kavukcuoglu 33 81 0 01 Mar 2017
Adaptive Bidirectional Backpropagation: Towards Biologically Plausible Error Signal Transmission in Neural Networks Hongyin Luo Jie Fu James R. Glass 19 8 0 23 Feb 2017
Neuromorphic Deep Learning Machines Emre Neftci C. Augustine Somnath Paul Georgios Detorakis BDL 135 258 0 16 Dec 2016
Decoupled Neural Interfaces using Synthetic Gradients Max Jaderberg Wojciech M. Czarnecki Simon Osindero Oriol Vinyals Alex Graves David Silver Koray Kavukcuoglu 47 353 0 18 Aug 2016