v1v2 (latest)

Decoupled Neural Interfaces using Synthetic Gradients

International Conference on Machine Learning (ICML), 2016

18 August 2016

Max Jaderberg

Wojciech M. Czarnecki

David Silver

Papers citing "Decoupled Neural Interfaces using Synthetic Gradients"

50 / 224 papers shown

Title
Spiking Neural Predictive Coding for Continual Learning from Data Streams Alexander Ororbia 383 35 0 23 Aug 2019
Metalearned Neural MemoryNeural Information Processing Systems (NeurIPS), 2019 Tsendsuren Munkhdalai Alessandro Sordoni Tong Wang Adam Trischler KELM 192 70 0 23 Jul 2019
Compositional Deep Learning Bruno Gavranovic BDL AI4CE 132 8 0 16 Jul 2019
A Unified Framework of Online Learning Algorithms for Training Recurrent Neural NetworksJournal of machine learning research (JMLR), 2019 O. Marschall Dong Wang Cristina Savin FedML 147 76 0 05 Jul 2019
Fully Decoupled Neural Network Learning Using Delayed GradientsIEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2019 Huiping Zhuang Yi Wang Qinglai Liu Shuai Zhang Zhiping Lin FedML 151 33 0 21 Jun 2019
Divide and Conquer: Leveraging Intermediate Feature Representations for Quantized Training of Neural NetworksInternational Conference on Machine Learning (ICML), 2019 Ahmed T. Elthakeb Prannoy Pilligundla Alex Cloninger H. Esmaeilzadeh MQ 175 9 0 14 Jun 2019
Associated Learning: Decomposing End-to-end Backpropagation based on Auto-encoders and Target PropagationNeural Computation (Neural Comput.), 2019 Yu-Wei Kao Hung-Hsuan Chen BDL 315 7 0 13 Jun 2019
Principled Training of Neural Networks with Direct Feedback Alignment Julien Launay Iacopo Poli Florent Krzakala 106 36 0 11 Jun 2019
Learning to solve the credit assignment problemInternational Conference on Learning Representations (ICLR), 2019 B. Lansdell P. Prakash Konrad Paul Kording 165 56 0 03 Jun 2019
Using local plasticity rules to train recurrent neural networks O. Marschall Dong Wang Cristina Savin 50 2 0 28 May 2019
Putting An End to End-to-End: Gradient-Isolated Learning of RepresentationsNeural Information Processing Systems (NeurIPS), 2019 Sindy Löwe Peter O'Connor Bastiaan S. Veeling SSL 273 155 0 28 May 2019
Lifelong Neural Predictive Coding: Learning Cumulatively Online without ForgettingNeural Information Processing Systems (NeurIPS), 2019 Alexander Ororbia A. Mali Daniel Kifer C. Lee Giles CLL KELM 330 21 0 25 May 2019
Efficient Optimization of Loops and Limits with Randomized Telescoping SumsInternational Conference on Machine Learning (ICML), 2019 Alex Beatson Ryan P. Adams 133 21 0 16 May 2019
Formal derivation of Mesh Neural Networks with their Forward-Only gradient PropagationNeural Processing Letters (NPL), 2019 Federico A. Galatolo M. G. Cimino G. Vaglini AI4CE 189 3 0 16 May 2019
Differentiable Game MechanicsJournal of machine learning research (JMLR), 2019 Alistair Letcher David Balduzzi S. Racanière James Martens Jakob N. Foerster K. Tuyls T. Graepel 211 85 0 13 May 2019
Improving Discrete Latent Representations With Differentiable Approximation BridgesIEEE International Joint Conference on Neural Network (IJCNN), 2019 Jason Ramapuram Russ Webb DRL 84 9 0 09 May 2019
Contrastive Learning for Lifted NetworksBritish Machine Vision Conference (BMVC), 2019 Christopher Zach V. Estellers SSL 161 13 0 07 May 2019
You Only Propagate Once: Accelerating Adversarial Training via Maximal PrincipleNeural Information Processing Systems (NeurIPS), 2019 Dinghuai Zhang Tianyuan Zhang Yiping Lu Zhanxing Zhu Bin Dong AAML 270 383 0 02 May 2019
Embodied Neuromorphic Vision with Event-Driven Random Backpropagation Jacques Kaiser Alexander Friedrich J. C. V. Tieck Daniel Reichard A. Rönnau Emre Neftci Rüdiger Dillmann 111 6 0 09 Apr 2019
Alternating Synthetic and Real Gradients for Neural Language Modeling Fangxin Shang Hao Zhang 148 1 0 27 Feb 2019
Modularity as a Means for Complexity Management in Neural Networks Learning David Castillo-Bolado Cayetano Guerra M. Hernández-Tejera 91 6 0 25 Feb 2019
$Error bounds for approximations with deep ReLU neural networks in $W^{s,p}$ norms$ Error bounds for approximations with deep ReLU neural networks in $W^{s,p}$ norms Ingo Gühring Gitta Kutyniok P. Petersen 164 219 0 21 Feb 2019
Optimal Kronecker-Sum Approximation of Real Time Recurrent LearningInternational Conference on Machine Learning (ICML), 2019 Frederik Benzing M. Gauy Asier Mujika A. Martinsson Angelika Steger 224 26 0 11 Feb 2019
Predict Globally, Correct Locally: Parallel-in-Time Optimal Control of Neural Networks P. Parpas Corey Muir OOD 148 12 0 07 Feb 2019
On the Variance of Unbiased Online Recurrent Optimization Tim Cooijmans James Martens 172 14 0 06 Feb 2019
DANTE: Deep AlterNations for Training nEural networksNeural Networks (NN), 2019 Vaibhav Sinha Sneha Kudugunta Adepu Ravi Sankar Surya Teja Chavali Purushottam Kar V. Balasubramanian 205 5 0 01 Feb 2019
TF-Replicator: Distributed Machine Learning for Researchers P. Buchlovsky David Budden Dominik Grewe Chris Jones John Aslanides ... Aidan Clark Sergio Gomez Colmenarejo Aedan Pope Fabio Viola Dan Belov GNN OffRL AI4CE 143 20 0 01 Feb 2019
Network Parameter Learning Using Nonlinear Transforms, Local Representation Goals and Local Propagation Constraints Dimche Kostadinov Behrooz Razdehi Svyatoslav Voloshynovskiy 80 0 0 31 Jan 2019
Biologically inspired alternatives to backpropagation through time for learning in recurrent neural nets G. Bellec Franz Scherr Elias Hajek Darjan Salaj Robert Legenstein Wolfgang Maass PINN 223 94 0 25 Jan 2019
Self-Supervised Generalisation with Meta Auxiliary Learning Shikun Liu Andrew J. Davison Edward Johns SSL OOD 284 172 0 25 Jan 2019
Decoupled Greedy Learning of CNNs Eugene Belilovsky Michael Eickenberg Edouard Oyallon 284 126 0 23 Jan 2019
Training Neural Networks with Local Error Signals Arild Nøkland L. Eidnes 192 248 0 20 Jan 2019
Credit Assignment Techniques in Stochastic Computation Graphs T. Weber N. Heess Lars Buesing David Silver 137 47 0 07 Jan 2019
Greedy Layerwise Learning Can Scale to ImageNet Eugene Belilovsky Michael Eickenberg Edouard Oyallon 312 197 0 29 Dec 2018
Synaptic Plasticity Dynamics for Deep Continuous Local Learning (DECOLLE) Jacques Kaiser Hesham Mostafa Emre Neftci 184 23 0 27 Nov 2018
Stable Opponent Shaping in Differentiable GamesInternational Conference on Learning Representations (ICLR), 2018 Alistair Letcher Jakob N. Foerster David Balduzzi Tim Rocktaschel Shimon Whiteson 310 116 0 20 Nov 2018
Towards learning-to-learn B. Lansdell Konrad Paul Kording 114 19 0 01 Nov 2018
Reversible Recurrent Neural Networks M. Mackay Paul Vicol Jimmy Ba Roger C. Grosse 128 56 0 25 Oct 2018
Continual Learning of Recurrent Neural Networks by Locally Aligning Distributed Representations Alexander Ororbia A. Mali C. Lee Giles Daniel Kifer 300 70 0 17 Oct 2018
Learning to Perform Local Rewriting for Combinatorial Optimization Xinyun Chen Yuandong Tian NAI OffRL 534 399 0 30 Sep 2018
Backprop-Q: Generalized Backpropagation for Stochastic Computation Graphs Xiaoran Xu Songpeng Zu Yuan Zhang Hanning Zhou Wei Feng BDL 130 4 0 25 Jul 2018
Training Neural Networks Using Features Replay Zhouyuan Huo Bin Gu Heng-Chiao Huang 227 75 0 12 Jul 2018
Guided evolutionary strategies: Augmenting random search with surrogate gradients Niru Maheswaranathan Luke Metz George Tucker Dami Choi Jascha Narain Sohl-Dickstein 221 22 0 26 Jun 2018
Gradient Adversarial Training of Neural Networks Ayan Sinha Zhao Chen Vijay Badrinarayanan Andrew Rabinovich AAML 130 36 0 21 Jun 2018
Massively Parallel Video Networks João Carreira Viorica Patraucean L. Mazaré Andrew Zisserman Simon Osindero 163 42 0 11 Jun 2018
Approximating Real-Time Recurrent Learning with Random Kronecker Factors Asier Mujika Florian Meier Angelika Steger 231 63 0 28 May 2018
Biologically Motivated Algorithms for Propagating Local Target Representations Alexander Ororbia A. Mali 323 95 0 26 May 2018
Breaking the Activation Function Bottleneck through Adaptive Parameterization Sebastian Flennerhag Hujun Yin J. Keane Mark Elliot 165 12 0 22 May 2018
Network Learning with Local Propagation Dimche Kostadinov Behrooz Razeghi Sohrab Ferdowsi Svyatoslav Voloshynovskiy 82 0 0 20 May 2018
Local Critic Training of Deep Neural Networks Hojung Lee Jong-Seok Lee 146 8 0 03 May 2018