Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
1608.05343
Cited By
v1
v2 (latest)
Decoupled Neural Interfaces using Synthetic Gradients
International Conference on Machine Learning (ICML), 2016
18 August 2016
Max Jaderberg
Wojciech M. Czarnecki
Simon Osindero
Oriol Vinyals
Alex Graves
David Silver
Koray Kavukcuoglu
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Decoupled Neural Interfaces using Synthetic Gradients"
50 / 224 papers shown
Can Forward Gradient Match Backpropagation?
International Conference on Machine Learning (ICML), 2023
Louis Fournier
Stéphane Rivaud
Eugene Belilovsky
Michael Eickenberg
Edouard Oyallon
330
31
0
12 Jun 2023
Online learning of long-range dependencies
Neural Information Processing Systems (NeurIPS), 2023
Nicolas Zucchet
Robert Meier
Simon Schug
Asier Mujika
João Sacramento
CLL
285
29
0
25 May 2023
Block-local learning with probabilistic latent representations
David Kappel
Khaleelulla Khan Nazeer
Cabrel Teguemne Fokam
Christian Mayr
Anand Subramoney
287
4
0
24 May 2023
ADA-GP: Accelerating DNN Training By Adaptive Gradient Prediction
Micro (MICRO), 2023
Vahid Janfaza
Shantanu Mandal
Farabi Mahmud
A. Muzahid
160
5
0
22 May 2023
Feed-Forward Optimization With Delayed Feedback for Neural Network Training
Katharina Flügel
D. Coquelin
Marie Weiel
Charlotte Debus
Achim Streit
Markus Goetz
AI4CE
313
10
0
26 Apr 2023
Decouple Graph Neural Networks: Train Multiple Simple GNNs Simultaneously Instead of One
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023
Hongyuan Zhang
Yanan Zhu
Xuelong Li
233
33
0
20 Apr 2023
Contrastive-Signal-Dependent Plasticity: Forward-Forward Learning of Spiking Neural Systems
Science Advances (Sci Adv), 2023
Alexander Ororbia
226
12
0
30 Mar 2023
Dual Propagation: Accelerating Contrastive Hebbian Learning with Dyadic Neurons
International Conference on Machine Learning (ICML), 2023
R. Høier
D. Staudt
Christopher Zach
453
12
0
02 Feb 2023
Local Learning with Neuron Groups
Adeetya Patel
Michael Eickenberg
Eugene Belilovsky
167
6
0
18 Jan 2023
The Predictive Forward-Forward Algorithm
Annual Meeting of the Cognitive Science Society (CogSci), 2023
Alexander Ororbia
A. Mali
415
43
0
04 Jan 2023
Local Learning on Transformers via Feature Reconstruction
P. Pathak
Jingwei Zhang
Dimitris Samaras
ViT
310
7
0
29 Dec 2022
Deep Incubation: Training Large Models by Divide-and-Conquering
IEEE International Conference on Computer Vision (ICCV), 2022
Zanlin Ni
Yulin Wang
Jiangwei Yu
Haojun Jiang
Yu Cao
Gao Huang
VLM
243
13
0
08 Dec 2022
Convolutional Neural Generative Coding: Scaling Predictive Coding to Natural Images
Annual Meeting of the Cognitive Science Society (CogSci), 2022
Alexander Ororbia
A. Mali
BDL
250
14
0
22 Nov 2022
Scaling Laws Beyond Backpropagation
Matthew J. Filipovich
Alessandro Cappelli
Daniel Hesslow
Julien Launay
199
4
0
26 Oct 2022
Block-wise Training of Residual Networks via the Minimizing Movement Scheme
Skander Karkar
Ibrahim Ayed
Emmanuel de Bézenac
Patrick Gallinari
214
1
0
03 Oct 2022
Hebbian Deep Learning Without Feedback
International Conference on Learning Representations (ICLR), 2022
Adrien Journé
Hector Garcia Rodriguez
Qinghai Guo
Timoleon Moraitis
AAML
280
67
0
23 Sep 2022
Active Predicting Coding: Brain-Inspired Reinforcement Learning for Sparse Reward Robotic Control Problems
Alexander Ororbia
A. Mali
238
9
0
19 Sep 2022
Biologically Plausible Training of Deep Neural Networks Using a Top-down Credit Assignment Network
Jian-Hui Chen
Cheng-Lin Liu
Zuoren Wang
210
0
0
01 Aug 2022
Layer-Wise Partitioning and Merging for Efficient and Scalable Deep Learning
Social Science Research Network (SSRN), 2022
S. Akintoye
Liangxiu Han
H. Lloyd
Xin Zhang
Darren Dancey
Haoming Chen
Daoqiang Zhang
FedML
192
5
0
22 Jul 2022
GLEAM: Greedy Learning for Large-Scale Accelerated MRI Reconstruction
Batu Mehmet Ozturkler
Arda Sahiner
Tolga Ergen
Arjun D Desai
Christopher M. Sandino
S. Vasanawala
John M. Pauly
Morteza Mardani
Mert Pilanci
153
5
0
18 Jul 2022
Emergent Abilities of Large Language Models
Jason W. Wei
Yi Tay
Rishi Bommasani
Colin Raffel
Barret Zoph
...
Tatsunori Hashimoto
Oriol Vinyals
Abigail Z. Jacobs
J. Dean
W. Fedus
ELM
ReLM
LRM
532
3,141
0
15 Jun 2022
A Robust Backpropagation-Free Framework for Images
Timothy Zee
Alexander Ororbia
A. Mali
Ifeoma Nwogu
243
1
0
03 Jun 2022
BackLink: Supervised Local Training with Backward Links
Wenzhe Guo
M. Fouda
A. Eltawil
K. Salama
153
2
0
14 May 2022
Signal Propagation: A Framework for Learning and Inference In a Forward Pass
IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2022
Adam A. Kohan
E. Rietman
H. Siegelmann
250
33
0
04 Apr 2022
The Frost Hollow Experiments: Pavlovian Signalling as a Path to Coordination and Communication Between Agents
P. Pilarski
Andrew Butcher
Elnaz Davoodi
Michael Bradley Johanson
Dylan J. A. Brenneis
Adam S. R. Parker
Leslie Acker
M. Botvinick
Joseph Modayil
Adam White
AI4CE
152
5
0
17 Mar 2022
Gradient Correction beyond Gradient Descent
Zefan Li
Bingbing Ni
Teng Li
WenJun Zhang
Wen Gao
78
0
0
16 Mar 2022
MetAug: Contrastive Learning via Meta Feature Augmentation
International Conference on Machine Learning (ICML), 2022
Jiangmeng Li
Jingyao Wang
Changwen Zheng
Fuchun Sun
Hui Xiong
302
32
0
10 Mar 2022
Efficient Attribute Unlearning: Towards Selective Removal of Input Attributes from Feature Representations
Tao Guo
Song Guo
Jiewei Zhang
Wenchao Xu
Junxiao Wang
MU
223
24
0
27 Feb 2022
Gradients without Backpropagation
A. G. Baydin
Barak A. Pearlmutter
Don Syme
Frank Wood
Juil Sock
191
86
0
17 Feb 2022
Error-driven Input Modulation: Solving the Credit Assignment Problem without a Backward Pass
International Conference on Machine Learning (ICML), 2022
Giorgia Dellaferrera
Gabriel Kreiman
393
73
0
27 Jan 2022
Learning to Predict Gradients for Semi-Supervised Continual Learning
IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2022
Yan Luo
Yongkang Wong
Mohan S. Kankanhalli
Qi Zhao
SSL
CLL
186
12
0
23 Jan 2022
Neural Capacitance: A New Perspective of Neural Network Selection via Edge Dynamics
Chunheng Jiang
Tejaswini Pedapati
Pin-Yu Chen
Luke Huan
Jianxi Gao
208
2
0
11 Jan 2022
Layer-Parallel Training of Residual Networks with Auxiliary-Variable Networks
Qi Sun
Hexin Dong
Zewei Chen
Jiacheng Sun
Zhenguo Li
Bin Dong
203
3
0
10 Dec 2021
Target Propagation via Regularized Inversion
Vincent Roulet
Zaïd Harchaoui
BDL
AAML
257
5
0
02 Dec 2021
On Training Implicit Models
Neural Information Processing Systems (NeurIPS), 2021
Zhengyang Geng
Xinyu Zhang
Shaojie Bai
Yisen Wang
Zhouchen Lin
352
92
0
09 Nov 2021
Cortico-cerebellar networks as decoupling neural interfaces
Neural Information Processing Systems (NeurIPS), 2021
J. Pemberton
E. Boven
Richard Apps
Rui Ponte Costa
179
7
0
21 Oct 2021
Biologically Plausible Training Mechanisms for Self-Supervised Learning in Deep Networks
Mufeng Tang
Jianlong Wu
Y. Amit
SSL
417
11
0
30 Sep 2021
LayerPipe: Accelerating Deep Neural Network Training by Intra-Layer and Inter-Layer Gradient Pipelining and Multiprocessor Scheduling
Nanda K. Unnikrishnan
Keshab K. Parhi
AI4CE
89
10
0
14 Aug 2021
Knowledge accumulating: The general pattern of learning
Zhuoran Xu
Hao Liu
CLL
156
0
0
09 Aug 2021
Few-Shot and Continual Learning with Attentive Independent Mechanisms
IEEE International Conference on Computer Vision (ICCV), 2021
Eugene Lee
Cheng-Han Huang
Chen-Yi Lee
CLL
142
31
0
29 Jul 2021
Backprop-Free Reinforcement Learning with Active Neural Generative Coding
AAAI Conference on Artificial Intelligence (AAAI), 2021
Alexander Ororbia
A. Mali
345
22
0
10 Jul 2021
Decoupled Greedy Learning of CNNs for Synchronous and Asynchronous Distributed Learning
Eugene Belilovsky
Louis Leconte
Lucas Caccia
Michael Eickenberg
Edouard Oyallon
143
9
0
11 Jun 2021
LocoProp: Enhancing BackProp via Local Loss Optimization
International Conference on Artificial Intelligence and Statistics (AISTATS), 2021
Ehsan Amid
Rohan Anil
Manfred K. Warmuth
ODL
175
21
0
11 Jun 2021
Front Contribution instead of Back Propagation
Swaroop Mishra
Anjana Arunkumar
151
0
0
10 Jun 2021
Bottom-up and top-down approaches for the design of neuromorphic processing systems: Tradeoffs and synergies between natural and artificial intelligence
Proceedings of the IEEE (Proc. IEEE), 2021
Charlotte Frenkel
D. Bol
Giacomo Indiveri
279
59
0
02 Jun 2021
Prediction of the Position of External Markers Using a Recurrent Neural Network Trained With Unbiased Online Recurrent Optimization for Safe Lung Cancer Radiotherapy
Michel Pohl
Mitsuru Uesaka
Hiroyuki Takahashi
K. Demachi
R. B. Chhatkuli
457
9
0
02 Jun 2021
Current State and Future Directions for Learning in Biological Recurrent Neural Networks: A Perspective Piece
Neurons, Behavior, Data analysis, and Theory (NBDT), 2021
Luke Y. Prince
Roy Henha Eyono
E. Boven
Arna Ghosh
Joe Pemberton
...
Rui Ponte Costa
Wolfgang Maass
Blake A. Richards
Cristina Savin
K. Wilmes
CLL
141
4
0
12 May 2021
Perceptual Gradient Networks
Dmitry Nikulin
Roman Suvorov
Aleksei Ivakhnenko
Victor Lempitsky
111
0
0
05 May 2021
Local Critic Training for Model-Parallel Learning of Deep Neural Networks
IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2021
Hojung Lee
Cho-Jui Hsieh
Jong-Seok Lee
136
16
0
03 Feb 2021
Revisiting Locally Supervised Learning: an Alternative to End-to-end Training
International Conference on Learning Representations (ICLR), 2021
Yulin Wang
Zanlin Ni
Shiji Song
Le Yang
Gao Huang
153
96
0
26 Jan 2021
Previous
1
2
3
4
5
Next
