Direct Feedback Alignment Provides Learning in Deep Neural Networks

6 September 2016

Papers citing "Direct Feedback Alignment Provides Learning in Deep Neural Networks"

50 / 248 papers shown

Title
Forward Direct Feedback Alignment for Online Gradient Estimates of Spiking Neural Networks Florian Bacho Dminique Chu 32 0 0 06 Feb 2024
Cyclic Neural Network Liangwei Yang Hengrui Zhang Zihe Song Jiawei Zhang Weizhi Zhang Jing Ma Philip S. Yu GNN 28 0 0 11 Jan 2024
Training Convolutional Neural Networks with the Forward-Forward algorithm Riccardo Scodellaro A. Kulkarni Frauke Alves Matthias Schröter 34 7 0 22 Dec 2023
Unlocking Deep Learning: A BP-Free Approach for Parallel Block-Wise Training of Neural Networks Anzhe Cheng Zhenkun Wang Chenzhong Yin Mingxi Cheng Heng Ping Xiongye Xiao Shahin Nazarian Paul Bogdan 28 2 0 20 Dec 2023
Convolutional Channel-wise Competitive Learning for the Forward-Forward Algorithm A. Papachristodoulou C. Kyrkou S. Timotheou T. Theocharides 32 8 0 19 Dec 2023
The Trifecta: Three simple techniques for training deeper Forward-Forward networks Thomas Dooms Ing Jyh Tsang José Oramas 38 4 0 29 Nov 2023
Representation Learning in a Decomposed Encoder Design for Bio-inspired Hebbian Learning Achref Jaziri Sina Ditzel Iuliia Pliushch Visvanathan Ramesh SSL 44 1 0 22 Nov 2023
Zenkai -- Framework For Exploring Beyond Backpropagation Greg Short 28 0 0 16 Nov 2023
Brain-like Flexible Visual Inference by Harnessing Feedback-Feedforward Alignment Tahereh Toosi Elias B. Issa 21 2 0 31 Oct 2023
Seeking Next Layer Neurons' Attention for Error-Backpropagation-Like Training in a Multi-Agent Network Framework Arshia Soltani Moakhar Mohammad Azizmalayeri Hossein Mirzaei M. T. Manzuri M. Rohban 33 2 0 15 Oct 2023
DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training Aochuan Chen Yimeng Zhang Jinghan Jia James Diffenderfer Jiancheng Liu Konstantinos Parasyris Yihua Zhang Zheng-Wei Zhang B. Kailkhura Sijia Liu 37 43 0 03 Oct 2023
Convergence guarantees for forward gradient descent in the linear regression model Thijs Bos Johannes Schmidt-Hieber 38 3 0 26 Sep 2023
Improving equilibrium propagation without weight symmetry through Jacobian homeostasis Axel Laborieux Friedemann Zenke 30 7 0 05 Sep 2023
Tensor-Compressed Back-Propagation-Free Training for (Physics-Informed) Neural Networks Yequan Zhao Xinling Yu Zhixiong Chen Zhengwu Liu Sijia Liu Zheng-Wei Zhang PINN 35 11 0 18 Aug 2023
TinyProp -- Adaptive Sparse Backpropagation for Efficient TinyML On-device Learning Marcus Rüb Daniel Maier Daniel Mueller-Gritschneder Patrick Selle 34 3 0 17 Aug 2023
A Novel Method for improving accuracy in neural network by reinstating traditional back propagation technique R. Gokulprasath 18 0 0 09 Aug 2023
S-TLLR: STDP-inspired Temporal Local Learning Rule for Spiking Neural Networks M. Apolinario Kaushik Roy 52 3 0 27 Jun 2023
Can Forward Gradient Match Backpropagation? Louis Fournier Stéphane Rivaud Eugene Belilovsky Michael Eickenberg Edouard Oyallon 21 16 0 12 Jun 2023
Biologically-Motivated Learning Model for Instructed Visual Processing R. Abel S. Ullman 27 0 0 04 Jun 2023
Implicit Regularization in Feedback Alignment Learning Mechanisms for Neural Networks Zachary Robertson Oluwasanmi Koyejo 43 0 0 02 Jun 2023
Reduced Precision Floating-Point Optimization for Deep Neural Network On-Device Learning on MicroControllers D. Nadalini Manuele Rusci Luca Benini Francesco Conti 31 15 0 30 May 2023
Block-local learning with probabilistic latent representations David Kappel Khaleelulla Khan Nazeer Cabrel Teguemne Fokam Christian Mayr Anand Subramoney 29 4 0 24 May 2023
ADA-GP: Accelerating DNN Training By Adaptive Gradient Prediction Vahid Janfaza Shantanu Mandal Farabi Mahmud A. Muzahid 30 2 0 22 May 2023
Training an Ising Machine with Equilibrium Propagation Jérémie Laydevant Danijela Marković Julie Grollier 30 30 0 22 May 2023
Brain-inspired learning in artificial neural networks: a review Samuel Schmidgall Jascha Achterberg Thomas Miconi Louis Kirsch Rojin Ziaei S. P. Hajiseyedrazi Jason K. Eshraghian 38 52 0 18 May 2023
One Forward is Enough for Neural Network Training via Likelihood Ratio Method Jinyang Jiang Zeliang Zhang Chenliang Xu Zhaofei Yu Yijie Peng 25 11 0 15 May 2023
Feed-Forward Optimization With Delayed Feedback for Neural Networks Katharina Flügel D. Coquelin Marie Weiel Charlotte Debus Achim Streit Markus Goetz AI4CE 40 7 0 26 Apr 2023
A Survey on Approximate Edge AI for Energy Efficient Autonomous Driving Services Dewant Katare Diego Perino J. Nurmi M. Warnier Marijn Janssen Aaron Yi Ding 34 37 0 13 Apr 2023
Online Spatio-Temporal Learning with Target Projection Thomas Ortner Lorenzo Pes Joris Gentinetta Charlotte Frenkel A. Pantazi 31 7 0 11 Apr 2023
Learning with augmented target information: An alternative theory of Feedback Alignment Huzi Cheng Joshua W. Brown CVBM 31 0 0 03 Apr 2023
Contrastive-Signal-Dependent Plasticity: Forward-Forward Learning of Spiking Neural Systems Alexander Ororbia 25 14 0 30 Mar 2023
Towards Memory- and Time-Efficient Backpropagation for Training Spiking Neural Networks Qingyan Meng Mingqing Xiao Shen Yan Yisen Wang Zhouchen Lin Zhimin Luo 31 39 0 28 Feb 2023
Forward Learning with Top-Down Feedback: Empirical and Analytical Characterization R. Srinivasan Francesca Mignacco M. Sorbaro Maria Refinetti A. Cooper Gabriel Kreiman Giorgia Dellaferrera 32 15 0 10 Feb 2023
Blockwise Self-Supervised Learning at Scale Shoaib Ahmed Siddiqui David M. Krueger Yann LeCun Stéphane Deny SSL 38 15 0 03 Feb 2023
Dual Propagation: Accelerating Contrastive Hebbian Learning with Dyadic Neurons R. Høier D. Staudt Christopher Zach 36 11 0 02 Feb 2023
SPIDE: A Purely Spike-based Method for Training Feedback Spiking Neural Networks Mingqing Xiao Qingyan Meng Zongpeng Zhang Yisen Wang Zhouchen Lin 27 11 0 01 Feb 2023
Interpreting learning in biological neural networks as zero-order optimization method Johannes Schmidt-Hieber 30 4 0 27 Jan 2023
Learning Reservoir Dynamics with Temporal Self-Modulation Yusuke Sakemi S. Nobukawa Toshitaka Matsuki Takashi Morie Kazuyuki Aihara 21 6 0 23 Jan 2023
ETLP: Event-based Three-factor Local Plasticity for online learning with neuromorphic hardware Fernando M. Quintana Fernando Perez-Peña Pedro L. Galindo Emre O. Netfci Elisabetta Chicca Lyes Khacef 22 11 0 19 Jan 2023
The Predictive Forward-Forward Algorithm Alexander Ororbia A. Mali 35 37 0 04 Jan 2023
Biologically Plausible Learning on Neuromorphic Hardware Architectures Christopher Wolters Brady Taylor Edward Hanson Xiaoxuan Yang Ulf Schlichtmann Yiran Chen 26 3 0 29 Dec 2022
Learning efficient backprojections across cortical hierarchies in real time Kevin Max Laura Kriener Garibaldi Pineda García Thomas Nowotny Ismael Jaras Walter Senn Mihai A. Petrovici OOD 26 15 0 20 Dec 2022
Fixed-Weight Difference Target Propagation Tatsukichi Shibuya Nakamasa Inoue Rei Kawakami Ikuro Sato AAML 24 3 0 19 Dec 2022
Low-Variance Forward Gradients using Direct Feedback Alignment and Momentum Florian Bacho Dominique F. Chu 26 8 0 14 Dec 2022
Is Bio-Inspired Learning Better than Backprop? Benchmarking Bio Learning vs. Backprop Manas Gupta Sarthak Ketanbhai Modi Hang Zhang Joon Hei Lee J. Lim 32 7 0 09 Dec 2022
Deep Incubation: Training Large Models by Divide-and-Conquering Zanlin Ni Yulin Wang Jiangwei Yu Haojun Jiang Yu Cao Gao Huang VLM 20 11 0 08 Dec 2022
Convolutional Neural Generative Coding: Scaling Predictive Coding to Natural Images Alexander Ororbia A. Mali BDL 38 10 0 22 Nov 2022
Meta-Learning Biologically Plausible Plasticity Rules with Random Feedback Pathways Navid Shervani-Tabar Robert Rosenbaum AI4CE 42 14 0 28 Oct 2022
Scaling Laws Beyond Backpropagation Matthew J. Filipovich Alessandro Cappelli Daniel Hesslow Julien Launay 24 3 0 26 Oct 2022
Online Training Through Time for Spiking Neural Networks Mingqing Xiao Qingyan Meng Zongpeng Zhang D.K. He Zhouchen Lin 47 61 0 09 Oct 2022