How Auto-Encoders Could Provide Credit Assignment in Deep Networks via Target Propagation

29 July 2014

Papers citing "How Auto-Encoders Could Provide Credit Assignment in Deep Networks via Target Propagation"

48 / 48 papers shown

Title
Benchmarking Predictive Coding Networks -- Made Simple Luca Pinchetti Chang Qi Oleh Lokshyn Gaspard Olivers Cornelius Emde ... Simon Frieder Bayar I. Menzat Rafal Bogacz Thomas Lukasiewicz Tommaso Salvatori 130 5 0 17 Feb 2025
Tight Stability, Convergence, and Robustness Bounds for Predictive Coding Networks A. Mali Tommaso Salvatori Alexander Ororbia 37 0 0 07 Oct 2024
Contribute to balance, wire in accordance: Emergence of backpropagation from a simple, bio-plausible neuroplasticity rule Xinhao Fan S. P. Mysore 37 0 0 23 May 2024
Learning Sequence Attractors in Recurrent Networks with Hidden Neurons Yao Lu Si Wu 35 3 0 03 Apr 2024
Brain-like Flexible Visual Inference by Harnessing Feedback-Feedforward Alignment Tahereh Toosi Elias B. Issa 19 2 0 31 Oct 2023
Improving equilibrium propagation without weight symmetry through Jacobian homeostasis Axel Laborieux Friedemann Zenke 20 7 0 05 Sep 2023
Biologically-Motivated Learning Model for Instructed Visual Processing R. Abel S. Ullman 25 0 0 04 Jun 2023
Deep Incubation: Training Large Models by Divide-and-Conquering Zanlin Ni Yulin Wang Jiangwei Yu Haojun Jiang Yu Cao Gao Huang VLM 18 11 0 08 Dec 2022
Predictive Coding beyond Gaussian Distributions Luca Pinchetti Tommaso Salvatori Yordan Yordanov Beren Millidge Yuhang Song Thomas Lukasiewicz UQCV BDL 32 11 0 07 Nov 2022
Scaling Forward Gradient With Local Losses Mengye Ren Simon Kornblith Renjie Liao Geoffrey E. Hinton 81 49 0 07 Oct 2022
Biologically-inspired neuronal adaptation improves learning in neural networks Yoshimasa Kubo Eric Chalmers Artur Luczak 17 6 0 08 Apr 2022
Constrained Parameter Inference as a Principle for Learning Nasir Ahmad Ellen Schrader Marcel van Gerven 18 10 0 22 Mar 2022
Gradients without Backpropagation A. G. Baydin Barak A. Pearlmutter Don Syme Frank Wood Philip Torr 38 66 0 17 Feb 2022
Towards Scaling Difference Target Propagation by Learning Backprop Targets M. Ernoult Fabrice Normandin A. Moudgil Sean Spinney Eugene Belilovsky Irina Rish Blake A. Richards Yoshua Bengio 19 28 0 31 Jan 2022
Gradient Descent on Neurons and its Link to Approximate Second-Order Optimization Frederik Benzing ODL 43 23 0 28 Jan 2022
Target Propagation via Regularized Inversion Vincent Roulet Zaïd Harchaoui BDL AAML 21 4 0 02 Dec 2021
On Training Implicit Models Zhengyang Geng Xinyu Zhang Shaojie Bai Yisen Wang Zhouchen Lin 61 69 0 09 Nov 2021
Benchmarking the Accuracy and Robustness of Feedback Alignment Algorithms Albert Jiménez Sanfiz Mohamed Akrout OOD AAML 10 8 0 30 Aug 2021
Feature Alignment as a Generative Process T. S. Farias Jonas Maziero DiffM BDL 21 1 0 23 Jun 2021
Credit Assignment in Neural Networks through Deep Feedback Control Alexander Meulemans Matilde Tristany Farinha Javier García Ordónez Pau Vilimelis Aceituno João Sacramento Benjamin Grewe 31 35 0 15 Jun 2021
Reverse Differentiation via Predictive Coding Tommaso Salvatori Yuhang Song Thomas Lukasiewicz Rafal Bogacz Zhenghua Xu PINN 30 26 0 08 Mar 2021
Training Deep Architectures Without End-to-End Backpropagation: A Survey on the Provably Optimal Methods Shiyu Duan José C. Príncipe MQ 30 3 0 09 Jan 2021
Differentiable Programming à la Moreau Vincent Roulet Zaïd Harchaoui 15 5 0 31 Dec 2020
Self Normalizing Flows Thomas Anderson Keller Jorn W. T. Peters P. Jaini Emiel Hoogeboom Patrick Forré Max Welling 30 14 0 14 Nov 2020
Direct Feedback Alignment Scales to Modern Deep Learning Tasks and Architectures Julien Launay Iacopo Poli Franccois Boniface Florent Krzakala 36 62 0 23 Jun 2020
Learning to Learn with Feedback and Local Plasticity Jack W Lindsey Ashok Litwin-Kumar CLL 34 32 0 16 Jun 2020
Kernelized information bottleneck leads to biologically plausible 3-factor Hebbian learning in deep networks Roman Pogodin P. Latham 24 34 0 12 Jun 2020
GAIT-prop: A biologically plausible learning rule derived from backpropagation of error Nasir Ahmad Marcel van Gerven L. Ambrogioni AAML 13 25 0 11 Jun 2020
Modularizing Deep Learning via Pairwise Learning With Kernels Shiyu Duan Shujian Yu José C. Príncipe MoMe 27 20 0 12 May 2020
Two Routes to Scalable Credit Assignment without Weight Symmetry D. Kunin Aran Nayebi Javier Sagastuy-Breña Surya Ganguli Jonathan M. Bloom Daniel L. K. Yamins 26 31 0 28 Feb 2020
Temporal Coding in Spiking Neural Networks with Alpha Synaptic Function: Learning with Backpropagation Iulia Comsa Krzysztof Potempa Luca Versari T. Fischbacher Andrea Gesmundo J. Alakuijala 23 174 0 30 Jul 2019
Associated Learning: Decomposing End-to-end Backpropagation based on Auto-encoders and Target Propagation Yu-Wei Kao Hung-Hsuan Chen BDL 15 5 0 13 Jun 2019
Principled Training of Neural Networks with Direct Feedback Alignment Julien Launay Iacopo Poli Florent Krzakala 19 35 0 11 Jun 2019
Training Neural Networks with Local Error Signals Arild Nøkland L. Eidnes 18 225 0 20 Jan 2019
Feedback alignment in deep convolutional networks Theodore H. Moskovitz Ashok Litwin-Kumar L. F. Abbott 24 59 0 12 Dec 2018
Combinatorial Attacks on Binarized Neural Networks Elias Boutros Khalil Amrita Gupta B. Dilkina AAML 49 40 0 08 Oct 2018
Assessing the Scalability of Biologically-Motivated Deep Learning Algorithms and Architectures Sergey Bartunov Adam Santoro Blake A. Richards Luke Marris Geoffrey E. Hinton Timothy Lillicrap 12 239 0 12 Jul 2018
Multi-Layered Gradient Boosting Decision Trees Ji Feng Yang Yu Zhi-Hua Zhou AI4CE 14 120 0 31 May 2018
Convergent Block Coordinate Descent for Training Tikhonov Regularized Deep Neural Networks Ziming Zhang M. Brand 26 70 0 20 Nov 2017
Deep Learning as a Mixed Convex-Combinatorial Optimization Problem A. Friesen Pedro M. Domingos 26 20 0 31 Oct 2017
Reconstruction of Hidden Representation for Robust Feature Extraction Zeng Yu Tianrui Li Ning Yu Yi Pan Hongmei Chen Bing-Quan Liu 11 27 0 08 Oct 2017
Decoupled Neural Interfaces using Synthetic Gradients Max Jaderberg Wojciech M. Czarnecki Simon Osindero Oriol Vinyals Alex Graves David Silver Koray Kavukcuoglu 13 353 0 18 Aug 2016
Deep Predictive Coding Networks for Video Prediction and Unsupervised Learning William Lotter Gabriel Kreiman David D. Cox SSL 52 927 0 25 May 2016
ReSeg: A Recurrent Neural Network-based Model for Semantic Segmentation Francesco Visin Marco Ciccone Adriana Romero Kyle Kastner Kyunghyun Cho Yoshua Bengio Matteo Matteucci Aaron Courville VLM SSeg 19 251 0 22 Nov 2015
Online Semi-Supervised Learning with Deep Hybrid Boltzmann Machines and Denoising Autoencoders Alexander Ororbia C. Lee Giles David Reitter AI4CE 12 30 0 22 Nov 2015
How Important is Weight Symmetry in Backpropagation? Q. Liao Joel Z Leibo T. Poggio 9 167 0 17 Oct 2015
Difference Target Propagation Dong-Hyun Lee Saizheng Zhang Asja Fischer Yoshua Bengio AAML 25 346 0 23 Dec 2014
From neural PCA to deep unsupervised learning Harri Valpola BDL 21 184 0 28 Nov 2014