The Forward-Forward Algorithm: Some Preliminary Investigations

27 December 2022

Papers citing "The Forward-Forward Algorithm: Some Preliminary Investigations"

46 / 146 papers shown

Title
One-class systems seamlessly fit in the forward-forward algorithm Michael W. Hopwood 11 1 0 27 Jun 2023
Beyond Geometry: Comparing the Temporal Structure of Computation in Neural Circuits with Dynamical Similarity Analysis Mitchell Ostrow Adam J. Eisen L. Kozachkov Ila Fiete 38 24 0 16 Jun 2023
Random Feedback Alignment Algorithms to train Neural Networks: Why do they Align? Dominique F. Chu Florian Bacho ODL 28 0 0 04 Jun 2023
Deep Classifier Mimicry without Data Access Steven Braun Martin Mundt Kristian Kersting DiffM 11 4 0 03 Jun 2023
A General Framework for Interpretable Neural Learning based on Local Information-Theoretic Goal Functions Abdullah Makkeh Marcel Graetz Andreas C. Schneider David A. Ehrlich V. Priesemann Michael Wibral 44 1 0 03 Jun 2023
White-Box Transformers via Sparse Rate Reduction Yaodong Yu Sam Buchanan Druv Pai Tianzhe Chu Ziyang Wu Shengbang Tong B. Haeffele Y. Ma ViT 29 80 0 01 Jun 2023
Forward-Forward Training of an Optical Neural Network Ilker Oguz Junjie Ke Qifei Wang Feng Yang Mustafa Yildirim Niyazi Ulaş Dinç J. Hsieh C. Moser D. Psaltis 18 14 0 30 May 2023
Understanding Predictive Coding as an Adaptive Trust-Region Method Francesco Innocenti Ryan Singh Christopher L. Buckley 23 0 0 29 May 2023
Fine-Tuning Language Models with Just Forward Passes Sadhika Malladi Tianyu Gao Eshaan Nichani Alexandru Damian Jason D. Lee Danqi Chen Sanjeev Arora 27 177 0 27 May 2023
Emergent representations in networks trained with the Forward-Forward algorithm Niccolo Tosato Lorenzo Basile Emanuele Ballarin Giuseppe de Alteriis Alberto Cazzaniga A. Ansuini 26 9 0 26 May 2023
Block-local learning with probabilistic latent representations David Kappel Khaleelulla Khan Nazeer Cabrel Teguemne Fokam Christian Mayr Anand Subramoney 24 4 0 24 May 2023
On quantum backpropagation, information reuse, and cheating measurement collapse Amira Abbas Robbie King Hsin-Yuan Huang W. Huggins R. Movassagh D. Gilboa Jarrod R. McClean 42 39 0 22 May 2023
The Integrated Forward-Forward Algorithm: Integrating Forward-Forward and Shallow Backpropagation With Local Losses De Tang 23 3 0 22 May 2023
Layer Collaboration in the Forward-Forward Algorithm Guy Lorberbom Itai Gat Yossi Adi A. Schwing Tamir Hazan 55 11 0 21 May 2023
One Forward is Enough for Neural Network Training via Likelihood Ratio Method Jinyang Jiang Zeliang Zhang Chenliang Xu Zhaofei Yu Yijie Peng 23 11 0 15 May 2023
Forward-Forward Contrastive Learning Md. Atik Ahamed Jin Chen A. Imran MedIm 30 6 0 04 May 2023
Representation Learning via Manifold Flattening and Reconstruction Michael Psenka Druv Pai Vishal Raman S. Sastry Y. Ma 28 10 0 02 May 2023
Feed-Forward Optimization With Delayed Feedback for Neural Networks Katharina Flügel D. Coquelin Marie Weiel Charlotte Debus Achim Streit Markus Goetz AI4CE 40 7 0 26 Apr 2023
Backpropagation-free Training of Deep Physical Neural Networks Ali Momeni Babak Rahmani M. Malléjac Philipp del Hougne Romain Fleury AI4CE PINN 29 54 0 20 Apr 2023
The Concept of Forward-Forward Learning Applied to a Multi Output Perceptron K. F. Karlsson 11 0 0 06 Apr 2023
ChatGPT: More than a Weapon of Mass Deception, Ethical challenges and responses from the Human-Centered Artificial Intelligence (HCAI) perspective A. Sison Marco Tulio Daza Roberto Gozalo-Brizuela E.C. Garrido-Merchán 32 81 0 06 Apr 2023
Grid-SD2E: A General Grid-Feedback in a System for Cognitive Learning Jingyi Feng Chenming Zhang 19 1 0 04 Apr 2023
Contrastive-Signal-Dependent Plasticity: Forward-Forward Learning of Spiking Neural Systems Alexander Ororbia 25 12 0 30 Mar 2023
Building artificial neural circuits for domain-general cognition: a primer on brain-inspired systems-level architecture Jascha Achterberg Danyal Akarca Moataz Assem Moritz P. Heimbach D. Astle John Duncan AI4CE 42 4 0 21 Mar 2023
The Cascaded Forward Algorithm for Neural Network Training Gongpei Zhao Tao Wang Yidong Li Yi Jin Congyan Lang Haibin Ling 11 16 0 17 Mar 2023
SymBa: Symmetric Backpropagation-Free Contrastive Learning with Forward-Forward Algorithm for Optimizing Convergence Heung-Chang Lee Jeonggeun Song 14 17 0 15 Mar 2023
Deep incremental learning models for financial temporal tabular datasets with distribution shifts Thomas Wong Mauricio Barahona OOD AIFin AI4TS 18 0 0 14 Mar 2023
Training neural networks with structured noise improves classification and generalization M. Benedetti Enrico Ventura 15 8 0 26 Feb 2023
Flexible Phase Dynamics for Bio-Plausible Contrastive Learning Ezekiel Williams C. Bredenberg Guillaume Lajoie 27 6 0 24 Feb 2023
Auto-Parallelizing Large Models with Rhino: A Systematic Approach on Production AI Platform Shiwei Zhang Lansong Diao Siyu Wang Zongyan Cao Yiliang Gu Chang Si Ziji Shi Zhen Zheng Chuan Wu W. Lin AI4CE 22 4 0 16 Feb 2023
Online Arbitrary Shaped Clustering through Correlated Gaussian Functions O. Eidheim 11 1 0 13 Feb 2023
Forward Learning with Top-Down Feedback: Empirical and Analytical Characterization R. Srinivasan Francesca Mignacco M. Sorbaro Maria Refinetti A. Cooper Gabriel Kreiman Giorgia Dellaferrera 24 15 0 10 Feb 2023
Graph Neural Networks Go Forward-Forward Daniele Paliotta Mathieu Alain Bálint Máté Franccois Fleuret GNN 17 7 0 10 Feb 2023
Thermodynamic AI and the fluctuation frontier Patrick J. Coles Collin Szczepanski Denis Melanson Kaelan Donatella Antonio J. Martinez Faris M. Sbahi AI4CE 40 16 0 09 Feb 2023
Blockwise Self-Supervised Learning at Scale Shoaib Ahmed Siddiqui David M. Krueger Yann LeCun Stéphane Deny SSL 35 15 0 03 Feb 2023
Computational Dualism and Objective Superintelligence Michael Timothy Bennett AI4CE 15 6 0 02 Feb 2023
The Predictive Forward-Forward Algorithm Alexander Ororbia A. Mali 20 37 0 04 Jan 2023
Low-Variance Forward Gradients using Direct Feedback Alignment and Momentum Florian Bacho Dominique F. Chu 18 7 0 14 Dec 2022
Neuromorphic Computing and Sensing in Space Dario Izzo Alexander Hadjiivanov Domink Dold Gabriele Meoni E. Blazquez 23 11 0 10 Dec 2022
Scaling Forward Gradient With Local Losses Mengye Ren Simon Kornblith Renjie Liao Geoffrey E. Hinton 81 49 0 07 Oct 2022
Activation Learning by Local Competitions Hongchao Zhou AAML 26 7 0 26 Sep 2022
Hebbian Deep Learning Without Feedback Adrien Journé Hector Garcia Rodriguez Qinghai Guo Timoleon Moraitis AAML 28 48 0 23 Sep 2022
Efficient Methods for Natural Language Processing: A Survey Marcos Vinícius Treviso Ji-Ung Lee Tianchu Ji Betty van Aken Qingqing Cao ... Emma Strubell Niranjan Balasubramanian Leon Derczynski Iryna Gurevych Roy Schwartz 28 109 0 31 Aug 2022
Biologically Plausible Training of Deep Neural Networks Using a Top-down Credit Assignment Network Jian-Hui Chen Cheng-Lin Liu Zuoren Wang 23 0 0 01 Aug 2022
Training Spiking Neural Networks Using Lessons From Deep Learning Jason Eshraghian Max Ward Emre Neftci Xinxin Wang Gregor Lenz Girish Dwivedi Bennamoun Doo Seok Jeong Wei D. Lu 40 432 0 27 Sep 2021
And/or trade-off in artificial neurons: impact on adversarial robustness A. Fontana AAML 25 0 0 15 Feb 2021