The Forward-Forward Algorithm: Some Preliminary Investigations

27 December 2022

Papers citing "The Forward-Forward Algorithm: Some Preliminary Investigations"

50 / 146 papers shown

Title
Employing Layerwised Unsupervised Learning to Lessen Data and Loss Requirements in Forward-Forward Algorithms Taewook Hwang H. Seo S. Jung 35 2 0 23 Apr 2024
Information encoding and decoding in in-vitro neural networks on micro electrode arrays through stimulation timing Trym A E Lindell O. H. Ramstad Ionna Sandvig A. Sandvig Stefano Nichele 17 2 0 16 Apr 2024
Lightweight Inference for Forward-Forward Algorithm Amin Aminifar Baichuan Huang Azra Abtahi Amir Aminifar 35 3 0 08 Apr 2024
Going Forward-Forward in Distributed Deep Learning Ege Aktemur Ege Zorlutuna Kaan Bilgili Tacettin Emre Bok Berrin Yanikoglu Suha Orhun Mutluergil FedML 23 1 0 30 Mar 2024
Thermal Crosstalk Modelling and Compensation Methods for Programmable Photonic Integrated Circuits Isidora Teofilović A. Cem David Sanchez-Jacome Daniel Pérez-López Francesco Da Ros 26 2 0 19 Mar 2024
Forward Learning of Graph Neural Networks Namyong Park Xing Wang Antoine Simoulin Shuai Yang Grey Yang Ryan Rossi Puja Trivedi Nesreen K. Ahmed GNN 44 1 0 16 Mar 2024
Better than classical? The subtle art of benchmarking quantum machine learning models Joseph Bowles Shahnawaz Ahmed Maria Schuld 39 64 0 11 Mar 2024
Consciousness qua Mortal Computation Johannes Kleiner 29 3 0 06 Mar 2024
Eternal Sunshine of the Mechanical Mind: The Irreconcilability of Machine Learning and the Right to be Forgotten Meem Arafat Manab MU 26 1 0 06 Mar 2024
Training Machine Learning models at the Edge: A Survey Aymen Rayane Khouas Mohamed Reda Bouadjenek Hakim Hacid Sunil Aryal 29 10 0 05 Mar 2024
Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark Yihua Zhang Pingzhi Li Junyuan Hong Jiaxiang Li Yimeng Zhang ... Wotao Yin Mingyi Hong Zhangyang Wang Sijia Liu Tianlong Chen 25 45 0 18 Feb 2024
A Review of Neuroscience-Inspired Machine Learning Alexander Ororbia A. Mali Adam Kohan Beren Millidge Tommaso Salvatori 27 7 0 16 Feb 2024
End-to-End Training Induces Information Bottleneck through Layer-Role Differentiation: A Comparative Analysis with Layer-wise Training Keitaro Sakamoto Issei Sato 24 4 0 14 Feb 2024
Nature-Inspired Local Propagation Alessandro Betti Marco Gori AI4CE 28 0 0 04 Feb 2024
Cyclic Neural Network Liangwei Yang Hengrui Zhang Zihe Song Jiawei Zhang Weizhi Zhang Jing Ma Philip S. Yu GNN 20 0 0 11 Jan 2024
Training Convolutional Neural Networks with the Forward-Forward algorithm Riccardo Scodellaro A. Kulkarni Frauke Alves Matthias Schröter 24 7 0 22 Dec 2023
Convolutional Channel-wise Competitive Learning for the Forward-Forward Algorithm A. Papachristodoulou C. Kyrkou S. Timotheou T. Theocharides 24 8 0 19 Dec 2023
Towards On-device Learning on the Edge: Ways to Select Neurons to Update under a Budget Constraint Ael Quélennec Enzo Tartaglione Pavlo Mozharovskyi Van-Tam Nguyen 31 2 0 08 Dec 2023
The Trifecta: Three simple techniques for training deeper Forward-Forward networks Thomas Dooms Ing Jyh Tsang José Oramas 31 4 0 29 Nov 2023
Evolutionary algorithms as an alternative to backpropagation for supervised training of Biophysical Neural Networks and Neural ODEs James Hazelden Yuhan Helena Liu Eli Shlizerman E. Shea-Brown 41 2 0 17 Nov 2023
A theory for the sparsity emerged in the Forward Forward algorithm Yukun Yang 47 7 0 09 Nov 2023
Sleep Deprivation in the Forward-Forward Algorithm Mircea Tudor Lica David Dinucu-Jianu 11 0 0 28 Oct 2023
Randomized Forward Mode of Automatic Differentiation For Optimization Algorithms Khemraj Shukla Yeonjong Shin ODL 26 4 0 22 Oct 2023
Learning to (Learn at Test Time) Yu Sun Xinhao Li Karan Dalal Chloe Hsu Oluwasanmi Koyejo Carlos Guestrin Xiaolong Wang Tatsunori Hashimoto Xinlei Chen SSL 30 6 0 20 Oct 2023
Recasting Continual Learning as Sequence Modeling Soochan Lee Jaehyeon Son Gunhee Kim CLL 25 9 0 18 Oct 2023
Seeking Next Layer Neurons' Attention for Error-Backpropagation-Like Training in a Multi-Agent Network Framework Arshia Soltani Moakhar Mohammad Azizmalayeri Hossein Mirzaei M. T. Manzuri M. Rohban 28 2 0 15 Oct 2023
DPZero: Private Fine-Tuning of Language Models without Backpropagation Liang Zhang Bingcong Li K. K. Thekumparampil Sewoong Oh Niao He 28 11 0 14 Oct 2023
How connectivity structure shapes rich and lazy learning in neural circuits Yuhan Helena Liu A. Baratin Jonathan H. Cornford Stefan Mihalas E. Shea-Brown Guillaume Lajoie 40 14 0 12 Oct 2023
Based on What We Can Control Artificial Neural Networks Cheng Kang Xujing Yao 13 0 0 09 Oct 2023
How Graph Neural Networks Learn: Lessons from Training Dynamics Chenxiao Yang Qitian Wu David Wipf Ruoyu Sun Junchi Yan AI4CE GNN 22 1 0 08 Oct 2023
ECoFLaP: Efficient Coarse-to-Fine Layer-Wise Pruning for Vision-Language Models Yi-Lin Sung Jaehong Yoon Mohit Bansal VLM 17 14 0 04 Oct 2023
DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training Aochuan Chen Yimeng Zhang Jinghan Jia James Diffenderfer Jiancheng Liu Konstantinos Parasyris Yihua Zhang Zheng-Wei Zhang B. Kailkhura Sijia Liu 30 43 0 03 Oct 2023
Effective Learning with Node Perturbation in Multi-Layer Neural Networks Sander Dalm Marcel van Gerven Nasir Ahmad AAML 30 0 0 02 Oct 2023
Intrinsic Biologically Plausible Adversarial Robustness Matilde Tristany Farinha Thomas Ortner Giorgia Dellaferrera Benjamin Grewe A. Pantazi AAML 36 1 0 29 Sep 2023
A Study of Forward-Forward Algorithm for Self-Supervised Learning Jonas Brenig Radu Timofte SSL 16 4 0 21 Sep 2023
Uncovering mesa-optimization algorithms in Transformers J. Oswald Eyvind Niklasson Maximilian Schlegel Seijin Kobayashi Nicolas Zucchet ... Mark Sandler Blaise Agüera y Arcas Max Vladymyrov Razvan Pascanu João Sacramento 26 53 0 11 Sep 2023
Improving equilibrium propagation without weight symmetry through Jacobian homeostasis Axel Laborieux Friedemann Zenke 17 7 0 05 Sep 2023
FedFwd: Federated Learning without Backpropagation Seonghwan Park Dahun Shin Jinseok Chung Namhoon Lee FedML 19 5 0 03 Sep 2023
FwdLLM: Efficient FedLLM using Forward Gradient Mengwei Xu Dongqi Cai Yaozong Wu Xiang Li Shangguang Wang FedML 55 24 0 26 Aug 2023
Vision-Based Intelligent Robot Grasping Using Sparse Neural Network Priya Shukla V. Kushwaha G. C. Nandi 22 0 0 22 Aug 2023
Tensor-Compressed Back-Propagation-Free Training for (Physics-Informed) Neural Networks Yequan Zhao Xinling Yu Zhixiong Chen Z. Liu Sijia Liu Zheng-Wei Zhang PINN 27 11 0 18 Aug 2023
Learning representations by forward-propagating errors Ryoungwoo Jang 12 1 0 17 Aug 2023
MOLE: MOdular Learning FramEwork via Mutual Information Maximization Tianchao Li Yulong Pei 30 0 0 15 Aug 2023
Spiking Neural Networks and Bio-Inspired Supervised Deep Learning: A Survey Gabriele Lagani Fabrizio Falchi Claudio Gennaro Giuseppe Amato 28 8 0 30 Jul 2023
Zero-th Order Algorithm for Softmax Attention Optimization Yichuan Deng Zhihang Li Sridhar Mahadevan Zhao-quan Song 35 13 0 17 Jul 2023
Using Linear Regression for Iteratively Training Neural Networks H. Khadilkar 14 0 0 11 Jul 2023
Pathway toward prior knowledge-integrated machine learning in engineering Xia Chen Philipp Geyer AI4CE 31 4 0 10 Jul 2023
Extending the Forward Forward Algorithm Saumya Gandhi Ritu Gala Jonah Kornberg Advaith Sridhar 37 6 0 09 Jul 2023
The Forward-Forward Algorithm as a feature extractor for skin lesion classification: A preliminary study Abel A. Reyes Angulo Sidike Paheding MedIm 11 2 0 02 Jul 2023
Forward-Forward Algorithm for Hyperspectral Image Classification: A Preliminary Study Sidike Paheding Abel A. Reyes Angulo 13 5 0 01 Jul 2023