Beyond accuracy: generalization properties of bio-plausible temporal credit assignment rules

2 June 2022

Papers citing "Beyond accuracy: generalization properties of bio-plausible temporal credit assignment rules"

7 / 7 papers shown

Title
Understanding Gradient Descent on Edge of Stability in Deep Learning Sanjeev Arora Zhiyuan Li A. Panigrahi MLT 72 88 0 19 May 2022
Anticorrelated Noise Injection for Improved Generalization Antonio Orvieto Hans Kersting F. Proske Francis R. Bach Aurélien Lucchi 50 44 0 06 Feb 2022
Training Feedback Spiking Neural Networks by Implicit Differentiation on the Equilibrium State Mingqing Xiao Qingyan Meng Zongpeng Zhang Yisen Wang Zhouchen Lin 98 50 0 29 Sep 2021
Local plasticity rules can learn deep representations using self-supervised contrastive predictions Bernd Illing Jean-Paul Ventura G. Bellec W. Gerstner SSL DRL 30 66 0 16 Oct 2020
The large learning rate phase of deep learning: the catapult mechanism Aitor Lewkowycz Yasaman Bahri Ethan Dyer Jascha Narain Sohl-Dickstein Guy Gur-Ari ODL 150 198 0 04 Mar 2020
Long short-term memory and learning-to-learn in networks of spiking neurons G. Bellec Darjan Salaj Anand Subramoney R. Legenstein Wolfgang Maass 111 477 0 26 Mar 2018
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 273 2,696 0 15 Sep 2016