Stability & Generalisation of Gradient Descent for Shallow Neural
Networks without the Neural Tangent Kernel

v1v2 (latest)

Stability & Generalisation of Gradient Descent for Shallow Neural Networks without the Neural Tangent Kernel

27 July 2021

Dominic Richards

Ilja Kuzborskij

ArXiv (abs)PDF HTML

Papers citing "Stability & Generalisation of Gradient Descent for Shallow Neural Networks without the Neural Tangent Kernel"

19 / 19 papers shown

Title
Stability and Generalization of Quantum Neural Networks Jiaqi Yang Wei Xie Xiaohua Xu 93 1 0 22 Jan 2025
Sharper Guarantees for Learning Neural Network Classifiers with Gradient Methods Hossein Taheri Christos Thrampoulidis Arya Mazumdar MLT 119 0 0 13 Oct 2024
Bootstrap SGD: Algorithmic Stability and Robustness Andreas Christmann Yunwen Lei 55 0 0 02 Sep 2024
Stable Minima Cannot Overfit in Univariate ReLU Networks: Generalization by Large Step Sizes Dan Qiao Kaiqi Zhang Esha Singh Daniel Soudry Yu-Xiang Wang NoLa 84 4 0 10 Jun 2024
NTK-Guided Few-Shot Class Incremental Learning Jingren Liu Zhong Ji Yanwei Pang YunLong Yu CLL 90 4 0 19 Mar 2024
On the Optimization and Generalization of Multi-head Attention Puneesh Deora Rouzbeh Ghaderi Hossein Taheri Christos Thrampoulidis MLT 85 34 0 19 Oct 2023
Stability and Generalization for Minibatch SGD and Local SGD Yunwen Lei Tao Sun Mingrui Liu 89 4 0 02 Oct 2023
Towards Understanding the Generalizability of Delayed Stochastic Gradient Descent Xiaoge Deng Li Shen Shengwei Li Tao Sun Dongsheng Li Dacheng Tao 85 3 0 18 Aug 2023
A Linearly Convergent GAN Inversion-based Algorithm for Reverse Engineering of Deceptions D. Thaker Paris V. Giampouras René Vidal AAML 49 0 0 07 Jun 2023
Three-Way Trade-Off in Multi-Objective Learning: Optimization, Generalization and Conflict-Avoidance Lisha Chen H. Fernando Yiming Ying Tianyi Chen 76 25 0 31 May 2023
Generalization Guarantees of Gradient Descent for Multi-Layer Neural Networks Puyu Wang Yunwen Lei Di Wang Yiming Ying Ding-Xuan Zhou MLT 63 4 0 26 May 2023
Generalization and Stability of Interpolating Neural Networks with Minimal Width Hossein Taheri Christos Thrampoulidis 105 16 0 18 Feb 2023
Norm-based Generalization Bounds for Compositionally Sparse Neural Networks Tomer Galanti Mengjia Xu Liane Galanti T. Poggio 61 9 0 28 Jan 2023
Stability and Generalization Analysis of Gradient Methods for Shallow Neural Networks Yunwen Lei Rong Jin Yiming Ying MLT 100 19 0 19 Sep 2022
Stability and Generalization of Stochastic Optimization with Nonconvex and Nonsmooth Problems Yunwen Lei 37 19 0 14 Jun 2022
Black-Box Generalization: Stability of Zeroth-Order Learning Konstantinos E. Nikolakakis Farzin Haddadpour Dionysios S. Kalogerias Amin Karbasi MLT 73 2 0 14 Feb 2022
On the Role of Optimization in Double Descent: A Least Squares Study Ilja Kuzborskij Csaba Szepesvári Omar Rivasplata Amal Rannen-Triki Razvan Pascanu 38 10 0 27 Jul 2021
Nonparametric Regression with Shallow Overparameterized Neural Networks Trained by GD with Early Stopping Ilja Kuzborskij Csaba Szepesvári 98 7 0 12 Jul 2021
Early-stopped neural networks are consistent Ziwei Ji Justin D. Li Matus Telgarsky 85 37 0 10 Jun 2021