Beyond Lipschitz: Sharp Generalization and Excess Risk Bounds for
Full-Batch GD

Beyond Lipschitz: Sharp Generalization and Excess Risk Bounds for Full-Batch GD

26 April 2022

Konstantinos E. Nikolakakis

Farzin Haddadpour

Dionysios S. Kalogerias

Papers citing "Beyond Lipschitz: Sharp Generalization and Excess Risk Bounds for Full-Batch GD"

15 / 15 papers shown

Title
Gradient Descent as a Shrinkage Operator for Spectral Bias Simon Lucey 38 0 0 25 Apr 2025
Stability-based Generalization Analysis of Randomized Coordinate Descent for Pairwise Learning Liang Wu Ruixi Hu Yunwen Lei 40 0 0 03 Mar 2025
Which Algorithms Have Tight Generalization Bounds? Michael C. Gastpar Ido Nachum Jonathan Shafer T. Weinberger 18 0 0 02 Oct 2024
Bootstrap SGD: Algorithmic Stability and Robustness Andreas Christmann Yunwen Lei 31 0 0 02 Sep 2024
On the Optimization and Generalization of Multi-head Attention Puneesh Deora Rouzbeh Ghaderi Hossein Taheri Christos Thrampoulidis MLT 31 33 0 19 Oct 2023
Fantastic Generalization Measures are Nowhere to be Found Michael C. Gastpar Ido Nachum Jonathan Shafer T. Weinberger 13 13 0 24 Sep 2023
Generalization error bounds for iterative learning algorithms with bounded updates Jingwen Fu Nanning Zheng 27 1 0 10 Sep 2023
Select without Fear: Almost All Mini-Batch Schedules Generalize Optimally Konstantinos E. Nikolakakis Amin Karbasi Dionysis Kalogerias 17 4 0 03 May 2023
Learning Trajectories are Generalization Indicators Jingwen Fu Zhizheng Zhang Dacheng Yin Yan Lu Nanning Zheng AI4CE 15 3 0 25 Apr 2023
Machine Learning and the Future of Bayesian Computation Steven Winter Trevor Campbell Lizhen Lin Sanvesh Srivastava David B. Dunson TPM 16 4 0 21 Apr 2023
Lower Generalization Bounds for GD and SGD in Smooth Stochastic Convex Optimization Peiyuan Zhang Jiaye Teng J. Zhang 16 4 0 19 Mar 2023
Stability and Generalization Analysis of Gradient Methods for Shallow Neural Networks Yunwen Lei Rong Jin Yiming Ying MLT 21 18 0 19 Sep 2022
Stochastic Training is Not Necessary for Generalization Jonas Geiping Micah Goldblum Phillip E. Pope Michael Moeller Tom Goldstein 81 72 0 29 Sep 2021
Information-Theoretic Generalization Bounds for SGLD via Data-Dependent Estimates Jeffrey Negrea Mahdi Haghifam Gintare Karolina Dziugaite Ashish Khisti Daniel M. Roy FedML 105 146 0 06 Nov 2019
Linear Convergence of Gradient and Proximal-Gradient Methods Under the Polyak-Łojasiewicz Condition Hamed Karimi J. Nutini Mark W. Schmidt 119 1,190 0 16 Aug 2016