v1v2 (latest)

Toward Better Generalization Bounds with Locally Elastic Stability

27 October 2020

Zhun Deng

Hangfeng He

Weijie J. Su

ArXiv (abs)PDF HTML

Papers citing "Toward Better Generalization Bounds with Locally Elastic Stability"

31 / 31 papers shown

Title
Stability-based Generalization Analysis of Randomized Coordinate Descent for Pairwise Learning Liang Wu Ruixi Hu Yunwen Lei 77 0 0 03 Mar 2025
Stability and Generalization of Quantum Neural Networks Jiaqi Yang Wei Xie Xiaohua Xu 93 1 0 22 Jan 2025
Stability and Sharper Risk Bounds with Convergence Rate $O(1/n^2)$ Bowei Zhu Shaojie Li Yong Liu 43 0 0 13 Oct 2024
Position: Understanding LLMs Requires More Than Statistical Generalization Patrik Reizinger Szilvia Ujváry Anna Mészáros A. Kerekes Wieland Brendel Ferenc Huszár 136 16 0 03 May 2024
From Robustness to Improved Generalization and Calibration in Pre-trained Language Models Josip Jukić Jan Snajder 85 0 0 31 Mar 2024
Convex SGD: Generalization Without Early Stopping Julien Hendrickx A. Olshevsky MLT LRM 65 1 0 08 Jan 2024
Class-wise Generalization Error: an Information-Theoretic Analysis Firas Laakom Yuheng Bu Moncef Gabbouj 76 1 0 05 Jan 2024
Stability and Generalization for Minibatch SGD and Local SGD Yunwen Lei Tao Sun Mingrui Liu 93 4 0 02 Oct 2023
How Does Information Bottleneck Help Deep Learning? Kenji Kawaguchi Zhun Deng Xu Ji Jiaoyang Huang 93 62 0 30 May 2023
Last-Layer Fairness Fine-tuning is Simple and Effective for Neural Networks Yuzhen Mao Zhun Deng Huaxiu Yao Ting Ye Kenji Kawaguchi James Zou 82 21 0 08 Apr 2023
Stability-based Generalization Analysis for Mixtures of Pointwise and Pairwise Learning Jiahuan Wang Jun Chen Hao Chen Bin Gu Weifu Li Xinwei Tang MLT 63 2 0 20 Feb 2023
On the Stability and Generalization of Triplet Learning Jun Chen Hao Chen Xue Jiang Bin Gu Weifu Li Tieliang Gong Feng Zheng 54 4 0 20 Feb 2023
Resampling Sensitivity of High-Dimensional PCA Haoyu Wang 58 0 0 30 Dec 2022
Reinforcement Learning with Stepwise Fairness Constraints Zhun Deng He Sun Zhiwei Steven Wu Linjun Zhang David C. Parkes FaML OffRL 83 11 0 08 Nov 2022
Stability and Generalization Analysis of Gradient Methods for Shallow Neural Networks Yunwen Lei Rong Jin Yiming Ying MLT 100 19 0 19 Sep 2022
Robustness Implies Generalization via Data-Dependent Generalization Bounds Kenji Kawaguchi Zhun Deng K. Luh Jiaoyang Huang OOD 113 23 0 27 Jun 2022
Stability and Generalization of Stochastic Optimization with Nonconvex and Nonsmooth Problems Yunwen Lei 46 19 0 14 Jun 2022
Stability and Generalization of Differentially Private Minimax Problems Yilin Kang Yong Liu Jian Li Weiping Wang 134 3 0 11 Apr 2022
On the Generalization Mystery in Deep Learning S. Chatterjee Piotr Zielinski OOD 77 35 0 18 Mar 2022
Black-Box Generalization: Stability of Zeroth-Order Learning Konstantinos E. Nikolakakis Farzin Haddadpour Dionysios S. Kalogerias Amin Karbasi MLT 75 2 0 14 Feb 2022
Black-box tests for algorithmic stability Byol Kim Rina Foygel Barber AAML 59 15 0 30 Nov 2021
Dynamics of Local Elasticity During Training of Neural Nets Soham Dan Anirbit Mukherjee Avirup Das Phanideep Gampa 52 0 0 01 Nov 2021
Imitating Deep Learning Dynamics via Locally Elastic Stochastic Differential Equations Jiayao Zhang Hua Wang Weijie J. Su 96 8 0 11 Oct 2021
An Unconstrained Layer-Peeled Perspective on Neural Collapse Wenlong Ji Yiping Lu Yiliang Zhang Zhun Deng Weijie J. Su 209 87 0 06 Oct 2021
Improved Learning Rates for Stochastic Optimization: Two Theoretical Viewpoints Shaojie Li Yong Liu 105 13 0 19 Jul 2021
Disparity Between Batches as a Signal for Early Stopping Mahsa Forouzesh Patrick Thiran 96 8 0 14 Jul 2021
Practical Assessment of Generalization Performance Robustness for Deep Networks via Contrastive Examples Xuanyu Wu Xuhong Li Haoyi Xiong Xiao Zhang Siyu Huang Dejing Dou 30 1 0 20 Jun 2021
Stability and Generalization of Stochastic Gradient Methods for Minimax Problems Yunwen Lei Zhenhuan Yang Tianbao Yang Yiming Ying 80 48 0 08 May 2021
Towards Sharper Utility Bounds for Differentially Private Pairwise Learning Yilin Kang Yong Liu Jian Li Weiping Wang FedML 62 2 0 07 May 2021
Characterization of Excess Risk for Locally Strongly Convex Population Risk Mingyang Yi Ruoyu Wang Zhi-Ming Ma 44 2 0 04 Dec 2020
What Neural Networks Memorize and Why: Discovering the Long Tail via Influence Estimation Vitaly Feldman Chiyuan Zhang TDI 248 472 0 09 Aug 2020