High probability generalization bounds for uniformly stable algorithms with nearly optimal rate

27 February 2019

Papers citing "High probability generalization bounds for uniformly stable algorithms with nearly optimal rate"

50 / 103 papers shown

Title
Non-vacuous Generalization Bounds for Deep Neural Networks without any modification to the trained models Khoat Than Dat Phan BDL AAML VLM 60 0 0 10 Mar 2025
A Theoretical Perspective: How to Prevent Model Collapse in Self-consuming Training Loops Shi Fu Yingjie Wang Yuzhu Chen Xinmei Tian Dacheng Tao 53 1 0 26 Feb 2025
Learning Variational Inequalities from Data: Fast Generalization Rates under Strong Monotonicity Eric Zhao Tatjana Chavdarova Michael I. Jordan 45 0 0 20 Feb 2025
Understanding the Generalization Error of Markov algorithms through Poissonization Benjamin Dupuis Maxime Haddouche George Deligiannidis Umut Simsekli 47 0 0 11 Feb 2025
A Theoretical Survey on Foundation Models Shi Fu Yuzhu Chen Yingjie Wang Dacheng Tao 28 0 0 15 Oct 2024
Stability and Sharper Risk Bounds with Convergence Rate $O(1/n^2)$ Bowei Zhu Shaojie Li Yong Liu 16 0 0 13 Oct 2024
Online-to-PAC generalization bounds under graph-mixing dependencies Baptiste Abeles Eugenio Clerico Gergely Neu 26 0 0 11 Oct 2024
Towards Sharper Risk Bounds for Minimax Problems Bowei Zhu Shaojie Li Yong Liu 36 0 0 11 Oct 2024
Learning Decisions Offline from Censored Observations with ε-insensitive Operational Costs Minxia Chen Ke Fu Teng Huang Miao Bai OffRL 16 0 0 14 Aug 2024
Decentralized Personalized Federated Learning Salma Kharrat Marco Canini Samuel Horváth FedML 54 0 0 10 Jun 2024
Uniformly Stable Algorithms for Adversarial Training and Beyond Jiancong Xiao Jiawei Zhang Zhimin Luo Asuman Ozdaglar AAML 45 0 0 03 May 2024
Differentially Private Worst-group Risk Minimization Xinyu Zhou Raef Bassily 35 2 0 29 Feb 2024
Unveiling Privacy, Memorization, and Input Curvature Links Deepak Ravikumar Efstathia Soufleri Abolfazl Hashemi Kaushik Roy 54 5 0 28 Feb 2024
Information Complexity of Stochastic Convex Optimization: Applications to Generalization and Memorization Idan Attias Gintare Karolina Dziugaite Mahdi Haghifam Roi Livni Daniel M. Roy 30 6 0 14 Feb 2024
Federated Learning Can Find Friends That Are Advantageous N. Tupitsa Samuel Horváth Martin Takávc Eduard A. Gorbunov FedML 41 2 0 07 Feb 2024
Metric Entropy-Free Sample Complexity Bounds for Sample Average Approximation in Convex Stochastic Programming Hongcheng Liu Jindong Tong 13 1 0 01 Jan 2024
Generalization Bounds for Label Noise Stochastic Gradient Descent Jung Eun Huh Patrick Rebeschini 13 1 0 01 Nov 2023
Sample-Conditioned Hypothesis Stability Sharpens Information-Theoretic Generalization Bounds Ziqiao Wang Yongyi Mao 27 5 0 31 Oct 2023
Stability and Generalization for Minibatch SGD and Local SGD Yunwen Lei Tao Sun Mingrui Liu 32 3 0 02 Oct 2023
A Unified Framework for Generative Data Augmentation: A Comprehensive Survey Yunhao Chen Zihui Yan Yunjie Zhu 29 3 0 30 Sep 2023
Generalization error bounds for iterative learning algorithms with bounded updates Jingwen Fu Nanning Zheng 44 1 0 10 Sep 2023
Towards Understanding the Generalizability of Delayed Stochastic Gradient Descent Xiaoge Deng Li Shen Shengwei Li Tao Sun Dongsheng Li Dacheng Tao 28 3 0 18 Aug 2023
High Probability Analysis for Non-Convex Stochastic Optimization with Clipping Shaojie Li Yong Liu 35 2 0 25 Jul 2023
Stability and Generalization of Stochastic Compositional Gradient Descent Algorithms Minghao Yang Xiyuan Wei Tianbao Yang Yiming Ying 37 1 0 07 Jul 2023
Improved Stability and Generalization Guarantees of the Decentralized SGD Algorithm B. L. Bars A. Bellet Marc Tommasi Kevin Scaman Giovanni Neglia 16 1 0 05 Jun 2023
Toward Understanding Generative Data Augmentation Chenyu Zheng Guoqiang Wu Chongxuan Li 29 25 0 27 May 2023
Uniform-in-Time Wasserstein Stability Bounds for (Noisy) Stochastic Gradient Descent Lingjiong Zhu Mert Gurbuzbalaban Anant Raj Umut Simsekli 26 6 0 20 May 2023
Select without Fear: Almost All Mini-Batch Schedules Generalize Optimally Konstantinos E. Nikolakakis Amin Karbasi Dionysis Kalogerias 30 5 0 03 May 2023
On the Concentration of the Minimizers of Empirical Risks Paul Escande 23 2 0 03 Apr 2023
Lower Generalization Bounds for GD and SGD in Smooth Stochastic Convex Optimization Peiyuan Zhang Jiaye Teng J. Zhang 36 4 0 19 Mar 2023
Stability-based Generalization Analysis for Mixtures of Pointwise and Pairwise Learning Jiahuan Wang Jun Chen H. Chen Bin Gu Weifu Li Xinwei Tang MLT 22 2 0 20 Feb 2023
On the Stability and Generalization of Triplet Learning Jun Chen H. Chen Xue Jiang Bin Gu Weifu Li Tieliang Gong Feng Zheng 26 4 0 20 Feb 2023
Maximum Optimality Margin: A Unified Approach for Contextual Linear Programming and Inverse Linear Programming Chunlin Sun Shang Liu Xiaocheng Li 19 9 0 26 Jan 2023
Sharper Analysis for Minibatch Stochastic Proximal Point Methods: Stability, Smoothness, and Deviation Xiao-Tong Yuan P. Li 32 2 0 09 Jan 2023
Limitations of Information-Theoretic Generalization Bounds for Gradient Descent Methods in Stochastic Convex Optimization Mahdi Haghifam Borja Rodríguez Gálvez Ragnar Thobaben Mikael Skoglund Daniel M. Roy Gintare Karolina Dziugaite 31 17 0 27 Dec 2022
On the Algorithmic Stability and Generalization of Adaptive Optimization Methods Han Nguyen Hai Pham Sashank J. Reddi Barnabás Póczos ODL AI4CE 17 2 0 08 Nov 2022
Stability Analysis and Generalization Bounds of Adversarial Training Jiancong Xiao Yanbo Fan Ruoyu Sun Jue Wang Zhimin Luo AAML 26 30 0 03 Oct 2022
Stability and Generalization Analysis of Gradient Methods for Shallow Neural Networks Yunwen Lei Rong Jin Yiming Ying MLT 37 18 0 19 Sep 2022
$Generalization Bounds for Stochastic Gradient Descent via Localized $\varepsilon$-Covers$ Generalization Bounds for Stochastic Gradient Descent via Localized $\varepsilon$ -Covers Sejun Park Umut Simsekli Murat A. Erdogdu 43 9 0 19 Sep 2022
Stability and Generalization for Markov Chain Stochastic Gradient Methods Puyu Wang Yunwen Lei Yiming Ying Ding-Xuan Zhou 16 18 0 16 Sep 2022
Generalisation under gradient descent via deterministic PAC-Bayes Eugenio Clerico Tyler Farghly George Deligiannidis Benjamin Guedj Arnaud Doucet 31 4 0 06 Sep 2022
Uniform Stability for First-Order Empirical Risk Minimization Amit Attia Tomer Koren 18 5 0 17 Jul 2022
Stability and Generalization of Stochastic Optimization with Nonconvex and Nonsmooth Problems Yunwen Lei 11 15 0 14 Jun 2022
On Convergence of FedProx: Local Dissimilarity Invariant Bounds, Non-smoothness and Beyond Xiao-Tong Yuan P. Li FedML 18 58 0 10 Jun 2022
Boosting the Confidence of Generalization for $L_2$ -Stable Randomized Learning Algorithms Xiao-Tong Yuan Ping Li 17 4 0 08 Jun 2022
Algorithmic Stability of Heavy-Tailed Stochastic Gradient Descent on Least Squares Anant Raj Melih Barsbey Mert Gurbuzbalaban Lingjiong Zhu Umut Simsekli 19 9 0 02 Jun 2022
Generalization Bounds of Nonconvex-(Strongly)-Concave Stochastic Minimax Optimization Siqi Zhang Yifan Hu Liang Zhang Niao He 30 3 0 28 May 2022
Generalization Bounds for Gradient Methods via Discrete and Continuous Prior Jun Yu Li Xu Luo Jian Li 19 4 0 27 May 2022
Beyond Lipschitz: Sharp Generalization and Excess Risk Bounds for Full-Batch GD Konstantinos E. Nikolakakis Farzin Haddadpour Amin Karbasi Dionysios S. Kalogerias 40 17 0 26 Apr 2022
Generalization bounds for learning under graph-dependence: A survey Rui-Ray Zhang Massih-Reza Amini OOD 16 11 0 25 Mar 2022