A PAC-Bayesian Analysis of Randomized Learning with Application to Stochastic Gradient Descent

19 September 2017

Papers citing "A PAC-Bayesian Analysis of Randomized Learning with Application to Stochastic Gradient Descent"

50 / 52 papers shown

Title
Randomized Pairwise Learning with Adaptive Sampling: A PAC-Bayes Analysis Sijia Zhou Yunwen Lei Ata Kabán 146 0 0 03 Apr 2025
A Generalization Result for Convergence in Learning-to-Optimize Michael Sucker Peter Ochs 89 0 0 10 Oct 2024
Generalization Error Matters in Decentralized Learning Under Byzantine Attacks Haoxiang Ye Qing Ling 63 1 0 11 Jul 2024
Uniform Generalization Bounds on Data-Dependent Hypothesis Sets via PAC-Bayesian Theory on Random Sets Benjamin Dupuis Paul Viallard George Deligiannidis Umut Simsekli 129 5 0 26 Apr 2024
Leveraging Gradients for Unsupervised Accuracy Estimation under Distribution Shift Renchunzi Xie Ambroise Odonnat Vasilii Feofanov I. Redko Jianfeng Zhang Bo An UQCV 150 1 0 17 Jan 2024
Convex SGD: Generalization Without Early Stopping Julien Hendrickx A. Olshevsky MLT LRM 65 1 0 08 Jan 2024
Information-Theoretic Generalization Bounds for Transductive Learning and its Applications Huayi Tang Yong Liu 154 0 0 08 Nov 2023
Sample-Conditioned Hypothesis Stability Sharpens Information-Theoretic Generalization Bounds Ziqiao Wang Yongyi Mao 90 7 0 31 Oct 2023
High Probability Analysis for Non-Convex Stochastic Optimization with Clipping Shaojie Li Yong Liu 58 3 0 25 Jul 2023
Minimax Excess Risk of First-Order Methods for Statistical Learning with Data-Dependent Oracles Kevin Scaman Mathieu Even B. L. Bars Laurent Massoulié 44 1 0 10 Jul 2023
Improved Stability and Generalization Guarantees of the Decentralized SGD Algorithm B. L. Bars A. Bellet Marc Tommasi Kevin Scaman Giovanni Neglia 60 2 0 05 Jun 2023
Enhance Diffusion to Improve Robust Generalization Jianhui Sun Sanchit Sinha Aidong Zhang 77 4 0 05 Jun 2023
PAC-Bayesian Learning of Optimization Algorithms Michael Sucker Peter Ochs 83 4 0 20 Oct 2022
On the Importance of Gradient Norm in PAC-Bayesian Bounds Itai Gat Yossi Adi Alex Schwing Tamir Hazan BDL 97 6 0 12 Oct 2022
$Generalization Bounds for Stochastic Gradient Descent via Localized $\varepsilon$-Covers$ Generalization Bounds for Stochastic Gradient Descent via Localized $\varepsilon$ -Covers Sejun Park Umut Simsekli Murat A. Erdogdu 107 9 0 19 Sep 2022
Super-model ecosystem: A domain-adaptation perspective Fengxiang He Dacheng Tao DiffM 84 1 0 30 Aug 2022
Uniform Stability for First-Order Empirical Risk Minimization Amit Attia Tomer Koren 66 5 0 17 Jul 2022
Generalization Bounds for Gradient Methods via Discrete and Continuous Prior Jun Yu Li Xu Luo Jian Li 80 4 0 27 May 2022
Demystify Optimization and Generalization of Over-parameterized PAC-Bayesian Learning Wei Huang Chunrui Liu Yilan Chen Tianyu Liu R. Xu BDL MLT 67 2 0 04 Feb 2022
User-friendly introduction to PAC-Bayes bounds Pierre Alquier FedML 193 206 0 21 Oct 2021
On the Generalization of Models Trained with SGD: Information-Theoretic Bounds and Implications Ziqiao Wang Yongyi Mao FedML MLT 124 26 0 07 Oct 2021
Improved Learning Rates for Stochastic Optimization: Two Theoretical Viewpoints Shaojie Li Yong Liu 105 13 0 19 Jul 2021
Optimal Rates for Random Order Online Optimization Uri Sherman Tomer Koren Yishay Mansour 57 8 0 29 Jun 2021
Heavy Tails in SGD and Compressibility of Overparametrized Neural Networks Melih Barsbey Romain Chor Murat A. Erdogdu Gaël Richard Umut Simsekli 73 41 0 07 Jun 2021
Stability and Generalization of Stochastic Gradient Methods for Minimax Problems Yunwen Lei Zhenhuan Yang Tianbao Yang Yiming Ying 80 48 0 08 May 2021
Variance Reduced Training with Stratified Sampling for Forecasting Models Yucheng Lu Youngsuk Park Lifan Chen Bernie Wang Christopher De Sa Dean Phillips Foster AI4TS 80 17 0 02 Mar 2021
Generalization Bounds for Meta-Learning via PAC-Bayes and Uniform Stability Alec Farid Anirudha Majumdar 81 36 0 12 Feb 2021
PAC-Bayes Bounds for Meta-learning with Data-Dependent Prior Tianyu Liu Jie Lu Zheng Yan Guangquan Zhang 56 14 0 07 Feb 2021
Generalization bounds for deep learning Guillermo Valle Pérez A. Louis BDL 82 45 0 07 Dec 2020
Tighter risk certificates for neural networks Maria Perez-Ortiz Omar Rivasplata John Shawe-Taylor Csaba Szepesvári UQCV 91 108 0 25 Jul 2020
Impact of base dataset design on few-shot image classification Othman Sbai Camille Couprie Mathieu Aubry VLM 68 23 0 17 Jul 2020
Adaptive Task Sampling for Meta-Learning Chenghao Liu Zhihao Wang Doyen Sahoo Yuan Fang Kun Zhang Guosheng Lin 104 55 0 17 Jul 2020
PAC-Bayes Analysis Beyond the Usual Bounds Omar Rivasplata Ilja Kuzborskij Csaba Szepesvári John Shawe-Taylor 123 80 0 23 Jun 2020
Hausdorff Dimension, Heavy Tails, and Generalization in Neural Networks Umut Simsekli Ozan Sener George Deligiannidis Murat A. Erdogdu 86 56 0 16 Jun 2020
PAC-Bayesian Generalization Bounds for MultiLayer Perceptrons Xinjie Lan Xin Guo Kenneth Barner 47 3 0 16 Jun 2020
Fine-Grained Analysis of Stability and Generalization for Stochastic Gradient Descent Yunwen Lei Yiming Ying MLT 99 129 0 15 Jun 2020
Stability of Stochastic Gradient Descent on Nonsmooth Convex Losses Raef Bassily Vitaly Feldman Cristóbal Guzmán Kunal Talwar MLT 66 198 0 12 Jun 2020
Practical calibration of the temperature parameter in Gibbs posteriors Lucie Perrotta 50 3 0 22 Apr 2020
De-randomized PAC-Bayes Margin Bounds: Applications to Non-convex and Non-smooth Predictors A. Banerjee Tiancong Chen Yingxue Zhou BDL 86 8 0 23 Feb 2020
On the generalization of bayesian deep nets for multi-class classification Yossi Adi Yaniv Nemcovsky Alex Schwing Tamir Hazan BDL UQCV 21 1 0 23 Feb 2020
Fast-rate PAC-Bayes Generalization Bounds via Shifted Rademacher Processes Jun Yang Shengyang Sun Daniel M. Roy 80 28 0 20 Aug 2019
PAC-Bayes with Backprop Omar Rivasplata Vikram Tankasali Csaba Szepesvári 97 50 0 19 Aug 2019
Time-Delay Momentum: A Regularization Perspective on the Convergence and Generalization of Stochastic Momentum for Deep Learning Ziming Zhang Wenju Xu Alan Sullivan 99 1 0 02 Mar 2019
High probability generalization bounds for uniformly stable algorithms with nearly optimal rate Vitaly Feldman J. Vondrák 74 155 0 27 Feb 2019
On Generalization Error Bounds of Noisy Gradient Methods for Non-Convex Learning Jian Li Xuanyuan Luo Mingda Qiao 73 89 0 02 Feb 2019
A Primer on PAC-Bayesian Learning Benjamin Guedj 179 223 0 16 Jan 2019
Generalization Bounds for Uniformly Stable Algorithms Vitaly Feldman J. Vondrák 70 89 0 24 Dec 2018
NIPS - Not Even Wrong? A Systematic Review of Empirically Complete Demonstrations of Algorithmic Effectiveness in the Machine Learning and Artificial Intelligence Literature Franz J. Király Bilal A. Mateen R. Sonabend 102 10 0 18 Dec 2018
PAC-Bayes bounds for stable algorithms with instance-dependent priors Omar Rivasplata E. Parrado-Hernández John Shawe-Taylor Shiliang Sun Csaba Szepesvári 55 54 0 18 Jun 2018
Generalization Error Bounds with Probabilistic Guarantee for SGD in Nonconvex Optimization Yi Zhou Yingbin Liang Huishuai Zhang MLT 85 26 0 19 Feb 2018