PAC-Bayes, MAC-Bayes and Conditional Mutual Information: Fast rate bounds that handle general VC classes

17 June 2021

Papers citing "PAC-Bayes, MAC-Bayes and Conditional Mutual Information: Fast rate bounds that handle general VC classes"

26 / 26 papers shown

Title
Generalization Bounds via Conditional $f$ -Information Ziqiao Wang Yongyi Mao FedML 40 1 0 30 Oct 2024
Information Complexity of Stochastic Convex Optimization: Applications to Generalization and Memorization Idan Attias Gintare Karolina Dziugaite Mahdi Haghifam Roi Livni Daniel M. Roy 25 6 0 14 Feb 2024
A PAC-Bayesian Link Between Generalisation and Flat Minima Maxime Haddouche Paul Viallard Umut Simsekli Benjamin Guedj 35 3 0 13 Feb 2024
Minimum Description Length and Generalization Guarantees for Representation Learning Milad Sefidgaran Abdellatif Zaidi Piotr Krasnowski 38 7 0 05 Feb 2024
Information-Theoretic Generalization Bounds for Transductive Learning and its Applications Huayi Tang Yong Liu 55 1 0 08 Nov 2023
Sample-Conditioned Hypothesis Stability Sharpens Information-Theoretic Generalization Bounds Ziqiao Wang Yongyi Mao 22 5 0 31 Oct 2023
An Introduction to the Calibration of Computer Models Richard D. Wilkinson Christopher W. Lanyon 24 0 0 13 Oct 2023
Importance-Weighted Offline Learning Done Right Germano Gabbianelli Gergely Neu Matteo Papini OffRL 14 5 0 27 Sep 2023
Local Risk Bounds for Statistical Aggregation Jaouad Mourtada Tomas Vavskevivcius Nikita Zhivotovskiy 20 1 0 29 Jun 2023
More PAC-Bayes bounds: From bounded losses, to losses with general tail behaviors, to anytime validity Borja Rodríguez Gálvez Ragnar Thobaben Mikael Skoglund 26 9 0 21 Jun 2023
Online-to-PAC Conversions: Generalization Bounds via Regret Analysis Gábor Lugosi Gergely Neu 20 11 0 31 May 2023
Exponential Stochastic Inequality Peter Grünwald M. F. Pérez-Ortiz Zakaria Mhammedi 21 1 0 27 Apr 2023
Lower Generalization Bounds for GD and SGD in Smooth Stochastic Convex Optimization Peiyuan Zhang Jiaye Teng J. Zhang 34 4 0 19 Mar 2023
Tighter Information-Theoretic Generalization Bounds from Supersamples Ziqiao Wang Yongyi Mao 19 17 0 05 Feb 2023
Limitations of Information-Theoretic Generalization Bounds for Gradient Descent Methods in Stochastic Convex Optimization Mahdi Haghifam Borja Rodríguez Gálvez Ragnar Thobaben Mikael Skoglund Daniel M. Roy Gintare Karolina Dziugaite 22 17 0 27 Dec 2022
Two Facets of SDE Under an Information-Theoretic Lens: Generalization of SGD via Training Trajectories and via Terminal States Ziqiao Wang Yongyi Mao 10 10 0 19 Nov 2022
Streaming PAC-Bayes Gaussian process regression with a performance guarantee for online decision making Tianyu Liu Jie Lu Zheng Yan Guangquan Zhang 36 0 0 16 Oct 2022
A New Family of Generalization Bounds Using Samplewise Evaluated CMI Fredrik Hellström G. Durisi 30 22 0 12 Oct 2022
Variational Inference of overparameterized Bayesian Neural Networks: a theoretical and empirical study Tom Huix Szymon Majewski Alain Durmus Eric Moulines Anna Korba BDL 13 6 0 08 Jul 2022
Fast Rate Generalization Error Bounds: Variations on a Theme Xuetong Wu J. Manton U. Aickelin Jingge Zhu 22 7 0 06 May 2022
Single Trajectory Nonparametric Learning of Nonlinear Dynamics Ingvar M. Ziemann H. Sandberg Nikolai Matni 16 22 0 16 Feb 2022
Minimax risk classifiers with 0-1 loss Santiago Mazuelas Mauricio Romero Peter Grünwald 19 6 0 17 Jan 2022
Stability Based Generalization Bounds for Exponential Family Langevin Dynamics A. Banerjee Tiancong Chen Xinyan Li Yingxue Zhou 13 8 0 09 Jan 2022
Information-Theoretic Bayes Risk Lower Bounds for Realizable Models M. Nokleby Ahmad Beirami 55 1 0 08 Nov 2021
User-friendly introduction to PAC-Bayes bounds Pierre Alquier FedML 34 196 0 21 Oct 2021
Information-Theoretic Generalization Bounds for SGLD via Data-Dependent Estimates Jeffrey Negrea Mahdi Haghifam Gintare Karolina Dziugaite Ashish Khisti Daniel M. Roy FedML 105 146 0 06 Nov 2019