v1v2 (latest)

Chaining Mutual Information and Tightening Generalization Bounds

11 June 2018

Papers citing "Chaining Mutual Information and Tightening Generalization Bounds"

43 / 43 papers shown

Title
Curse of Slicing: Why Sliced Mutual Information is a Deceptive Measure of Statistical Dependence Alexander Semenenko I. Butakov Alexey Frolov Ivan Oseledets 51 0 0 04 Jun 2025
Generalization and Robustness of the Tilted Empirical Risk Gholamali Aminian Amir R. Asadi Tian Li Ahmad Beirami Gesine Reinert Samuel N. Cohen 71 0 0 28 Sep 2024
Information-Theoretic Generalization Bounds for Deep Neural Networks Haiyun He Christina Lee Yu 108 6 0 04 Apr 2024
Information-Theoretic Generalization Bounds for Transductive Learning and its Applications Huayi Tang Yong Liu 152 0 0 08 Nov 2023
An Entropy-Based Model for Hierarchical Learning Amir-Reza Asadi 73 1 0 30 Dec 2022
Mutual Information Learned Regressor: an Information-theoretic Viewpoint of Training Regression Systems Jirong Yi Q. Zhang Zhengbo Chen Qiaoan Liu Weizhuo Shao Yusen He Yao Wang SSL 57 0 0 23 Nov 2022
Two Facets of SDE Under an Information-Theoretic Lens: Generalization of SGD via Training Trajectories and via Terminal States Ziqiao Wang Yongyi Mao 111 12 0 19 Nov 2022
Higher-order mutual information reveals synergistic sub-networks for multi-neuron importance Kenzo Clauw S. Stramaglia Daniele Marinazzo SSL FAtt 49 8 0 01 Nov 2022
A New Family of Generalization Bounds Using Samplewise Evaluated CMI Fredrik Hellström G. Durisi 92 26 0 12 Oct 2022
Learning Algorithm Generalization Error Bounds via Auxiliary Distributions Gholamali Aminian Saeed Masiha Laura Toni M. Rodrigues 53 9 0 02 Oct 2022
Understanding Generalization via Leave-One-Out Conditional Mutual Information Mahdi Haghifam Shay Moran Daniel M. Roy Gintare Karolina Dziugaite 75 15 0 29 Jun 2022
Generalization Error Bounds for Deep Neural Networks Trained by SGD Mingze Wang Chao Ma 31 14 0 07 Jun 2022
Fast Rate Generalization Error Bounds: Variations on a Theme Xuetong Wu J. Manton U. Aickelin Jingge Zhu 66 7 0 06 May 2022
Chained Generalisation Bounds Eugenio Clerico Amitis Shidani George Deligiannidis Arnaud Doucet AI4CE FedML 74 13 0 02 Mar 2022
Tighter Expected Generalization Error Bounds via Convexity of Information Measures Gholamali Aminian Yuheng Bu G. Wornell Miguel R. D. Rodrigues 70 24 0 24 Feb 2022
Information-Theoretic Analysis of Minimax Excess Risk Hassan Hafez-Kolahi Behrad Moniri S. Kasaei 54 5 0 15 Feb 2022
Towards a Unified Information-Theoretic Framework for Generalization Mahdi Haghifam Gintare Karolina Dziugaite Shay Moran Daniel M. Roy 150 34 0 09 Nov 2021
User-friendly introduction to PAC-Bayes bounds Pierre Alquier FedML 193 206 0 21 Oct 2021
On the Generalization of Models Trained with SGD: Information-Theoretic Bounds and Implications Ziqiao Wang Yongyi Mao FedML MLT 124 26 0 07 Oct 2021
Fractal Structure and Generalization Properties of Stochastic Optimization Algorithms A. Camuto George Deligiannidis Murat A. Erdogdu Mert Gurbuzbalaban Umut cSimcsekli Lingjiong Zhu 80 29 0 09 Jun 2021
Generalization Bounds for Noisy Iterative Algorithms Using Properties of Additive Noise Channels Hao Wang Rui Gao Flavio du Pin Calmon 81 18 0 05 Feb 2021
Information-Theoretic Bounds on the Moments of the Generalization Error of Learning Algorithms Gholamali Aminian Laura Toni M. Rodrigues 139 16 0 03 Feb 2021
Information-Theoretic Generalization Bounds for Stochastic Gradient Descent Gergely Neu Gintare Karolina Dziugaite Mahdi Haghifam Daniel M. Roy 117 90 0 01 Feb 2021
Tighter expected generalization error bounds via Wasserstein distance Borja Rodríguez Gálvez Germán Bassi Ragnar Thobaben Mikael Skoglund 79 46 0 22 Jan 2021
Individually Conditional Individual Mutual Information Bound on Generalization Error Ruida Zhou C. Tian Tie Liu 78 32 0 17 Dec 2020
On the Information Complexity of Proper Learners for VC Classes in the Realizable Case Mahdi Haghifam Gintare Karolina Dziugaite Shay Moran Daniel M. Roy 17 1 0 05 Nov 2020
Jensen-Shannon Information Based Characterization of the Generalization Error of Learning Algorithms Gholamali Aminian Laura Toni M. Rodrigues 78 31 0 23 Oct 2020
Fast-Rate Loss Bounds via Conditional Information Measures with Applications to Neural Networks Fredrik Hellström G. Durisi 95 2 0 22 Oct 2020
Maximum Multiscale Entropy and Neural Network Regularization Amir-Reza Asadi Emmanuel Abbe 34 1 0 25 Jun 2020
Hausdorff Dimension, Heavy Tails, and Generalization in Neural Networks Umut Simsekli Ozan Sener George Deligiannidis Murat A. Erdogdu 86 56 0 16 Jun 2020
Generalization Bounds via Information Density and Conditional Information Density Fredrik Hellström G. Durisi 126 67 0 16 May 2020
Information-Theoretic Generalization Bounds for Meta-Learning and Applications Sharu Theresa Jose Osvaldo Simeone 87 47 0 09 May 2020
Information-Theoretic Bounds on the Generalization Error and Privacy Leakage in Federated Learning Semih Yagli Alex Dytso H. Vincent Poor FedML 81 33 0 05 May 2020
Sharpened Generalization Bounds based on Conditional Mutual Information and an Application to Noisy, Iterative Algorithms Mahdi Haghifam Jeffrey Negrea Ashish Khisti Daniel M. Roy Gintare Karolina Dziugaite 206 108 0 27 Apr 2020
Margin Maximization as Lossless Maximal Compression N. Nikolaou Henry W. J. Reeve Gavin Brown 35 4 0 28 Jan 2020
Reasoning About Generalization via Conditional Mutual Information Thomas Steinke Lydia Zakynthinou 161 166 0 24 Jan 2020
General Information Bottleneck Objectives and their Applications to Machine Learning S. Mukherjee 29 4 0 12 Dec 2019
Generalization Error Bounds Via Rényi-, $f$ -Divergences and Maximal Leakage A. Esposito Michael C. Gastpar Ibrahim Issa 85 76 0 01 Dec 2019
Information-Theoretic Generalization Bounds for SGLD via Data-Dependent Estimates Jeffrey Negrea Mahdi Haghifam Gintare Karolina Dziugaite Ashish Khisti Daniel M. Roy FedML 200 153 0 06 Nov 2019
Chaining Meets Chain Rule: Multilevel Entropic Regularization and Training of Neural Nets Amir-Reza Asadi Emmanuel Abbe BDL AI4CE 85 13 0 26 Jun 2019
Norm-based generalisation bounds for multi-class convolutional neural networks Antoine Ledent Waleed Mustafa Yunwen Lei Marius Kloft 66 5 0 29 May 2019
Tightening Mutual Information Based Bounds on Generalization Error Yuheng Bu Shaofeng Zou Venugopal V. Veeravalli 66 177 0 15 Jan 2019
Average-Case Information Complexity of Learning Ido Nachum Amir Yehudayoff 45 11 0 25 Nov 2018