Jensen-Shannon Information Based Characterization of the Generalization
Error of Learning Algorithms

v1v2 (latest)

Jensen-Shannon Information Based Characterization of the Generalization Error of Learning Algorithms

23 October 2020

Gholamali Aminian

ArXiv (abs)PDF HTML

Papers citing "Jensen-Shannon Information Based Characterization of the Generalization Error of Learning Algorithms"

17 / 17 papers shown

Title
The Generalization Error of Machine Learning Algorithms S. Perlaza Xinying Zou 118 6 0 18 Nov 2024
Generalization and Robustness of the Tilted Empirical Risk Gholamali Aminian Amir R. Asadi Tian Li Ahmad Beirami Gesine Reinert Samuel N. Cohen 71 0 0 28 Sep 2024
Generalization Analysis of Machine Learning Algorithms via the Worst-Case Data-Generating Probability Measure Xinying Zou S. Perlaza I. Esnaola Eitan Altman 58 18 0 19 Dec 2023
Information-Theoretic Generalization Bounds for Transductive Learning and its Applications Huayi Tang Yong Liu 152 0 0 08 Nov 2023
On the Validation of Gibbs Algorithms: Training Datasets, Test Datasets and their Aggregation S. Perlaza I. Esnaola Gaetan Bisson H. Vincent Poor 59 22 0 21 Jun 2023
Empirical Risk Minimization with Relative Entropy Regularization S. Perlaza Gaetan Bisson I. Esnaola Alain Jean-Marie Stefano Rini 64 23 0 12 Nov 2022
Learning Algorithm Generalization Error Bounds via Auxiliary Distributions Gholamali Aminian Saeed Masiha Laura Toni M. Rodrigues 53 9 0 02 Oct 2022
Understanding Generalization via Leave-One-Out Conditional Mutual Information Mahdi Haghifam Shay Moran Daniel M. Roy Gintare Karolina Dziugaite 75 15 0 29 Jun 2022
f-divergences and their applications in lossy compression and bounding generalization error Saeed Masiha A. Gohari Mohammad Hossein Yassaee 76 14 0 21 Jun 2022
Formal limitations of sample-wise information-theoretic generalization bounds Hrayr Harutyunyan Greg Ver Steeg Aram Galstyan 48 2 0 13 May 2022
Tighter Expected Generalization Error Bounds via Convexity of Information Measures Gholamali Aminian Yuheng Bu G. Wornell Miguel R. D. Rodrigues 78 24 0 24 Feb 2022
An Information-theoretical Approach to Semi-supervised Learning under Covariate-shift Gholamali Aminian Mahed Abroshan Mohammad Mahdi Khalili Laura Toni M. Rodrigues OOD 114 28 0 24 Feb 2022
Characterizing and Understanding the Generalization Error of Transfer Learning with Gibbs Algorithm Yuheng Bu Gholamali Aminian Laura Toni Miguel R. D. Rodrigues G. Wornell 64 14 0 02 Nov 2021
Characterizing the Generalization Error of Gibbs Algorithm with Symmetrized KL information Gholamali Aminian Yuheng Bu Laura Toni M. Rodrigues G. Wornell 73 4 0 28 Jul 2021
Generalization Bounds for Noisy Iterative Algorithms Using Properties of Additive Noise Channels Hao Wang Rui Gao Flavio du Pin Calmon 81 18 0 05 Feb 2021
Information-Theoretic Bounds on the Moments of the Generalization Error of Learning Algorithms Gholamali Aminian Laura Toni M. Rodrigues 139 16 0 03 Feb 2021
An Information-Theoretic Analysis of the Impact of Task Similarity on Meta-Learning Sharu Theresa Jose Osvaldo Simeone 84 11 0 21 Jan 2021