Tightening Mutual Information Based Bounds on Generalization Error

v1v2 (latest)

Tightening Mutual Information Based Bounds on Generalization Error

15 January 2019

Venugopal V. Veeravalli

ArXiv (abs)PDF HTML

Papers citing "Tightening Mutual Information Based Bounds on Generalization Error"

18 / 118 papers shown

Title
On Random Subset Generalization Error Bounds and the Stochastic Gradient Langevin Dynamics Algorithm Borja Rodríguez Gálvez Germán Bassi Ragnar Thobaben Mikael Skoglund 115 32 0 21 Oct 2020
Conditional Mutual Information-Based Generalization Bound for Meta Learning A. Rezazadeh Sharu Theresa Jose G. Durisi Osvaldo Simeone 70 1 0 21 Oct 2020
Information-Theoretic Bounds on Transfer Generalization Gap Based on Jensen-Shannon Divergence Sharu Theresa Jose Osvaldo Simeone 106 16 0 13 Oct 2020
Information-theoretic analysis for transfer learning Xuetong Wu J. Manton U. Aickelin Jingge Zhu 56 34 0 18 May 2020
Generalization Bounds via Information Density and Conditional Information Density Fredrik Hellström G. Durisi 126 67 0 16 May 2020
Upper Bounds on the Generalization Error of Private Algorithms for Discrete Data Borja Rodríguez Gálvez Germán Bassi Mikael Skoglund 65 4 0 12 May 2020
Information-Theoretic Generalization Bounds for Meta-Learning and Applications Sharu Theresa Jose Osvaldo Simeone 87 47 0 09 May 2020
Information-Theoretic Bounds on the Generalization Error and Privacy Leakage in Federated Learning Semih Yagli Alex Dytso H. Vincent Poor FedML 87 33 0 05 May 2020
Sharpened Generalization Bounds based on Conditional Mutual Information and an Application to Noisy, Iterative Algorithms Mahdi Haghifam Jeffrey Negrea Ashish Khisti Daniel M. Roy Gintare Karolina Dziugaite 206 108 0 27 Apr 2020
Generalization Error Bounds via $m$ th Central Moments of the Information Density Fredrik Hellström G. Durisi 61 5 0 20 Apr 2020
Think Global, Act Local: Relating DNN generalisation and node-level SNR Paul Norridge 29 1 0 11 Feb 2020
Reasoning About Generalization via Conditional Mutual Information Thomas Steinke Lydia Zakynthinou 161 166 0 24 Jan 2020
General Information Bottleneck Objectives and their Applications to Machine Learning S. Mukherjee 36 4 0 12 Dec 2019
Generalization Error Bounds Via Rényi-, $f$ -Divergences and Maximal Leakage A. Esposito Michael C. Gastpar Ibrahim Issa 94 76 0 01 Dec 2019
Information-Theoretic Generalization Bounds for SGLD via Data-Dependent Estimates Jeffrey Negrea Mahdi Haghifam Gintare Karolina Dziugaite Ashish Khisti Daniel M. Roy FedML 200 153 0 06 Nov 2019
Chaining Meets Chain Rule: Multilevel Entropic Regularization and Training of Neural Nets Amir-Reza Asadi Emmanuel Abbe BDL AI4CE 85 13 0 26 Jun 2019
A Tunable Loss Function for Robust Classification: Calibration, Landscape, and Generalization Tyler Sypherd Mario Díaz J. Cava Gautam Dasarathy Peter Kairouz Lalitha Sankar 67 29 0 05 Jun 2019
Gaussian Mean Field Regularizes by Limiting Learned Information Julius Kunze Louis Kirsch H. Ritter David Barber FedML MLT 41 2 0 12 Feb 2019