ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2005.08044
  4. Cited By
Generalization Bounds via Information Density and Conditional
  Information Density
v1v2v3v4v5v6 (latest)

Generalization Bounds via Information Density and Conditional Information Density

16 May 2020
Fredrik Hellström
G. Durisi
ArXiv (abs)PDFHTML

Papers citing "Generalization Bounds via Information Density and Conditional Information Density"

44 / 44 papers shown
PAC-Bayesian Reinforcement Learning Trains Generalizable Policies
PAC-Bayesian Reinforcement Learning Trains Generalizable Policies
Abdelkrim Zitouni
Mehdi Hennequin
Juba Agoun
Ryan Horache
Nadia Kabachi
Omar Rivasplata
OffRLBDL
211
0
0
12 Oct 2025
PAC-Bayesian Generalization Bounds for Graph Convolutional Networks on Inductive Node Classification
PAC-Bayesian Generalization Bounds for Graph Convolutional Networks on Inductive Node Classification
Huayi Tang
Yong Liu
GNNAI4CE
216
0
0
08 Sep 2025
Generalization and Robustness of the Tilted Empirical Risk
Generalization and Robustness of the Tilted Empirical Risk
Gholamali Aminian
Amir R. Asadi
Tian Li
Ahmad Beirami
Gesine Reinert
Samuel N. Cohen
485
1
0
28 Sep 2024
An Information-Theoretic Framework for Out-of-Distribution
  Generalization
An Information-Theoretic Framework for Out-of-Distribution Generalization
Wenliang Liu
Guanding Yu
Lele Wang
Renjie Liao
303
5
0
29 Mar 2024
A note on generalization bounds for losses with finite moments
A note on generalization bounds for losses with finite moments
Borja Rodríguez Gálvez
Omar Rivasplata
Ragnar Thobaben
Mikael Skoglund
219
0
0
25 Mar 2024
Leveraging PAC-Bayes Theory and Gibbs Distributions for Generalization
  Bounds with Complexity Measures
Leveraging PAC-Bayes Theory and Gibbs Distributions for Generalization Bounds with Complexity Measures
Paul Viallard
Rémi Emonet
Amaury Habrard
Emilie Morvant
Valentina Zantedeschi
369
5
0
19 Feb 2024
PAC-Bayes-Chernoff bounds for unbounded losses
PAC-Bayes-Chernoff bounds for unbounded lossesNeural Information Processing Systems (NeurIPS), 2024
Ioar Casado
Luis A. Ortega
A. Masegosa
Aritz Pérez Martínez
621
9
0
02 Jan 2024
Generalization Analysis of Machine Learning Algorithms via the
  Worst-Case Data-Generating Probability Measure
Generalization Analysis of Machine Learning Algorithms via the Worst-Case Data-Generating Probability Measure
Xinying Zou
S. Perlaza
I. Esnaola
Eitan Altman
248
28
0
19 Dec 2023
Information-Theoretic Generalization Bounds for Transductive Learning and its Applications
Information-Theoretic Generalization Bounds for Transductive Learning and its Applications
Huayi Tang
Yong Liu
543
3
0
08 Nov 2023
Comparing Comparators in Generalization Bounds
Comparing Comparators in Generalization BoundsInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2023
Fredrik Hellström
Benjamin Guedj
321
5
0
16 Oct 2023
More PAC-Bayes bounds: From bounded losses, to losses with general tail
  behaviors, to anytime validity
More PAC-Bayes bounds: From bounded losses, to losses with general tail behaviors, to anytime validityJournal of machine learning research (JMLR), 2023
Borja Rodríguez Gálvez
Ragnar Thobaben
Mikael Skoglund
542
16
0
21 Jun 2023
Online-to-PAC Conversions: Generalization Bounds via Regret Analysis
Online-to-PAC Conversions: Generalization Bounds via Regret Analysis
Gábor Lugosi
Gergely Neu
224
15
0
31 May 2023
How Does Information Bottleneck Help Deep Learning?
How Does Information Bottleneck Help Deep Learning?International Conference on Machine Learning (ICML), 2023
Kenji Kawaguchi
Zhun Deng
Xu Ji
Jiaoyang Huang
243
115
0
30 May 2023
A unified framework for information-theoretic generalization bounds
A unified framework for information-theoretic generalization boundsNeural Information Processing Systems (NeurIPS), 2023
Y.-C. Chu
Maxim Raginsky
236
27
0
18 May 2023
Exactly Tight Information-Theoretic Generalization Error Bound for the
  Quadratic Gaussian Problem
Exactly Tight Information-Theoretic Generalization Error Bound for the Quadratic Gaussian ProblemInternational Symposium on Information Theory (ISIT), 2023
Ruida Zhou
C. Tian
Tie Liu
303
5
0
01 May 2023
Generalization Error Bounds for Noisy, Iterative Algorithms via Maximal
  Leakage
Generalization Error Bounds for Noisy, Iterative Algorithms via Maximal Leakage
Ibrahim Issa
A. Esposito
Michael C. Gastpar
272
5
0
28 Feb 2023
Tighter Information-Theoretic Generalization Bounds from Supersamples
Tighter Information-Theoretic Generalization Bounds from SupersamplesInternational Conference on Machine Learning (ICML), 2023
Ziqiao Wang
Yongyi Mao
499
22
0
05 Feb 2023
Two Facets of SDE Under an Information-Theoretic Lens: Generalization of
  SGD via Training Trajectories and via Terminal States
Two Facets of SDE Under an Information-Theoretic Lens: Generalization of SGD via Training Trajectories and via Terminal StatesConference on Uncertainty in Artificial Intelligence (UAI), 2022
Ziqiao Wang
Yongyi Mao
367
12
0
19 Nov 2022
Evaluated CMI Bounds for Meta Learning: Tightness and Expressiveness
Evaluated CMI Bounds for Meta Learning: Tightness and ExpressivenessNeural Information Processing Systems (NeurIPS), 2022
Fredrik Hellström
G. Durisi
253
15
0
12 Oct 2022
A New Family of Generalization Bounds Using Samplewise Evaluated CMI
A New Family of Generalization Bounds Using Samplewise Evaluated CMINeural Information Processing Systems (NeurIPS), 2022
Fredrik Hellström
G. Durisi
315
30
0
12 Oct 2022
f-divergences and their applications in lossy compression and bounding
  generalization error
f-divergences and their applications in lossy compression and bounding generalization errorIEEE Transactions on Information Theory (IEEE Trans. Inf. Theory), 2022
Saeed Masiha
A. Gohari
Mohammad Hossein Yassaee
333
24
0
21 Jun 2022
Formal limitations of sample-wise information-theoretic generalization
  bounds
Formal limitations of sample-wise information-theoretic generalization boundsInformation Theory Workshop (ITW), 2022
Hrayr Harutyunyan
Greg Ver Steeg
Aram Galstyan
282
3
0
13 May 2022
Rate-Distortion Theoretic Generalization Bounds for Stochastic Learning
  Algorithms
Rate-Distortion Theoretic Generalization Bounds for Stochastic Learning AlgorithmsAnnual Conference Computational Learning Theory (COLT), 2022
Romain Chor
A. Gohari
Gaël Richard
Umut Simsekli
318
28
0
04 Mar 2022
Chained Generalisation Bounds
Chained Generalisation BoundsAnnual Conference Computational Learning Theory (COLT), 2022
Eugenio Clerico
Amitis Shidani
George Deligiannidis
Arnaud Doucet
AI4CEFedML
294
14
0
02 Mar 2022
Single Trajectory Nonparametric Learning of Nonlinear Dynamics
Single Trajectory Nonparametric Learning of Nonlinear DynamicsAnnual Conference Computational Learning Theory (COLT), 2022
Ingvar M. Ziemann
H. Sandberg
Nikolai Matni
312
29
0
16 Feb 2022
Information-Theoretic Analysis of Minimax Excess Risk
Information-Theoretic Analysis of Minimax Excess RiskIEEE Transactions on Information Theory (IEEE Trans. Inf. Theory), 2022
Hassan Hafez-Kolahi
Behrad Moniri
S. Kasaei
205
5
0
15 Feb 2022
Generalization Bounds via Convex Analysis
Generalization Bounds via Convex AnalysisAnnual Conference Computational Learning Theory (COLT), 2022
Gábor Lugosi
Gergely Neu
314
37
0
10 Feb 2022
Stability Based Generalization Bounds for Exponential Family Langevin
  Dynamics
Stability Based Generalization Bounds for Exponential Family Langevin DynamicsInternational Conference on Machine Learning (ICML), 2022
A. Banerjee
Tiancong Chen
Xinyan Li
Yingxue Zhou
336
9
0
09 Jan 2022
Towards a Unified Information-Theoretic Framework for Generalization
Towards a Unified Information-Theoretic Framework for GeneralizationNeural Information Processing Systems (NeurIPS), 2021
Mahdi Haghifam
Gintare Karolina Dziugaite
Shay Moran
Daniel M. Roy
423
38
0
09 Nov 2021
User-friendly introduction to PAC-Bayes bounds
User-friendly introduction to PAC-Bayes bounds
Pierre Alquier
FedML
704
272
0
21 Oct 2021
PAC-Bayes, MAC-Bayes and Conditional Mutual Information: Fast rate
  bounds that handle general VC classes
PAC-Bayes, MAC-Bayes and Conditional Mutual Information: Fast rate bounds that handle general VC classesAnnual Conference Computational Learning Theory (COLT), 2021
Peter Grünwald
Thomas Steinke
Lydia Zakynthinou
209
34
0
17 Jun 2021
Information Complexity and Generalization Bounds
Information Complexity and Generalization BoundsInternational Symposium on Information Theory (ISIT), 2021
P. Banerjee
Guido Montúfar
405
18
0
04 May 2021
Generalization Bounds for Noisy Iterative Algorithms Using Properties of
  Additive Noise Channels
Generalization Bounds for Noisy Iterative Algorithms Using Properties of Additive Noise ChannelsJournal of machine learning research (JMLR), 2021
Hao Wang
Rui Gao
Flavio du Pin Calmon
346
20
0
05 Feb 2021
Information-Theoretic Bounds on the Moments of the Generalization Error
  of Learning Algorithms
Information-Theoretic Bounds on the Moments of the Generalization Error of Learning AlgorithmsInternational Symposium on Information Theory (ISIT), 2021
Gholamali Aminian
Laura Toni
M. Rodrigues
442
18
0
03 Feb 2021
Tighter expected generalization error bounds via Wasserstein distance
Tighter expected generalization error bounds via Wasserstein distanceNeural Information Processing Systems (NeurIPS), 2021
Borja Rodríguez Gálvez
Germán Bassi
Ragnar Thobaben
Mikael Skoglund
313
51
0
22 Jan 2021
An Information-Theoretic Analysis of the Impact of Task Similarity on
  Meta-Learning
An Information-Theoretic Analysis of the Impact of Task Similarity on Meta-LearningInternational Symposium on Information Theory (ISIT), 2021
Sharu Theresa Jose
Osvaldo Simeone
285
15
0
21 Jan 2021
Recent advances in deep learning theory
Recent advances in deep learning theory
Fengxiang He
Dacheng Tao
AI4CE
389
57
0
20 Dec 2020
Transfer Meta-Learning: Information-Theoretic Bounds and Information
  Meta-Risk Minimization
Transfer Meta-Learning: Information-Theoretic Bounds and Information Meta-Risk Minimization
Sharu Theresa Jose
Osvaldo Simeone
G. Durisi
333
17
0
04 Nov 2020
Fast-Rate Loss Bounds via Conditional Information Measures with
  Applications to Neural Networks
Fast-Rate Loss Bounds via Conditional Information Measures with Applications to Neural Networks
Fredrik Hellström
G. Durisi
331
2
0
22 Oct 2020
On Random Subset Generalization Error Bounds and the Stochastic Gradient
  Langevin Dynamics Algorithm
On Random Subset Generalization Error Bounds and the Stochastic Gradient Langevin Dynamics Algorithm
Borja Rodríguez Gálvez
Germán Bassi
Ragnar Thobaben
Mikael Skoglund
283
37
0
21 Oct 2020
Conditional Mutual Information-Based Generalization Bound for Meta
  Learning
Conditional Mutual Information-Based Generalization Bound for Meta Learning
A. Rezazadeh
Sharu Theresa Jose
G. Durisi
Osvaldo Simeone
190
1
0
21 Oct 2020
Information-Theoretic Bounds on Transfer Generalization Gap Based on
  Jensen-Shannon Divergence
Information-Theoretic Bounds on Transfer Generalization Gap Based on Jensen-Shannon Divergence
Sharu Theresa Jose
Osvaldo Simeone
538
18
0
13 Oct 2020
Upper Bounds on the Generalization Error of Private Algorithms for
  Discrete Data
Upper Bounds on the Generalization Error of Private Algorithms for Discrete Data
Borja Rodríguez Gálvez
Germán Bassi
Mikael Skoglund
313
9
0
12 May 2020
Reasoning About Generalization via Conditional Mutual Information
Reasoning About Generalization via Conditional Mutual InformationAnnual Conference Computational Learning Theory (COLT), 2020
Thomas Steinke
Lydia Zakynthinou
521
194
0
24 Jan 2020
1
Page 1 of 1