Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2004.14941
Cited By
v1
v2 (latest)
The Information Bottleneck Problem and Its Applications in Machine Learning
IEEE Journal on Selected Areas in Information Theory (JSAIT), 2020
30 April 2020
Ziv Goldfeld
Yury Polyanskiy
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"The Information Bottleneck Problem and Its Applications in Machine Learning"
50 / 57 papers shown
IBNorm: Information-Bottleneck Inspired Normalization for Representation Learning
Xiandong Zou
Pan Zhou
Xiaotong Yuan
Pan Zhou
171
0
0
29 Oct 2025
Distributed Information Bottleneck Theory for Multi-Modal Task-Aware Semantic Communication
Yujie Zhou
Yiwei Liao
Cheng Peng
Yong Xiao
Yong Xiao
Yingyu Li
Guangming Shi
368
0
0
05 Oct 2025
Entropy-Based Non-Invasive Reliability Monitoring of Convolutional Neural Networks
Amirhossein Nazeri
Wael Hafez
AAML
125
2
0
29 Aug 2025
Surgical Foundation Model Leveraging Compression and Entropy Maximization for Image-Guided Surgical Assistance
Lianhao Yin
O. Meireles
Guy Rosman
Daniela Rus
226
0
0
16 May 2025
CIBR: Cross-modal Information Bottleneck Regularization for Robust CLIP Generalization
International Conference on Artificial Neural Networks (ICANN), 2025
Yingrui Ji
Xi Xiao
Gaofei Chen
Hao Xu
Chenrui Ma
Lijing Zhu
Aokun Liang
Jiansheng Chen
VLM
317
6
0
31 Mar 2025
L
2
^2
2
M: Mutual Information Scaling Law for Long-Context Language Modeling
Zhuo Chen
Oriol Mayné i Comas
Zhuotao Jin
Di Luo
Marin Soljacic
427
6
0
06 Mar 2025
Which bits went where? Past and future transfer entropy decomposition with the information bottleneck
Kieran A. Murphy
Zhuowen Yin
D. Bassett
307
2
0
07 Nov 2024
From PINNs to PIKANs: Recent Advances in Physics-Informed Machine Learning
Juan Diego Toscano
Vivek Oommen
Alan John Varghese
Zongren Zou
Nazanin Ahmadi Daryakenari
Chenxi Wu
George Karniadakis
PINN
AI4CE
331
160
0
17 Oct 2024
MacDiff: Unified Skeleton Modeling with Masked Conditional Diffusion
European Conference on Computer Vision (ECCV), 2024
Lehong Wu
Lilang Lin
Jiahang Zhang
Yi Ma
Jiaying Liu
DiffM
304
13
0
16 Sep 2024
An Information-Theoretic Analysis of Temporal GNNs
Information Theory Workshop (ITW), 2024
Amirmohammad Farzaneh
113
0
0
10 Aug 2024
10 Years of Fair Representations: Challenges and Opportunities
Mattia Cerrato
Marius Köppel
Philipp Wolf
Stefan Kramer
FaML
242
6
0
04 Jul 2024
A comprehensive and FAIR comparison between MLP and KAN representations for differential equations and operator networks
K. Shukla
Juan Diego Toscano
Zhicheng Wang
Zongren Zou
George Karniadakis
366
192
0
05 Jun 2024
TimeX++: Learning Time-Series Explanations with Information Bottleneck
International Conference on Machine Learning (ICML), 2024
Zichuan Liu
Tianchun Wang
Jimeng Shi
Xu Zheng
Zhuomin Chen
Lei Song
Wenqian Dong
J. Obeysekera
Farhad Shirani
Dongsheng Luo
AI4TS
305
33
0
15 May 2024
Partial information decomposition: redundancy as information bottleneck
Entropy (Entropy), 2024
Artemy Kolchinsky
401
3
0
13 May 2024
Information-Theoretic Generalization Bounds for Deep Neural Networks
IEEE Transactions on Information Theory (IEEE Trans. Inf. Theory), 2024
Haiyun He
Christina Lee Yu
525
12
0
04 Apr 2024
Information Plane Analysis Visualization in Deep Learning via Transfer Entropy
Adrian Moldovan
A. Cataron
Razvan Andonie
FAtt
143
1
0
01 Apr 2024
Learning in PINNs: Phase transition, total diffusion, and generalization
Sokratis J. Anagnostopoulos
Juan Diego Toscano
Nikolaos Stergiopulos
George Karniadakis
277
16
0
27 Mar 2024
Towards Independence Criterion in Machine Unlearning of Features and Labels
Ling Han
Nanqing Luo
Hao Huang
Jing Chen
Mary-Anne Hartley
MU
387
8
0
12 Mar 2024
Towards Tracing Trustworthiness Dynamics: Revisiting Pre-training Period of Large Language Models
Chao Qian
Jie Zhang
Wei Yao
Dongrui Liu
Zhen-fei Yin
Yu Qiao
Yong Liu
Jing Shao
LLMSV
LRM
270
16
0
29 Feb 2024
Minimum Description Length and Generalization Guarantees for Representation Learning
Neural Information Processing Systems (NeurIPS), 2024
Romain Chor
Abdellatif Zaidi
Piotr Krasnowski
376
13
0
05 Feb 2024
Expand-and-Quantize: Unsupervised Semantic Segmentation Using High-Dimensional Space and Product Quantization
AAAI Conference on Artificial Intelligence (AAAI), 2023
Jiyoung Kim
Kyuhong Shim
Insu Lee
B. Shim
266
4
0
12 Dec 2023
MIMIR: Masked Image Modeling for Mutual Information-based Adversarial Robustness
Xiaoyun Xu
Shujian Yu
Jingzheng Wu
S. Picek
AAML
688
10
0
08 Dec 2023
Elastic Information Bottleneck
Yuyan Ni
Yanyan Lan
Ao Liu
Zhiming Ma
297
3
0
07 Nov 2023
MemDA: Forecasting Urban Time Series with Memory-based Drift Adaptation
International Conference on Information and Knowledge Management (CIKM), 2023
Zekun Cai
Renhe Jiang
Xinyu Yang
Zhaonan Wang
Diansheng Guo
Hiroki Kobayashi
Xuan Song
Ryosuke Shibasaki
AI4TS
422
16
0
25 Sep 2023
Lossless Transformations and Excess Risk Bounds in Statistical Inference
Entropy (Entropy), 2023
László Gyorfi
Tamás Linder
Harro Walk
499
6
0
31 Jul 2023
Demystifying Local and Global Fairness Trade-offs in Federated Learning Using Partial Information Decomposition
Faisal Hamman
Sanghamitra Dutta
FedML
366
16
0
21 Jul 2023
The Role of Entropy and Reconstruction in Multi-View Self-Supervised Learning
International Conference on Machine Learning (ICML), 2023
Borja Rodríguez Gálvez
Arno Blaas
P. Rodríguez
Adam Goliñski
Xavier Suau
Jason Ramapuram
Dan Busbridge
Luca Zappella
329
12
0
20 Jul 2023
Information decomposition in complex systems via machine learning
Proceedings of the National Academy of Sciences of the United States of America (PNAS), 2023
Kieran A. Murphy
Danielle Bassett
374
20
0
10 Jul 2023
Residual-based attention and connection to information bottleneck theory in PINNs
Sokratis J. Anagnostopoulos
Juan Diego Toscano
Nikos Stergiopulos
George Karniadakis
354
27
0
01 Jul 2023
Individual and Structural Graph Information Bottlenecks for Out-of-Distribution Generalization
IEEE Transactions on Knowledge and Data Engineering (TKDE), 2023
Ling Yang
Jiayi Zheng
Heyuan Wang
Zhongyi Liu
Zhilin Huang
Shenda Hong
Wentao Zhang
Tengjiao Wang
296
24
0
28 Jun 2023
GIMM: InfoMin-Max for Automated Graph Contrastive Learning
Xin Xiong
Jian Zhao
Xiangyu Wang
School of Materials Science
241
0
0
27 May 2023
To Compress or Not to Compress- Self-Supervised Learning and Information Theory: A Review
Entropy (Entropy), 2023
Ravid Shwartz-Ziv
Yann LeCun
SSL
617
114
0
19 Apr 2023
Local Intrinsic Dimensional Entropy
AAAI Conference on Artificial Intelligence (AAAI), 2023
Rohan Ghosh
Mehul Motani
436
2
0
05 Apr 2023
Using Intermediate Forward Iterates for Intermediate Generator Optimization
Harshit Mishra
Jurijs Nazarovs
Manmohan Dogra
Sathya Ravi
DiffM
324
0
0
05 Feb 2023
Machine Learning for Large-Scale Optimization in 6G Wireless Networks
IEEE Communications Surveys and Tutorials (COMST), 2023
Yandong Shi
Lixiang Lian
Yuanming Shi
Zixin Wang
Yong Zhou
Liqun Fu
Lin Bai
Jun Zhang
Wei Zhang
AI4CE
313
176
0
03 Jan 2023
On the Effect of Pre-training for Transformer in Different Modality on Offline Reinforcement Learning
Neural Information Processing Systems (NeurIPS), 2022
S. Takagi
OffRL
252
8
0
17 Nov 2022
Invariant Representations with Stochastically Quantized Neural Networks
AAAI Conference on Artificial Intelligence (AAAI), 2022
Mattia Cerrato
Marius Köppel
Roberto Esposito
Stefan Kramer
MQ
243
5
0
04 Aug 2022
Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communications
IEEE Journal on Selected Areas in Communications (JSAC), 2022
Deniz Gunduz
Zhijin Qin
Iñaki Estella Aguerri
Harpreet S. Dhillon
Zhaohui Yang
Aylin Yener
Kai‐Kit Wong
C. Chae
501
717
0
19 Jul 2022
Bottlenecks CLUB: Unifying Information-Theoretic Trade-offs Among Complexity, Leakage, and Utility
IEEE Transactions on Information Forensics and Security (IEEE TIFS), 2022
Behrooz Razeghi
Flavio du Pin Calmon
Deniz Gunduz
Svyatoslav Voloshynovskiy
216
23
0
11 Jul 2022
Disentangling private classes through regularization
Neurocomputing (Neurocomputing), 2022
Enzo Tartaglione
F. Gennari
Marco Grangetto
AILaw
176
5
0
05 Jul 2022
Classification Utility, Fairness, and Compactness via Tunable Information Bottleneck and Rényi Measures
IEEE Transactions on Information Forensics and Security (IEEE TIFS), 2022
A. Gronowski
William Paul
F. Alajaji
Bahman Gharesifard
Philippe Burlina
FaML
347
7
0
20 Jun 2022
k-Sliced Mutual Information: A Quantitative Study of Scalability with Dimension
Ziv Goldfeld
Kristjan Greenewald
Theshani Nuradha
Galen Reeves
244
0
0
17 Jun 2022
Semantic Information Recovery in Wireless Networks
Italian National Conference on Sensors (INS), 2022
Edgar Beck
C. Bockelmann
Armin Dekorsy
413
35
0
28 Apr 2022
An Indirect Rate-Distortion Characterization for Semantic Sources: General Model and the Case of Gaussian Observation
IEEE Transactions on Communications (IEEE Trans. Commun.), 2022
Jiakun Liu
Shuo Shao
Wenyi Zhang
H. Vincent Poor
275
50
0
29 Jan 2022
Gated Information Bottleneck for Generalization in Sequential Environments
Industrial Conference on Data Mining (IDM), 2021
Francesco Alesiani
Shujian Yu
Xi Yu
OOD
AAML
294
14
0
12 Oct 2021
Task-Oriented Communication for Multi-Device Cooperative Edge Inference
IEEE Transactions on Wireless Communications (IEEE TWC), 2021
Jiawei Shao
Yuyi Mao
Jun Zhang
330
185
0
01 Sep 2021
Adversarial Graph Augmentation to Improve Graph Contrastive Learning
Neural Information Processing Systems (NeurIPS), 2021
Susheel Suresh
Pan Li
Cong Hao
Jennifer Neville
AAML
523
431
0
10 Jun 2021
A Critical Review of Information Bottleneck Theory and its Applications to Deep Learning
Mohammad Ali Alomrani
339
3
0
07 May 2021
Learning Robust Variational Information Bottleneck with Reference
Weizhu Qian
Bowei Chen
Xiaowei Huang
AAML
167
1
0
29 Apr 2021
Scalable Vector Gaussian Information Bottleneck
International Symposium on Information Theory (ISIT), 2021
Mohammad Mahdi Mahvari
M. Kobayashi
Milad Sefidgaran
249
2
0
15 Feb 2021
1
2
Next
Page 1 of 2
