On the Information Bottleneck Problems: Models, Connections, Applications and Information Theoretic Views

Entropy (Entropy), 2020

31 January 2020

Milad Sefidgaran

Iñaki Estella Aguerri

S. Shamai

ArXiv (abs)PDF HTML

Papers citing "On the Information Bottleneck Problems: Models, Connections, Applications and Information Theoretic Views"

28 / 28 papers shown

Title
Multi-Modal Multi-Task Semantic Communication: A Distributed Information Bottleneck Perspective Yujie Zhou Yiwei Liao Cheng Peng Yong Xiao Yong Xiao Yingyu Li Guangming Shi 70 0 0 05 Oct 2025
Generalization Guarantees for Multi-View Representation Learning and Application to Regularization via Gaussian Product Mixture Prior Romain Chor Abdellatif Zaidi Piotr Krasnowski 156 2 0 25 Apr 2025
Minimum Description Length and Generalization Guarantees for Representation LearningNeural Information Processing Systems (NeurIPS), 2024 Romain Chor Abdellatif Zaidi Piotr Krasnowski 188 11 0 05 Feb 2024
Elastic Information Bottleneck Yuyan Ni Yanyan Lan Ao Liu Zhiming Ma 165 3 0 07 Nov 2023
Lossless Transformations and Excess Risk Bounds in Statistical InferenceEntropy (Entropy), 2023 László Gyorfi Tamás Linder Harro Walk 175 5 0 31 Jul 2023
Information decomposition in complex systems via machine learningProceedings of the National Academy of Sciences of the United States of America (PNAS), 2023 Kieran A. Murphy Danielle Bassett 181 12 0 10 Jul 2023
The Information Bottleneck's Ordinary Differential Equation: First-Order Root-Tracking for the IBEntropy (Entropy), 2023 Shlomi Agmon 184 0 0 16 Jun 2023
Lessons from Generalization Error Analysis of Federated Learning: You May Communicate Less Often!International Conference on Machine Learning (ICML), 2023 Romain Chor Abdellatif Zaidi Milad Sefidgaran Yijun Wan FedML 155 9 0 09 Jun 2023
Beyond Transmitting Bits: Context, Semantics, and Task-Oriented CommunicationsIEEE Journal on Selected Areas in Communications (JSAC), 2022 Deniz Gunduz Zhijin Qin Iñaki Estella Aguerri Harpreet S. Dhillon Zhaohui Yang Aylin Yener Kai‐Kit Wong C. Chae 189 568 0 19 Jul 2022
Bottlenecks CLUB: Unifying Information-Theoretic Trade-offs Among Complexity, Leakage, and UtilityIEEE Transactions on Information Forensics and Security (IEEE TIFS), 2022 Behrooz Razeghi Flavio du Pin Calmon Deniz Gunduz Svyatoslav Voloshynovskiy 125 18 0 11 Jul 2022
Classification Utility, Fairness, and Compactness via Tunable Information Bottleneck and Rényi MeasuresIEEE Transactions on Information Forensics and Security (IEEE TIFS), 2022 A. Gronowski William Paul F. Alajaji Bahman Gharesifard Philippe Burlina FaML 149 7 0 20 Jun 2022
Semantic Information Recovery in Wireless NetworksItalian National Conference on Sensors (INS), 2022 Edgar Beck C. Bockelmann Armin Dekorsy 238 29 0 28 Apr 2022
Theoretical Analysis of Deep Neural Networks in Physical Layer CommunicationIEEE Transactions on Communications (IEEE Trans. Commun.), 2022 Jing Liu Haitao Zhao Dongtang Ma Kai Mei Jibo Wei 127 5 0 21 Feb 2022
Studying the Interplay between Information Loss and Operation Loss in Representations for Classification Jorge F. Silva Felipe A. Tobar Mario L. Vicuna Felipe Cordova 104 2 0 30 Dec 2021
Gated Information Bottleneck for Generalization in Sequential EnvironmentsIndustrial Conference on Data Mining (IDM), 2021 Francesco Alesiani Shujian Yu Xi Yu OOD AAML 109 13 0 12 Oct 2021
In-Network Learning: Distributed Training and Inference in NetworksEntropy (Entropy), 2021 Matei Moldoveanu Milad Sefidgaran 130 13 0 07 Jul 2021
Opening the Black Box of Deep Neural Networks in Physical Layer CommunicationIEEE Wireless Communications and Networking Conference (WCNC), 2021 Jun Liu Haitao Zhao Dongtang Ma Kai Mei Jibo Wei AI4CE 181 3 0 02 Jun 2021
On In-network learning. A Comparative Study with Federated and Split LearningInternational Workshop on Signal Processing Advances in Wireless Communications (SPAWC), 2021 Matei Moldoveanu Milad Sefidgaran FedML 153 7 0 30 Apr 2021
Scalable Vector Gaussian Information BottleneckInternational Symposium on Information Theory (ISIT), 2021 Mohammad Mahdi Mahvari M. Kobayashi Milad Sefidgaran 70 2 0 15 Feb 2021
Information flows of diverse autoencodersEntropy (Entropy), 2021 Sungyeop Lee Junghyo Jo 129 11 0 15 Feb 2021
Learning Task-Oriented Communication for Edge Inference: An Information Bottleneck ApproachIEEE Journal on Selected Areas in Communications (JSAC), 2021 Jiawei Shao Yuyi Mao Jun Zhang 139 260 0 08 Feb 2021
Deep Deterministic Information Bottleneck with Matrix-based Entropy FunctionalIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2021 Xi Yu Shujian Yu José C. Príncipe AAML 126 31 0 31 Jan 2021
Bottleneck Problems: Information and Estimation-Theoretic View S. Asoodeh Flavio du Pin Calmon 108 18 0 12 Nov 2020
On the Relevance-Complexity Region of Scalable Information Bottleneck Mohammad Mahdi Mahvari M. Kobayashi Milad Sefidgaran 90 2 0 02 Nov 2020
Least $k$ th-Order and Rényi Generative Adversarial NetworksNeural Computation (Neural Comput.), 2020 Himesh Bhatia William Paul F. Alajaji Bahman Gharesifard Philippe Burlina GAN 116 8 0 03 Jun 2020
The Information Bottleneck Problem and Its Applications in Machine LearningIEEE Journal on Selected Areas in Information Theory (JSAIT), 2020 Ziv Goldfeld Yury Polyanskiy 133 150 0 30 Apr 2020
A Modular Deep Learning Pipeline for Galaxy-Scale Strong Gravitational Lens Detection and Modeling Sandeep Madireddy Nesar Ramachandra Nan Li James P. Butler Dali Wang Salman Habib K. Heitmann The LSST Dark Energy Science Collaboration 106 5 0 10 Nov 2019
Variational Information Bottleneck for Unsupervised Clustering: Deep Gaussian Mixture EmbeddingEntropy (Entropy), 2019 Yiğit Uğur George Arvanitakis Milad Sefidgaran BDL DRL 182 24 0 28 May 2019