The Conditional Entropy Bottleneck

Entropy (Entropy), 2020

13 February 2020

Papers citing "The Conditional Entropy Bottleneck"

50 / 75 papers shown

Title
H-SPLID: HSIC-based Saliency Preserving Latent Information Decomposition Lukas Miklautz Chengzhi Shi Andrii Shkabrii Theodoros Thirimachos Davarakis Prudence Lam Claudia Plant Jennifer Dy Stratis Ioannidis 52 0 0 23 Oct 2025
How Patterns Dictate Learnability in Sequential Data Mario Morawski Anais Despres Rémi Rehm AI4TS 80 0 0 12 Oct 2025
IndiSeek learns information-guided disentangled representations Yu Gui Cong Ma Zongming Ma DRL 310 0 0 25 Sep 2025
Label Smoothing is a Pragmatic Information Bottleneck Sota Kudo 75 0 0 12 Aug 2025
Comparing human and LLM proofreading in L2 writing: Impact on lexical and syntactic featuresWorkshop on Innovative Use of NLP for Building Educational Applications (UNBEA), 2025 Hakyung Sung Karla Csuros Min-Chang Sung 194 0 0 10 Jun 2025
Multimodal Conditional Information Bottleneck for Generalizable AI-Generated Image Detection Haotian Qin Dongliang Chang Y. Gao Bingyao Yu Lei Chen Zhanyu Ma 268 1 0 21 May 2025
Generalization Guarantees for Multi-View Representation Learning and Application to Regularization via Gaussian Product Mixture Prior Romain Chor Abdellatif Zaidi Piotr Krasnowski 193 2 0 25 Apr 2025
Mitigating Hallucinations in Large Vision-Language Models by Adaptively Constraining Information FlowAAAI Conference on Artificial Intelligence (AAAI), 2025 Jiaqi Bai Hongcheng Guo Zhongyuan Peng Zhiqiang Wang Zhiyu Li Mingze Li Zhihong Tian VLM 172 5 0 28 Feb 2025
Generalization Guarantees for Representation Learning via Data-Dependent Gaussian Mixture PriorsInternational Conference on Learning Representations (ICLR), 2025 Romain Chor Milad Sefidgaran Piotr Krasnowski 418 3 0 21 Feb 2025
Steinmetz Neural Networks for Complex-Valued DataInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2024 Shyam Venkatasubramanian Ali Pezeshki Vahid Tarokh 936 1 0 17 Feb 2025
Structural Entropy Guided Probabilistic CodingAAAI Conference on Artificial Intelligence (AAAI), 2024 Xiang Huang Hao Peng Li Sun Hui Lin Chunyang Liu Jiang Cao Philip S. Yu 265 3 0 12 Dec 2024
An Information Criterion for Controlled Disentanglement of Multimodal DataInternational Conference on Learning Representations (ICLR), 2024 Chenyu Wang Sharut Gupta Xinyi Zhang Sana Tonekaboni Stefanie Jegelka Tommi Jaakkola Caroline Uhler DRL 320 6 0 31 Oct 2024
Contrastive Learning and Adversarial Disentanglement for Privacy-Aware Task-Oriented Semantic Communication Omar Erak Omar Alhussein Wen Tong 298 0 0 30 Oct 2024
Multimodal Information Bottleneck for Deep Reinforcement Learning with Multiple SensorsNeural Networks (NN), 2024 Bang You Huaping Liu SSL 160 13 0 23 Oct 2024
Choices are More Important than Efforts: LLM Enables Efficient Multi-Agent Exploration Yun Qu Boyuan Wang Yuhang Jiang Jianzhun Shao Yixiu Mao Cheems Wang Chang Liu Xiangyang Ji 266 9 0 03 Oct 2024
How Does Distribution Matching Help Domain Generalization: An Information-theoretic AnalysisIEEE Transactions on Information Theory (IEEE Trans. Inf. Theory), 2024 Yuxin Dong Tieliang Gong Hong Chen Shuangyong Song Weizhan Zhang Chen Li OOD 202 2 0 14 Jun 2024
Representation Learning with Conditional Information Flow MaximizationAnnual Meeting of the Association for Computational Linguistics (ACL), 2024 Dou Hu Lingwei Wei Wei Zhou Songlin Hu SSL 222 1 0 08 Jun 2024
An Information Bottleneck Perspective for Effective Noise Filtering on Retrieval-Augmented Generation Kun Zhu Xiaocheng Feng Xiyuan Du Yuxuan Gu Weijiang Yu Haotian Wang Qianglong Chen Zheng Chu Jingchang Chen Bing Qin 258 18 0 03 Jun 2024
Partial information decomposition: redundancy as information bottleneckEntropy (Entropy), 2024 Artemy Kolchinsky 226 2 0 13 May 2024
Cauchy-Schwarz Divergence Information Bottleneck for Regression Shujian Yu Xi Yu Sigurd Løkse Robert Jenssen José C. Príncipe UQCV 166 10 0 27 Apr 2024
The Fundamental Limits of Least-Privilege Learning Theresa Stadler B. Kulynych Michael Gastpar Nicoals Papernot Carmela Troncoso 129 1 0 19 Feb 2024
Privacy for Fairness: Information Obfuscation for Fair Representation Learning with Local Differential Privacy Songjie Xie Youlong Wu Jiaxuan Li Ming Ding Khaled B. Letaief AAML 142 2 0 16 Feb 2024
REMEDI: Corrective Transformations for Improved Neural Entropy Estimation Viktor Nilsson Anirban Samaddar Sandeep Madireddy Pierre Nyquist 120 3 0 08 Feb 2024
Minimum Description Length and Generalization Guarantees for Representation LearningNeural Information Processing Systems (NeurIPS), 2024 Romain Chor Abdellatif Zaidi Piotr Krasnowski 296 11 0 05 Feb 2024
Flexible Variational Information Bottleneck: Achieving Diverse Compression with a Single Training Sota Kudo N. Ono Shigehiko Kanaya Ming Huang 115 3 0 02 Feb 2024
Structured Probabilistic Coding Dou Hu Lingwei Wei Yaxin Liu Wei Zhou Songlin Hu 415 2 0 21 Dec 2023
Elastic Information Bottleneck Yuyan Ni Yanyan Lan Ao Liu Zhiming Ma 230 3 0 07 Nov 2023
Expression Syntax Information Bottleneck for Math Word ProblemsAnnual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2022 Jing Xiong Chengming Li Min Yang Xiping Hu Bin Hu 163 6 0 24 Oct 2023
Planning to Go Out-of-Distribution in Offline-to-Online Reinforcement Learning Trevor A. McInroe Adam Jelley Stefano V. Albrecht Amos Storkey OffRL OnRL 235 7 0 09 Oct 2023
Latent Representation and Simulation of Markov Processes via Time-Lagged Information BottleneckInternational Conference on Learning Representations (ICLR), 2023 Marco Federici Patrick Forré Ryota Tomioka Bastiaan S. Veeling 243 7 0 13 Sep 2023
How Does Information Bottleneck Help Deep Learning?International Conference on Machine Learning (ICML), 2023 Kenji Kawaguchi Zhun Deng Xu Ji Jiaoyang Huang 178 97 0 30 May 2023
Deep RL at Scale: Sorting Waste in Office Buildings with a Fleet of Mobile Manipulators Alexander Herzog Kanishka Rao Karol Hausman Yao Lu Paul Wohlhart ... Noah Brown Mrinal Kalakrishnan Julian Ibarz P. Pastor Sergey Levine OffRL 188 35 0 05 May 2023
To Compress or Not to Compress- Self-Supervised Learning and Information Theory: A ReviewEntropy (Entropy), 2023 Ravid Shwartz-Ziv Yann LeCun SSL 435 97 0 19 Apr 2023
Transfer Entropy Bottleneck: Learning Sequence to Sequence Information Transfer Damjan Kalajdzievski Ximeng Mao Pascal Fortier-Poisson Guillaume Lajoie Blake A. Richards AI4TS 155 5 0 29 Nov 2022
Causal Information Bottleneck Boosts Adversarial Robustness of Deep Neural Network Hua Hua Jun Yan Xi Fang Weiquan Huang Huilin Yin Wancheng Ge AAML 131 1 0 25 Oct 2022
PI-QT-Opt: Predictive Information Improves Multi-Task Robotic Reinforcement Learning at ScaleConference on Robot Learning (CoRL), 2022 Kuang-Huei Lee Ted Xiao A. Li Paul Wohlhart Ian S. Fischer Yao Lu 266 11 0 15 Oct 2022
Pruning Adversarially Robust Neural Networks without Adversarial ExamplesIndustrial Conference on Data Mining (IDM), 2022 T. Jian Zifeng Wang Yanzhi Wang Jennifer Dy Stratis Ioannidis AAML VLM 126 14 0 09 Oct 2022
PI-ARS: Accelerating Evolution-Learned Visual-Locomotion with Predictive Information RepresentationsIEEE/RJS International Conference on Intelligent RObots and Systems (IROS), 2022 Kuang-Huei Lee Ofir Nachum Tingnan Zhang S. Guadarrama Jie Tan Wenhao Yu 183 17 0 27 Jul 2022
Bottlenecks CLUB: Unifying Information-Theoretic Trade-offs Among Complexity, Leakage, and UtilityIEEE Transactions on Information Forensics and Security (IEEE TIFS), 2022 Behrooz Razeghi Flavio du Pin Calmon Deniz Gunduz Svyatoslav Voloshynovskiy 161 19 0 11 Jul 2022
Multi-Horizon Representations with Hierarchical Forward Models for Reinforcement Learning Trevor A. McInroe Lukas Schafer Stefano V. Albrecht 169 7 0 22 Jun 2022
Classification Utility, Fairness, and Compactness via Tunable Information Bottleneck and Rényi MeasuresIEEE Transactions on Information Forensics and Security (IEEE TIFS), 2022 A. Gronowski William Paul F. Alajaji Bahman Gharesifard Philippe Burlina FaML 173 7 0 20 Jun 2022
Look, Radiate, and Learn: Self-Supervised Localisation via Radio-Visual CorrespondenceComputer Vision and Pattern Recognition (CVPR), 2022 Mohammed Alloulah Maximilian Arnold SSL 276 2 0 13 Jun 2022
An Empirical Investigation of Representation Learning for Imitation Xin Chen Sam Toyer Cody Wild Scott Emmons Ian S. Fischer ... Steven H. Wang Ping Luo Stuart J. Russell Pieter Abbeel Rohin Shah AI4TS 145 27 0 16 May 2022
Pareto-optimal clustering with the primal deterministic information bottleneck Andrew K. Tan Max Tegmark I. Chuang 95 3 0 05 Apr 2022
Renyi Fair Information Bottleneck for Image ClassificationCanadian Workshop on Information Theory (CWIT), 2022 A. Gronowski William Paul F. Alajaji Bahman Gharesifard Philippe Burlina FaML 113 8 0 09 Mar 2022
Sparsity-Inducing Categorical Prior Improves Robustness of the Information BottleneckInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2022 Anirban Samaddar Sandeep Madireddy Dali Wang Tapabrata Maiti Gustavo de los Campos Ian Fischer 149 2 0 04 Mar 2022
Integrating Contrastive Learning with Dynamic Models for Reinforcement Learning from ImagesNeurocomputing (Neurocomputing), 2022 Bang You Oleg Arenz Youping Chen Jan Peters 158 23 0 02 Mar 2022
Gated Information Bottleneck for Generalization in Sequential EnvironmentsIndustrial Conference on Data Mining (IDM), 2021 Francesco Alesiani Shujian Yu Xi Yu OOD AAML 161 13 0 12 Oct 2021
Compressive Visual RepresentationsNeural Information Processing Systems (NeurIPS), 2021 Kuang-Huei Lee Anurag Arnab S. Guadarrama John F. Canny Ian S. Fischer SSL 238 52 0 27 Sep 2021
Task-Oriented Communication for Multi-Device Cooperative Edge InferenceIEEE Transactions on Wireless Communications (IEEE TWC), 2021 Jiawei Shao Yuyi Mao Jun Zhang 267 160 0 01 Sep 2021