The Information Bottleneck Problem and Its Applications in Machine Learning

30 April 2020

Papers citing "The Information Bottleneck Problem and Its Applications in Machine Learning"

16 / 16 papers shown

Title
Information-Theoretic Generalization Bounds for Deep Neural Networks Haiyun He Christina Lee Yu 35 4 0 04 Apr 2024
MIMIR: Masked Image Modeling for Mutual Information-based Adversarial Robustness Xiaoyun Xu Shujian Yu Jingzheng Wu S. Picek AAML 35 0 0 08 Dec 2023
Elastic Information Bottleneck Yuyan Ni Yanyan Lan Ao Liu Zhiming Ma 22 2 0 07 Nov 2023
Residual-based attention and connection to information bottleneck theory in PINNs Sokratis J. Anagnostopoulos Juan Diego Toscano Nikos Stergiopulos George Karniadakis 17 20 0 01 Jul 2023
Individual and Structural Graph Information Bottlenecks for Out-of-Distribution Generalization Ling Yang Jiayi Zheng Heyuan Wang Zhongyi Liu Zhilin Huang Shenda Hong Wentao Zhang Bin Cui 22 13 0 28 Jun 2023
Local Intrinsic Dimensional Entropy Rohan Ghosh Mehul Motani 23 2 0 05 Apr 2023
Using Intermediate Forward Iterates for Intermediate Generator Optimization Harshit Mishra Jurijs Nazarovs Manmohan Dogra Sathya Ravi DiffM 27 0 0 05 Feb 2023
On the Effect of Pre-training for Transformer in Different Modality on Offline Reinforcement Learning S. Takagi OffRL 18 7 0 17 Nov 2022
Invariant Representations with Stochastically Quantized Neural Networks Mattia Cerrato Marius Köppel Roberto Esposito Stefan Kramer MQ 19 4 0 04 Aug 2022
Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communications Deniz Gunduz Zhijin Qin Iñaki Estella Aguerri Harpreet S. Dhillon Zhaohui Yang Aylin Yener Kai‐Kit Wong C. Chae 24 432 0 19 Jul 2022
Semantic Information Recovery in Wireless Networks Edgar Beck C. Bockelmann Armin Dekorsy 18 22 0 28 Apr 2022
An Indirect Rate-Distortion Characterization for Semantic Sources: General Model and the Case of Gaussian Observation Jiakun Liu Shuo Shao Wenyi Zhang H. Vincent Poor 21 34 0 29 Jan 2022
Task-Oriented Communication for Multi-Device Cooperative Edge Inference Jiawei Shao Yuyi Mao Jun Zhang 20 128 0 01 Sep 2021
Learning Task-Oriented Communication for Edge Inference: An Information Bottleneck Approach Jiawei Shao Yuyi Mao Jun Zhang 36 212 0 08 Feb 2021
On Information Plane Analyses of Neural Network Classifiers -- A Review Bernhard C. Geiger 24 50 0 21 Mar 2020
Benefits of depth in neural networks Matus Telgarsky 136 602 0 14 Feb 2016