Learnability for the Information Bottleneck

17 July 2019

Papers citing "Learnability for the Information Bottleneck"

25 / 25 papers shown

Title
Geometry of Learning -- L2 Phase Transitions in Deep and Shallow Neural Networks Ibrahim Talha Ersoy Karoline Wiesner 83 0 0 10 May 2025
Pre-train and Fine-tune: Recommenders as Large Models Zhenhao Jiang Chong Chen Hao Feng Yu Yang Jin Liu Jie Zhang Jia Jia Ning Hu 90 0 0 24 Jan 2025
Flexible Variational Information Bottleneck: Achieving Diverse Compression with a Single Training Sota Kudo N. Ono Shigehiko Kanaya Ming Huang 46 1 0 02 Feb 2024
Information theory for data-driven model reduction in physics and biology Matthew S. Schmitt Maciej Koch-Janusz Michel Fruchart Daniel S. Seara Michael Rust Vincenzo Vitelli 85 5 0 11 Dec 2023
The Information Bottleneck's Ordinary Differential Equation: First-Order Root-Tracking for the IB Shlomi Agmon 65 0 0 16 Jun 2023
Generalized Information Bottleneck for Gaussian Variables Wave Ngampruetikorn David J. Schwab 76 1 0 31 Mar 2023
Do Neural Networks Generalize from Self-Averaging Sub-classifiers in the Same Way As Adaptive Boosting? Michael Sun Peter Chatain AI4CE 78 0 0 14 Feb 2023
Interpretability with full complexity by constraining feature information Kieran A. Murphy Danielle Bassett FAtt 98 5 0 30 Nov 2022
Transfer Entropy Bottleneck: Learning Sequence to Sequence Information Transfer Damjan Kalajdzievski Ximeng Mao Pascal Fortier-Poisson Guillaume Lajoie Blake A. Richards AI4TS 40 4 0 29 Nov 2022
Bottlenecks CLUB: Unifying Information-Theoretic Trade-offs Among Complexity, Leakage, and Utility Behrooz Razeghi Flavio du Pin Calmon Deniz Gunduz Svyatoslav Voloshynovskiy 58 16 0 11 Jul 2022
Pareto-optimal clustering with the primal deterministic information bottleneck Andrew K. Tan Max Tegmark I. Chuang 28 3 0 05 Apr 2022
Adaptive Information Bottleneck Guided Joint Source and Channel Coding for Image Transmission Lunan Sun Yang Yang Mingzhe Chen Caili Guo Walid Saad H. Vincent Poor 45 26 0 12 Mar 2022
Lossy Compression for Lossless Prediction Yann Dubois Benjamin Bloem-Reddy Karen Ullrich Chris J. Maddison 145 62 0 21 Jun 2021
Perturbation Theory for the Information Bottleneck Wave Ngampruetikorn D. Schwab 63 12 0 28 May 2021
Adversarial Information Bottleneck Penglong Zhai Shihua Zhang AAML 49 8 0 28 Feb 2021
A Provably Convergent Information Bottleneck Solution via ADMM Tengfei Huang Aly El Gamal 60 6 0 09 Feb 2021
DICE: Diversity in Deep Ensembles via Conditional Redundancy Adversarial Estimation Alexandre Ramé Matthieu Cord FedML 85 52 0 14 Jan 2021
Bottleneck Problems: Information and Estimation-Theoretic View S. Asoodeh Flavio du Pin Calmon 37 18 0 12 Nov 2020
CEB Improves Model Robustness Ian S. Fischer Alexander A. Alemi AAML 137 30 0 13 Feb 2020
The Conditional Entropy Bottleneck Ian S. Fischer OOD 117 122 0 13 Feb 2020
Intelligence, physics and information -- the tradeoff between accuracy and simplicity in machine learning Tailin Wu 123 1 0 11 Jan 2020
Phase Transitions for the Information Bottleneck in Representation Learning Tailin Wu Ian S. Fischer DRL 85 29 0 07 Jan 2020
The Convex Information Bottleneck Lagrangian Borja Rodríguez Gálvez Ragnar Thobaben Mikael Skoglund 46 29 0 25 Nov 2019
Do Compressed Representations Generalize Better? Hassan Hafez-Kolahi S. Kasaei Mahdiyeh Soleymani-Baghshah 51 1 0 20 Sep 2019
Pareto-optimal data compression for binary classification tasks Max Tegmark Tailin Wu 37 16 0 23 Aug 2019