v1v2 (latest)

The deterministic information bottleneck

1 April 2016

Papers citing "The deterministic information bottleneck"

35 / 35 papers shown

Title
A Deterministic Information Bottleneck Method for Clustering Mixed-Type Data Efthymios Costa Ioanna Papatsouma Angelos Markos 41 0 0 03 Jul 2024
Understanding Encoder-Decoder Structures in Machine Learning Using Information Measures Jorge F. Silva Victor Faraggi Camilo Ramírez Álvaro F. Egaña Eduardo Pavez 64 1 0 30 May 2024
Elastic Information Bottleneck Yuyan Ni Yanyan Lan Ao Liu Zhiming Ma 103 2 0 07 Nov 2023
A Linear Programming Approach for Resource-Aware Information-Theoretic Tree Abstractions Daniel T. Larsson Dipankar Maity Panagiotis Tsiotras 33 2 0 08 Aug 2022
Bounding generalization error with input compression: An empirical study with infinite-width networks A. Galloway A. Golubeva Mahmoud Salem Mihai Nica Yani Andrew Ioannou Graham W. Taylor MLT AI4CE 76 4 0 19 Jul 2022
Bottlenecks CLUB: Unifying Information-Theoretic Trade-offs Among Complexity, Leakage, and Utility Behrooz Razeghi Flavio du Pin Calmon Deniz Gunduz Svyatoslav Voloshynovskiy 58 16 0 11 Jul 2022
Classification Utility, Fairness, and Compactness via Tunable Information Bottleneck and Rényi Measures A. Gronowski William Paul F. Alajaji Bahman Gharesifard Philippe Burlina FaML 95 3 0 20 Jun 2022
Optimal Randomized Approximations for Matrix based Renyi's Entropy Yuxin Dong Tieliang Gong Shujian Yu Chen Li 75 8 0 16 May 2022
Conditional entropy minimization principle for learning domain invariant representation features Thuan Q. Nguyen Boyang Lyu Prakash Ishwar matthias. scheutz Shuchin Aeron OOD 75 8 0 25 Jan 2022
Studying the Interplay between Information Loss and Operation Loss in Representations for Classification Jorge F. Silva Felipe A. Tobar Mario L. Vicuna Felipe Cordova 56 2 0 30 Dec 2021
Gated Information Bottleneck for Generalization in Sequential Environments Francesco Alesiani Shujian Yu Xi Yu OOD AAML 58 13 0 12 Oct 2021
From Canonical Correlation Analysis to Self-supervised Graph Neural Networks Hengrui Zhang Qitian Wu Junchi Yan David Wipf Philip S. Yu SSL 97 223 0 23 Jun 2021
Invariance Principle Meets Information Bottleneck for Out-of-Distribution Generalization Kartik Ahuja Ethan Caballero Dinghuai Zhang Jean-Christophe Gagnon-Audet Yoshua Bengio Ioannis Mitliagkas Irina Rish OOD 73 271 0 11 Jun 2021
Drop-Bottleneck: Learning Discrete Compressed Representation for Noise-Robust Exploration Jaekyeom Kim Minjung Kim Dongyeon Woo Gunhee Kim 69 17 0 23 Mar 2021
Deep Deterministic Information Bottleneck with Matrix-based Entropy Functional Xi Yu Shujian Yu José C. Príncipe AAML 74 27 0 31 Jan 2021
Progressive Interpretation Synthesis: Interpreting Task Solving by Quantifying Previously Used and Unused Information Zhengqi He Taro Toyoizumi 41 1 0 08 Jan 2021
Maximum-Entropy Adversarial Data Augmentation for Improved Generalization and Robustness Long Zhao Ting Liu Xi Peng Dimitris N. Metaxas OOD AAML 131 171 0 15 Oct 2020
The Dual Information Bottleneck Zoe Piran Ravid Shwartz-Ziv Naftali Tishby 66 15 0 08 Jun 2020
The Information Bottleneck Problem and Its Applications in Machine Learning Ziv Goldfeld Yury Polyanskiy 79 139 0 30 Apr 2020
Unpacking Information Bottlenecks: Unifying Information-Theoretic Objectives in Deep Learning Andreas Kirsch Clare Lyle Y. Gal 102 16 0 27 Mar 2020
On the Information Bottleneck Problems: Models, Connections, Applications and Information Theoretic Views Milad Sefidgaran Iñaki Estella Aguerri S. Shamai 58 90 0 31 Jan 2020
Margin Maximization as Lossless Maximal Compression N. Nikolaou Henry W. J. Reeve Gavin Brown 45 4 0 28 Jan 2020
Q-Search Trees: An Information-Theoretic Approach Towards Hierarchical Abstractions for Agents with Computational Limitations Daniel T. Larsson Dipankar Maity Panagiotis Tsiotras 53 7 0 30 Sep 2019
Do Compressed Representations Generalize Better? Hassan Hafez-Kolahi S. Kasaei Mahdiyeh Soleymani-Baghshah 58 1 0 20 Sep 2019
Learnability for the Information Bottleneck Tailin Wu Ian S. Fischer Isaac L. Chuang Max Tegmark 90 42 0 17 Jul 2019
Minimal Achievable Sufficient Statistic Learning Milan Cvitkovic Günther Koliander 84 12 0 19 May 2019
Caveats for information bottleneck in deterministic scenarios Artemy Kolchinsky Brendan D. Tracey S. Kuyk 104 83 0 23 Aug 2018
Variational Information Bottleneck on Vector Quantized Autoencoders Hanwei Wu M. Flierl DRL 40 5 0 02 Aug 2018
Learning Product Codebooks using Vector Quantized Autoencoders for Image Retrieval Hanwei Wu M. Flierl SSL CML DRL 155 19 0 12 Jul 2018
A high-bias, low-variance introduction to Machine Learning for physicists Pankaj Mehta Marin Bukov Ching-Hao Wang A. G. Day C. Richardson Charles K. Fisher D. Schwab AI4CE 133 884 0 23 Mar 2018
Learning Representations for Neural Network-Based Classification Using the Information Bottleneck Principle Rana Ali Amjad Bernhard C. Geiger 135 198 0 27 Feb 2018
Layer-wise Learning of Stochastic Neural Networks with Information Bottleneck Thanh T. Nguyen Jaesik Choi 68 13 0 04 Dec 2017
Efficient mixture model for clustering of sparse high dimensional binary data Marek Śmieja Krzysztof Hajto Jacek Tabor 56 15 0 11 Jul 2017
Nonlinear Information Bottleneck Artemy Kolchinsky Brendan D. Tracey David Wolpert 91 157 0 06 May 2017
Semi-supervised cross-entropy clustering with information bottleneck constraint Marek Śmieja Bernhard C. Geiger 50 20 0 03 May 2017