Adaptive Estimators Show Information Compression in Deep Neural Networks

24 February 2019

Papers citing "Adaptive Estimators Show Information Compression in Deep Neural Networks"

8 / 8 papers shown

Title
Bridging Information-Theoretic and Geometric Compression in Language Models Emily Cheng Corentin Kervadec Marco Baroni 34 17 0 20 Oct 2023
HRel: Filter Pruning based on High Relevance between Activation Maps and Class Labels C. Sarvani Mrinmoy Ghorai S. Dubey S. H. Shabbeer Basha VLM 39 37 0 22 Feb 2022
The Unreasonable Effectiveness of the Final Batch Normalization Layer Veysel Kocaman O. M. Shir T. Baeck 18 1 0 18 Sep 2021
Information flows of diverse autoencoders Sungyeop Lee Junghyo Jo 16 11 0 15 Feb 2021
Derivation of Information-Theoretically Optimal Adversarial Attacks with Applications to Robust Machine Learning Jirong Yi R. Mudumbai Weiyu Xu AAML 30 2 0 28 Jul 2020
On Information Plane Analyses of Neural Network Classifiers -- A Review Bernhard C. Geiger 32 50 0 21 Mar 2020
Information Plane Analysis of Deep Neural Networks via Matrix-Based Renyi's Entropy and Tensor Kernels Kristoffer Wickstrøm Sigurd Løkse Michael C. Kampffmeyer Shujian Yu José C. Príncipe Robert Jenssen 24 31 0 25 Sep 2019
Understanding Convolutional Neural Networks with Information Theory: An Initial Exploration Shujian Yu Kristoffer Wickstrøm Robert Jenssen José C. Príncipe 6 73 0 18 Apr 2018