High-Dimensional Smoothed Entropy Estimation via Dimensionality
Reduction

v1v2 (latest)

High-Dimensional Smoothed Entropy Estimation via Dimensionality Reduction

International Symposium on Information Theory (ISIT), 2023

8 May 2023

Kristjan Greenewald

Brian Kingsbury

ArXiv (abs)PDF HTML

Papers citing "High-Dimensional Smoothed Entropy Estimation via Dimensionality Reduction"

6 / 6 papers shown

Title
Binary Autoencoder for Mechanistic Interpretability of Large Language Models Hakaze Cho Haolin Yang Brian M. Kurkoski Naoya Inoue MQ 180 0 0 25 Sep 2025
Curse of Slicing: Why Sliced Mutual Information is a Deceptive Measure of Statistical Dependence Alexander Semenenko I. Butakov Alexey Frolov Ivan Oseledets 239 1 0 04 Jun 2025
InfoBridge: Mutual Information estimation via Bridge Matching Sergei Kholkin Ivan Butakov Evgeny Burnaev Nikita Gushchin Alexander Korotin DiffM FedML 447 1 0 03 Feb 2025
Mutual Information Estimation via Normalizing Flows I. Butakov Alexander Tolmachev S. Malanchuk A. Neopryatnaya Alexey Frolov 293 16 0 04 Mar 2024
Neural Network Characterization and Entropy Regulated Data Balancing through Principal Component Analysis David Yevick Karolina Hutchison 135 1 0 03 Dec 2023
Information Bottleneck Analysis of Deep Neural Networks via Lossy CompressionInternational Conference on Learning Representations (ICLR), 2023 I. Butakov Alexander Tolmachev S. Malanchuk A. Neopryatnaya Alexey Frolov K. Andreev 254 16 0 13 May 2023