Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
1411.2003
Cited By
v1
v2
v3 (latest)
Efficient Estimation of Mutual Information for Strongly Dependent Variables
International Conference on Artificial Intelligence and Statistics (AISTATS), 2014
7 November 2014
Shuyang Gao
Greg Ver Steeg
Aram Galstyan
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Efficient Estimation of Mutual Information for Strongly Dependent Variables"
50 / 83 papers shown
Nonparametric Estimation of Joint Entropy via Partitioned Sample-Spacing
Jungwoo Ho
Sangun Park
Soyeong Oh
141
0
0
17 Nov 2025
TELL-TALE: Task Efficient LLMs with Task Aware Layer Elimination
Omar Naim
Krish Sharma
Nicholas M. Asher
Nicholas Asher
153
0
0
26 Oct 2025
Multimodal Datasets with Controllable Mutual Information
Raheem Karim Hashmani
G. W. Merz
Helen Qu
Mariel Pettee
K. Cranmer
200
1
0
24 Oct 2025
MMG: Mutual Information Estimation via the MMSE Gap in Diffusion
Longxuan Yu
Xing Shi
Xianghao Kong
Tong Jia
Greg Ver Steeg
DiffM
276
0
0
24 Sep 2025
ML-PWS: Estimating the Mutual Information Between Experimental Time Series Using Neural Networks
Manuel Reinhardt
Gašper Tkačik
Pieter Rein ten Wolde
AI4TS
174
1
0
22 Aug 2025
Accurate Estimation of Mutual Information in High Dimensional Data
Eslam Abdelaleem
K. M. Martini
I. Nemenman
269
4
0
31 May 2025
L
2
^2
2
M: Mutual Information Scaling Law for Long-Context Language Modeling
Zhuo Chen
Oriol Mayné i Comas
Zhuotao Jin
Di Luo
Marin Soljacic
435
6
0
06 Mar 2025
INFO-SEDD: Continuous Time Markov Chains as Scalable Information Metrics Estimators
Alberto Foresti
Giulio Franzese
Pietro Michiardi
490
2
0
26 Feb 2025
A Benchmark Suite for Evaluating Neural Mutual Information Estimators on Unstructured Datasets
Neural Information Processing Systems (NeurIPS), 2024
Kyungeun Lee
Wonjong Rhee
292
11
0
14 Oct 2024
fastHDMI: Fast Mutual Information Estimation for High-Dimensional Data
Kai Yang
M. Asgharian
N. Bhagwat
J B Poline
C. Greenwood
159
0
0
14 Oct 2024
Approximating mutual information of high-dimensional variables using learned representations
Neural Information Processing Systems (NeurIPS), 2024
Gokul Gowri
Xiao-Kang Lun
Allon M. Klein
Peng Yin
357
25
0
03 Sep 2024
Many Perception Tasks are Highly Redundant Functions of their Input Data
Rahul Ramesh
Anthony Bisulco
Ronald W. DiTullio
Linran Wei
Vijay Balasubramanian
Kostas Daniilidis
Pratik Chaudhari
480
4
0
18 Jul 2024
Optimizing Privacy and Utility Tradeoffs for Group Interests Through Harmonization
Bishwas Mandal
G. Amariucai
Shuangqing Wei
187
0
0
07 Apr 2024
Multimodal Interpretable Data-Driven Models for Early Prediction of Antimicrobial Multidrug Resistance Using Multivariate Time-Series
Sergio Martínez-Aguero
Antonio G. Marques
Inmaculada Mora-Jiménez
Joaquín Alvárez-Rodríguez
Cristina Soguero-Ruiz
236
0
0
09 Feb 2024
An Information Theoretic Approach to Interaction-Grounded Learning
International Conference on Machine Learning (ICML), 2024
Xiaoyan Hu
Farzan Farnia
Ho-fung Leung
VLM
494
3
0
10 Jan 2024
Assessing Neural Network Representations During Training Using Noise-Resilient Diffusion Spectral Entropy
Annual Conference on Information Sciences and Systems (CISS), 2023
Danqi Liao
Chen Liu
Benjamin W. Christensen
Alexander Tong
Guillaume Huguet
Guy Wolf
Maximilian Nickel
Ian M. Adelstein
Smita Krishnaswamy
DiffM
301
13
0
04 Dec 2023
Robust Concept Erasure via Kernelized Rate-Distortion Maximization
Neural Information Processing Systems (NeurIPS), 2023
Somnath Basu Roy Chowdhury
Nicholas Monath
Kumar Avinava Dubey
Amr Ahmed
Snigdha Chaturvedi
422
7
0
30 Nov 2023
MINDE: Mutual Information Neural Diffusion Estimation
International Conference on Learning Representations (ICLR), 2023
Giulio Franzese
Mustapha Bounoua
Pietro Michiardi
DiffM
386
20
0
13 Oct 2023
Towards a Rigorous Analysis of Mutual Information in Contrastive Learning
Neural Networks (Neural Netw.), 2023
Kyungeun Lee
Jaeill Kim
Suhyun Kang
Wonjong Rhee
SSL
344
7
0
30 Aug 2023
A Distance Correlation-Based Approach to Characterize the Effectiveness of Recurrent Neural Networks for Time Series Forecasting
Neurocomputing (Neurocomputing), 2023
Christopher Salazar
A. Banerjee
AI4TS
325
13
0
28 Jul 2023
Safety Performance of Neural Networks in the Presence of Covariate Shift
Verified Software: Theories, Tools, Experiments (VSTTE), 2023
Chih-Hong Cheng
Harald Ruess
K. Theodorou
174
1
0
24 Jul 2023
Beyond Normal: On the Evaluation of Mutual Information Estimators
Neural Information Processing Systems (NeurIPS), 2023
Paweł Czyż
Frederic Grabowski
Julia E. Vogt
N. Beerenwinkel
Alexander Marx
316
59
0
19 Jun 2023
On the Effectiveness of Hybrid Mutual Information Estimation
Marco Federici
David Ruhe
Patrick Forré
401
7
0
01 Jun 2023
To Compress or Not to Compress- Self-Supervised Learning and Information Theory: A Review
Entropy (Entropy), 2023
Ravid Shwartz-Ziv
Yann LeCun
SSL
623
114
0
19 Apr 2023
VNE: An Effective Method for Improving Deep Representation by Manipulating Eigenvalue Distribution
Computer Vision and Pattern Recognition (CVPR), 2023
Jaeill Kim
Suhyun Kang
Duhun Hwang
Jungwook Shin
Wonjong Rhee
DRL
348
29
0
04 Apr 2023
Sample Complexity of Probability Divergences under Group Symmetry
International Conference on Machine Learning (ICML), 2023
Ziyu Chen
Markos A. Katsoulakis
Luc Rey-Bellet
Weixia Zhu
565
14
0
03 Feb 2023
miCSE: Mutual Information Contrastive Learning for Low-shot Sentence Embeddings
Annual Meeting of the Association for Computational Linguistics (ACL), 2022
T. Klein
Moin Nabi
SSL
274
22
0
09 Nov 2022
A robust estimator of mutual information for deep learning interpretability
Davide Piras
H. Peiris
A. Pontzen
Luisa Lucie-Smith
Ningyuan Guo
Brian D. Nord
SSL
DRL
388
24
0
31 Oct 2022
Correcting Convexity Bias in Function and Functional Estimate
Research in the Mathematical Sciences (Res. Math. Sci.), 2022
Chao Ma
Lexing Ying
188
2
0
17 Aug 2022
Network Binarization via Contrastive Learning
European Conference on Computer Vision (ECCV), 2022
Yuzhang Shang
Dan Xu
Ziliang Zong
Liqiang Nie
Yan Yan
AAML
MQ
421
26
0
06 Jul 2022
DeepSE-WF: Unified Security Estimation for Website Fingerprinting Defenses
Proceedings on Privacy Enhancing Technologies (PoPETs), 2022
Alexander Veicht
Cédric Renggli
Diogo Barradas
AAML
365
9
0
08 Mar 2022
A Reverse Jensen Inequality Result with Application to Mutual Information Estimation
Information Theory Workshop (ITW), 2021
Gerhard Wunder
Benedikt Groß
Rick Fritschek
Rafael F. Schaefer
190
12
0
12 Nov 2021
On the Surrogate Gap between Contrastive and Supervised Losses
Han Bao
Yoshihiro Nagano
Kento Nozawa
SSL
UQCV
400
27
0
06 Oct 2021
Simpler, Faster, Stronger: Breaking The log-K Curse On Contrastive Learners With FlatNCE
Junya Chen
Zhe Gan
Xuan Li
Qing Guo
Liqun Chen
...
Belinda Zeng
Wenlian Lu
Fan Li
Lawrence Carin
Chenyang Tao
250
32
0
02 Jul 2021
Tight Mutual Information Estimation With Contrastive Fenchel-Legendre Optimization
Qing Guo
Junya Chen
Dong Wang
Yuewei Yang
Xinwei Deng
Lawrence Carin
Fan Li
Jing-Zheng Huang
Chenyang Tao
382
24
0
02 Jul 2021
A Simple Generative Network
D. Nissani
GAN
276
0
0
17 Jun 2021
Causal Influence Detection for Improving Efficiency in Reinforcement Learning
Neural Information Processing Systems (NeurIPS), 2021
Maximilian Seitzer
Bernhard Schölkopf
Georg Martius
CML
374
106
0
07 Jun 2021
Bird's Eye: Probing for Linguistic Graph Structures with a Simple Information-Theoretic Approach
Annual Meeting of the Association for Computational Linguistics (ACL), 2021
Buse Giledereli
Mrinmaya Sachan
359
12
0
06 May 2021
Farewell to Mutual Information: Variational Distillation for Cross-Modal Person Re-Identification
Computer Vision and Pattern Recognition (CVPR), 2021
Xudong Tian
Zhizhong Zhang
Shaohui Lin
Yanyun Qu
Yuan Xie
Lizhuang Ma
270
158
0
07 Apr 2021
MIND: Inductive Mutual Information Estimation, A Convex Maximum-Entropy Copula Approach
International Conference on Artificial Intelligence and Statistics (AISTATS), 2021
Yves-Laurent Kom Samo
249
10
0
25 Feb 2021
Neural Joint Entropy Estimation
IEEE Transactions on Neural Networks and Learning Systems (IEEE TNNLS), 2020
Yuval Shalev
Amichai Painsky
I. Ben-Gal
377
14
0
21 Dec 2020
Generating private data with user customization
Xiao Chen
Thomas Navidi
Ram Rajagopal
237
2
0
02 Dec 2020
DEMI: Discriminative Estimator of Mutual Information
Ruizhi Liao
Daniel Moyer
Polina Golland
W. Wells
DRL
315
8
0
05 Oct 2020
An Extension of Fano's Inequality for Characterizing Model Susceptibility to Membership Inference Attacks
Sumit Kumar Jha
Susmit Jha
Rickard Ewetz
Sunny Raj
Alvaro Velasquez
L. Pullum
A. Swami
MIACV
197
8
0
17 Sep 2020
Variational Representations and Neural Network Estimation of Rényi Divergences
SIAM Journal on Mathematics of Data Science (SIMODS), 2020
Jeremiah Birrell
P. Dupuis
Markos A. Katsoulakis
Luc Rey-Bellet
Jie Wang
429
37
0
07 Jul 2020
Kendall transformation: a robust representation of continuous data for information theory
M. Kursa
107
7
0
29 Jun 2020
A Deterministic Approximation to Neural SDEs
Andreas Look
M. Kandemir
Barbara Rakitsch
Jan Peters
DiffM
694
5
0
16 Jun 2020
C-MI-GAN : Estimation of Conditional Mutual Information using MinMax formulation
A. Mondal
A. Bhattacharya
Sudipto Mukherjee
A. Prathosh
Sreeram Kannan
Himanshu Asnani
255
16
0
17 May 2020
Mutual Information Gradient Estimation for Representation Learning
International Conference on Learning Representations (ICLR), 2020
Liangjiang Wen
Yiji Zhou
Lirong He
Mingyuan Zhou
Zenglin Xu
DRL
SSL
393
34
0
03 May 2020
MINT: Deep Network Compression via Mutual Information-based Neuron Trimming
International Conference on Pattern Recognition (ICPR), 2020
Madan Ravi Ganesh
Jason J. Corso
Salimeh Yasaei Sekeh
MQ
355
17
0
18 Mar 2020
1
2
Next
Page 1 of 2
