v1v2 (latest)

Demystifying Fixed k-Nearest Neighbor Information Estimators

11 April 2016

Weihao Gao

Sewoong Oh

Pramod Viswanath

ArXiv (abs)PDF HTML

Papers citing "Demystifying Fixed k-Nearest Neighbor Information Estimators"

48 / 48 papers shown

Title
Privacy-preserving Prompt Personalization in Federated Learning for Multimodal Large Language Models Sizai Hou Songze Li Baturalp Buyukates 60 0 0 28 May 2025
A Neural Difference-of-Entropies Estimator for Mutual Information Haoran Ni Martin Lotz SSL DRL 138 0 0 18 Feb 2025
Contextual Bandits for Unbounded Context Distributions Puning Zhao Xiaogang Xu Zhe Liu Huiwen Wu Qin Zhang Zong Ke Tianhang Zheng 304 10 0 19 Aug 2024
REMEDI: Corrective Transformations for Improved Neural Entropy Estimation Viktor Nilsson Anirban Samaddar Sandeep Madireddy Pierre Nyquist 54 2 0 08 Feb 2024
No Free Prune: Information-Theoretic Barriers to Pruning at Initialization Tanishq Kumar Kevin Luo Mark Sellke 78 3 0 02 Feb 2024
Partial Information Decomposition for Continuous Variables based on Shared Exclusions: Analytical Formulation and Estimation David A. Ehrlich Kyle Schick-Poland Abdullah Makkeh Felix Lanfermann Patricia Wollstadt Michael Wibral 103 9 0 10 Nov 2023
Beyond Normal: On the Evaluation of Mutual Information Estimators Paweł Czyż Frederic Grabowski Julia E. Vogt N. Beerenwinkel Alexander Marx 103 35 0 19 Jun 2023
Disentanglement via Latent Quantization Kyle Hsu W. Dorrell James C. R. Whittington Jiajun Wu Chelsea Finn DRL 163 27 0 28 May 2023
Nearest-Neighbor Sampling Based Conditional Independence Testing Shuai Li Ziqi Chen Hong-Tu Zhu Christina Dan Wang Wang Wen 29 4 0 09 Apr 2023
Improving Mutual Information based Feature Selection by Boosting Unique Relevance Shiyu Liu Mehul Motani 62 5 0 09 Dec 2022
Pitfalls of Climate Network Construction: A Statistical Perspective Moritz Haas B. Goswami U. V. Luxburg 55 4 0 05 Nov 2022
A Reverse Jensen Inequality Result with Application to Mutual Information Estimation Gerhard Wunder Benedikt Groß Rick Fritschek Rafael F. Schaefer 23 10 0 12 Nov 2021
Tight Mutual Information Estimation With Contrastive Fenchel-Legendre Optimization Qing Guo Junya Chen Dong Wang Yuewei Yang Xinwei Deng Lawrence Carin Fan Li Jing-Zheng Huang Chenyang Tao 91 21 0 02 Jul 2021
Statistical tests based on Rényi entropy estimation Mehmet Siddik Cadirci Dafydd Evans Nikolai N. Leonenko O. Seleznjev 27 1 0 01 Jun 2021
DICE: Diversity in Deep Ensembles via Conditional Redundancy Adversarial Estimation Alexandre Ramé Matthieu Cord FedML 85 52 0 14 Jan 2021
A Maximal Correlation Approach to Imposing Fairness in Machine Learning Joshua K. Lee Yuheng Bu P. Sattigeri Yikang Shen G. Wornell Leonid Karlinsky Rogerio Feris FaML 46 17 0 30 Dec 2020
The entropy based goodness of fit tests for generalized von Mises-Fisher distributions and beyond Nikolai N. Leonenko Vitalii Makogin Mehmet Siddik Cadirci 25 0 0 21 Oct 2020
Entropy-based test for generalized Gaussian distributions Mehmet Siddik Cadirci Dafydd Evans Nikolai Leonenko Vitalii Makogin 27 5 0 13 Oct 2020
Parametric Copula-GP model for analyzing multidimensional neuronal and behavioral relationships N. Kudryashova Theoklitos Amvrosiadis Nathalie Dupuy Nathalie L Rochefort A. Onken 65 5 0 03 Aug 2020
Neural Estimators for Conditional Mutual Information Using Nearest Neighbors Sampling Sina Molavipour Germán Bassi Mikael Skoglund 53 8 0 12 Jun 2020
C-MI-GAN : Estimation of Conditional Mutual Information using MinMax formulation A. Mondal A. Bhattacharya Sudipto Mukherjee A. Prathosh Sreeram Kannan Himanshu Asnani 77 15 0 17 May 2020
Efficient Distributed Algorithms for the $K$ -Nearest Neighbors Problem Reza Fathi A. R. Molla Gopal Pandurangan 11 3 0 15 May 2020
Minimax Optimal Estimation of KL Divergence for Continuous Distributions Puning Zhao Lifeng Lai 65 21 0 26 Feb 2020
Mitigating Class Boundary Label Uncertainty to Reduce Both Model Bias and Variance Matthew Almeida Wei Ding S. Crouter Ping Chen 31 10 0 23 Feb 2020
Fast Fair Regression via Efficient Approximations of Mutual Information D. Steinberg Alistair Reid S. O'Callaghan Finnian Lattimore L. McCalman Tibério S. Caetano FaML 73 16 0 14 Feb 2020
Conditional Mutual Information Estimation for Mixed Discrete and Continuous Variables with Nearest Neighbors O. Mesner C. Shalizi 56 5 0 06 Dec 2019
Model-Augmented Estimation of Conditional Mutual Information for Feature Selection Alan Yang AmirEmad Ghassami Maxim Raginsky Negar Kiyavash E. Rosenbaum 32 1 0 12 Nov 2019
Conditional Mutual Information Neural Estimator Sina Molavipour Germán Bassi Mikael Skoglund 118 14 0 06 Nov 2019
MIM: Mutual Information Machine M. Livne Kevin Swersky David J. Fleet DRL 47 6 0 08 Oct 2019
High Mutual Information in Representation Learning with Symmetric Variational Inference M. Livne Kevin Swersky David J. Fleet SSL DRL 58 0 0 04 Oct 2019
CCMI : Classifier based Conditional Mutual Information Estimation Sudipto Mukherjee Himanshu Asnani Sreeram Kannan VLM 127 81 0 05 Jun 2019
Data-Efficient Mutual Information Neural Estimator Xiaoyu Lin Indranil Sur Samuel A. Nastase Ajay Divakaran Uri Hasson Mohamed R. Amer DRL 71 21 0 08 May 2019
Deep Learning for Channel Coding via Neural Mutual Information Estimation Rick Fritschek Rafael F. Schaefer Gerhard Wunder 85 46 0 07 Mar 2019
Tightening Mutual Information Based Bounds on Generalization Error Yuheng Bu Shaofeng Zou Venugopal V. Veeravalli 82 177 0 15 Jan 2019
Mimic and Classify : A meta-algorithm for Conditional Independence Testing Rajat Sen Karthikeyan Shanmugam Himanshu Asnani Arman Rahimzamani Sreeram Kannan CML VLM 83 16 0 25 Jun 2018
The Nearest Neighbor Information Estimator is Adaptively Near Minimax Rate-Optimal Jiantao Jiao Weihao Gao Yanjun Han 75 47 0 23 Nov 2017
Optimal rates of entropy estimation over Lipschitz balls Yanjun Han Jiantao Jiao Tsachy Weissman Yihong Wu 114 73 0 06 Nov 2017
Potential Conditional Mutual Information: Estimators, Properties and Applications Arman Rahimzamani Sreeram Kannan 50 11 0 13 Oct 2017
Estimating Mutual Information for Discrete-Continuous Mixtures Weihao Gao Sreeram Kannan Sewoong Oh Pramod Viswanath 92 159 0 19 Sep 2017
Model-Powered Conditional Independence Test Rajat Sen A. Suresh Karthikeyan Shanmugam A. Dimakis Sanjay Shakkottai VLM CML 60 91 0 18 Sep 2017
Conditional independence testing based on a nearest-neighbor estimator of conditional mutual information Jakob Runge 164 171 0 05 Sep 2017
Inhomogeneous Hypergraph Clustering with Applications Pan Li O. Milenkovic 86 161 0 05 Sep 2017
Ensemble Estimation of Generalized Mutual Information with Applications to Genomics Kevin R. Moon K. Sricharan Alfred Hero 39 9 0 27 Jan 2017
Information Theoretic Structure Learning with Confidence Kevin R. Moon M. Noshad Salimeh Yasaei Sekeh Alfred Hero 43 18 0 13 Sep 2016
Breaking the Bandwidth Barrier: Geometrical Adaptive Entropy Estimation Weihao Gao Sewoong Oh Pramod Viswanath 73 33 0 07 Sep 2016
Finite-Sample Analysis of Fixed-k Nearest Neighbor Density Functional Estimators Shashank Singh Barnabás Póczós 72 53 0 05 Jun 2016
Efficient multivariate entropy estimation via $k$ -nearest neighbour distances Thomas B. Berrett R. Samworth M. Yuan 132 126 0 01 Jun 2016
Conditional Dependence via Shannon Capacity: Axioms, Estimators and Applications Weihao Gao Sreeram Kannan Sewoong Oh Pramod Viswanath 69 9 0 10 Feb 2016