v1v2v3 (latest)

Estimating Mutual Information for Discrete-Continuous Mixtures

19 September 2017

Pramod Viswanath

Papers citing "Estimating Mutual Information for Discrete-Continuous Mixtures"

50 / 54 papers shown

Title
Fairness Overfitting in Machine Learning: An Information-Theoretic Perspective Firas Laakom Haobo Chen Jürgen Schmidhuber Yuheng Bu 14 0 0 09 Jun 2025
State and Action Factorization in Power Grids Gianvito Losapio Davide Beretta Marco Mussi Alberto Maria Metelli Marcello Restelli 57 1 0 03 Sep 2024
Quantifying the redundancy between prosody and text Lukas Wolf Tiago Pimentel Evelina Fedorenko Ryan Cotterell Alex Warstadt Ethan Gotlieb Wilcox Tamar I. Regev 80 11 0 28 Nov 2023
Non-parametric Conditional Independence Testing for Mixed Continuous-Categorical Variables: A Novel Method and Numerical Evaluation Oana-Iuliana Popescu Andreas Gerhardus Jakob Runge 18 0 0 17 Oct 2023
Causal Feature Selection via Transfer Entropy Paolo Bonetti Alberto Maria Metelli Marcello Restelli CML 56 6 0 17 Oct 2023
On the Properties and Estimation of Pointwise Mutual Information Profiles Paweł Czyż Frederic Grabowski Julia E. Vogt N. Beerenwinkel Alexander Marx 83 3 0 16 Oct 2023
Beyond Normal: On the Evaluation of Mutual Information Estimators Paweł Czyż Frederic Grabowski Julia E. Vogt N. Beerenwinkel Alexander Marx 103 35 0 19 Jun 2023
On the Effectiveness of Hybrid Mutual Information Estimation Marco Federici David Ruhe Patrick Forré 76 6 0 01 Jun 2023
MITFAS: Mutual Information based Temporal Feature Alignment and Sampling for Aerial Video Action Recognition Ruiqi Xian Xijun Wang Tianyi Zhou 70 10 0 05 Mar 2023
Active Velocity Estimation using Light Curtains via Self-Supervised Multi-Armed Bandits Siddharth Ancha Gaurav Pathak Ji Zhang S. Narasimhan David Held 61 1 0 24 Feb 2023
Improving Mutual Information based Feature Selection by Boosting Unique Relevance Shiyu Liu Mehul Motani 62 5 0 09 Dec 2022
Pitfalls of Climate Network Construction: A Statistical Perspective Moritz Haas B. Goswami U. V. Luxburg 55 4 0 05 Nov 2022
Greedy Modality Selection via Approximate Submodular Maximization Runxiang Cheng Gargi Balasubramaniam Yifei He Yao-Hung Hubert Tsai Han Zhao 49 1 0 22 Oct 2022
ARLO: A Framework for Automated Reinforcement Learning Marco Mussi Davide Lombarda Alberto Maria Metelli F. Trovò Marcello Restelli OffRL 78 4 0 20 May 2022
Fast Rate Generalization Error Bounds: Variations on a Theme Xuetong Wu J. Manton U. Aickelin Jingge Zhu 66 7 0 06 May 2022
Implicit Feature Decoupling with Depthwise Quantization Iordanis Fostiropoulos Barry W. Boehm 41 2 0 15 Mar 2022
DeepSE-WF: Unified Security Estimation for Website Fingerprinting Defenses Alexander Veicht Cédric Renggli Diogo Barradas AAML 73 8 0 08 Mar 2022
Can Information Flows Suggest Targets for Interventions in Neural Circuits? Praveen Venkatesh Sanghamitra Dutta Neil Mehta P. Grover AAML 70 8 0 09 Nov 2021
Are Gender-Neutral Queries Really Gender-Neutral? Mitigating Gender Bias in Image Search Jialu Wang Yang Liu Xinze Wang FaML 207 95 0 12 Sep 2021
A Maximum Entropy Copula Model for Mixed Data: Representation, Estimation, and Applications S. Mukhopadhyay Mukhopadhyay 46 1 0 21 Aug 2021
Beyond Voice Identity Conversion: Manipulating Voice Attributes by Adversarial Learning of Structured Disentangled Representations L. Benaroya Nicolas Obin Axel Roebel 40 5 0 26 Jul 2021
Towards quantifying information flows: relative entropy in deep neural networks and the renormalization group J. Erdmenger Kevin T. Grosvenor R. Jefferson 82 17 0 14 Jul 2021
A Rigorous Information-Theoretic Definition of Redundancy and Relevancy in Feature Selection Based on (Partial) Information Decomposition Patricia Wollstadt Sebastian Schmitt Michael Wibral 78 30 0 10 May 2021
Stochastic Mutual Information Gradient Estimation for Dimensionality Reduction Networks Ozan Özdenizci Deniz Erdogmus 28 16 0 01 May 2021
Fundamental Limits and Tradeoffs in Invariant Representation Learning Han Zhao Chen Dan Bryon Aragam Tommi Jaakkola Geoffrey J. Gordon Pradeep Ravikumar FaML 99 45 0 19 Dec 2020
Advantages of biologically-inspired adaptive neural activation in RNNs during learning Victor Geadah Giancarlo Kerg Stefan Horoi Guy Wolf Guillaume Lajoie 10 0 0 22 Jun 2020
On the Maximum Mutual Information Capacity of Neural Architectures Brandon Foggo Nan Yu TPM 78 3 0 10 Jun 2020
A Theory of Usable Information Under Computational Constraints Yilun Xu Shengjia Zhao Jiaming Song Russell Stewart Stefano Ermon 86 175 0 25 Feb 2020
Minimax Optimal Nonparametric Estimation of Heterogeneous Treatment Effects Zijun Gao Yanjun Han CML 87 16 0 15 Feb 2020
Fast Fair Regression via Efficient Approximations of Mutual Information D. Steinberg Alistair Reid S. O'Callaghan Finnian Lattimore L. McCalman Tibério S. Caetano FaML 65 16 0 14 Feb 2020
On the Estimation of Information Measures of Continuous Distributions Georg Pichler Pablo Piantanida Günther Koliander 68 13 0 07 Feb 2020
Conditional Mutual Information Estimation for Mixed Discrete and Continuous Variables with Nearest Neighbors O. Mesner C. Shalizi 56 5 0 06 Dec 2019
Model-Augmented Estimation of Conditional Mutual Information for Feature Selection Alan Yang AmirEmad Ghassami Maxim Raginsky Negar Kiyavash E. Rosenbaum 32 1 0 12 Nov 2019
Obfuscation via Information Density Estimation Hsiang Hsu S. Asoodeh Flavio du Pin Calmon 60 12 0 17 Oct 2019
Understanding the Limitations of Variational Mutual Information Estimators Jiaming Song Stefano Ermon SSL DRL 85 204 0 14 Oct 2019
Feature Selection via Mutual Information: New Theoretical Insights Mario Beraha Alberto Maria Metelli Matteo Papini Andrea Tirinzoni Marcello Restelli 71 67 0 17 Jul 2019
Twin Auxiliary Classifiers GAN Biwei Huang Yanwu Xu Chunyuan Li Kuncai Zhang Kayhan Batmanghelich 125 33 0 05 Jul 2019
Random Forests for Adaptive Nearest Neighbor Estimation of Information-Theoretic Quantities Ronan Perry Ronak D. Mehta Richard Guo Eva Yezerets Jesús Arroyo Michael A. Powell Hayden Helm Cencheng Shen Joshua T. Vogelstein 37 2 0 30 Jun 2019
CCMI : Classifier based Conditional Mutual Information Estimation Sudipto Mukherjee Himanshu Asnani Sreeram Kannan VLM 127 81 0 05 Jun 2019
Data-Efficient Mutual Information Neural Estimator Xiaoyu Lin Indranil Sur Samuel A. Nastase Ajay Divakaran Uri Hasson Mohamed R. Amer DRL 71 21 0 08 May 2019
Information Theoretic Feature Transformation Learning for Brain Interfaces Ozan Özdenizci Deniz Erdogmus 44 15 0 28 Mar 2019
On Network Science and Mutual Information for Explaining Deep Neural Networks Brian Davis Umang Bhatt Kartikeya Bhardwaj R. Marculescu J. M. F. Moura FedML SSL FAtt 55 10 0 20 Jan 2019
On mutual information estimation for mixed-pair random variables A. Beknazaryan Xin Dang Hailin Sang 63 13 0 27 Dec 2018
Structure Learning of Markov Random Fields through Grow-Shrink Maximum Pseudolikelihood Estimation Yuya Takashina Shuyo Nakatani Masato Inoue 133 0 0 03 Jul 2018
Mimic and Classify : A meta-algorithm for Conditional Independence Testing Rajat Sen Karthikeyan Shanmugam Himanshu Asnani Arman Rahimzamani Sreeram Kannan CML VLM 83 16 0 25 Jun 2018
Discrete-Continuous Mixtures in Probabilistic Programming: Generalized Semantics and Inference Algorithms Yi Wu Siddharth Srivastava N. Hay S. Du Stuart J. Russell 85 25 0 06 Jun 2018
Statistical Estimation of Conditional Shannon Entropy A. Bulinski A. Kozhevin 48 13 0 23 Apr 2018
Minimax Estimation of Quadratic Fourier Functionals Shashank Singh Bharath K. Sriperumbudur Barnabás Póczós 106 5 0 30 Mar 2018
GILBO: One Metric to Measure Them All Alexander A. Alemi Ian S. Fischer DRL 89 17 0 13 Feb 2018
Scalable Mutual Information Estimation using Dependence Graphs M. Noshad Yu Zeng Alfred Hero 77 73 0 27 Jan 2018