Estimating informativeness of samples with Smooth Unique Information

Estimating informativeness of samples with Smooth Unique Information

17 January 2021

Hrayr Harutyunyan

Alessandro Achille

Giovanni Paolini

Orchid Majumder

Avinash Ravichandran

Papers citing "Estimating informativeness of samples with Smooth Unique Information"

16 / 16 papers shown

Title
SoK: Memorisation in machine learning Dmitrii Usynin Moritz Knolle Georgios Kaissis 17 1 0 06 Nov 2023
The Memory Perturbation Equation: Understanding Model's Sensitivity to Data Peter Nickl Lu Xu Dharmesh Tailor Thomas Möllenhoff Mohammad Emtiyaz Khan 24 10 0 30 Oct 2023
Taming AI Bots: Controllability of Neural States in Large Language Models Stefano Soatto Paulo Tabuada Pratik Chaudhari Tianwei Liu LLMAG LM&Ro 18 13 0 29 May 2023
AI Model Disgorgement: Methods and Choices Alessandro Achille Michael Kearns Carson Klingenberg Stefano Soatto MU 17 11 0 07 Apr 2023
Two Facets of SDE Under an Information-Theoretic Lens: Generalization of SGD via Training Trajectories and via Terminal States Ziqiao Wang Yongyi Mao 13 10 0 19 Nov 2022
On Leave-One-Out Conditional Mutual Information For Generalization Mohamad Rida Rammal Alessandro Achille Aditya Golatkar Suhas Diggavi Stefano Soatto VLM 26 5 0 01 Jul 2022
Beyond neural scaling laws: beating power law scaling via data pruning Ben Sorscher Robert Geirhos Shashank Shekhar Surya Ganguli Ari S. Morcos 17 416 0 29 Jun 2022
Quantifying Feature Contributions to Overall Disparity Using Information Theory Sanghamitra Dutta Praveen Venkatesh P. Grover FAtt 11 5 0 16 Jun 2022
Unintended memorisation of unique features in neural networks J. Hartley Sotirios A. Tsaftaris 30 1 0 20 May 2022
Towards Differential Relational Privacy and its use in Question Answering Simone Bombari Alessandro Achille Zijian Wang Yu-Xiang Wang Yusheng Xie Kunwar Yashraj Singh Srikar Appalaraju Vijay Mahadevan Stefano Soatto 11 1 0 30 Mar 2022
Measuring Unintended Memorisation of Unique Private Features in Neural Networks J. Hartley Sotirios A. Tsaftaris 19 7 0 16 Feb 2022
Information-theoretic generalization bounds for black-box learning algorithms Hrayr Harutyunyan Maxim Raginsky Greg Ver Steeg Aram Galstyan 32 41 0 04 Oct 2021
Survey: Leakage and Privacy at Inference Time Marija Jegorova Chaitanya Kaul Charlie Mayor Alison Q. OÑeil Alexander Weir Roderick Murray-Smith Sotirios A. Tsaftaris PILM MIACV 17 71 0 04 Jul 2021
Understanding Instance-based Interpretability of Variational Auto-Encoders Zhifeng Kong Kamalika Chaudhuri TDI 11 27 0 29 May 2021
LQF: Linear Quadratic Fine-Tuning Alessandro Achille Aditya Golatkar Avinash Ravichandran M. Polito Stefano Soatto 14 27 0 21 Dec 2020
Estimating Example Difficulty Using Variance of Gradients Chirag Agarwal Daniel D'souza Sara Hooker 208 107 0 26 Aug 2020