Distribution Density, Tails, and Outliers in Machine Learning: Metrics and Applications

29 October 2019

Papers citing "Distribution Density, Tails, and Outliers in Machine Learning: Metrics and Applications"

42 / 42 papers shown

Title
The Easy Path to Robustness: Coreset Selection using Sample Hardness Pranav Ramesh Arjun Roy Deepak Ravikumar Kaushik Roy Gopalakrishnan Srinivasan 93 0 0 13 Oct 2025
Like Oil and Water: Group Robustness Methods and Poisoning Defenses May Be at OddsInternational Conference on Learning Representations (ICLR), 2025 Michael-Andrei Panaitescu-Liess Yigitcan Kaya Sicheng Zhu Furong Huang Tudor Dumitras AAML 236 0 0 02 Apr 2025
Trustworthy Machine Learning via Memorization and the Granular Long-Tail: A Survey on Interactions, Tradeoffs, and Beyond Qiongxiu Li Xiaoyu Luo Yiyi Chen Johannes Bjerva 459 4 0 10 Mar 2025
FairDropout: Using Example-Tied Dropout to Enhance Generalization of Minority Groups Géraldin Nanfack Eugene Belilovsky 225 1 0 10 Feb 2025
Uncovering Memorization Effect in the Presence of Spurious CorrelationsNature Communications (Nat Commun), 2025 Chenyu You Haocheng Dai Yifei Min Jasjeet Sekhon S. Joshi James S. Duncan 435 3 0 01 Jan 2025
Scalability of memorization-based machine unlearning Kairan Zhao Peter Triantafillou MU 166 5 0 21 Oct 2024
Fragile Giants: Understanding the Susceptibility of Models to Subpopulation Attacks Isha Gupta Hidde Lycklama Emanuel Opel Evan Rose Anwar Hithnawi AAML 175 1 0 11 Oct 2024
Exploring Differences between Human Perception and Model Inference in Audio Event Recognition Yizhou Tan Yanru Wu Yuanbo Hou Xin Xu Hui Bu Shengchen Li Dick Botteldooren Mark D. Plumbley 129 1 0 10 Sep 2024
Memorization in deep learning: A survey Jiaheng Wei Yanjun Zhang Leo Yu Zhang Ming Ding Chao Chen Kok-Leong Ong Jun Zhang Yang Xiang 241 15 0 06 Jun 2024
What makes unlearning hard and what to do about it Kairan Zhao M. Kurmanji George-Octavian Barbulescu Eleni Triantafillou Peter Triantafillou MU 207 46 0 03 Jun 2024
Why is SAM Robust to Label Noise?International Conference on Learning Representations (ICLR), 2024 Christina Baek Zico Kolter Aditi Raghunathan NoLa AAML 210 19 0 06 May 2024
Minimum Topology Attacks for Graph Neural Networks Mengmei Zhang Tianlin Li Chuan Shi Lingjuan Lyu Tianchi Yang Junping Du AAML 150 10 0 05 Mar 2024
Unveiling Privacy, Memorization, and Input Curvature Links Deepak Ravikumar Efstathia Soufleri Abolfazl Hashemi Kaushik Roy 210 12 0 28 Feb 2024
Dataset Difficulty and the Role of Inductive Bias Devin Kwok Nikhil Anand Jonathan Frankle Gintare Karolina Dziugaite David Rolnick 162 10 0 03 Jan 2024
Influence Scores at Scale for Efficient Language Data SamplingConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Nikhil Anand Joshua Tan Maria Minakova TDI 210 3 0 27 Nov 2023
SoK: Memorisation in machine learning Dmitrii Usynin Moritz Knolle Georgios Kaissis 253 1 0 06 Nov 2023
Interactive Multi-fidelity Learning for Cost-effective Adaptation of Language Model with Sparse Human SupervisionNeural Information Processing Systems (NeurIPS), 2023 Jiaxin Zhang Zhuohang Li Kamalika Das Kumar Sricharan 279 4 0 31 Oct 2023
Late Stopping: Avoiding Confidently Learning from Mislabeled ExamplesIEEE International Conference on Computer Vision (ICCV), 2023 Suqin Yuan Lei Feng Tongliang Liu NoLa 199 16 0 26 Aug 2023
Extended Linear Regression: A Kalman Filter Approach for Minimizing Loss via Area Under the Curve R. Gokulprasath 106 0 0 23 Aug 2023
Unlocking Accuracy and Fairness in Differentially Private Image Classification Leonard Berrada Soham De J. Shen Jamie Hayes Robert Stanforth David Stutz Pushmeet Kohli Samuel L. Smith Borja Balle 156 18 0 21 Aug 2023
Can Neural Network Memorization Be Localized?International Conference on Machine Learning (ICML), 2023 Pratyush Maini Michael C. Mozer Hanie Sedghi Zachary Chase Lipton J. Zico Kolter Chiyuan Zhang TDI 145 72 0 18 Jul 2023
Memorization Through the Lens of Curvature of Loss Function Around SamplesInternational Conference on Machine Learning (ICML), 2023 Isha Garg Deepak Ravikumar Kaushik Roy TDI 224 19 0 11 Jul 2023
T-MARS: Improving Visual Representations by Circumventing Text Feature LearningInternational Conference on Learning Representations (ICLR), 2023 Pratyush Maini Sachin Goyal Zachary Chase Lipton J. Zico Kolter Aditi Raghunathan VLM 119 40 0 06 Jul 2023
Read, Look or Listen? What's Needed for Solving a Multimodal Dataset Netta Madvil Yonatan Bitton Roy Schwartz 152 3 0 06 Jul 2023
Adaptive Conformal Regression with Jackknife+ Rescaled Scores N. Deutschmann Mattia Rigotti María Rodríguez Martínez 153 12 0 31 May 2023
Bitrate-Constrained DRO: Beyond Worst Case Robustness To Unknown Group ShiftsInternational Conference on Learning Representations (ICLR), 2023 Amrith Rajagopal Setlur D. Dennis Benjamin Eysenbach Aditi Raghunathan Chelsea Finn Virginia Smith Sergey Levine OOD 187 11 0 06 Feb 2023
Generalized Uncertainty of Deep Neural Networks: Taxonomy and Applications Chengyu Dong OOD UQCV BDL AI4CE 297 2 0 02 Feb 2023
Tensions Between the Proxies of Human Values in AI Teresa Datta D. Nissani Max Cembalest Akash Khanna Haley Massa John P. Dickerson 180 4 0 14 Dec 2022
Characterizing Datapoints via Second-Split ForgettingNeural Information Processing Systems (NeurIPS), 2022 Pratyush Maini Saurabh Garg Zachary Chase Lipton J. Zico Kolter 180 38 0 26 Oct 2022
SelfMix: Robust Learning Against Textual Label Noise with Self-Mixup TrainingInternational Conference on Computational Linguistics (COLING), 2022 Dan Qiao Chenchen Dai Yuyang Ding Juntao Li Qiang Chen Wenliang Chen Hao Fei VLM NoLa 193 15 0 10 Oct 2022
Metadata Archaeology: Unearthing Data Subsets by Leveraging Training DynamicsInternational Conference on Learning Representations (ICLR), 2022 Shoaib Ahmed Siddiqui Nitarshan Rajkumar Tegan Maharaj David M. Krueger Sara Hooker 234 31 0 20 Sep 2022
FreeMatch: Self-adaptive Thresholding for Semi-supervised LearningInternational Conference on Learning Representations (ICLR), 2022 Yidong Wang Hao Chen Qiang Heng Wenxin Hou Yue Fan ... Marios Savvides T. Shinozaki Bhiksha Raj Bernt Schiele Xing Xie 415 364 0 15 May 2022
Unlocking High-Accuracy Differentially Private Image Classification through Scale Soham De Leonard Berrada Jamie Hayes Samuel L. Smith Borja Balle 271 260 0 28 Apr 2022
Unsupervised Selective Labeling for More Effective Semi-Supervised Learning Xudong Wang Long Lian Stella X. Yu 533 37 0 06 Oct 2021
A Tale Of Two Long Tails Daniel D'souza Zach Nussbaum Chirag Agarwal Sara Hooker 124 24 0 27 Jul 2021
Deep Learning Through the Lens of Example DifficultyNeural Information Processing Systems (NeurIPS), 2021 R. Baldock Hartmut Maennel Behnam Neyshabur 235 178 0 17 Jun 2021
Towards the Memorization Effect of Neural Networks in Adversarial Training Han Xu Xiaorui Liu Wentao Wang Wenbiao Ding Zhongqin Wu Zitao Liu Anil K. Jain Shucheng Zhou TDI AAML 141 7 0 09 Jun 2021
Interpretable Deep Learning: Interpretation, Interpretability, Trustworthiness, and BeyondKnowledge and Information Systems (KAIS), 2021 Xuhong Li Haoyi Xiong Xingjian Li Xuanyu Wu Xiao Zhang Ji Liu Jiang Bian Dejing Dou AAML FaML XAI HAI 196 418 0 19 Mar 2021
Estimating Example Difficulty Using Variance of GradientsComputer Vision and Pattern Recognition (CVPR), 2020 Chirag Agarwal Daniel D'souza Sara Hooker 446 122 0 26 Aug 2020
What Neural Networks Memorize and Why: Discovering the Long Tail via Influence EstimationNeural Information Processing Systems (NeurIPS), 2020 Vitaly Feldman Chiyuan Zhang TDI 466 558 0 09 Aug 2020
Improving Calibration through the Relationship with Adversarial Robustness Yao Qin Xuezhi Wang Alex Beutel Ed H. Chi AAML 172 28 0 29 Jun 2020
FixMatch: Simplifying Semi-Supervised Learning with Consistency and ConfidenceNeural Information Processing Systems (NeurIPS), 2020 Kihyuk Sohn David Berthelot Chun-Liang Li Zizhao Zhang Nicholas Carlini E. D. Cubuk Alexey Kurakin Han Zhang Colin Raffel AAML 351 4,163 0 21 Jan 2020