BREEDS: Benchmarks for Subpopulation Shift

11 August 2020

Papers citing "BREEDS: Benchmarks for Subpopulation Shift"

36 / 36 papers shown

Title
Project-Probe-Aggregate: Efficient Fine-Tuning for Group Robustness B. Zhu Jiequan Cui H. Zhang Chi Zhang 85 0 0 12 Mar 2025
Detecting Systematic Weaknesses in Vision Models along Predefined Human-Understandable Dimensions Sujan Sai Gannamaneni Rohil Prakash Rao Michael Mock Maram Akila Stefan Wrobel AAML 141 0 0 17 Feb 2025
Challenging reaction prediction models to generalize to novel chemistry John Bradshaw Anji Zhang Babak Mahjour David E. Graff Marwin H. S. Segler Connor W. Coley 40 1 0 11 Jan 2025
Learning Structured Representations by Embedding Class Hierarchy with Fast Optimal Transport Siqi Zeng Sixian Du M. Yamada Han Zhao OT 36 0 0 04 Oct 2024
Evaluating Model Performance Under Worst-case Subpopulations Mike Li Hongseok Namkoong Shangzhou Xia 37 17 0 01 Jul 2024
Fine-grained Classes and How to Find Them Matej Grcić Artyom Gadetsky Maria Brbić 29 1 0 16 Jun 2024
Decision Boundary-aware Knowledge Consolidation Generates Better Instance-Incremental Learner Qiang Nie Weifu Fu Yuhuan Lin Jialin Li Yifeng Zhou Yong Liu Lei Zhu Chengjie Wang 30 0 0 05 Jun 2024
Embracing Diversity: Interpretable Zero-shot classification beyond one vector per class Mazda Moayeri Michael G. Rabbat Mark Ibrahim Diane Bouchacourt VLM 46 1 0 25 Apr 2024
Novel Node Category Detection Under Subpopulation Shift Hsing-Huan Chung Shravan Chaudhari Yoav Wald Xing Han Joydeep Ghosh 34 1 0 01 Apr 2024
Leveraging Gradients for Unsupervised Accuracy Estimation under Distribution Shift Renchunzi Xie Ambroise Odonnat Vasilii Feofanov I. Redko Jianfeng Zhang Bo An UQCV 72 1 0 17 Jan 2024
HGCLIP: Exploring Vision-Language Models with Graph Representations for Hierarchical Understanding Peng Xia Xingtong Yu Ming Hu Lie Ju Zhiyong Wang Peibo Duan Zongyuan Ge VLM 54 9 0 23 Nov 2023
Improving neural network representations using human similarity judgments Lukas Muttenthaler Lorenz Linhardt Jonas Dippel Robert A. Vandermeulen Katherine L. Hermann Andrew Kyle Lampinen Simon Kornblith 40 29 0 07 Jun 2023
Rectifying Group Irregularities in Explanations for Distribution Shift Adam Stein Yinjun Wu Eric Wong Mayur Naik 27 1 0 25 May 2023
Preemptively Pruning Clever-Hans Strategies in Deep Neural Networks Lorenz Linhardt Klaus-Robert Muller G. Montavon AAML 23 7 0 12 Apr 2023
Project and Probe: Sample-Efficient Domain Adaptation by Interpolating Orthogonal Features Annie S. Chen Yoonho Lee Amrith Rajagopal Setlur Sergey Levine Chelsea Finn VLM 29 9 0 10 Feb 2023
CHiLS: Zero-Shot Image Classification with Hierarchical Label Sets Zachary Novack Julian McAuley Zachary Chase Lipton Saurabh Garg VLM 24 79 0 06 Feb 2023
A Call to Reflect on Evaluation Practices for Failure Detection in Image Classification Paul F. Jaeger Carsten T. Lüth Lukas Klein Till J. Bungert UQCV 26 35 0 28 Nov 2022
ModelDiff: A Framework for Comparing Learning Algorithms Harshay Shah Sung Min Park Andrew Ilyas A. Madry SyDa 51 26 0 22 Nov 2022
Sufficient Invariant Learning for Distribution Shift Taero Kim Sungjun Lim Kyungwoo Song OOD 29 2 0 24 Oct 2022
Surgical Fine-Tuning Improves Adaptation to Distribution Shifts Yoonho Lee Annie S. Chen Fahim Tajwar Ananya Kumar Huaxiu Yao Percy Liang Chelsea Finn OOD 51 197 0 20 Oct 2022
A Closer Look at Novel Class Discovery from the Labeled Set Ziyun Li Jona Otholt Ben Dai Diane Hu Christoph Meinel Haojin Yang BDL 15 12 0 19 Sep 2022
The Value of Out-of-Distribution Data Ashwin De Silva Rahul Ramesh Carey E. Priebe Pratik Chaudhari Joshua T. Vogelstein OODD 19 11 0 23 Aug 2022
Invariant Feature Learning for Generalized Long-Tailed Classification Kaihua Tang Mingyuan Tao Jiaxin Qi Zhenguang Liu Hanwang Zhang VLM 24 52 0 19 Jul 2022
Calibrated ensembles can mitigate accuracy tradeoffs under distribution shift Ananya Kumar Tengyu Ma Percy Liang Aditi Raghunathan UQCV OODD OOD 42 38 0 18 Jul 2022
Contrastive Adapters for Foundation Model Group Robustness Michael Zhang Christopher Ré VLM 10 61 0 14 Jul 2022
Distilling Model Failures as Directions in Latent Space Saachi Jain Hannah Lawrence Ankur Moitra A. Madry 18 89 0 29 Jun 2022
Delving into the Openness of CLIP Shuhuai Ren Lei Li Xuancheng Ren Guangxiang Zhao Xu Sun VLM 22 13 0 04 Jun 2022
Interpolating Compressed Parameter Subspaces Siddhartha Datta N. Shadbolt 34 5 0 19 May 2022
Learn2Weight: Parameter Adaptation against Similar-domain Adversarial Attacks Siddhartha Datta AAML 32 4 0 15 May 2022
How to Combine Membership-Inference Attacks on Multiple Updated Models Matthew Jagielski Stanley Wu Alina Oprea Jonathan R. Ullman Roxana Geambasu 21 10 0 12 May 2022
MetaShift: A Dataset of Datasets for Evaluating Contextual Distribution Shifts and Training Conflicts Weixin Liang James Y. Zou OOD 35 82 0 14 Feb 2022
Log-Euclidean Signatures for Intrinsic Distances Between Unaligned Datasets Tal Shnitzer Mikhail Yurochkin Kristjan Greenewald Justin Solomon 35 6 0 03 Feb 2022
Editing a classifier by rewriting its prediction rules Shibani Santurkar Dimitris Tsipras Mahalaxmi Elango David Bau Antonio Torralba A. Madry KELM 175 89 0 02 Dec 2021
An Information-theoretic Approach to Distribution Shifts Marco Federici Ryota Tomioka Patrick Forré OOD 38 17 0 07 Jun 2021
Evaluating Model Robustness and Stability to Dataset Shift Adarsh Subbaswamy R. Adams S. Saria OOD 24 9 0 28 Oct 2020
A Testbed for Cross-Dataset Analysis Tatiana Tommasi Tinne Tuytelaars Barbara Caputo 165 96 0 24 Feb 2014