Ask Your Distribution Shift if Pre-Training is Right for You

Ask Your Distribution Shift if Pre-Training is Right for You

29 February 2024

Benjamin Cohen-Wang

Aleksander Madry

Papers citing "Ask Your Distribution Shift if Pre-Training is Right for You"

7 / 7 papers shown

Title
The Best Instruction-Tuning Data are Those That Fit Dylan Zhang Qirun Dai Hao Peng ALM 115 3 0 06 Feb 2025
On the Variance of Neural Network Training with respect to Test Sets and Distributions Keller Jordan OOD 16 10 0 04 Apr 2023
When does Bias Transfer in Transfer Learning? Hadi Salman Saachi Jain Andrew Ilyas Logan Engstrom Eric Wong A. Madry 38 34 0 06 Jul 2022
An Empirical Study on Distribution Shift Robustness From the Perspective of Pre-Training and Data Augmentation Ziquan Liu Yi Tian Xu Yuanhong Xu Qi Qian Hao Li Rong Jin Xiangyang Ji Antoni B. Chan OOD 39 14 0 25 May 2022
A Fine-Grained Analysis on Distribution Shift Olivia Wiles Sven Gowal Florian Stimberg Sylvestre-Alvise Rebuffi Ira Ktena Krishnamurthy Dvijotham A. Cemgil OOD 217 201 0 21 Oct 2021
Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision Chao Jia Yinfei Yang Ye Xia Yi-Ting Chen Zarana Parekh Hieu H. Pham Quoc V. Le Yun-hsuan Sung Zhen Li Tom Duerig VLM CLIP 293 3,693 0 11 Feb 2021
An Investigation of Why Overparameterization Exacerbates Spurious Correlations Shiori Sagawa Aditi Raghunathan Pang Wei Koh Percy Liang 146 370 0 09 May 2020