The Power and Limitation of Pretraining-Finetuning for Linear Regression
under Covariate Shift

The Power and Limitation of Pretraining-Finetuning for Linear Regression under Covariate Shift

3 August 2022

Vladimir Braverman

Quanquan Gu

Papers citing "The Power and Limitation of Pretraining-Finetuning for Linear Regression under Covariate Shift"

17 / 17 papers shown

Title
Memory-Statistics Tradeoff in Continual Learning with Structural Regularization Haoran Li Jingfeng Wu Vladimir Braverman CLL 34 0 0 05 Apr 2025
Scaling Law Phenomena Across Regression Paradigms: Multiple and Kernel Approaches Yifang Chen Xuyang Guo Xiaoyu Li Yingyu Liang Zhenmei Shi Zhao Song 73 3 0 03 Mar 2025
Prediction Accuracy & Reliability: Classification and Object Localization under Distribution Shift Fabian Diet Moussa Kassem Sbeyti Michelle Karg 41 0 0 05 Sep 2024
Memorization Capacity for Additive Fine-Tuning with Small ReLU Networks Jy-yong Sohn Dohyun Kwon Seoyeon An Kangwook Lee 46 0 0 01 Aug 2024
Scaling Laws in Linear Regression: Compute, Parameters, and Data Licong Lin Jingfeng Wu Sham Kakade Peter L. Bartlett Jason D. Lee LRM 44 15 0 12 Jun 2024
A Statistical Theory of Regularization-Based Continual Learning Xuyang Zhao Huiyuan Wang Weiran Huang Wei Lin 37 13 0 10 Jun 2024
Understanding Forgetting in Continual Learning with Linear Regression Meng Ding Kaiyi Ji Di Wang Jinhui Xu CLL 31 8 0 27 May 2024
On the Benefits of Over-parameterization for Out-of-Distribution Generalization Yifan Hao Yong Lin Difan Zou Tong Zhang OODD OOD 42 4 0 26 Mar 2024
Out of the Ordinary: Spectrally Adapting Regression for Covariate Shift Benjamin Eyre Elliot Creager David Madras Antonio Torralba Katherine Heller OOD OODD 40 1 0 29 Dec 2023
Fixed Design Analysis of Regularization-Based Continual Learning Haoran Li Jingfeng Wu Vladimir Braverman CLL 26 9 0 17 Mar 2023
Finite-Sample Analysis of Learning High-Dimensional Single ReLU Neuron Jingfeng Wu Difan Zou Zixiang Chen Vladimir Braverman Quanquan Gu Sham Kakade 90 6 0 03 Mar 2023
Pseudo-Labeling for Kernel Ridge Regression under Covariate Shift Kaizheng Wang 32 10 0 20 Feb 2023
Demystifying Disagreement-on-the-Line in High Dimensions Dong-Hwan Lee Behrad Moniri Xinmeng Huang Yan Sun Hamed Hassani 21 8 0 31 Jan 2023
A new similarity measure for covariate shift with applications to nonparametric regression Reese Pathak Cong Ma Martin J. Wainwright 63 31 0 06 Feb 2022
Last Iterate Risk Bounds of SGD with Decaying Stepsize for Overparameterized Linear Regression Jingfeng Wu Difan Zou Vladimir Braverman Quanquan Gu Sham Kakade 104 20 0 12 Oct 2021
New Analysis and Algorithm for Learning with Drifting Distributions M. Mohri Andrés Munoz Medina 97 123 0 19 May 2012
Domain Adaptation: Learning Bounds and Algorithms Yishay Mansour M. Mohri Afshin Rostamizadeh 179 790 0 19 Feb 2009