Two models of double descent for weak features

18 March 2019

Papers citing "Two models of double descent for weak features"

50 / 262 papers shown

Title
Generalization Performance of Transfer Learning: Overparameterized and Underparameterized Regimes Peizhong Ju Sen Lin M. Squillante Yitao Liang Ness B. Shroff 27 2 0 08 Jun 2023
Asymptotic Characterisation of Robust Empirical Risk Minimisation Performance in the Presence of Outliers Matteo Vilucchio Emanuele Troiani Vittorio Erba Florent Krzakala 22 1 0 30 May 2023
Representation Transfer Learning via Multiple Pre-trained models for Linear Regression Navjot Singh Suhas Diggavi 34 1 0 25 May 2023
Dropout Drops Double Descent Tianbao Yang J. Suzuki 19 1 0 25 May 2023
From Tempered to Benign Overfitting in ReLU Neural Networks Guy Kornowski Gilad Yehudai Ohad Shamir 20 12 0 24 May 2023
Least Squares Regression Can Exhibit Under-Parameterized Double Descent Xinyue Li Rishi Sonthalia 36 3 0 24 May 2023
Prediction Risk and Estimation Risk of the Ridgeless Least Squares Estimator under General Assumptions on Regression Errors Sungyoon Lee S. Lee 19 0 0 22 May 2023
New Equivalences Between Interpolation and SVMs: Kernels and Structured Features Chiraag Kaushik Andrew D. McRae Mark A. Davenport Vidya Muthukumar 22 2 0 03 May 2023
Subsample Ridge Ensembles: Equivalences and Generalized Cross-Validation Jin-Hong Du Pratik V. Patil Arun K. Kuchibhotla 16 11 0 25 Apr 2023
Theoretical Characterization of the Generalization Performance of Overfitted Meta-Learning Peizhong Ju Yitao Liang Ness B. Shroff MLT AI4CE 26 2 0 09 Apr 2023
General Loss Functions Lead to (Approximate) Interpolation in High Dimensions Kuo-Wei Lai Vidya Muthukumar 26 5 0 13 Mar 2023
Benign Overfitting for Two-layer ReLU Convolutional Neural Networks Yiwen Kou Zi-Yuan Chen Yuanzhou Chen Quanquan Gu MLT 49 12 0 07 Mar 2023
Benign Overfitting in Linear Classifiers and Leaky ReLU Networks from KKT Conditions for Margin Maximization Spencer Frei Gal Vardi Peter L. Bartlett Nathan Srebro 30 22 0 02 Mar 2023
High-dimensional analysis of double descent for linear regression with random projections Francis R. Bach 26 34 0 02 Mar 2023
DSD $^2$ : Can We Dodge Sparse Double Descent and Compress the Neural Network Worry-Free? Victor Quétu Enzo Tartaglione 26 7 0 02 Mar 2023
Over-parametrization via Lifting for Low-rank Matrix Sensing: Conversion of Spurious Solutions to Strict Saddle Points Ziye Ma Igor Molybog Javad Lavaei Somayeh Sojoudi 23 3 0 15 Feb 2023
Precise Asymptotic Analysis of Deep Random Feature Models David Bosch Ashkan Panahi B. Hassibi 35 19 0 13 Feb 2023
Theory on Forgetting and Generalization of Continual Learning Sen Lin Peizhong Ju Yitao Liang Ness B. Shroff CLL 34 40 0 12 Feb 2023
Implicit Regularization Leads to Benign Overfitting for Sparse Linear Regression Mo Zhou Rong Ge 27 2 0 01 Feb 2023
Deep networks for system identification: a Survey G. Pillonetto Aleksandr Aravkin Daniel Gedon L. Ljung Antônio H. Ribeiro Thomas B. Schon OOD 35 35 0 30 Jan 2023
A Simple Algorithm For Scaling Up Kernel Methods Tengyu Xu Bryan T. Kelly Semyon Malamud 11 0 0 26 Jan 2023
Bayesian Interpolation with Deep Linear Networks Boris Hanin Alexander Zlokapa 42 25 0 29 Dec 2022
Homophily modulates double descent generalization in graph convolution networks Chengzhi Shi Liming Pan Hong Hu Ivan Dokmanić 33 9 0 26 Dec 2022
Gradient flow in the gaussian covariate model: exact solution of learning curves and multiple descent structures Antione Bodin N. Macris 34 4 0 13 Dec 2022
High Dimensional Binary Classification under Label Shift: Phase Transition and Regularization Jiahui Cheng Minshuo Chen Hao Liu Tuo Zhao Wenjing Liao 36 0 0 01 Dec 2022
Regularization Trade-offs with Fake Features Martin Hellkvist Ayça Özçelikkale Anders Ahlén 14 0 0 01 Dec 2022
Transfer Learning with Kernel Methods Adityanarayanan Radhakrishnan Max Ruiz Luyten Neha Prasad Caroline Uhler 14 18 0 01 Nov 2022
Globally Gated Deep Linear Networks Qianyi Li H. Sompolinsky AI4CE 19 10 0 31 Oct 2022
The good, the bad and the ugly sides of data augmentation: An implicit spectral regularization perspective Chi-Heng Lin Chiraag Kaushik Eva L. Dyer Vidya Muthukumar 26 27 0 10 Oct 2022
On the Impossible Safety of Large AI Models El-Mahdi El-Mhamdi Sadegh Farhadkhani R. Guerraoui Nirupam Gupta L. Hoang Rafael Pinot Sébastien Rouault John Stephan 30 31 0 30 Sep 2022
Magnitude and Angle Dynamics in Training Single ReLU Neurons Sangmin Lee Byeongsu Sim Jong Chul Ye MLT 96 6 0 27 Sep 2022
Deep Double Descent via Smooth Interpolation Matteo Gamba Erik Englesson Marten Bjorkman Hossein Azizpour 63 10 0 21 Sep 2022
Multiple Descent in the Multiple Random Feature Model Xuran Meng Jianfeng Yao Yuan Cao 37 7 0 21 Aug 2022
Investigating the Impact of Model Width and Density on Generalization in Presence of Label Noise Yihao Xue Kyle Whitecross Baharan Mirzasoleiman NoLa 25 1 0 17 Aug 2022
A Universal Trade-off Between the Model Size, Test Loss, and Training Loss of Linear Predictors Nikhil Ghosh M. Belkin 13 7 0 23 Jul 2022
Benign, Tempered, or Catastrophic: A Taxonomy of Overfitting Neil Rohit Mallinar James B. Simon Amirhesam Abedsoltan Parthe Pandit M. Belkin Preetum Nakkiran 24 37 0 14 Jul 2022
Local Identifiability of Deep ReLU Neural Networks: the Theory Joachim Bona-Pellissier Franccois Malgouyres F. Bachoc FAtt 67 6 0 15 Jun 2022
Neural Collapse: A Review on Modelling Principles and Generalization Vignesh Kothapalli 21 71 0 08 Jun 2022
How does overparametrization affect performance on minority groups? Subha Maity Saptarshi Roy Songkai Xue Mikhail Yurochkin Yuekai Sun 19 3 0 07 Jun 2022
Generalization for multiclass classification with overparameterized linear models Vignesh Subramanian Rahul Arya A. Sahai AI4CE 34 9 0 03 Jun 2022
Regularization-wise double descent: Why it occurs and how to eliminate it Fatih Yilmaz Reinhard Heckel 25 11 0 03 Jun 2022
Analysis of Catastrophic Forgetting for Random Orthogonal Transformation Tasks in the Overparameterized Regime Daniel Goldfarb Paul Hand CLL 20 10 0 01 Jun 2022
Optimal Activation Functions for the Random Features Regression Model Jianxin Wang José Bento 32 3 0 31 May 2022
The CLRS Algorithmic Reasoning Benchmark Petar Velivcković Adria Puigdomenech Badia David Budden Razvan Pascanu Andrea Banino Mikhail Dashevskiy R. Hadsell Charles Blundell 161 88 0 31 May 2022
VC Theoretical Explanation of Double Descent Eng Hock Lee V. Cherkassky 27 3 0 31 May 2022
A Blessing of Dimensionality in Membership Inference through Regularization Jasper Tan Daniel LeJeune Blake Mason Hamid Javadi Richard G. Baraniuk 32 18 0 27 May 2022
On the Inconsistency of Kernel Ridgeless Regression in Fixed Dimensions Daniel Beaglehole M. Belkin Parthe Pandit 4 11 0 26 May 2022
Concentration of Random Feature Matrices in High-Dimensions Zhijun Chen Hayden Schaeffer Rachel A. Ward 22 6 0 14 Apr 2022
Overparameterized Linear Regression under Adversarial Attacks Antônio H. Ribeiro Thomas B. Schon AAML 12 18 0 13 Apr 2022
Random Features Model with General Convex Regularization: A Fine Grained Analysis with Precise Asymptotic Learning Curves David Bosch Ashkan Panahi Ayça Özçelikkale Devdatt Dubhash MLT 16 2 0 06 Apr 2022