Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
1903.07571
Cited By
v1
v2 (latest)
Two models of double descent for weak features
SIAM Journal on Mathematics of Data Science (SIMODS), 2019
18 March 2019
M. Belkin
Daniel J. Hsu
Ji Xu
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Two models of double descent for weak features"
50 / 269 papers shown
Algebraic and Statistical Properties of the Ordinary Least Squares Interpolator
Dennis Shen
Dogyoon Song
Peng Ding
Jasjeet Sekhon
206
3
0
27 Sep 2023
Adaptive Lasso, Transfer Lasso, and Beyond: An Asymptotic Perspective
Masaaki Takada
Hironori Fujisawa
184
2
0
30 Aug 2023
Noisy Interpolation Learning with Shallow Univariate ReLU Networks
International Conference on Learning Representations (ICLR), 2023
Nirmit Joshi
Gal Vardi
Nathan Srebro
296
8
0
28 Jul 2023
Precise Asymptotic Generalization for Multiclass Classification with Overparameterized Linear Models
Neural Information Processing Systems (NeurIPS), 2023
David X. Wu
A. Sahai
361
4
0
23 Jun 2023
Adversarial Training with Generated Data in High-Dimensional Regression: An Asymptotic Study
Yue Xing
180
1
0
21 Jun 2023
Quantifying lottery tickets under label noise: accuracy, calibration, and complexity
Conference on Uncertainty in Artificial Intelligence (UAI), 2023
V. Arora
Daniele Irto
Sebastian Goldt
G. Sanguinetti
235
2
0
21 Jun 2023
Gibbs-Based Information Criteria and the Over-Parameterized Regime
International Conference on Artificial Intelligence and Statistics (AISTATS), 2023
Haobo Chen
Yuheng Bu
Greg Wornell
325
1
0
08 Jun 2023
Generalization Performance of Transfer Learning: Overparameterized and Underparameterized Regimes
Peizhong Ju
Sen Lin
M. Squillante
Yitao Liang
Ness B. Shroff
199
3
0
08 Jun 2023
Asymptotic Characterisation of Robust Empirical Risk Minimisation Performance in the Presence of Outliers
Matteo Vilucchio
Emanuele Troiani
Vittorio Erba
Florent Krzakala
243
1
0
30 May 2023
Representation Transfer Learning via Multiple Pre-trained models for Linear Regression
International Symposium on Information Theory (ISIT), 2023
Navjot Singh
Suhas Diggavi
244
1
0
25 May 2023
Dropout Drops Double Descent
Japanese Journal of Statistics and Data Science (JSDS), 2023
Tianbao Yang
J. Suzuki
261
1
0
25 May 2023
From Tempered to Benign Overfitting in ReLU Neural Networks
Neural Information Processing Systems (NeurIPS), 2023
Guy Kornowski
Gilad Yehudai
Ohad Shamir
260
12
0
24 May 2023
Least Squares Regression Can Exhibit Under-Parameterized Double Descent
Neural Information Processing Systems (NeurIPS), 2023
Xinyue Li
Rishi Sonthalia
330
5
0
24 May 2023
Prediction Risk and Estimation Risk of the Ridgeless Least Squares Estimator under General Assumptions on Regression Errors
International Conference on Learning Representations (ICLR), 2023
Sungyoon Lee
S. Lee
163
0
0
22 May 2023
New Equivalences Between Interpolation and SVMs: Kernels and Structured Features
SIAM Journal on Mathematics of Data Science (SIMODS), 2023
Chiraag Kaushik
Andrew D. McRae
Mark A. Davenport
Vidya Muthukumar
250
4
0
03 May 2023
Subsample Ridge Ensembles: Equivalences and Generalized Cross-Validation
International Conference on Machine Learning (ICML), 2023
Jin-Hong Du
Pratik V. Patil
Arun K. Kuchibhotla
230
12
0
25 Apr 2023
Theoretical Characterization of the Generalization Performance of Overfitted Meta-Learning
International Conference on Learning Representations (ICLR), 2023
Peizhong Ju
Yitao Liang
Ness B. Shroff
MLT
AI4CE
164
4
0
09 Apr 2023
General Loss Functions Lead to (Approximate) Interpolation in High Dimensions
Kuo-Wei Lai
Vidya Muthukumar
268
5
0
13 Mar 2023
Benign Overfitting for Two-layer ReLU Convolutional Neural Networks
International Conference on Machine Learning (ICML), 2023
Yiwen Kou
Zi-Yuan Chen
Yuanzhou Chen
Quanquan Gu
MLT
226
25
0
07 Mar 2023
Benign Overfitting in Linear Classifiers and Leaky ReLU Networks from KKT Conditions for Margin Maximization
Annual Conference Computational Learning Theory (COLT), 2023
Spencer Frei
Gal Vardi
Peter L. Bartlett
Nathan Srebro
215
29
0
02 Mar 2023
High-dimensional analysis of double descent for linear regression with random projections
SIAM Journal on Mathematics of Data Science (SIMODS), 2023
Francis R. Bach
232
52
0
02 Mar 2023
DSD
2
^2
2
: Can We Dodge Sparse Double Descent and Compress the Neural Network Worry-Free?
AAAI Conference on Artificial Intelligence (AAAI), 2023
Victor Quétu
Enzo Tartaglione
338
6
0
02 Mar 2023
Over-parametrization via Lifting for Low-rank Matrix Sensing: Conversion of Spurious Solutions to Strict Saddle Points
International Conference on Machine Learning (ICML), 2023
Ziye Ma
Igor Molybog
Javad Lavaei
Somayeh Sojoudi
264
3
0
15 Feb 2023
Precise Asymptotic Analysis of Deep Random Feature Models
Annual Conference Computational Learning Theory (COLT), 2023
David Bosch
Ashkan Panahi
B. Hassibi
213
20
0
13 Feb 2023
Theory on Forgetting and Generalization of Continual Learning
International Conference on Machine Learning (ICML), 2023
Sen Lin
Peizhong Ju
Yitao Liang
Ness B. Shroff
CLL
222
62
0
12 Feb 2023
Implicit Regularization Leads to Benign Overfitting for Sparse Linear Regression
International Conference on Machine Learning (ICML), 2023
Mo Zhou
Rong Ge
366
3
0
01 Feb 2023
Deep networks for system identification: a Survey
G. Pillonetto
Aleksandr Aravkin
Daniel Gedon
L. Ljung
Antônio H. Ribeiro
Thomas B. Schon
OOD
329
91
0
30 Jan 2023
A Simple Algorithm For Scaling Up Kernel Methods
Tengyu Xu
Bryan Kelly
Semyon Malamud
181
0
0
26 Jan 2023
Bayesian Interpolation with Deep Linear Networks
Proceedings of the National Academy of Sciences of the United States of America (PNAS), 2022
Boris Hanin
Alexander Zlokapa
424
29
0
29 Dec 2022
Homophily modulates double descent generalization in graph convolution networks
Proceedings of the National Academy of Sciences of the United States of America (PNAS), 2022
Chengzhi Shi
Liming Pan
Hong Hu
Ivan Dokmanić
397
13
0
26 Dec 2022
Gradient flow in the gaussian covariate model: exact solution of learning curves and multiple descent structures
Antione Bodin
N. Macris
208
4
0
13 Dec 2022
High Dimensional Binary Classification under Label Shift: Phase Transition and Regularization
Sampling Theory, Signal Processing, and Data Analysis (SampTA), 2022
Jiahui Cheng
Minshuo Chen
Hao Liu
Tuo Zhao
Wenjing Liao
315
1
0
01 Dec 2022
Regularization Trade-offs with Fake Features
European Signal Processing Conference (EUSIPCO), 2022
Martin Hellkvist
Ayça Özçelikkale
Anders Ahlén
346
0
0
01 Dec 2022
Transfer Learning with Kernel Methods
Nature Communications (Nat Commun), 2022
Adityanarayanan Radhakrishnan
Max Ruiz Luyten
Neha Prasad
Caroline Uhler
153
30
0
01 Nov 2022
Globally Gated Deep Linear Networks
Neural Information Processing Systems (NeurIPS), 2022
Qianyi Li
H. Sompolinsky
AI4CE
252
15
0
31 Oct 2022
The good, the bad and the ugly sides of data augmentation: An implicit spectral regularization perspective
Journal of machine learning research (JMLR), 2022
Chi-Heng Lin
Chiraag Kaushik
Eva L. Dyer
Vidya Muthukumar
381
42
0
10 Oct 2022
On the Impossible Safety of Large AI Models
El-Mahdi El-Mhamdi
Sadegh Farhadkhani
R. Guerraoui
Nirupam Gupta
L. Hoang
Rafael Pinot
Sébastien Rouault
John Stephan
359
37
0
30 Sep 2022
Magnitude and Angle Dynamics in Training Single ReLU Neurons
Neural Networks (NN), 2022
Sangmin Lee
Byeongsu Sim
Jong Chul Ye
MLT
352
6
0
27 Sep 2022
Deep Double Descent via Smooth Interpolation
Matteo Gamba
Erik Englesson
Mårten Björkman
Hossein Azizpour
611
12
0
21 Sep 2022
Multiple Descent in the Multiple Random Feature Model
Journal of machine learning research (JMLR), 2022
Xuran Meng
Jianfeng Yao
Yuan Cao
254
9
0
21 Aug 2022
Investigating the Impact of Model Width and Density on Generalization in Presence of Label Noise
Conference on Uncertainty in Artificial Intelligence (UAI), 2022
Yihao Xue
Kyle Whitecross
Baharan Mirzasoleiman
NoLa
387
2
0
17 Aug 2022
A Universal Trade-off Between the Model Size, Test Loss, and Training Loss of Linear Predictors
SIAM Journal on Mathematics of Data Science (SIMODS), 2022
Nikhil Ghosh
M. Belkin
366
7
0
23 Jul 2022
Benign, Tempered, or Catastrophic: A Taxonomy of Overfitting
Neil Rohit Mallinar
James B. Simon
Amirhesam Abedsoltan
Parthe Pandit
M. Belkin
Preetum Nakkiran
357
39
0
14 Jul 2022
Local Identifiability of Deep ReLU Neural Networks: the Theory
Neural Information Processing Systems (NeurIPS), 2022
Joachim Bona-Pellissier
Franccois Malgouyres
François Bachoc
FAtt
293
11
0
15 Jun 2022
Neural Collapse: A Review on Modelling Principles and Generalization
Vignesh Kothapalli
370
103
0
08 Jun 2022
How does overparametrization affect performance on minority groups?
Subha Maity
Saptarshi Roy
Songkai Xue
Mikhail Yurochkin
Yuekai Sun
164
2
0
07 Jun 2022
Generalization for multiclass classification with overparameterized linear models
Neural Information Processing Systems (NeurIPS), 2022
Vignesh Subramanian
Rahul Arya
A. Sahai
AI4CE
192
12
0
03 Jun 2022
Regularization-wise double descent: Why it occurs and how to eliminate it
International Symposium on Information Theory (ISIT), 2022
Fatih Yilmaz
Reinhard Heckel
196
11
0
03 Jun 2022
Analysis of Catastrophic Forgetting for Random Orthogonal Transformation Tasks in the Overparameterized Regime
International Conference on Artificial Intelligence and Statistics (AISTATS), 2022
Daniel Goldfarb
Paul Hand
CLL
182
19
0
01 Jun 2022
Optimal Activation Functions for the Random Features Regression Model
International Conference on Learning Representations (ICLR), 2022
Jianxin Wang
José Bento
258
4
0
31 May 2022
Previous
1
2
3
4
5
6
Next
