Two models of double descent for weak features

18 March 2019

Papers citing "Two models of double descent for weak features"

50 / 262 papers shown

Title
A dynamic view of the double descent Vivek Shripad Borkar 63 0 0 03 May 2025
Gradient Descent Robustly Learns the Intrinsic Dimension of Data in Training Convolutional Neural Networks Chenyang Zhang Peifeng Gao Difan Zou Yuan Cao OOD MLT 59 0 0 11 Apr 2025
Markets for Models Krishna Dasaratha Juan Ortner Chengyang Zhu 34 0 0 04 Mar 2025
A Near Complete Nonasymptotic Generalization Theory For Multilayer Neural Networks: Beyond the Bias-Variance Tradeoff Hao Yu Xiangyang Ji AI4CE 58 0 0 03 Mar 2025
Correlating and Predicting Human Evaluations of Language Models from Natural Language Processing Benchmarks Rylan Schaeffer Punit Singh Koura Binh Tang R. Subramanian Aaditya K. Singh ... Vedanuj Goswami Sergey Edunov Dieuwke Hupkes Sanmi Koyejo Sharan Narang ALM 71 0 0 24 Feb 2025
Understanding Generalization in Transformers: Error Bounds and Training Dynamics Under Benign and Harmful Overfitting Yingying Zhang Z. Wu Jian Li Y. Liu MLT AI4CE 39 0 0 18 Feb 2025
Analysis of Overparameterization in Continual Learning under a Linear Model Daniel Goldfarb Paul Hand CLL 39 0 0 11 Feb 2025
Overfitting Regimes of Nadaraya-Watson Interpolators Daniel Barzilai Guy Kornowski Ohad Shamir 76 0 0 11 Feb 2025
How more data can hurt: Instability and regularization in next-generation reservoir computing Yuanzhao Zhang Edmilson Roque dos Santos Sean P. Cornelius 77 2 0 28 Jan 2025
Algebraic and Statistical Properties of the Partially Regularized Ordinary Least Squares Interpolator Letian Yang Dennis Shen 30 0 0 10 Nov 2024
Double Descent Meets Out-of-Distribution Detection: Theoretical Insights and Empirical Analysis on the role of model complexity Mouin Ben Ammar David Brellmann Arturo Mendoza Antoine Manzanera Gianni Franchi OODD 34 0 0 04 Nov 2024
On Goodhart's law, with an application to value alignment El-Mahdi El-Mhamdi Lê-Nguyên Hoang 19 0 0 12 Oct 2024
MUSO: Achieving Exact Machine Unlearning in Over-Parameterized Regimes Ruikai Yang M. He Zhengbao He Youmei Qiu X. Huang MU BDL 37 1 0 11 Oct 2024
Defending Membership Inference Attacks via Privacy-aware Sparsity Tuning Qiang Hu Hengxiang Zhang Hongxin Wei 26 1 0 09 Oct 2024
Provable Weak-to-Strong Generalization via Benign Overfitting David X. Wu A. Sahai 65 6 0 06 Oct 2024
Investigating the Impact of Model Complexity in Large Language Models Jing Luo Huiyuan Wang Weiran Huang 34 0 0 01 Oct 2024
The poison of dimensionality Lê-Nguyên Hoang 31 2 0 25 Sep 2024
Overfitting Behaviour of Gaussian Kernel Ridgeless Regression: Varying Bandwidth or Dimensionality Marko Medvedev Gal Vardi Nathan Srebro 68 3 0 05 Sep 2024
Can We Theoretically Quantify the Impacts of Local Updates on the Generalization Performance of Federated Learning? Peizhong Ju Haibo Yang Jia Liu Yingbin Liang Ness B. Shroff FedML 33 0 0 05 Sep 2024
Theoretical Insights into Overparameterized Models in Multi-Task and Replay-Based Continual Learning Mohammadamin Banayeeanzade Mahdi Soltanolkotabi Mohammad Rostami CLL LRM 103 1 0 29 Aug 2024
Implicit Regularization Paths of Weighted Neural Representations Jin-Hong Du Pratik Patil 27 0 0 28 Aug 2024
On the effect of noise on fitting linear regression models Insha Ullah A. H. Welsh 17 0 0 15 Aug 2024
Towards an Improved Understanding and Utilization of Maximum Manifold Capacity Representations Rylan Schaeffer Victor Lecomte Dhruv Pai Andres Carranza Berivan Isik ... Yann LeCun SueYeon Chung Andrey Gromov Ravid Shwartz-Ziv Sanmi Koyejo 49 5 0 13 Jun 2024
Precise analysis of ridge interpolators under heavy correlations -- a Random Duality Theory view Mihailo Stojnic 27 1 0 13 Jun 2024
Ridge interpolators in correlated factor regression models -- exact risk analysis Mihailo Stojnic 20 1 0 13 Jun 2024
Class-wise Activation Unravelling the Engima of Deep Double Descent Yufei Gu 36 0 0 13 May 2024
Finite Sample Analysis and Bounds of Generalization Error of Gradient Descent in In-Context Linear Regression Karthik Duraisamy MLT 39 3 0 03 May 2024
Understanding Optimal Feature Transfer via a Fine-Grained Bias-Variance Analysis Yufan Li Subhabrata Sen Ben Adlam MLT 48 1 0 18 Apr 2024
High-dimensional analysis of ridge regression for non-identically distributed data with a variance profile Jérémie Bigot Issa-Mbenard Dabo Camille Male 31 4 0 29 Mar 2024
On the Benefits of Over-parameterization for Out-of-Distribution Generalization Yifan Hao Yong Lin Difan Zou Tong Zhang OODD OOD 42 4 0 26 Mar 2024
Understanding the Double Descent Phenomenon in Deep Learning Marc Lafon Alexandre Thomas 20 2 0 15 Mar 2024
A Predictive Surrogate Model for Heat Transfer of an Impinging Jet on a Concave Surface Sajad Salavatidezfouli Saeid Rakhsha Armin Sheidani G. Stabile G. Rozza AI4CE 16 2 0 16 Feb 2024
One-Bit Quantization and Sparsification for Multiclass Linear Classification via Regularized Regression Reza Ghane D. Akhtiamov Babak Hassibi 14 1 0 16 Feb 2024
Stochastic Gradient Flow Dynamics of Test Risk and its Exact Solution for Weak Features Rodrigo Veiga Anastasia Remizova Nicolas Macris 37 0 0 12 Feb 2024
On Catastrophic Inheritance of Large Foundation Models Hao Chen Bhiksha Raj Xing Xie Jindong Wang AI4CE 56 12 0 02 Feb 2024
The Surprising Harmfulness of Benign Overfitting for Adversarial Robustness Yifan Hao Tong Zhang AAML 21 4 0 19 Jan 2024
Flat Minima in Linear Estimation and an Extended Gauss Markov Theorem Simon Segert 24 0 0 18 Nov 2023
Minimum norm interpolation by perceptra: Explicit regularization and implicit bias Jiyoung Park Ian Pelakh Stephan Wojtowytsch 42 2 0 10 Nov 2023
Unraveling the Enigma of Double Descent: An In-depth Analysis through the Lens of Learned Feature Space Yufei Gu Xiaoqing Zheng T. Aste 37 3 0 20 Oct 2023
Regularization properties of adversarially-trained linear regression Antônio H. Ribeiro Dave Zachariah Francis Bach Thomas B. Schon AAML 31 8 0 16 Oct 2023
Asymptotically free sketched ridge ensembles: Risks, cross-validation, and tuning Filip Szatkowski Daniel LeJeune 27 9 0 06 Oct 2023
Benign Overfitting in Two-Layer ReLU Convolutional Neural Networks for XOR Data Xuran Meng Difan Zou Yuan Cao MLT 29 7 0 03 Oct 2023
Universality of max-margin classifiers Andrea Montanari Feng Ruan Basil Saeed Youngtak Sohn 31 3 0 29 Sep 2023
Algebraic and Statistical Properties of the Ordinary Least Squares Interpolator Dennis Shen Dogyoon Song Peng Ding Jasjeet Sekhon 8 1 0 27 Sep 2023
Adaptive Lasso, Transfer Lasso, and Beyond: An Asymptotic Perspective Masaaki Takada Hironori Fujisawa 16 1 0 30 Aug 2023
Noisy Interpolation Learning with Shallow Univariate ReLU Networks Nirmit Joshi Gal Vardi Nathan Srebro 32 8 0 28 Jul 2023
Precise Asymptotic Generalization for Multiclass Classification with Overparameterized Linear Models David X. Wu A. Sahai 26 2 0 23 Jun 2023
Adversarial Training with Generated Data in High-Dimensional Regression: An Asymptotic Study Yue Xing 22 0 0 21 Jun 2023
Quantifying lottery tickets under label noise: accuracy, calibration, and complexity V. Arora Daniele Irto Sebastian Goldt G. Sanguinetti 36 2 0 21 Jun 2023
Gibbs-Based Information Criteria and the Over-Parameterized Regime Haobo Chen Yuheng Bu Greg Wornell 27 1 0 08 Jun 2023