All Papers

0 / 0 papers shown

Title

v1v2 (latest)

Reconciling modern machine learning practice and the bias-variance trade-off

28 December 2018

Papers citing "Reconciling modern machine learning practice and the bias-variance trade-off"

50 / 942 papers shown

Title
Redundant representations help generalization in wide neural networksNeural Information Processing Systems (NeurIPS), 2021 Diego Doimo Aldo Glielmo Sebastian Goldt Alessandro Laio AI4CE 235 10 0 07 Jun 2021
On Memorization in Probabilistic Deep Generative ModelsNeural Information Processing Systems (NeurIPS), 2021 G. V. D. Burg Christopher K. I. Williams TDI 262 78 0 06 Jun 2021
Towards an Understanding of Benign Overfitting in Neural Networks Zhu Li Zhi Zhou Arthur Gretton MLT 235 35 0 06 Jun 2021
An Even More Optimal Stochastic Optimization Algorithm: Minibatching and Interpolation LearningNeural Information Processing Systems (NeurIPS), 2021 Blake E. Woodworth Nathan Srebro 189 22 0 04 Jun 2021
Fundamental tradeoffs between memorization and robustness in random features and neural tangent regimes Elvis Dohmatob 112 9 0 04 Jun 2021
Out-of-Distribution Generalization in Kernel RegressionNeural Information Processing Systems (NeurIPS), 2021 Abdulkadir Canatar Blake Bordelon Cengiz Pehlevan OODD OOD 158 21 0 04 Jun 2021
Double Descent Optimization Pattern and Aliasing: Caveats of Noisy Labels Florian Dubost Erin Hong Max Pike Siddharth Sharma Siyi Tang Nandita Bhaskhar Christopher Lee-Messer D. Rubin NoLa 214 2 0 03 Jun 2021
Neural Collapse Under MSE Loss: Proximity to and Dynamics on the Central PathInternational Conference on Learning Representations (ICLR), 2021 X. Y. Han Vardan Papyan D. Donoho AAML 370 161 0 03 Jun 2021
Optimization Variance: Exploring Generalization Properties of DNNs Xiao Zhang Dongrui Wu Haoyi Xiong Bo Dai 137 5 0 03 Jun 2021
Exploring Memorization in Adversarial TrainingInternational Conference on Learning Representations (ICLR), 2021 Yinpeng Dong Ke Xu Xiao Yang Tianyu Pang Zhijie Deng Hang Su Jun Zhu TDI 101 82 0 03 Jun 2021
Effect of Pre-Training Scale on Intra- and Inter-Domain Full and Few-Shot Transfer Learning for Natural and Medical X-Ray Chest ImagesIEEE International Joint Conference on Neural Network (IJCNN), 2021 Mehdi Cherti J. Jitsev LM&MA 375 30 0 31 May 2021
Ten Quick Tips for Deep Learning in Biology Benjamin D. Lee A. Gitter Casey S. Greene S. Raschka F. Maguire ... Alexandr A Kalinin T. Triche Benjamin J. Lengerich Timothy J. Triche Jr S. Boca OOD 169 30 0 29 May 2021
Fit without fear: remarkable mathematical phenomena of deep learning through the prism of interpolationActa Numerica (AN), 2021 M. Belkin 151 207 0 29 May 2021
$Neural Network Training Using $\ell_1$-Regularization and Bi-fidelity Data$ Neural Network Training Using $\ell_1$ -Regularization and Bi-fidelity DataJournal of Computational Physics (JCP), 2021 Subhayan De Alireza Doostan 184 30 0 27 May 2021
A Universal Law of Robustness via IsoperimetryNeural Information Processing Systems (NeurIPS), 2021 Sébastien Bubeck Mark Sellke 303 228 0 26 May 2021
A Precise Performance Analysis of Support Vector RegressionInternational Conference on Machine Learning (ICML), 2021 Houssem Sifaou A. Kammoun Mohamed-Slim Alouini 104 6 0 21 May 2021
Latent Gaussian Model BoostingIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2021 Fabio Sigrist AI4CE 209 28 0 19 May 2021
Relative stability toward diffeomorphisms indicates performance in deep netsNeural Information Processing Systems (NeurIPS), 2021 Leonardo Petrini Alessandro Favero Mario Geiger Matthieu Wyart OOD 255 15 0 06 May 2021
A Geometric Analysis of Neural Collapse with Unconstrained FeaturesNeural Information Processing Systems (NeurIPS), 2021 Zhihui Zhu Tianyu Ding Jinxin Zhou Xiao Li Chong You Jeremias Sulam Qing Qu 266 230 0 06 May 2021
AdaBoost and robust one-bit compressed sensingMathematical Statistics and Learning (MSL), 2021 Geoffrey Chinot Felix Kuchelmeister Matthias Löffler Sara van de Geer 370 7 0 05 May 2021
Soft Mode in the Dynamics of Over-realizable On-line Learning for Soft Committee MachinesPhysical Review E (PRE), 2021 Frederieke Richert Roman Worschech B. Rosenow 82 9 0 29 Apr 2021
Risk Bounds for Over-parameterized Maximum Margin Classification on Sub-Gaussian MixturesNeural Information Processing Systems (NeurIPS), 2021 Yuan Cao Quanquan Gu M. Belkin 155 56 0 28 Apr 2021
Deep limits and cut-off phenomena for neural networks B. Avelin A. Karlsson AI4CE 198 3 0 21 Apr 2021
Noether: The More Things Change, the More Stay the Same Grzegorz Gluch R. Urbanke 135 20 0 12 Apr 2021
Generalization of GANs and overparameterized models under Lipschitz continuity Khoat Than Nghia D. Vu AI4CE 203 2 0 06 Apr 2021
A Sieve Stochastic Gradient Descent Estimator for Online Nonparametric Regression in Sobolev ellipsoidsAnnals of Statistics (Ann. Stat.), 2021 Tianyu Zhang N. Simon 241 5 0 02 Apr 2021
Trusted Artificial Intelligence: Towards Certification of Machine Learning Applications P. M. Winter Sebastian K. Eder J. Weissenbock Christoph Schwald Thomas Doms Tom Vogt Sepp Hochreiter Bernhard Nessler 184 28 0 31 Mar 2021
Fitting Elephants P. Mitra 79 0 0 31 Mar 2021
Trees, Forests, Chickens, and Eggs: When and Why to Prune Trees in a Random ForestStatistical analysis and data mining (SADM), 2021 Siyu Zhou L. Mentch 145 26 0 30 Mar 2021
Fundamental Challenges in Deep Learning for Stiff Contact DynamicsIEEE/RJS International Conference on Intelligent RObots and Systems (IROS), 2021 Mihir Parmar Mathew Halm Michael Posa 211 40 0 29 Mar 2021
Lower Bounds on the Generalization Error of Nonlinear Learning ModelsIEEE Transactions on Information Theory (IEEE Trans. Inf. Theory), 2021 Inbar Seroussi Ofer Zeitouni 168 6 0 26 Mar 2021
The Geometry of Over-parameterized Regression and Adversarial Perturbations J. Rocks Pankaj Mehta AAML 155 9 0 25 Mar 2021
Embracing the Disharmony in Medical Imaging: A Simple and Effective Framework for Domain Adaptation Rongguang Wang Pratik Chaudhari Christos Davatzikos OOD 379 56 0 23 Mar 2021
Comments on Leo Breiman's paper 'Statistical Modeling: The Two Cultures' (Statistical Science, 2001, 16(3), 199-231) Jelena Bradic Yinchu Zhu 80 0 0 21 Mar 2021
The Shape of Learning Curves: a ReviewIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2021 T. Viering Marco Loog 257 171 0 19 Mar 2021
The Low-Rank Simplicity Bias in Deep Networks Minyoung Huh H. Mobahi Richard Y. Zhang Brian Cheung Pulkit Agrawal Phillip Isola 384 143 0 18 Mar 2021
Understanding Generalization in Adversarial Training via the Bias-Variance Decomposition Yaodong Yu Zitong Yang Guang Cheng Jacob Steinhardt Yi-An Ma 238 19 0 17 Mar 2021
Pre-interpolation loss behaviour in neural networks Arthur E. W. Venter Marthinus W. Theunissen Marelie Hattingh Davel 102 3 0 14 Mar 2021
Robustness to Pruning Predicts Generalization in Deep Neural Networks Lorenz Kuhn Clare Lyle Aidan Gomez Jonas Rothfuss Y. Gal 149 15 0 10 Mar 2021
The Common Intuition to Transfer Learning Can Win or Lose: Case Studies for Linear RegressionSIAM Journal on Mathematics of Data Science (SIMODS), 2021 Yehuda Dar Daniel LeJeune Richard G. Baraniuk MLT 115 6 0 09 Mar 2021
Asymptotics of Ridge Regression in Convolutional ModelsInternational Conference on Machine Learning (ICML), 2021 Mojtaba Sahraee-Ardakan Tung Mai Anup B. Rao Ryan Rossi S. Rangan A. Fletcher MLT 89 2 0 08 Mar 2021
Exact Gap between Generalization Error and Uniform Convergence in Random Feature ModelsInternational Conference on Machine Learning (ICML), 2021 Zitong Yang Yu Bai Song Mei 129 19 0 08 Mar 2021
Lost in Pruning: The Effects of Pruning Neural Networks beyond Test AccuracyConference on Machine Learning and Systems (MLSys), 2021 Lucas Liebenwein Cenk Baykal Brandon Carter David K Gifford Daniela Rus AAML 180 81 0 04 Mar 2021
Slow-Growing Trees Philippe Goulet Coulombe 163 1 0 02 Mar 2021
Self-Regularity of Non-Negative Output Weights for Overparameterized Two-Layer Neural NetworksIEEE Transactions on Signal Processing (IEEE TSP), 2021 D. Gamarnik Eren C. Kizildaug Ilias Zadik 132 1 0 02 Mar 2021
Asymptotic Risk of Overparameterized Likelihood Models: Double Descent Theory for Deep Neural Networks Ryumei Nakada Masaaki Imaizumi 183 2 0 28 Feb 2021
Provable Super-Convergence with a Large Cyclical Learning RateIEEE Signal Processing Letters (IEEE SPL), 2021 Samet Oymak 161 15 0 22 Feb 2021
Generalization in Quantum Machine Learning: a Quantum Information PerspectivePRX Quantum (PRX Quantum), 2021 L. Banchi Jason Pereira S. Pirandola 179 24 0 17 Feb 2021
Learning curves of generic features maps for realistic datasets with a teacher-student modelNeural Information Processing Systems (NeurIPS), 2021 Bruno Loureiro Cédric Gerbelot Hugo Cui Sebastian Goldt Florent Krzakala M. Mézard Lenka Zdeborová 326 153 0 16 Feb 2021
Low Curvature Activations Reduce Overfitting in Adversarial TrainingIEEE International Conference on Computer Vision (ICCV), 2021 Vasu Singla Sahil Singla David Jacobs Soheil Feizi AAML 212 49 0 15 Feb 2021

v1v2 (latest)

Reconciling modern machine learning practice and the bias-variance trade-off

28 December 2018

Papers citing "Reconciling modern machine learning practice and the bias-variance trade-off"

50 / 942 papers shown

Title
Redundant representations help generalization in wide neural networksNeural Information Processing Systems (NeurIPS), 2021 Diego Doimo Aldo Glielmo Sebastian Goldt Alessandro Laio AI4CE 235 10 0 07 Jun 2021
On Memorization in Probabilistic Deep Generative ModelsNeural Information Processing Systems (NeurIPS), 2021 G. V. D. Burg Christopher K. I. Williams TDI 262 78 0 06 Jun 2021
Towards an Understanding of Benign Overfitting in Neural Networks Zhu Li Zhi Zhou Arthur Gretton MLT 235 35 0 06 Jun 2021
An Even More Optimal Stochastic Optimization Algorithm: Minibatching and Interpolation LearningNeural Information Processing Systems (NeurIPS), 2021 Blake E. Woodworth Nathan Srebro 189 22 0 04 Jun 2021
Fundamental tradeoffs between memorization and robustness in random features and neural tangent regimes Elvis Dohmatob 112 9 0 04 Jun 2021
Out-of-Distribution Generalization in Kernel RegressionNeural Information Processing Systems (NeurIPS), 2021 Abdulkadir Canatar Blake Bordelon Cengiz Pehlevan OODD OOD 158 21 0 04 Jun 2021
Double Descent Optimization Pattern and Aliasing: Caveats of Noisy Labels Florian Dubost Erin Hong Max Pike Siddharth Sharma Siyi Tang Nandita Bhaskhar Christopher Lee-Messer D. Rubin NoLa 214 2 0 03 Jun 2021
Neural Collapse Under MSE Loss: Proximity to and Dynamics on the Central PathInternational Conference on Learning Representations (ICLR), 2021 X. Y. Han Vardan Papyan D. Donoho AAML 370 161 0 03 Jun 2021
Optimization Variance: Exploring Generalization Properties of DNNs Xiao Zhang Dongrui Wu Haoyi Xiong Bo Dai 137 5 0 03 Jun 2021
Exploring Memorization in Adversarial TrainingInternational Conference on Learning Representations (ICLR), 2021 Yinpeng Dong Ke Xu Xiao Yang Tianyu Pang Zhijie Deng Hang Su Jun Zhu TDI 101 82 0 03 Jun 2021
Effect of Pre-Training Scale on Intra- and Inter-Domain Full and Few-Shot Transfer Learning for Natural and Medical X-Ray Chest ImagesIEEE International Joint Conference on Neural Network (IJCNN), 2021 Mehdi Cherti J. Jitsev LM&MA 375 30 0 31 May 2021
Ten Quick Tips for Deep Learning in Biology Benjamin D. Lee A. Gitter Casey S. Greene S. Raschka F. Maguire ... Alexandr A Kalinin T. Triche Benjamin J. Lengerich Timothy J. Triche Jr S. Boca OOD 169 30 0 29 May 2021
Fit without fear: remarkable mathematical phenomena of deep learning through the prism of interpolationActa Numerica (AN), 2021 M. Belkin 151 207 0 29 May 2021
$Neural Network Training Using $\ell_1$-Regularization and Bi-fidelity Data$ Neural Network Training Using $\ell_1$ -Regularization and Bi-fidelity DataJournal of Computational Physics (JCP), 2021 Subhayan De Alireza Doostan 184 30 0 27 May 2021
A Universal Law of Robustness via IsoperimetryNeural Information Processing Systems (NeurIPS), 2021 Sébastien Bubeck Mark Sellke 303 228 0 26 May 2021
A Precise Performance Analysis of Support Vector RegressionInternational Conference on Machine Learning (ICML), 2021 Houssem Sifaou A. Kammoun Mohamed-Slim Alouini 104 6 0 21 May 2021
Latent Gaussian Model BoostingIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2021 Fabio Sigrist AI4CE 209 28 0 19 May 2021
Relative stability toward diffeomorphisms indicates performance in deep netsNeural Information Processing Systems (NeurIPS), 2021 Leonardo Petrini Alessandro Favero Mario Geiger Matthieu Wyart OOD 255 15 0 06 May 2021
A Geometric Analysis of Neural Collapse with Unconstrained FeaturesNeural Information Processing Systems (NeurIPS), 2021 Zhihui Zhu Tianyu Ding Jinxin Zhou Xiao Li Chong You Jeremias Sulam Qing Qu 266 230 0 06 May 2021
AdaBoost and robust one-bit compressed sensingMathematical Statistics and Learning (MSL), 2021 Geoffrey Chinot Felix Kuchelmeister Matthias Löffler Sara van de Geer 370 7 0 05 May 2021
Soft Mode in the Dynamics of Over-realizable On-line Learning for Soft Committee MachinesPhysical Review E (PRE), 2021 Frederieke Richert Roman Worschech B. Rosenow 82 9 0 29 Apr 2021
Risk Bounds for Over-parameterized Maximum Margin Classification on Sub-Gaussian MixturesNeural Information Processing Systems (NeurIPS), 2021 Yuan Cao Quanquan Gu M. Belkin 155 56 0 28 Apr 2021
Deep limits and cut-off phenomena for neural networks B. Avelin A. Karlsson AI4CE 198 3 0 21 Apr 2021
Noether: The More Things Change, the More Stay the Same Grzegorz Gluch R. Urbanke 135 20 0 12 Apr 2021
Generalization of GANs and overparameterized models under Lipschitz continuity Khoat Than Nghia D. Vu AI4CE 203 2 0 06 Apr 2021
A Sieve Stochastic Gradient Descent Estimator for Online Nonparametric Regression in Sobolev ellipsoidsAnnals of Statistics (Ann. Stat.), 2021 Tianyu Zhang N. Simon 241 5 0 02 Apr 2021
Trusted Artificial Intelligence: Towards Certification of Machine Learning Applications P. M. Winter Sebastian K. Eder J. Weissenbock Christoph Schwald Thomas Doms Tom Vogt Sepp Hochreiter Bernhard Nessler 184 28 0 31 Mar 2021
Fitting Elephants P. Mitra 79 0 0 31 Mar 2021
Trees, Forests, Chickens, and Eggs: When and Why to Prune Trees in a Random ForestStatistical analysis and data mining (SADM), 2021 Siyu Zhou L. Mentch 145 26 0 30 Mar 2021
Fundamental Challenges in Deep Learning for Stiff Contact DynamicsIEEE/RJS International Conference on Intelligent RObots and Systems (IROS), 2021 Mihir Parmar Mathew Halm Michael Posa 211 40 0 29 Mar 2021
Lower Bounds on the Generalization Error of Nonlinear Learning ModelsIEEE Transactions on Information Theory (IEEE Trans. Inf. Theory), 2021 Inbar Seroussi Ofer Zeitouni 168 6 0 26 Mar 2021
The Geometry of Over-parameterized Regression and Adversarial Perturbations J. Rocks Pankaj Mehta AAML 155 9 0 25 Mar 2021
Embracing the Disharmony in Medical Imaging: A Simple and Effective Framework for Domain Adaptation Rongguang Wang Pratik Chaudhari Christos Davatzikos OOD 379 56 0 23 Mar 2021
Comments on Leo Breiman's paper 'Statistical Modeling: The Two Cultures' (Statistical Science, 2001, 16(3), 199-231) Jelena Bradic Yinchu Zhu 80 0 0 21 Mar 2021
The Shape of Learning Curves: a ReviewIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2021 T. Viering Marco Loog 257 171 0 19 Mar 2021
The Low-Rank Simplicity Bias in Deep Networks Minyoung Huh H. Mobahi Richard Y. Zhang Brian Cheung Pulkit Agrawal Phillip Isola 384 143 0 18 Mar 2021
Understanding Generalization in Adversarial Training via the Bias-Variance Decomposition Yaodong Yu Zitong Yang Guang Cheng Jacob Steinhardt Yi-An Ma 238 19 0 17 Mar 2021
Pre-interpolation loss behaviour in neural networks Arthur E. W. Venter Marthinus W. Theunissen Marelie Hattingh Davel 102 3 0 14 Mar 2021
Robustness to Pruning Predicts Generalization in Deep Neural Networks Lorenz Kuhn Clare Lyle Aidan Gomez Jonas Rothfuss Y. Gal 149 15 0 10 Mar 2021
The Common Intuition to Transfer Learning Can Win or Lose: Case Studies for Linear RegressionSIAM Journal on Mathematics of Data Science (SIMODS), 2021 Yehuda Dar Daniel LeJeune Richard G. Baraniuk MLT 115 6 0 09 Mar 2021
Asymptotics of Ridge Regression in Convolutional ModelsInternational Conference on Machine Learning (ICML), 2021 Mojtaba Sahraee-Ardakan Tung Mai Anup B. Rao Ryan Rossi S. Rangan A. Fletcher MLT 89 2 0 08 Mar 2021
Exact Gap between Generalization Error and Uniform Convergence in Random Feature ModelsInternational Conference on Machine Learning (ICML), 2021 Zitong Yang Yu Bai Song Mei 129 19 0 08 Mar 2021
Lost in Pruning: The Effects of Pruning Neural Networks beyond Test AccuracyConference on Machine Learning and Systems (MLSys), 2021 Lucas Liebenwein Cenk Baykal Brandon Carter David K Gifford Daniela Rus AAML 180 81 0 04 Mar 2021
Slow-Growing Trees Philippe Goulet Coulombe 163 1 0 02 Mar 2021
Self-Regularity of Non-Negative Output Weights for Overparameterized Two-Layer Neural NetworksIEEE Transactions on Signal Processing (IEEE TSP), 2021 D. Gamarnik Eren C. Kizildaug Ilias Zadik 132 1 0 02 Mar 2021
Asymptotic Risk of Overparameterized Likelihood Models: Double Descent Theory for Deep Neural Networks Ryumei Nakada Masaaki Imaizumi 183 2 0 28 Feb 2021
Provable Super-Convergence with a Large Cyclical Learning RateIEEE Signal Processing Letters (IEEE SPL), 2021 Samet Oymak 161 15 0 22 Feb 2021
Generalization in Quantum Machine Learning: a Quantum Information PerspectivePRX Quantum (PRX Quantum), 2021 L. Banchi Jason Pereira S. Pirandola 179 24 0 17 Feb 2021
Learning curves of generic features maps for realistic datasets with a teacher-student modelNeural Information Processing Systems (NeurIPS), 2021 Bruno Loureiro Cédric Gerbelot Hugo Cui Sebastian Goldt Florent Krzakala M. Mézard Lenka Zdeborová 326 153 0 16 Feb 2021
Low Curvature Activations Reduce Overfitting in Adversarial TrainingIEEE International Conference on Computer Vision (ICCV), 2021 Vasu Singla Sahil Singla David Jacobs Soheil Feizi AAML 212 49 0 15 Feb 2021