v1v2 (latest)

Reconciling modern machine learning practice and the bias-variance trade-off

28 December 2018

Papers citing "Reconciling modern machine learning practice and the bias-variance trade-off"

50 / 942 papers shown

Title
A Multi-resolution Theory for Approximating Infinite- $p$ -Zero- $n$ : Transitional Inference, Individualized Predictions, and a World Without Bias-Variance Trade-offJournal of the American Statistical Association (JASA), 2020 Xinran Li Xiangxu Meng 145 15 0 17 Oct 2020
For self-supervised learning, Rationality implies generalization, provablyInternational Conference on Learning Representations (ICLR), 2020 Yamini Bansal Gal Kaplun Boaz Barak OOD SSL 221 23 0 16 Oct 2020
Failures of model-dependent generalization bounds for least-norm interpolationJournal of machine learning research (JMLR), 2020 Peter L. Bartlett Philip M. Long 351 31 0 16 Oct 2020
Deep and interpretable regression models for ordinal outcomes Lucas Kook L. Herzog Torsten Hothorn Oliver Durr Beate Sick 389 15 0 16 Oct 2020
What causes the test error? Going beyond bias-variance via ANOVAJournal of machine learning research (JMLR), 2020 Licong Lin Guang Cheng 252 35 0 11 Oct 2020
Regularizing Neural Networks via Adversarial Model PerturbationComputer Vision and Pattern Recognition (CVPR), 2020 Yaowei Zheng Richong Zhang Yongyi Mao AAML 298 107 0 10 Oct 2020
Kernel regression in high dimensions: Refined analysis beyond double descent Fanghui Liu Zhenyu Liao Johan A. K. Suykens 280 49 0 06 Oct 2020
On the Universality of the Double Descent Peak in Ridgeless RegressionInternational Conference on Learning Representations (ICLR), 2020 David Holzmüller 425 13 0 05 Oct 2020
Effective Regularization Through Loss-Function MetalearningIEEE Congress on Evolutionary Computation (CEC), 2020 Santiago Gonzalez Xin Qiu Risto Miikkulainen 472 5 0 02 Oct 2020
Benign overfitting in ridge regression Alexander Tsigler Peter L. Bartlett 259 195 0 29 Sep 2020
Experimental Design for Overparameterized Learning with Application to Single Shot Deep Active LearningIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2020 N. Shoham H. Avron BDL 181 13 0 27 Sep 2020
Small Data, Big Decisions: Model Selection in the Small-Data RegimeInternational Conference on Machine Learning (ICML), 2020 J. Bornschein Francesco Visin Simon Osindero 138 45 0 26 Sep 2020
ContactNets: Learning Discontinuous Contact Dynamics with Smooth, Implicit RepresentationsConference on Robot Learning (CoRL), 2020 Samuel Pfrommer Mathew Halm Michael Posa 315 93 0 23 Sep 2020
Implicit Gradient RegularizationInternational Conference on Learning Representations (ICLR), 2020 David Barrett Benoit Dherin 332 169 0 23 Sep 2020
Towards a Mathematical Understanding of Neural Network-Based Machine Learning: what we know and what we don'tCSIAM Transactions on Applied Mathematics (CSIAM Trans. Appl. Math.), 2020 E. Weinan Chao Ma Stephan Wojtowytsch Lei Wu AI4CE 292 146 0 22 Sep 2020
Adversarial Robustness through Bias Variance Decomposition: A New Perspective for Federated LearningInternational Conference on Information and Knowledge Management (CIKM), 2020 Yao Zhou Jun Wu Haixun Wang Jingrui He AAML FedML 305 32 0 18 Sep 2020
A Principle of Least Action for the Training of Neural Networks Skander Karkar Ibrahhim Ayed Emmanuel de Bézenac Patrick Gallinari AI4CE 306 10 0 17 Sep 2020
Distributional Generalization: A New Kind of Generalization Preetum Nakkiran Yamini Bansal OOD 228 47 0 17 Sep 2020
Efficient Quantum State Sample Tomography with Basis-dependent Neural-networksPRX Quantum (PRX Quantum), 2020 Alistair W. R. Smith Johnnie Gray M. S. Kim 229 35 0 16 Sep 2020
End-to-end Kernel Learning via Generative Random Fourier FeaturesPattern Recognition (Pattern Recognit.), 2020 Kun Fang Fanghui Liu Xiaolin Huang Jie Yang 382 11 0 10 Sep 2020
Minimum discrepancy principle strategy for choosing $k$ in $k$ -NN regression Yaroslav Averyanov Alain Celisse 350 0 0 20 Aug 2020
Asymptotics of Wide Convolutional Neural Networks Anders Andreassen Ethan Dyer 187 24 0 19 Aug 2020
How Powerful are Shallow Neural Networks with Bandlimited Random Weights? Ming Li Sho Sonoda Feilong Cao Yu Wang Jiye Liang 183 10 0 19 Aug 2020
Prevalence of Neural Collapse during the terminal phase of deep learning training Vardan Papyan Xuemei Han D. Donoho 501 713 0 18 Aug 2020
Intelligence plays dice: Stochasticity is essential for machine learning M. Sabuncu 181 6 0 17 Aug 2020
To Bag is to Prune Philippe Goulet Coulombe UQCV 262 9 0 17 Aug 2020
The Neural Tangent Kernel in High Dimensions: Triple Descent and a Multi-Scale Theory of Generalization Ben Adlam Jeffrey Pennington 174 129 0 15 Aug 2020
Small Towers Make Big Differences Yuyan Wang Zhe Zhao Bo Dai Christopher Fifty Dong Lin Lichan Hong Ed H. Chi 166 10 0 13 Aug 2020
The Slow Deterioration of the Generalization Error of the Random Feature ModelMathematical and Scientific Machine Learning (MSML), 2020 Chao Ma Lei Wu E. Weinan 124 16 0 13 Aug 2020
Benign Overfitting and Noisy Features Zhu Li Weijie Su Dino Sejdinovic 192 25 0 06 Aug 2020
Making Coherence Out of Nothing At All: Measuring the Evolution of Gradient Alignment S. Chatterjee Piotr Zielinski 121 9 0 03 Aug 2020
Implicit Regularization via Neural Feature Alignment A. Baratin Thomas George César Laurent R. Devon Hjelm Guillaume Lajoie Pascal Vincent Damien Scieur 116 7 0 03 Aug 2020
Diet deep generative audio models with structured lottery P. Esling Ninon Devis Adrien Bitton Antoine Caillon Axel Chemla-Romeu-Santos Constance Douwes 187 6 0 31 Jul 2020
Finite Versus Infinite Neural Networks: an Empirical StudyNeural Information Processing Systems (NeurIPS), 2020 Jaehoon Lee S. Schoenholz Jeffrey Pennington Ben Adlam Lechao Xiao Roman Novak Jascha Narain Sohl-Dickstein 228 226 0 31 Jul 2020
Compressing Deep Neural Networks via Layer Fusion James OÑeill Greg Ver Steeg Aram Galstyan AI4CE 76 6 0 29 Jul 2020
A finite sample analysis of the benign overfitting phenomenon for ridge function estimation E. Caron Stéphane Chrétien MLT 221 6 0 25 Jul 2020
The Interpolation Phase Transition in Neural Networks: Memorization and Generalization under Lazy TrainingAnnals of Statistics (Ann. Stat.), 2020 Andrea Montanari Yiqiao Zhong 346 101 0 25 Jul 2020
Activation function dependence of the storage capacity of treelike neural networks Jacob A. Zavatone-Veth Cengiz Pehlevan 189 15 0 21 Jul 2020
Early Stopping in Deep Networks: Double Descent and How to Eliminate it Reinhard Heckel Fatih Yilmaz 211 54 0 20 Jul 2020
Prediction in latent factor regression: Adaptive PCR and beyond Xin Bing F. Bunea Seth Strimas-Mackey M. Wegkamp 223 2 0 20 Jul 2020
Large scale analysis of generalization error in learning using margin based classification methodsJournal of Statistical Mechanics: Theory and Experiment (JSTAT), 2020 Hanwen Huang Qinglong Yang 132 9 0 16 Jul 2020
On Power Laws in Deep EnsemblesNeural Information Processing Systems (NeurIPS), 2020 E. Lobacheva Nadezhda Chirkova M. Kodryan Dmitry Vetrov UQCV 240 46 0 16 Jul 2020
Data-driven effective model shows a liquid-like deep learningPhysical Review Research (PRResearch), 2020 Wenxuan Zou Haiping Huang 199 2 0 16 Jul 2020
The Computational Limits of Deep Learning Neil C. Thompson Kristjan Greenewald Keeheon Lee Gabriel F. Manso VLM 281 622 0 10 Jul 2020
Maximum-and-Concatenation NetworksInternational Conference on Machine Learning (ICML), 2020 Xingyu Xie Hao Kong Yue Yu Wayne Zhang Guangcan Liu Zhouchen Lin 244 2 0 09 Jul 2020
The curious case of developmental BERTology: On sparsity, transfer learning, generalization and the brain Xin Wang 88 1 0 07 Jul 2020
Bespoke vs. Prêt-à-Porter Lottery Tickets: Exploiting Mask Similarity for Trainable Sub-Network Finding Michela Paganini Jessica Zosa Forde UQCV 112 6 0 06 Jul 2020
For interpolating kernel machines, minimizing the norm of the ERM solution minimizes stability Akshay Rangamani Lorenzo Rosasco T. Poggio 134 0 0 28 Jun 2020
Bidirectional compression in heterogeneous settings for distributed or federated learning with partial participation: tight convergence guarantees Constantin Philippenko Hadrien Hendrikx FedML 320 54 0 25 Jun 2020
The Quenching-Activation Behavior of the Gradient Descent Dynamics for Two-layer Neural Network Models Chao Ma Lei Wu E. Weinan MLT 167 11 0 25 Jun 2020