v1v2 (latest)

Reconciling modern machine learning practice and the bias-variance trade-off

28 December 2018

Papers citing "Reconciling modern machine learning practice and the bias-variance trade-off"

50 / 942 papers shown

Title
Low-Pass Filtering SGD for Recovering Flat Optima in the Deep Learning Optimization LandscapeInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2022 Devansh Bisla Jing Wang A. Choromańska 279 45 0 20 Jan 2022
Towards Sample-efficient Overparameterized Meta-learningNeural Information Processing Systems (NeurIPS), 2022 Yue Sun Adhyyan Narang Halil Ibrahim Gulluk Samet Oymak Maryam Fazel BDL 144 25 0 16 Jan 2022
Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextJournal of Scientific Computing (J. Sci. Comput.), 2022 S. Cuomo Vincenzo Schiano Di Cola F. Giampaolo G. Rozza Maizar Raissi F. Piccialli PINN 406 1,785 0 14 Jan 2022
Agent-Temporal Attention for Reward Redistribution in Episodic Multi-Agent Reinforcement LearningAdaptive Agents and Multi-Agent Systems (AAMAS), 2022 Baicen Xiao Bhaskar Ramasubramanian Radha Poovendran 161 8 0 12 Jan 2022
On generalization bounds for deep networks based on loss surface implicit regularizationIEEE Transactions on Information Theory (IEEE Trans. Inf. Theory), 2022 Masaaki Imaizumi Johannes Schmidt-Hieber ODL 310 4 0 12 Jan 2022
Complexity from Adaptive-Symmetries Breaking: Global Minima in the Statistical Mechanics of Deep Neural Networks Shaun Li AI4CE 214 1 0 03 Jan 2022
Benign Overfitting in Adversarially Robust Linear ClassificationConference on Uncertainty in Artificial Intelligence (UAI), 2021 Jinghui Chen Yuan Cao Quanquan Gu AAML SILM 186 11 0 31 Dec 2021
Recur, Attend or Convolve? On Whether Temporal Modeling Matters for Cross-Domain Robustness in Action RecognitionIEEE Workshop/Winter Conference on Applications of Computer Vision (WACV), 2021 Sofia Broomé Ernest Pokropek Boyu Li Hedvig Kjellström 205 8 0 22 Dec 2021
Manifold embedding data-driven mechanicsJournal of the mechanics and physics of solids (JMPS), 2021 B. Bahmani WaiChing Sun PINN AI4CE 136 11 0 18 Dec 2021
Approximation of functions with one-bit neural networks C. S. Güntürk Weilin Li 166 10 0 16 Dec 2021
Representation Alignment in Neural Networks Ehsan Imani Wei Hu Martha White 177 6 0 15 Dec 2021
SCORE: Approximating Curvature Information under Self-Concordant Regularization Adeyemi Damilare Adeoye Alberto Bemporad 146 4 0 14 Dec 2021
Programming with Neural Surrogates of Programs Alex Renda Yi Ding Michael Carbin 112 6 0 12 Dec 2021
Global convergence of ResNets: From finite to infinite width using linear parameterization Raphael Barboni Gabriel Peyré Franccois-Xavier Vialard 212 12 0 10 Dec 2021
Optimistic Rates: A Unifying Theory for Interpolation Learning and Regularization in Linear Regression Lijia Zhou Frederic Koehler Danica J. Sutherland Nathan Srebro 254 28 0 08 Dec 2021
Extrapolation Frameworks in Cognitive Psychology Suitable for Study of Image Classification Models Roozbeh Yousefzadeh J. Mollick 138 6 0 06 Dec 2021
Multi-scale Feature Learning Dynamics: Insights for Double DescentInternational Conference on Machine Learning (ICML), 2021 Mohammad Pezeshki Amartya Mitra Yoshua Bengio Guillaume Lajoie 187 30 0 06 Dec 2021
On the Convergence of Shallow Neural Network Training with Randomly Masked Neurons Fangshuo Liao Anastasios Kyrillidis 299 16 0 05 Dec 2021
Pixelated Butterfly: Simple and Efficient Sparse training for Neural Network Models Tri Dao Beidi Chen Kaizhao Liang Jiaming Yang Zhao Song Atri Rudra Christopher Ré 376 90 0 30 Nov 2021
Leveraging The Topological Consistencies of Learning in Deep Neural Networks Stuart Synakowski Fabian Benitez-Quiroz Aleix M. Martinez 95 0 0 30 Nov 2021
Approximate Spectral Decomposition of Fisher Information Matrix for Simple ReLU Networks Yoshinari Takeishi Masazumi Iida Junichi Takeuchi 274 7 0 30 Nov 2021
Generalization Performance of Empirical Risk Minimization on Over-parameterized Deep ReLU NetsIEEE Transactions on Information Theory (IEEE Trans. Inf. Theory), 2021 Shao-Bo Lin Yao Wang Ding-Xuan Zhou ODL 292 5 0 28 Nov 2021
Learning from learning machines: a new generation of AI technology to meet the needs of science L. Pion-Tonachini K. Bouchard Héctor García Martín S. Peisert W. B. Holtz ... Rick L. Stevens Mark Anderson Ken Kreutz-Delgado Michael W. Mahoney James B. Brown 207 9 0 27 Nov 2021
$μ$ NCA: Texture Generation with Ultra-Compact Neural Cellular Automata A. Mordvintsev Eyvind Niklasson 90 15 0 26 Nov 2021
Plant ñ' Seek: Can You Find the Winning Ticket?International Conference on Learning Representations (ICLR), 2021 Jonas Fischer R. Burkholz 138 21 0 22 Nov 2021
On the Existence of Universal Lottery TicketsInternational Conference on Learning Representations (ICLR), 2021 R. Burkholz Nilanjana Laha Rajarshi Mukherjee Alkis Gotovos UQCV 158 33 0 22 Nov 2021
Bayesian Learning via Neural Schrödinger-Föllmer FlowsStatistics and computing (Stat Comput), 2021 Francisco Vargas Andrius Ovsianas David Fernandes Mark Girolami Neil D. Lawrence Nikolas Nusken BDL 743 57 0 20 Nov 2021
Tight bounds for minimum l1-norm interpolation of noisy data Guillaume Wang Konstantin Donhauser Fanny Yang 296 20 0 10 Nov 2021
Harmless interpolation in regression and classification with structured featuresInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2021 Andrew D. McRae Santhosh Karnik Mark A. Davenport Vidya Muthukumar 306 15 0 09 Nov 2021
There is no Double-Descent in Random Forests Sebastian Buschjäger K. Morik 122 8 0 08 Nov 2021
Mean-field Analysis of Piecewise Linear Solutions for Wide ReLU NetworksJournal of machine learning research (JMLR), 2021 Aleksandr Shevchenko Vyacheslav Kungurtsev Marco Mondelli MLT 262 15 0 03 Nov 2021
Tractability from overparametrization: The example of the negative perceptronProbability theory and related fields (PTRF), 2021 Andrea Montanari Yiqiao Zhong Kangjie Zhou 132 18 0 28 Oct 2021
Model, sample, and epoch-wise descents: exact solution of gradient flow in the random feature modelNeural Information Processing Systems (NeurIPS), 2021 A. Bodin N. Macris 241 14 0 22 Oct 2021
Conditioning of Random Feature Matrices: Double Descent and Generalization Error Zhijun Chen Hayden Schaeffer 263 13 0 21 Oct 2021
On Optimal Interpolation In Linear RegressionNeural Information Processing Systems (NeurIPS), 2021 Eduard Oravkin Patrick Rebeschini 94 4 0 21 Oct 2021
Data splitting improves statistical performance in overparametrized regimesInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2021 Nicole Mücke Enrico Reiss Jonas Rungenhagen Markus Klein 171 8 0 21 Oct 2021
Behavioral Experiments for Understanding Catastrophic Forgetting Samuel J. Bell Neil D. Lawrence 204 4 0 20 Oct 2021
A-Optimal Active Learning Tue Boesen E. Haber 90 0 0 18 Oct 2021
Single Layer Predictive Normalized Maximum Likelihood for Out-of-Distribution Detection Koby Bibas M. Feder Tal Hassner OODD 131 27 0 18 Oct 2021
On the Double Descent of Random Features Models Trained with SGD Fanghui Liu Johan A. K. Suykens Volkan Cevher MLT 415 11 0 13 Oct 2021
The Role of Permutation Invariance in Linear Mode Connectivity of Neural NetworksInternational Conference on Learning Representations (ICLR), 2021 R. Entezari Hanie Sedghi O. Saukh Behnam Neyshabur MoMe 533 270 0 12 Oct 2021
NFT-K: Non-Fungible Tangent KernelsIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2021 Sina Alemohammad Hossein Babaei C. Barberan Naiming Liu Lorenzo Luzi Blake Mason Richard G. Baraniuk AAML 91 0 0 11 Oct 2021
The Eigenlearning Framework: A Conservation Law Perspective on Kernel Regression and Wide Neural Networks James B. Simon Madeline Dickens Dhruva Karkada M. DeWeese 422 28 0 08 Oct 2021
On the Optimal Memorization Power of ReLU Neural Networks Gal Vardi Gilad Yehudai Ohad Shamir 157 38 0 07 Oct 2021
Label Noise in Adversarial Training: A Novel Perspective to Study Robust Overfitting Chengyu Dong Liyuan Liu Jingbo Shang NoLa AAML 326 26 0 07 Oct 2021
On the Generalization of Models Trained with SGD: Information-Theoretic Bounds and Implications Ziqiao Wang Yongyi Mao FedML MLT 256 32 0 07 Oct 2021
Foolish Crowds Support Benign Overfitting Niladri S. Chatterji Philip M. Long 270 23 0 06 Oct 2021
Trustworthy AI: From Principles to Practices Yue Liu Peng Qi Bo Liu Shuai Di Jingen Liu Jiquan Pei Jinfeng Yi Bowen Zhou 371 499 0 04 Oct 2021
Learning through atypical "phase transitions" in overparameterized neural networks Carlo Baldassi Clarissa Lauditi Enrico M. Malatesta R. Pacelli Gabriele Perugini R. Zecchina 276 31 0 01 Oct 2021
Powerpropagation: A sparsity inducing weight reparameterisation Jonathan Richard Schwarz Siddhant M. Jayakumar Razvan Pascanu P. Latham Yee Whye Teh 337 57 0 01 Oct 2021