Implicit Regularization and Momentum Algorithms in Nonlinearly Parameterized Adaptive Control and Prediction

31 December 2019

Papers citing "Implicit Regularization and Momentum Algorithms in Nonlinearly Parameterized Adaptive Control and Prediction"

29 / 29 papers shown

Title
Learning Stability Certificates from Data Nicholas M. Boffi Stephen Tu Nikolai Matni Jean-Jacques E. Slotine Vikas Sindhwani 20 94 0 13 Aug 2020
Learning nonlinear dynamical systems from a single trajectory Dylan J. Foster Alexander Rakhlin Tuhin Sarkar 29 73 0 30 Apr 2020
Optimization with Momentum: Dynamical, Control-Theoretic, and Symplectic Perspectives Michael Muehlebach Michael I. Jordan 28 64 0 28 Feb 2020
Symplectic Recurrent Neural Networks Zhengdao Chen Jianyu Zhang Martín Arjovsky Léon Bottou 186 223 0 29 Sep 2019
Introduction to Online Convex Optimization Elad Hazan OffRL 90 1,922 0 07 Sep 2019
Benign Overfitting in Linear Regression Peter L. Bartlett Philip M. Long Gábor Lugosi Alexander Tsigler MLT 55 769 0 26 Jun 2019
Stochastic Mirror Descent on Overparameterized Nonlinear Models: Convergence, Implicit Regularization, and Generalization Navid Azizan Sahin Lale B. Hassibi 121 71 0 10 Jun 2019
Generalized Momentum-Based Methods: A Hamiltonian Perspective Jelena Diakonikolas Michael I. Jordan 29 57 0 02 Jun 2019
A Dynamical Systems Perspective on Nesterov Acceleration Michael Muehlebach Michael I. Jordan 43 120 0 17 May 2019
Harmless interpolation of noisy data in regression Vidya Muthukumar Kailas Vodrahalli Vignesh Subramanian A. Sahai 47 204 0 21 Mar 2019
Conformal Symplectic and Relativistic Optimization G. Francca Jeremias Sulam Daniel P. Robinson René Vidal 23 69 0 11 Mar 2019
Acceleration via Symplectic Discretization of High-Resolution Differential Equations Bin Shi S. Du Weijie J. Su Michael I. Jordan 26 121 0 11 Feb 2019
Reconciling modern machine learning practice and the bias-variance trade-off M. Belkin Daniel J. Hsu Siyuan Ma Soumik Mandal 172 1,628 0 28 Dec 2018
A continuous-time analysis of distributed stochastic gradient Nicholas M. Boffi Jean-Jacques E. Slotine 36 15 0 28 Dec 2018
The Sparse Manifold Transform Yubei Chen Dylan M. Paiton Bruno A. Olshausen MedIm 24 57 0 23 Jun 2018
Stochastic Gradient/Mirror Descent: Minimax Optimality and Implicit Regularization Navid Azizan B. Hassibi 32 62 0 04 Jun 2018
Implicit Bias of Gradient Descent on Linear Convolutional Networks Suriya Gunasekar Jason D. Lee Daniel Soudry Nathan Srebro MDE 52 408 0 01 Jun 2018
Characterizing Implicit Bias in Terms of Optimization Geometry Suriya Gunasekar Jason D. Lee Daniel Soudry Nathan Srebro AI4CE 60 404 0 22 Feb 2018
Iterate averaging as regularization for stochastic gradient descent Gergely Neu Lorenzo Rosasco MoMe 66 61 0 22 Feb 2018
Learning One Convolutional Layer with Overlapping Patches Surbhi Goel Adam R. Klivans Raghu Meka MLT 56 80 0 07 Feb 2018
The Implicit Bias of Gradient Descent on Separable Data Daniel Soudry Elad Hoffer Mor Shpigel Nacson Suriya Gunasekar Nathan Srebro 64 908 0 27 Oct 2017
Cooperative Adaptive Control for Cloud-Based Robotics Patrick M. Wensing Jean-Jacques E. Slotine 36 18 0 21 Sep 2017
Predicting non-linear dynamics by stable local learning in a recurrent spiking neural network Aditya Gilra W. Gerstner 25 79 0 21 Feb 2017
Linear Matrix Inequalities for Physically-Consistent Inertial Parameter Identification: A Statistical Perspective on the Mass Distribution Patrick M. Wensing Sangbae Kim Jean-Jacques E. Slotine 24 121 0 16 Jan 2017
Understanding deep learning requires rethinking generalization Chiyuan Zhang Samy Bengio Moritz Hardt Benjamin Recht Oriol Vinyals HAI 264 4,620 0 10 Nov 2016
A Variational Perspective on Accelerated Methods in Optimization Andre Wibisono Ashia Wilson Michael I. Jordan 80 572 0 14 Mar 2016
A Differential Equation for Modeling Nesterov's Accelerated Gradient Method: Theory and Insights Weijie Su Stephen P. Boyd Emmanuel J. Candes 149 1,161 0 04 Mar 2015
Deep learning with Elastic Averaging SGD Sixin Zhang A. Choromańska Yann LeCun FedML 53 609 0 20 Dec 2014
Efficient Learning of Generalized Linear and Single Index Models with Isotonic Regression Sham Kakade Adam Tauman Kalai Varun Kanade Ohad Shamir 120 180 0 11 Apr 2011