v1v2v3v4 (latest)

Online stochastic gradient descent on non-convex losses from high-dimensional inference

23 March 2020

Papers citing "Online stochastic gradient descent on non-convex losses from high-dimensional inference"

25 / 25 papers shown

Title
Generalization Bound of Gradient Flow through Training Trajectory and Data-dependent Kernel Yilan Chen Zhichao Wang Wei Huang Andi Han Taiji Suzuki Arya Mazumdar MLT 15 0 0 12 Jun 2025
The Generative Leap: Sharp Sample Complexity for Efficiently Learning Gaussian Multi-Index Models Alex Damian Jason D. Lee Joan Bruna 40 1 0 05 Jun 2025
Asymptotics of SGD in Sequence-Single Index Models and Single-Layer Attention Networks Luca Arnaboldi Bruno Loureiro Ludovic Stephan Florent Krzakala Lenka Zdeborová 53 0 0 03 Jun 2025
Survey on Algorithms for multi-index models Joan Bruna Daniel Hsu 103 3 0 07 Apr 2025
Feature learning from non-Gaussian inputs: the case of Independent Component Analysis in high dimensions Fabiola Ricci Lorenzo Bardone Sebastian Goldt OOD 207 0 0 31 Mar 2025
Provable Benefits of Unsupervised Pre-training and Transfer Learning via Single-Index Models Taj Jones-McCormick Aukosh Jagannath S. Sen 119 0 0 24 Feb 2025
A distributional simplicity bias in the learning dynamics of transformers Riccardo Rende Federica Gerace Alessandro Laio Sebastian Goldt 127 9 0 17 Feb 2025
Low-dimensional Functions are Efficiently Learnable under Randomly Biased Distributions Elisabetta Cornacchia Dan Mikulincer Elchanan Mossel 138 1 0 10 Feb 2025
Spectral Estimators for Multi-Index Models: Precise Asymptotics and Optimal Weak Recovery Filip Kovačević Yihan Zhang Marco Mondelli 110 3 0 03 Feb 2025
Learning Gaussian Multi-Index Models with Gradient Flow: Time Complexity and Directional Convergence Berfin Simsek Amire Bendjeddou Daniel Hsu 183 3 0 13 Nov 2024
Robust Feature Learning for Multi-Index Models in High Dimensions Alireza Mousavi-Hosseini Adel Javanmard Murat A. Erdogdu OOD AAML 170 1 0 21 Oct 2024
Learning Multi-Index Models with Neural Networks via Mean-Field Langevin Dynamics Alireza Mousavi-Hosseini Denny Wu Murat A. Erdogdu MLT AI4CE 99 8 0 14 Aug 2024
Repetita Iuvant: Data Repetition Allows SGD to Learn High-Dimensional Multi-Index Functions Luca Arnaboldi Yatin Dandi Florent Krzakala Luca Pesce Ludovic Stephan 128 18 0 24 May 2024
Six Lectures on Linearized Neural Networks Theodor Misiakiewicz Andrea Montanari 134 13 0 25 Aug 2023
How Two-Layer Neural Networks Learn, One (Giant) Step at a Time Yatin Dandi Florent Krzakala Bruno Loureiro Luca Pesce Ludovic Stephan MLT 122 29 0 29 May 2023
Provable Guarantees for Nonlinear Feature Learning in Three-Layer Neural Networks Eshaan Nichani Alexandru Damian Jason D. Lee MLT 201 15 0 11 May 2023
Learning time-scales in two-layers neural networks Raphael Berthier Andrea Montanari Kangjie Zhou 196 38 0 28 Feb 2023
Statistical Inference for Linear Functionals of Online SGD in High-dimensional Linear Regression Bhavya Agrawalla Krishnakumar Balasubramanian Promit Ghosal 107 2 0 20 Feb 2023
Learning Single-Index Models with Shallow Neural Networks A. Bietti Joan Bruna Clayton Sanford M. Song 225 71 0 27 Oct 2022
Rigorous dynamical mean field theory for stochastic gradient descent methods Cédric Gerbelot Emanuele Troiani Francesca Mignacco Florent Krzakala Lenka Zdeborova 114 29 0 12 Oct 2022
On free energy barriers in Gaussian priors and failure of cold start MCMC for high-dimensional unimodal distributions Afonso S. Bandeira Antoine Maillard Richard Nickl Sven Wang 83 10 0 05 Sep 2022
Hidden Progress in Deep Learning: SGD Learns Parities Near the Computational Limit Boaz Barak Benjamin L. Edelman Surbhi Goel Sham Kakade Eran Malach Cyril Zhang 114 133 0 18 Jul 2022
High-dimensional limit theorems for SGD: Effective dynamics and critical scaling Gerard Ben Arous Reza Gheissari Aukosh Jagannath 131 59 0 08 Jun 2022
High-dimensional Asymptotics of Langevin Dynamics in Spiked Matrix Models Tengyuan Liang Subhabrata Sen Pragya Sur 81 7 0 09 Apr 2022
On the Cryptographic Hardness of Learning Single Periodic Neurons M. Song Ilias Zadik Joan Bruna AAML 68 28 0 20 Jun 2021