Empirical Tests of Optimization Assumptions in Deep Learning

1 July 2024

Papers citing "Empirical Tests of Optimization Assumptions in Deep Learning"

5 / 5 papers shown

Title
Loss Landscape Characterization of Neural Networks without Over-Parametrization Rustem Islamov Niccolò Ajroldi Antonio Orvieto Aurélien Lucchi 33 4 0 16 Oct 2024
Understanding Adam Optimizer via Online Learning of Updates: Adam is FTRL in Disguise Kwangjun Ahn Zhiyu Zhang Yunbum Kook Yan Dai 37 11 0 02 Feb 2024
$On the Convergence of AdaGrad(Norm) on $\R^{d}$: Beyond Convexity, Non-Asymptotic Rate and Acceleration$ On the Convergence of AdaGrad(Norm) on $\R^{d}$ : Beyond Convexity, Non-Asymptotic Rate and Acceleration Zijian Liu Ta Duy Nguyen Alina Ene Huy Le Nguyen 36 7 0 29 Sep 2022
The Pile: An 800GB Dataset of Diverse Text for Language Modeling Leo Gao Stella Biderman Sid Black Laurence Golding Travis Hoppe ... Horace He Anish Thite Noa Nabeshima Shawn Presser Connor Leahy AIMat 248 1,986 0 31 Dec 2020
The Loss Surfaces of Multilayer Networks A. Choromańska Mikael Henaff Michaël Mathieu Gerard Ben Arous Yann LeCun ODL 175 1,184 0 30 Nov 2014