The loss landscape of deep linear neural networks: a second-order
analysis

The loss landscape of deep linear neural networks: a second-order analysis

28 July 2021

Franccois Malgouyres

Sébastien Gerchinovitz

Papers citing "The loss landscape of deep linear neural networks: a second-order analysis"

10 / 10 papers shown

Title
A new Input Convex Neural Network with application to options pricing Vincent Lemaire Gilles Pagès Christian Yeo 59 0 0 19 Nov 2024
Geometry of Critical Sets and Existence of Saddle Branches for Two-layer Neural Networks Leyang Zhang Yao Zhang Tao Luo 28 0 0 26 May 2024
How do Transformers perform In-Context Autoregressive Learning? Michael E. Sander Raja Giryes Taiji Suzuki Mathieu Blondel Gabriel Peyré 21 7 0 08 Feb 2024
Weight fluctuations in (deep) linear neural networks and a derivation of the inverse-variance flatness relation Markus Gross A. Raulf Christoph Räth 19 0 0 23 Nov 2023
$Geometric structure of Deep Learning networks and construction of global ${\mathcal L}^2$ minimizers$ Geometric structure of Deep Learning networks and construction of global ${\mathcal L}^2$ minimizers Thomas Chen Patrícia Muñoz Ewald 26 4 0 19 Sep 2023
$Geometric structure of shallow neural networks and constructive ${\mathcal L}^2$ cost minimization$ Geometric structure of shallow neural networks and constructive ${\mathcal L}^2$ cost minimization Thomas Chen Patrícia Muñoz Ewald 11 2 0 19 Sep 2023
A Dynamics Theory of Implicit Regularization in Deep Low-Rank Matrix Factorization JIAN-PENG Cao Chao Qian Yihui Huang Dicheng Chen Yuncheng Gao Jiyang Dong D. Guo X. Qu 12 1 0 29 Dec 2022
Deep Linear Networks can Benignly Overfit when Shallow Ones Do Niladri S. Chatterji Philip M. Long 13 8 0 19 Sep 2022
Global optimality conditions for deep neural networks Chulhee Yun S. Sra Ali Jadbabaie 116 117 0 08 Jul 2017
The Loss Surfaces of Multilayer Networks A. Choromańska Mikael Henaff Michaël Mathieu Gerard Ben Arous Yann LeCun ODL 175 1,184 0 30 Nov 2014