The loss surface of deep linear networks viewed through the algebraic geometry lens

17 October 2018

Papers citing "The loss surface of deep linear networks viewed through the algebraic geometry lens"

10 / 10 papers shown

Title
Function Space and Critical Points of Linear Convolutional Networks Kathlén Kohn Guido Montúfar V. Shahverdi Matthew Trager 21 11 0 12 Apr 2023
Complex Critical Points of Deep Linear Neural Networks Ayush Bharadwaj Serkan Hosten 17 1 0 30 Jan 2023
Neural Collapse: A Review on Modelling Principles and Generalization Vignesh Kothapalli 21 71 0 08 Jun 2022
Exact Solutions of a Deep Linear Network Liu Ziyin Botao Li Xiangmin Meng ODL 19 21 0 10 Feb 2022
The loss landscape of deep linear neural networks: a second-order analysis E. M. Achour Franccois Malgouyres Sébastien Gerchinovitz ODL 24 9 0 28 Jul 2021
Critical Point-Finding Methods Reveal Gradient-Flat Regions of Deep Network Losses Charles G. Frye James B. Simon Neha S. Wadia A. Ligeralde M. DeWeese K. Bouchard ODL 16 2 0 23 Mar 2020
First-order Methods Almost Always Avoid Saddle Points J. Lee Ioannis Panageas Georgios Piliouras Max Simchowitz Michael I. Jordan Benjamin Recht ODL 93 82 0 20 Oct 2017
Global optimality conditions for deep neural networks Chulhee Yun S. Sra Ali Jadbabaie 125 117 0 08 Jul 2017
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 284 2,889 0 15 Sep 2016
The Loss Surfaces of Multilayer Networks A. Choromańska Mikael Henaff Michaël Mathieu Gerard Ben Arous Yann LeCun ODL 179 1,185 0 30 Nov 2014