Shallow Univariate ReLu Networks as Splines: Initialization, Loss Surface, Hessian, & Gradient Flow Dynamics

4 August 2020

Papers citing "Shallow Univariate ReLu Networks as Splines: Initialization, Loss Surface, Hessian, & Gradient Flow Dynamics"

7 / 7 papers shown

Title
On the Geometry of Deep Learning Randall Balestriero Ahmed Imtiaz Humayun Richard G. Baraniuk AI4CE 39 1 0 09 Aug 2024
Equidistribution-based training of Free Knot Splines and ReLU Neural Networks Simone Appella S. Arridge Chris Budd Teo Deveney L. Kreusser 33 0 0 02 Jul 2024
Loss Landscape of Shallow ReLU-like Neural Networks: Stationary Points, Saddle Escape, and Network Embedding Zhengqing Wu Berfin Simsek Francois Ged ODL 40 0 0 08 Feb 2024
On the Effective Number of Linear Regions in Shallow Univariate ReLU Networks: Convergence Guarantees and Implicit Bias Itay Safran Gal Vardi Jason D. Lee MLT 51 23 0 18 May 2022
Mean-field Analysis of Piecewise Linear Solutions for Wide ReLU Networks A. Shevchenko Vyacheslav Kungurtsev Marco Mondelli MLT 36 13 0 03 Nov 2021
Neural Mechanics: Symmetry and Broken Conservation Laws in Deep Learning Dynamics D. Kunin Javier Sagastuy-Breña Surya Ganguli Daniel L. K. Yamins Hidenori Tanaka 99 77 0 08 Dec 2020
Inverse Problems, Deep Learning, and Symmetry Breaking Kshitij Tayal Chieh-Hsin Lai Vipin Kumar Ju Sun AI4CE 72 15 0 20 Mar 2020