v1v2v3v4 (latest)

The Hidden Convex Optimization Landscape of Two-Layer ReLU Neural Networks: an Exact Characterization of the Optimal Solutions

10 June 2020

Papers citing "The Hidden Convex Optimization Landscape of Two-Layer ReLU Neural Networks: an Exact Characterization of the Optimal Solutions"

20 / 20 papers shown

Title
Spring-block theory of feature learning in deep neural networks Chengzhi Shi Liming Pan Ivan Dokmanić AI4CE 132 1 0 28 Jul 2024
The Real Tropical Geometry of Neural Networks Marie-Charlotte Brandenburg Georg Loho Guido Montúfar 119 8 0 18 Mar 2024
Loss Landscape of Shallow ReLU-like Neural Networks: Stationary Points, Saddle Escape, and Network Embedding Zhengqing Wu Berfin Simsek Francois Ged ODL 121 0 0 08 Feb 2024
Convex Relaxations of ReLU Neural Networks Approximate Global Optima in Polynomial Time Sungyoon Kim Mert Pilanci 191 4 0 06 Feb 2024
The Convex Landscape of Neural Networks: Characterizing Global Optima and Stationary Points via Lasso Models Tolga Ergen Mert Pilanci 56 2 0 19 Dec 2023
A qualitative difference between gradient flows of convex functions in finite- and infinite-dimensional Hilbert spaces Jonathan W. Siegel Stephan Wojtowytsch 51 3 0 26 Oct 2023
From Complexity to Clarity: Analytical Expressions of Deep Neural Network Weights via Clifford's Geometric Algebra and Convexity Mert Pilanci 74 2 0 28 Sep 2023
Fixing the NTK: From Neural Network Linearizations to Exact Convex Programs Rajat Vadiraj Dwaraknath Tolga Ergen Mert Pilanci 140 0 0 26 Sep 2023
Test-Time Training on Video Streams Renhao Wang Yu Sun Yossi Gandelsman Xinlei Chen Alexei A. Efros Alexei A. Efros Xiaolong Wang TTA ViT 3DGS 134 21 0 11 Jul 2023
On the Global Convergence of Natural Actor-Critic with Two-layer Neural Network Parametrization Mudit Gaur Amrit Singh Bedi Di-di Wang Vaneet Aggarwal 84 3 0 18 Jun 2023
Optimal Sets and Solution Paths of ReLU Networks Aaron Mishkin Mert Pilanci 122 4 0 31 May 2023
Mildly Overparameterized ReLU Networks Have a Favorable Loss Landscape Kedar Karhadkar Michael Murray Hanna Tseran Guido Montúfar 53 8 0 31 May 2023
Penalising the biases in norm regularisation enforces sparsity Etienne Boursier Nicolas Flammarion 127 17 0 02 Mar 2023
On the Global Convergence of Fitted Q-Iteration with Two-layer Neural Network Parametrization Mudit Gaur Vaneet Aggarwal Mridul Agarwal MLT 105 1 0 14 Nov 2022
PathProx: A Proximal Gradient Algorithm for Weight Decay Regularized Deep Neural Networks Liu Yang Jifan Zhang Joseph Shenouda Dimitris Papailiopoulos Kangwook Lee Robert D. Nowak 145 1 0 06 Oct 2022
A Combinatorial Perspective on the Optimization of Shallow ReLU Networks Michael Matena Colin Raffel 30 1 0 01 Oct 2022
Unraveling Attention via Convex Duality: Analysis and Interpretations of Vision Transformers Arda Sahiner Tolga Ergen Batu Mehmet Ozturkler John M. Pauly Morteza Mardani Mert Pilanci 129 33 0 17 May 2022
Fast Convex Optimization for Two-Layer ReLU Networks: Equivalent Model Classes and Cone Decompositions Aaron Mishkin Arda Sahiner Mert Pilanci OffRL 183 30 0 02 Feb 2022
Nonasymptotic theory for two-layer neural networks: Beyond the bias-variance trade-off Huiyuan Wang Wei Lin MLT 41 4 0 09 Jun 2021
Practical Convex Formulation of Robust One-hidden-layer Neural Network Training Yatong Bai Tanmay Gautam Yujie Gai Somayeh Sojoudi AAML 91 3 0 25 May 2021