Optimization and Generalization of Shallow Neural Networks with
Quadratic Activation Functions

v1v2v3 (latest)

Optimization and Generalization of Shallow Neural Networks with Quadratic Activation Functions

27 June 2020

Stefano Sarao Mannelli

Eric Vanden-Eijnden

Lenka Zdeborová

ArXiv (abs)PDF HTML

Papers citing "Optimization and Generalization of Shallow Neural Networks with Quadratic Activation Functions"

18 / 18 papers shown

Title
Enhancing Expressivity of Quantum Neural Networks Based on the SWAP test Sebastian Nagies Emiliano Tolotti D. Pastorello Enrico Blanzieri 12 0 0 20 Jun 2025
Statistical mechanics of extensive-width Bayesian neural networks near interpolation Jean Barbier Francesco Camilli Minh-Toan Nguyen Mauro Pastore Rudy Skerk 33 0 0 30 May 2025
Curse of Dimensionality in Neural Network Optimization Sanghoon Na Haizhao Yang 84 0 0 07 Feb 2025
Information-Theoretic Guarantees for Recovering Low-Rank Tensors from Symmetric Rank-One Measurements Eren C. Kızıldağ 118 0 0 07 Feb 2025
Geometry and Optimization of Shallow Polynomial Networks Yossi Arjevani Joan Bruna Joe Kileel Elzbieta Polak Matthew Trager 86 3 0 10 Jan 2025
$Geometric structure of Deep Learning networks and construction of global ${\mathcal L}^2$ minimizers$ Geometric structure of Deep Learning networks and construction of global ${\mathcal L}^2$ minimizers Thomas Chen Patrícia Muñoz Ewald 73 4 0 19 Sep 2023
Sampling with flows, diffusion and autoregressive neural networks: A spin-glass perspective Davide Ghio Yatin Dandi Florent Krzakala Lenka Zdeborová DiffM 67 29 0 27 Aug 2023
Embeddings between Barron spaces with higher order activation functions T. J. Heeringa L. Spek Felix L. Schwenninger C. Brune 77 3 0 25 May 2023
SQ-Swin: a Pretrained Siamese Quadratic Swin Transformer for Lettuce Browning Prediction Dayang Wang Boce Zhang Yongshun Xu Yaguang Luo Hengyong Yu ViT 89 1 0 16 Sep 2022
On Feature Learning in Neural Networks with Global Convergence Guarantees Zhengdao Chen Eric Vanden-Eijnden Joan Bruna MLT 90 13 0 22 Apr 2022
Separation of Scales and a Thermodynamic Description of Feature Learning in Some CNNs Inbar Seroussi Gadi Naveh Zohar Ringel 95 55 0 31 Dec 2021
Analytic Study of Families of Spurious Minima in Two-Layer ReLU Neural Networks: A Tale of Symmetry II Yossi Arjevani M. Field 70 19 0 21 Jul 2021
The Limiting Dynamics of SGD: Modified Loss, Phase Space Oscillations, and Anomalous Diffusion D. Kunin Javier Sagastuy-Breña Lauren Gillespie Eshed Margalit Hidenori Tanaka Surya Ganguli Daniel L. K. Yamins 93 20 0 19 Jul 2021
A self consistent theory of Gaussian Processes captures feature learning effects in finite CNNs Gadi Naveh Zohar Ringel SSL MLT 91 33 0 08 Jun 2021
Noether: The More Things Change, the More Stay the Same Grzegorz Gluch R. Urbanke 67 18 0 12 Apr 2021
Landscape analysis for shallow neural networks: complete classification of critical points for affine target functions Patrick Cheridito Arnulf Jentzen Florian Rossmannek 78 10 0 19 Mar 2021
Stochasticity helps to navigate rough landscapes: comparing gradient-descent-based algorithms in the phase retrieval problem Francesca Mignacco Pierfrancesco Urbani Lenka Zdeborová 85 36 0 08 Mar 2021
Towards a Mathematical Understanding of Neural Network-Based Machine Learning: what we know and what we don't E. Weinan Chao Ma Stephan Wojtowytsch Lei Wu AI4CE 125 134 0 22 Sep 2020