Depth Separations in Neural Networks: What is Actually Being Separated?

Depth Separations in Neural Networks: What is Actually Being Separated?

15 April 2019

Papers citing "Depth Separations in Neural Networks: What is Actually Being Separated?"

15 / 15 papers shown

Title
On the Depth of Monotone ReLU Neural Networks and ICNNs Egor Bakaev Florestan Brunck Christoph Hertrich Daniel Reichman Amir Yehudayoff 26 1 0 09 May 2025
Provable Guarantees for Nonlinear Feature Learning in Three-Layer Neural Networks Eshaan Nichani Alexandru Damian Jason D. Lee MLT 47 13 0 11 May 2023
Lower Bounds on the Depth of Integral ReLU Neural Networks via Lattice Polytopes Christian Haase Christoph Hertrich Georg Loho 34 22 0 24 Feb 2023
Sharp Lower Bounds on Interpolation by Deep ReLU Neural Networks at Irregularly Spaced Data Jonathan W. Siegel 14 2 0 02 Feb 2023
Transformers Learn Shortcuts to Automata Bingbin Liu Jordan T. Ash Surbhi Goel A. Krishnamurthy Cyril Zhang OffRL LRM 48 158 0 19 Oct 2022
$Intrinsic dimensionality and generalization properties of the $\mathcal{R}$-norm inductive bias$ Intrinsic dimensionality and generalization properties of the $\mathcal{R}$ -norm inductive bias Navid Ardeshir Daniel J. Hsu Clayton Sanford CML AI4CE 26 6 0 10 Jun 2022
Random Feature Amplification: Feature Learning and Generalization in Neural Networks Spencer Frei Niladri S. Chatterji Peter L. Bartlett MLT 30 29 0 15 Feb 2022
Interplay between depth of neural networks and locality of target functions Takashi Mori Masakuni Ueda 25 0 0 28 Jan 2022
Optimization-Based Separations for Neural Networks Itay Safran Jason D. Lee 200 14 0 04 Dec 2021
Expressivity of Neural Networks via Chaotic Itineraries beyond Sharkovsky's Theorem Clayton Sanford Vaggos Chatziafratis 16 1 0 19 Oct 2021
Depth separation beyond radial functions Luca Venturi Samy Jelassi Tristan Ozuch Joan Bruna 25 15 0 02 Feb 2021
The Connection Between Approximation, Depth Separation and Learnability in Neural Networks Eran Malach Gilad Yehudai Shai Shalev-Shwartz Ohad Shamir 21 20 0 31 Jan 2021
Size and Depth Separation in Approximating Benign Functions with Neural Networks Gal Vardi Daniel Reichman T. Pitassi Ohad Shamir 28 7 0 30 Jan 2021
$Approximation by Combinations of ReLU and Squared ReLU Ridge Functions with $ \ell^1 $ and $ \ell^0 $ Controls$ Approximation by Combinations of ReLU and Squared ReLU Ridge Functions with $\ell^1$ and $\ell^0$ Controls Jason M. Klusowski Andrew R. Barron 132 142 0 26 Jul 2016
Benefits of depth in neural networks Matus Telgarsky 153 603 0 14 Feb 2016