ResNet with one-neuron hidden layers is a Universal Approximator

28 June 2018

Papers citing "ResNet with one-neuron hidden layers is a Universal Approximator"

33 / 33 papers shown

Title
Fundamental Limits of Deep Learning-Based Binary Classifiers Trained with Hinge Loss T. Getu Georges Kaddoum M. Bennis 34 1 0 13 Sep 2023
Are Transformers with One Layer Self-Attention Using Low-Rank Weight Matrices Universal Approximators? T. Kajitsuka Issei Sato 29 16 0 26 Jul 2023
Universal Approximation Property of Hamiltonian Deep Neural Networks M. Zakwan M. d’Angelo Giancarlo Ferrari-Trecate 28 5 0 21 Mar 2023
LU decomposition and Toeplitz decomposition of a neural network Yucong Liu Simiao Jiao Lek-Heng Lim 30 7 0 25 Nov 2022
Towards Global Neural Network Abstractions with Locally-Exact Reconstruction Edoardo Manino I. Bessa Lucas C. Cordeiro 19 1 0 21 Oct 2022
The (Un)Scalability of Heuristic Approximators for NP-Hard Search Problems Sumedh Pendurkar Taoan Huang Sven Koenig Guni Sharon 26 1 0 07 Sep 2022
Approximation of Lipschitz Functions using Deep Spline Neural Networks Sebastian Neumayer Alexis Goujon Pakshal Bohra M. Unser 21 15 0 13 Apr 2022
Learning High-Dimensional Parametric Maps via Reduced Basis Adaptive Residual Networks Thomas O'Leary-Roseberry Xiaosong Du A. Chaudhuri J. Martins Karen E. Willcox Omar Ghattas 30 22 0 14 Dec 2021
Reconstructing Nonlinear Dynamical Systems from Multi-Modal Time Series Daniel Kramer P. Bommer Carlo Tombolini G. Koppe Daniel Durstewitz BDL AI4TS AI4CE 14 18 0 04 Nov 2021
Meta Internal Learning Raphael Bensadoun Shir Gur Tomer Galanti Lior Wolf GAN 23 8 0 06 Oct 2021
Understanding the computational demands underlying visual reasoning Mohit Vaishnav Rémi Cadène A. Alamia Drew Linsley Rufin VanRullen Thomas Serre GNN CoGe 34 16 0 08 Aug 2021
Choose a Transformer: Fourier or Galerkin Shuhao Cao 39 220 0 31 May 2021
Optimal Approximation Rate of ReLU Networks in terms of Width and Depth Zuowei Shen Haizhao Yang Shijun Zhang 101 115 0 28 Feb 2021
Advances in Electron Microscopy with Deep Learning Jeffrey M. Ede 29 2 0 04 Jan 2021
Convex Potential Flows: Universal Probability Distributions with Optimal Transport and Convex Optimization Chin-Wei Huang Ricky T. Q. Chen Christos Tsirigotis Aaron Courville OT 112 95 0 10 Dec 2020
The universal approximation theorem for complex-valued neural networks F. Voigtlaender 14 62 0 06 Dec 2020
Review: Deep Learning in Electron Microscopy Jeffrey M. Ede 26 79 0 17 Sep 2020
Expressivity of Deep Neural Networks Ingo Gühring Mones Raslan Gitta Kutyniok 16 50 0 09 Jul 2020
On Interpretability of Artificial Neural Networks: A Survey Fenglei Fan Jinjun Xiong Mengzhou Li Ge Wang AAML AI4CE 38 300 0 08 Jan 2020
Mean-Field and Kinetic Descriptions of Neural Differential Equations Michael Herty T. Trimborn G. Visconti 28 6 0 07 Jan 2020
Lossless Compression of Deep Neural Networks Thiago Serra Abhinav Kumar Srikumar Ramalingam 24 56 0 01 Jan 2020
Optimal Function Approximation with Relu Neural Networks Bo Liu Yi Liang 25 33 0 09 Sep 2019
A Review on Deep Learning in Medical Image Reconstruction Hai-Miao Zhang Bin Dong MedIm 29 122 0 23 Jun 2019
Universal Approximation with Deep Narrow Networks Patrick Kidger Terry Lyons 27 323 0 21 May 2019
A neural network-based framework for financial model calibration Shuaiqiang Liu Anastasia Borovykh L. Grzelak C. Oosterlee 27 103 0 23 Apr 2019
On Residual Networks Learning a Perturbation from Identity Michael Hauser 13 4 0 11 Feb 2019
On a Sparse Shortcut Topology of Artificial Neural Networks Fenglei Fan Dayang Wang Hengtao Guo Qikui Zhu Pingkun Yan Ge Wang Hengyong Yu 38 21 0 22 Nov 2018
Real-time Power System State Estimation and Forecasting via Deep Neural Networks Liang Zhang G. Wang G. Giannakis AI4TS 19 183 0 15 Nov 2018
Empirical Bounds on Linear Regions of Deep Rectifier Networks Thiago Serra Srikumar Ramalingam 8 42 0 08 Oct 2018
Mad Max: Affine Spline Insights into Deep Learning Randall Balestriero Richard Baraniuk AI4CE 28 78 0 17 May 2018
Global optimality conditions for deep neural networks Chulhee Yun S. Sra Ali Jadbabaie 121 117 0 08 Jul 2017
Benefits of depth in neural networks Matus Telgarsky 133 602 0 14 Feb 2016
The Loss Surfaces of Multilayer Networks A. Choromańska Mikael Henaff Michaël Mathieu Gerard Ben Arous Yann LeCun ODL 179 1,185 0 30 Nov 2014