Approximation and Non-parametric Estimation of ResNet-type Convolutional Neural Networks

24 March 2019

Papers citing "Approximation and Non-parametric Estimation of ResNet-type Convolutional Neural Networks"

30 / 30 papers shown

Title
Adaptivity of deep ReLU network for learning in Besov and mixed smooth Besov spaces: optimal rate and curse of dimensionality Taiji Suzuki 87 243 0 18 Oct 2018
Equivalence of approximation by convolutional neural networks and fully-connected networks P. Petersen Felix Voigtländer 37 78 0 04 Sep 2018
ResNet with one-neuron hidden layers is a Universal Approximator Hongzhou Lin Stefanie Jegelka 62 227 0 28 Jun 2018
Dynamical Isometry and a Mean Field Theory of RNNs: Gating Enables Signal Propagation in Recurrent Neural Networks Minmin Chen Jeffrey Pennington S. Schoenholz SyDa AI4CE 38 116 0 14 Jun 2018
The universal approximation power of finite-width deep ReLU networks Dmytro Perekrestenko Philipp Grohs Dennis Elbrächter Helmut Bölcskei 23 36 0 05 Jun 2018
Universality of Deep Convolutional Neural Networks Ding-Xuan Zhou HAI PINN 176 513 0 28 May 2018
Understanding Generalization and Optimization Performance of Deep CNNs Pan Zhou Jiashi Feng MLT 93 49 0 28 May 2018
Universal approximations of invariant maps by neural networks Dmitry Yarotsky 57 210 0 26 Apr 2018
Functional Gradient Boosting based on Residual Network Perception Atsushi Nitanda Taiji Suzuki 38 27 0 25 Feb 2018
Spectral Normalization for Generative Adversarial Networks Takeru Miyato Toshiki Kataoka Masanori Koyama Yuichi Yoshida ODL 127 4,421 0 16 Feb 2018
Stronger generalization bounds for deep nets via a compression approach Sanjeev Arora Rong Ge Behnam Neyshabur Yi Zhang MLT AI4CE 66 637 0 14 Feb 2018
Deep Neural Networks Learn Non-Smooth Functions Effectively Masaaki Imaizumi Kenji Fukumizu 116 123 0 13 Feb 2018
Spherical CNNs Taco S. Cohen Mario Geiger Jonas Köhler Max Welling 107 898 0 30 Jan 2018
Beyond Finite Layer Neural Networks: Bridging Deep Architectures and Numerical Differential Equations Yiping Lu Aoxiao Zhong Quanzheng Li Bin Dong 126 495 0 27 Oct 2017
Optimal approximation of piecewise smooth functions using deep ReLU neural networks P. Petersen Felix Voigtländer 147 472 0 15 Sep 2017
The Expressive Power of Neural Networks: A View from the Width Zhou Lu Hongming Pu Feicheng Wang Zhiqiang Hu Liwei Wang 62 886 0 08 Sep 2017
Nonparametric regression using deep neural networks with ReLU activation function Johannes Schmidt-Hieber 93 804 0 22 Aug 2017
Learning Deep ResNet Blocks Sequentially using Boosting Theory Furong Huang Jordan T. Ash John Langford Robert Schapire 34 111 0 15 Jun 2017
Optimal Approximation with Sparsely Connected Deep Neural Networks Helmut Bölcskei Philipp Grohs Gitta Kutyniok P. Petersen 112 256 0 04 May 2017
On the ability of neural nets to express distributions Holden Lee Rong Ge Tengyu Ma Andrej Risteski Sanjeev Arora BDL 48 84 0 22 Feb 2017
Error bounds for approximations with deep ReLU networks Dmitry Yarotsky 118 1,226 0 03 Oct 2016
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Zhiwen Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 788 6,768 0 26 Sep 2016
Densely Connected Convolutional Networks Gao Huang Zhuang Liu Laurens van der Maaten Kilian Q. Weinberger PINN 3DV 600 36,599 0 25 Aug 2016
$Approximation by Combinations of ReLU and Squared ReLU Ridge Functions with $ \ell^1 $ and $ \ell^0 $ Controls$ Approximation by Combinations of ReLU and Squared ReLU Ridge Functions with $\ell^1$ and $\ell^0$ Controls Jason M. Klusowski Andrew R. Barron 193 142 0 26 Jul 2016
Understanding and Improving Convolutional Neural Networks via Concatenated Rectified Linear Units Wenling Shang Kihyuk Sohn Diogo Almeida Honglak Lee 47 503 0 16 Mar 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 1.2K 192,638 0 10 Dec 2015
U-Net: Convolutional Networks for Biomedical Image Segmentation Olaf Ronneberger Philipp Fischer Thomas Brox SSeg 3DV 989 76,547 0 18 May 2015
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift Sergey Ioffe Christian Szegedy OOD 260 43,154 0 11 Feb 2015
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification Kaiming He Xinming Zhang Shaoqing Ren Jian Sun VLM 144 18,534 0 06 Feb 2015
Going Deeper with Convolutions Christian Szegedy Wei Liu Yangqing Jia P. Sermanet Scott E. Reed Dragomir Anguelov D. Erhan Vincent Vanhoucke Andrew Rabinovich 269 43,511 0 17 Sep 2014