The Power of Depth for Feedforward Neural Networks

12 December 2015

Papers citing "The Power of Depth for Feedforward Neural Networks"

50 / 367 papers shown

Title
A Systematic Comparison of Deep Learning Architectures in an Autonomous Vehicle Michael Teti William Edward Hahn Shawn Martin W. Hahn Elan Barenholtz 20 5 0 26 Mar 2018
Generalization and Expressivity for Deep Nets Shao-Bo Lin 24 45 0 10 Mar 2018
Some Approximation Bounds for Deep Networks B. McCane Lech Szymanski 13 1 0 08 Mar 2018
Neural Networks Should Be Wide Enough to Learn Disconnected Decision Regions Quynh N. Nguyen Mahesh Chandra Mukkamala Matthias Hein MLT 19 54 0 28 Feb 2018
Limits on representing Boolean functions by linear combinations of simple functions: thresholds, ReLUs, and low-degree polynomials Richard Ryan Williams 32 27 0 26 Feb 2018
On the Optimization of Deep Networks: Implicit Acceleration by Overparameterization Sanjeev Arora Nadav Cohen Elad Hazan 25 456 0 19 Feb 2018
The Role of Information Complexity and Randomization in Representation Learning Matías Vera Pablo Piantanida L. Rey Vega 45 14 0 14 Feb 2018
On Characterizing the Capacity of Neural Networks using Algebraic Topology William H. Guss Ruslan Salakhutdinov 35 89 0 13 Feb 2018
Deep Learning Works in Practice. But Does it Work in Theory? L. Hoang R. Guerraoui PINN 33 3 0 31 Jan 2018
A Deep Learning Interpretable Classifier for Diabetic Retinopathy Disease Grading J. D. L. Torre A. Valls D. Puig 14 162 0 21 Dec 2017
The exploding gradient problem demystified - definition, prevalence, impact, origin, tradeoffs, and solutions George Philipp D. Song J. Carbonell ODL 35 46 0 15 Dec 2017
A trans-disciplinary review of deep learning research for water resources scientists Chaopeng Shen AI4CE 33 682 0 06 Dec 2017
Exploiting Nontrivial Connectivity for Automatic Speech Recognition Marius Paraschiv Lasse Borgholt T. M. S. Tax Marco Singh Lars Maaløe 33 0 0 28 Nov 2017
Lower bounds over Boolean inputs for deep neural networks with ReLU gates Anirbit Mukherjee A. Basu 25 21 0 08 Nov 2017
Bounding and Counting Linear Regions of Deep Neural Networks Thiago Serra Christian Tjandraatmadja Srikumar Ramalingam MLT 17 246 0 06 Nov 2017
An efficient quantum algorithm for generative machine learning Xun Gao Zhengyu Zhang L. Duan 13 25 0 06 Nov 2017
Expressive power of recurrent neural networks Valentin Khrulkov Alexander Novikov Ivan Oseledets 21 112 0 02 Nov 2017
Optimization Landscape and Expressivity of Deep CNNs Quynh N. Nguyen Matthias Hein 24 29 0 30 Oct 2017
On the Long-Term Memory of Deep Recurrent Networks Yoav Levine Or Sharir Alon Ziv Amnon Shashua 15 24 0 25 Oct 2017
Learning hard quantum distributions with variational autoencoders Andrea Rocchetto Edward Grant Sergii Strelchuk Giuseppe Carleo Simone Severini BDL DRL 30 76 0 02 Oct 2017
The Expressive Power of Neural Networks: A View from the Width Zhou Lu Hongming Pu Feicheng Wang Zhiqiang Hu Liwei Wang 20 880 0 08 Sep 2017
Deep Learning Techniques for Music Generation -- A Survey Jean-Pierre Briot Gaëtan Hadjeres F. Pachet MGen 37 297 0 05 Sep 2017
Training Shallow and Thin Networks for Acceleration via Knowledge Distillation with Conditional Adversarial Networks Zheng Xu Yen-Chang Hsu Jiawei Huang GAN 35 12 0 02 Sep 2017
On the Compressive Power of Deep Rectifier Networks for High Resolution Representation of Class Boundaries Senjian An Bennamoun F. Boussaïd 20 2 0 24 Aug 2017
On the Complexity of Learning Neural Networks Le Song Santosh Vempala John Wilmes Bo Xie 14 59 0 14 Jul 2017
Neural networks and rational functions Matus Telgarsky 22 81 0 11 Jun 2017
Fast learning rate of deep learning via a kernel perspective Taiji Suzuki 18 6 0 29 May 2017
The Landscape of Deep Learning Algorithms Pan Zhou Jiashi Feng 12 24 0 19 May 2017
The power of deeper networks for expressing natural functions David Rolnick Max Tegmark 36 174 0 16 May 2017
Analysis and Design of Convolutional Networks via Hierarchical Tensor Decompositions Nadav Cohen Or Sharir Yoav Levine Ronen Tamari David Yakira Amnon Shashua 20 38 0 05 May 2017
Optimal Approximation with Sparsely Connected Deep Neural Networks Helmut Bölcskei Philipp Grohs Gitta Kutyniok P. Petersen 30 255 0 04 May 2017
From Deep to Shallow: Transformations of Deep Rectifier Networks Senjian An F. Boussaïd Bennamoun Jiankun Hu 19 2 0 30 Mar 2017
Native Language Identification using Stacked Generalization S. Malmasi Mark Dras 13 39 0 19 Mar 2017
Deep Radial Kernel Networks: Approximating Radially Symmetric Functions with Deep Networks B. McCane Lech Szymanski 41 6 0 09 Mar 2017
Nearly-tight VC-dimension and pseudodimension bounds for piecewise linear neural networks Peter L. Bartlett Nick Harvey Christopher Liaw Abbas Mehrabian 16 424 0 08 Mar 2017
On the Expressive Power of Overlapping Architectures of Deep Learning Or Sharir Amnon Shashua 19 10 0 06 Mar 2017
Mixing Complexity and its Applications to Neural Networks Michal Moshkovitz Naftali Tishby 21 11 0 02 Mar 2017
Depth Separation for Neural Networks Amit Daniely MDE 9 74 0 27 Feb 2017
On the Origin of Deep Learning Haohan Wang Bhiksha Raj MedIm 3DV VLM 48 223 0 24 Feb 2017
On the ability of neural nets to express distributions Holden Lee Rong Ge Tengyu Ma Andrej Risteski Sanjeev Arora BDL 18 84 0 22 Feb 2017
Deep Stochastic Configuration Networks with Universal Approximation Property Dianhui Wang Ming Li BDL 13 6 0 18 Feb 2017
Deep Submodular Functions J. Bilmes Wenruo Bai 19 45 0 31 Jan 2017
Deep Learning and Hierarchal Generative Models Elchanan Mossel BDL GAN 22 23 0 29 Dec 2016
Reliably Learning the ReLU in Polynomial Time Surbhi Goel Varun Kanade Adam R. Klivans J. Thaler 21 124 0 30 Nov 2016
An Overview on Data Representation Learning: From Traditional Feature Learning to Recent Deep Learning G. Zhong Lina Wang Junyu Dong AI4TS 36 180 0 25 Nov 2016
Survey of Expressivity in Deep Neural Networks M. Raghu Ben Poole Jon M. Kleinberg Surya Ganguli Jascha Narain Sohl-Dickstein 24 15 0 24 Nov 2016
Understanding deep learning requires rethinking generalization Chiyuan Zhang Samy Bengio Moritz Hardt Benjamin Recht Oriol Vinyals HAI 82 4,589 0 10 Nov 2016
Understanding Deep Neural Networks with Rectified Linear Units R. Arora A. Basu Poorya Mianjy Anirbit Mukherjee PINN 41 633 0 04 Nov 2016
Learning Identity Mappings with Residual Gates Pedro H. P. Savarese Leonardo O. Mazza Daniel R. Figueiredo 25 5 0 04 Nov 2016
Why and When Can Deep -- but Not Shallow -- Networks Avoid the Curse of Dimensionality: a Review T. Poggio H. Mhaskar Lorenzo Rosasco Brando Miranda Q. Liao 14 573 0 02 Nov 2016