On the number of response regions of deep feed forward networks with piece-wise linear activations

20 December 2013

Papers citing "On the number of response regions of deep feed forward networks with piece-wise linear activations"

50 / 56 papers shown

Title
A Relative Homology Theory of Representation in Neural Networks Kosio Beshkov 99 0 0 17 Feb 2025
Investigating Generalization Behaviours of Generative Flow Networks Lazar Atanackovic Emmanuel Bengio AI4CE 30 2 0 07 Feb 2024
Polyhedral Complex Extraction from ReLU Networks using Edge Subdivision Arturs Berzins 27 5 0 12 Jun 2023
When Deep Learning Meets Polyhedral Theory: A Survey Joey Huchette Gonzalo Muñoz Thiago Serra Calvin Tsay AI4CE 94 32 0 29 Apr 2023
The Power of Typed Affine Decision Structures: A Case Study Gerrit Nolte Maximilian Schlüter Alnis Murtovi Bernhard Steffen AAML 20 3 0 28 Apr 2023
Towards Rigorous Understanding of Neural Networks via Semantics-preserving Transformations Maximilian Schlüter Gerrit Nolte Alnis Murtovi Bernhard Steffen 29 6 0 19 Jan 2023
Getting Away with More Network Pruning: From Sparsity to Geometry and Linear Regions Junyang Cai Khai-Nguyen Nguyen Nishant Shrestha Aidan Good Ruisen Tu Xin Yu Shandian Zhe Thiago Serra MLT 40 7 0 19 Jan 2023
Expected Gradients of Maxout Networks and Consequences to Parameter Initialization Hanna Tseran Guido Montúfar ODL 30 0 0 17 Jan 2023
Understanding the Spectral Bias of Coordinate Based MLPs Via Training Dynamics J. Lazzari Xiuwen Liu 26 3 0 14 Jan 2023
Variational Laplace Autoencoders Yookoon Park C. Kim Gunhee Kim BDL DRL 26 21 0 30 Nov 2022
Interpreting Neural Networks through the Polytope Lens Sid Black Lee D. Sharkey Léo Grinsztajn Eric Winsor Daniel A. Braun ... Kip Parker Carlos Ramón Guevara Beren Millidge Gabriel Alfour Connor Leahy FAtt MILM 31 22 0 22 Nov 2022
Non-Linear Coordination Graphs Yipeng Kang Tonghan Wang Xiao-Ren Wu Qianlan Yang Chongjie Zhang 34 9 0 26 Oct 2022
A Dimension-Augmented Physics-Informed Neural Network (DaPINN) with High Level Accuracy and Efficiency Weilong Guan Kai-Ping Yang Yinsheng Chen Zhong Guan PINN AI4CE 18 12 0 19 Oct 2022
Improved Bounds on Neural Complexity for Representing Piecewise Linear Functions Kuan-Lin Chen H. Garudadri Bhaskar D. Rao 11 18 0 13 Oct 2022
Sparse deep neural networks for modeling aluminum electrolysis dynamics E. Lundby Adil Rasheed I. Halvorsen J. Gravdahl 23 14 0 13 Sep 2022
Lower and Upper Bounds for Numbers of Linear Regions of Graph Convolutional Networks Hao Chen Yu Wang Huan Xiong GNN 16 6 0 01 Jun 2022
$Training Fully Connected Neural Networks is $\exists\mathbb{R}$-Complete$ Training Fully Connected Neural Networks is $\exists\mathbb{R}$ -Complete Daniel Bertschinger Christoph Hertrich Paul Jungeblut Tillmann Miltzow Simon Weber OffRL 61 30 0 04 Apr 2022
The Combinatorial Brain Surgeon: Pruning Weights That Cancel One Another in Neural Networks Xin Yu Thiago Serra Srikumar Ramalingam Shandian Zhe 42 48 0 09 Mar 2022
Training Thinner and Deeper Neural Networks: Jumpstart Regularization Carles Roger Riera Molina Camilo Rey Thiago Serra Eloi Puertas O. Pujol 27 4 0 30 Jan 2022
Spatial-Temporal-Fusion BNN: Variational Bayesian Feature Layer Shiye Lei Zhuozhuo Tu Leszek Rutkowski Feng Zhou Li Shen Fengxiang He Dacheng Tao BDL 23 2 0 12 Dec 2021
Measuring Complexity of Learning Schemes Using Hessian-Schatten Total Variation Shayan Aziznejad Joaquim Campos M. Unser 21 9 0 12 Dec 2021
Unsupervised Representation Learning via Neural Activation Coding Yookoon Park Sangho Lee Gunhee Kim David M. Blei SSL 23 8 0 07 Dec 2021
On the Effectiveness of Neural Ensembles for Image Classification with Small Datasets Lorenzo Brigato Luca Iocchi UQCV 30 0 0 29 Nov 2021
Discovering and Explaining the Representation Bottleneck of DNNs Huiqi Deng Qihan Ren Hao Zhang Quanshi Zhang 39 59 0 11 Nov 2021
An Embedding of ReLU Networks and an Analysis of their Identifiability Pierre Stock Rémi Gribonval 31 17 0 20 Jul 2021
Multifidelity Modeling for Physics-Informed Neural Networks (PINNs) Michael Penwarden Shandian Zhe A. Narayan Robert M. Kirby 29 42 0 25 Jun 2021
Learning and Meshing from Deep Implicit Surface Networks Using an Efficient Implementation of Analytic Marching Jiabao Lei Kui Jia Yi Ma 15 10 0 18 Jun 2021
Layer Folding: Neural Network Depth Reduction using Activation Linearization Amir Ben Dror Niv Zehngut Avraham Raviv E. Artyomov Ran Vitek R. Jevnisek 29 20 0 17 Jun 2021
Sharp bounds for the number of regions of maxout networks and vertices of Minkowski sums Guido Montúfar Yue Ren Leon Zhang 20 39 0 16 Apr 2021
Fast Jacobian-Vector Product for Deep Networks Randall Balestriero Richard Baraniuk 31 4 0 01 Apr 2021
PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learning Yunbo Wang Haixu Wu Jianjin Zhang Zhifeng Gao Jianmin Wang Philip S. Yu Mingsheng Long 17 378 0 17 Mar 2021
Weisfeiler and Lehman Go Topological: Message Passing Simplicial Networks Cristian Bodnar Fabrizio Frasca Yu Guang Wang N. Otter Guido Montúfar Pietro Lió M. Bronstein 48 247 0 04 Mar 2021
Provably Correct Training of Neural Network Controllers Using Reachability Analysis Xiaowu Sun Yasser Shoukry 20 7 0 22 Feb 2021
On the Number of Linear Functions Composing Deep Neural Network: Towards a Refined Definition of Neural Networks Complexity Yuuki Takai Akiyoshi Sannai Matthieu Cordonnier 77 4 0 23 Oct 2020
Expressivity of Deep Neural Networks Ingo Gühring Mones Raslan Gitta Kutyniok 16 51 0 09 Jul 2020
In Proximity of ReLU DNN, PWA Function, and Explicit MPC Saman Fahandezh-Saadi Masayoshi Tomizuka 18 4 0 09 Jun 2020
Analytic Marching: An Analytic Meshing Solution from Deep Implicit Surface Networks Jiabao Lei Kui Jia 22 21 0 16 Feb 2020
Linear predictor on linearly-generated data with missing values: non consistency and solutions Marine Le Morvan Nicolas Prost Julie Josse Erwan Scornet Gaël Varoquaux 11 26 0 03 Feb 2020
Empirical Studies on the Properties of Linear Regions in Deep Neural Networks Xiao Zhang Dongrui Wu 21 38 0 04 Jan 2020
Lossless Compression of Deep Neural Networks Thiago Serra Abhinav Kumar Srikumar Ramalingam 24 56 0 01 Jan 2020
Stochastic Feedforward Neural Networks: Universal Approximation Thomas Merkh Guido Montúfar 17 8 0 22 Oct 2019
Tucker Decomposition Network: Expressive Power and Comparison Ye Liu Junjun Pan Michael K. Ng 16 1 0 23 May 2019
Is Deeper Better only when Shallow is Good? Eran Malach Shai Shalev-Shwartz 28 45 0 08 Mar 2019
Empirical Bounds on Linear Regions of Deep Rectifier Networks Thiago Serra Srikumar Ramalingam 8 42 0 08 Oct 2018
On Characterizing the Capacity of Neural Networks using Algebraic Topology William H. Guss Ruslan Salakhutdinov 27 89 0 13 Feb 2018
The Upper Bound on Knots in Neural Networks Kevin K. Chen 19 1 0 29 Nov 2016
Survey of Expressivity in Deep Neural Networks M. Raghu Ben Poole Jon M. Kleinberg Surya Ganguli Jascha Narain Sohl-Dickstein 14 15 0 24 Nov 2016
Understanding Deep Neural Networks with Rectified Linear Units R. Arora A. Basu Poorya Mianjy Anirbit Mukherjee PINN 30 633 0 04 Nov 2016
Understanding intermediate layers using linear classifier probes Guillaume Alain Yoshua Bengio FAtt 47 894 0 05 Oct 2016
Cooperative Training of Descriptor and Generator Networks Jianwen Xie Yang Lu Ruiqi Gao Song-Chun Zhu Ying Nian Wu GAN 26 140 0 29 Sep 2016