Understanding Deep Neural Networks with Rectified Linear Units

4 November 2016

Papers citing "Understanding Deep Neural Networks with Rectified Linear Units"

50 / 100 papers shown

Title
On the Depth of Monotone ReLU Neural Networks and ICNNs Egor Bakaev Florestan Brunck Christoph Hertrich Daniel Reichman Amir Yehudayoff 26 1 0 09 May 2025
A Relative Homology Theory of Representation in Neural Networks Kosio Beshkov 99 0 0 17 Feb 2025
An Invitation to Neuroalgebraic Geometry G. Marchetti V. Shahverdi Stefano Mereta Matthew Trager Kathlén Kohn 119 2 0 31 Jan 2025
Neural Networks and (Virtual) Extended Formulations Christoph Hertrich Georg Loho 78 3 0 05 Nov 2024
On the Complexity of Neural Computation in Superposition Micah Adler Nir Shavit 120 3 0 05 Sep 2024
Mitigating Overconfidence in Out-of-Distribution Detection by Capturing Extreme Activations Mohammad Azizmalayeri Ameen Abu-Hanna Giovanni Cina OODD 47 1 0 21 May 2024
Approximation Error and Complexity Bounds for ReLU Networks on Low-Regular Function Spaces Owen Davis Gianluca Geraci Mohammad Motamed 46 2 0 10 May 2024
Counting Like Transformers: Compiling Temporal Counting Logic Into Softmax Transformers Andy Yang David Chiang 41 8 0 05 Apr 2024
Which Frequencies do CNNs Need? Emergent Bottleneck Structure in Feature Learning Yuxiao Wen Arthur Jacot 60 6 0 12 Feb 2024
Expressivity and Approximation Properties of Deep Neural Networks with ReLU $^k$ Activation Juncai He Tong Mao Jinchao Xu 40 3 0 27 Dec 2023
Tight Certified Robustness via Min-Max Representations of ReLU Neural Networks Brendon G. Anderson Samuel Pfrommer Somayeh Sojoudi OOD 34 1 0 07 Oct 2023
Frameless Graph Knowledge Distillation Dai Shi Zhiqi Shao Yi Guo Junbin Gao 39 4 0 13 Jul 2023
Learning Prescriptive ReLU Networks Wei-Ju Sun Asterios Tsiourvas 21 2 0 01 Jun 2023
Bottleneck Structure in Learned Features: Low-Dimension vs Regularity Tradeoff Arthur Jacot MLT 26 13 0 30 May 2023
When Deep Learning Meets Polyhedral Theory: A Survey Joey Huchette Gonzalo Muñoz Thiago Serra Calvin Tsay AI4CE 94 32 0 29 Apr 2023
The Power of Typed Affine Decision Structures: A Case Study Gerrit Nolte Maximilian Schlüter Alnis Murtovi Bernhard Steffen AAML 20 3 0 28 Apr 2023
VIPeR: Provably Efficient Algorithm for Offline RL with Neural Function Approximation Thanh Nguyen-Tang R. Arora OffRL 46 5 0 24 Feb 2023
Lower Bounds on the Depth of Integral ReLU Neural Networks via Lattice Polytopes Christian Haase Christoph Hertrich Georg Loho 34 22 0 24 Feb 2023
Towards Rigorous Understanding of Neural Networks via Semantics-preserving Transformations Maximilian Schlüter Gerrit Nolte Alnis Murtovi Bernhard Steffen 29 6 0 19 Jan 2023
Getting Away with More Network Pruning: From Sparsity to Geometry and Linear Regions Junyang Cai Khai-Nguyen Nguyen Nishant Shrestha Aidan Good Ruisen Tu Xin Yu Shandian Zhe Thiago Serra MLT 40 7 0 19 Jan 2023
Impossibility Theorems for Feature Attribution Blair Bilodeau Natasha Jaques Pang Wei Koh Been Kim FAtt 20 68 0 22 Dec 2022
Non-Linear Coordination Graphs Yipeng Kang Tonghan Wang Xiao-Ren Wu Qianlan Yang Chongjie Zhang 37 9 0 26 Oct 2022
Precision Machine Learning Eric J. Michaud Ziming Liu Max Tegmark 24 34 0 24 Oct 2022
Improved Bounds on Neural Complexity for Representing Piecewise Linear Functions Kuan-Lin Chen H. Garudadri Bhaskar D. Rao 11 19 0 13 Oct 2022
Implicit Bias of Large Depth Networks: a Notion of Rank for Nonlinear Functions Arthur Jacot 36 25 0 29 Sep 2022
Why neural networks find simple solutions: the many regularizers of geometric complexity Benoit Dherin Michael Munn M. Rosca David Barrett 57 31 0 27 Sep 2022
PulseDL-II: A System-on-Chip Neural Network Accelerator for Timing and Energy Extraction of Nuclear Detector Signals P. Ai Z. Deng Yi Wang H. Gong Xinchi Ran Z. Lang 13 2 0 02 Sep 2022
On the Number of Regions of Piecewise Linear Neural Networks Alexis Goujon Arian Etemadi M. Unser 44 13 0 17 Jun 2022
Robust stabilization of polytopic systems via fast and reliable neural network-based approximations F. Fabiani Paul Goulart 22 5 0 27 Apr 2022
$Training Fully Connected Neural Networks is $\exists\mathbb{R}$-Complete$ Training Fully Connected Neural Networks is $\exists\mathbb{R}$ -Complete Daniel Bertschinger Christoph Hertrich Paul Jungeblut Tillmann Miltzow Simon Weber OffRL 61 30 0 04 Apr 2022
Qualitative neural network approximation over R and C: Elementary proofs for analytic and polynomial activation Josiah Park Stephan Wojtowytsch 26 1 0 25 Mar 2022
The Combinatorial Brain Surgeon: Pruning Weights That Cancel One Another in Neural Networks Xin Yu Thiago Serra Srikumar Ramalingam Shandian Zhe 42 48 0 09 Mar 2022
Neural network approach to reconstructing spectral functions and complex poles of confined particles Thibault Lechien D. Dudal 11 9 0 07 Mar 2022
Training Thinner and Deeper Neural Networks: Jumpstart Regularization Carles Roger Riera Molina Camilo Rey Thiago Serra Eloi Puertas O. Pujol 27 4 0 30 Jan 2022
De Rham compatible Deep Neural Network FEM M. Longo J. Opschoor Nico Disch Christoph Schwab Jakob Zech 22 8 0 14 Jan 2022
Measuring Complexity of Learning Schemes Using Hessian-Schatten Total Variation Shayan Aziznejad Joaquim Campos M. Unser 27 9 0 12 Dec 2021
Unsupervised Representation Learning via Neural Activation Coding Yookoon Park Sangho Lee Gunhee Kim David M. Blei SSL 23 8 0 07 Dec 2021
Tailored neural networks for learning optimal value functions in MPC Dieter Teichrib M. S. Darup 34 4 0 07 Dec 2021
The Geometric Occam's Razor Implicit in Deep Learning Benoit Dherin Micheal Munn David Barrett 22 6 0 30 Nov 2021
Neural networks with linear threshold activations: structure and algorithms Sammy Khalife Hongyu Cheng A. Basu 42 14 0 15 Nov 2021
Availability Attacks Create Shortcuts Da Yu Huishuai Zhang Wei Chen Jian Yin Tie-Yan Liu AAML 31 57 0 01 Nov 2021
Graph Posterior Network: Bayesian Predictive Uncertainty for Node Classification Maximilian Stadler Bertrand Charpentier Simon Geisler Daniel Zügner Stephan Günnemann UQCV BDL 41 81 0 26 Oct 2021
Expressivity of Neural Networks via Chaotic Itineraries beyond Sharkovsky's Theorem Clayton Sanford Vaggos Chatziafratis 16 1 0 19 Oct 2021
Path Regularization: A Convexity and Sparsity Inducing Regularization for Parallel ReLU Networks Tolga Ergen Mert Pilanci 32 16 0 18 Oct 2021
Sound and Complete Neural Network Repair with Minimality and Locality Guarantees Feisi Fu Wenchao Li KELM AAML 41 26 0 14 Oct 2021
Multi-Head ReLU Implicit Neural Representation Networks Arya Aftab Alireza Morsali 42 11 0 07 Oct 2021
Activation Functions in Deep Learning: A Comprehensive Survey and Benchmark S. Dubey S. Singh B. B. Chaudhuri 41 643 0 29 Sep 2021
PI3NN: Out-of-distribution-aware prediction intervals from three neural networks Si-Yuan Liu Pei Zhang Dan Lu Guannan Zhang OODD 22 10 0 05 Aug 2021
Mitigating severe over-parameterization in deep convolutional neural networks through forced feature abstraction and compression with an entropy-based heuristic Nidhi Gowdra R. Sinha Stephen G. MacDonell W. Yan 21 9 0 27 Jun 2021
Provably Robust Detection of Out-of-distribution Data (almost) for free Alexander Meinke Julian Bitterwolf Matthias Hein OODD 33 22 0 08 Jun 2021