Path Regularization: A Convexity and Sparsity Inducing Regularization
for Parallel ReLU Networks

v1v2v3v4 (latest)

Path Regularization: A Convexity and Sparsity Inducing Regularization for Parallel ReLU Networks

18 October 2021

ArXiv (abs)PDF HTML

Papers citing "Path Regularization: A Convexity and Sparsity Inducing Regularization for Parallel ReLU Networks"

14 / 14 papers shown

Title
A Recovery Guarantee for Sparse Neural Networks Sara Fridovich-Keil Mert Pilanci 34 0 0 24 Sep 2025
Geometric Algebra Planes: Convex Implicit Neural Volumes Irmak Sivgin Sara Fridovich-Keil Gordon Wetzstein Mert Pilanci 263 2 0 20 Nov 2024
Approaching Deep Learning through the Spectral Dynamics of Weights David Yunis Kumar Kshitij Patel Samuel Wheeler Pedro H. P. Savarese Gal Vardi Karen Livescu Michael Maire Matthew R. Walter 185 12 0 21 Aug 2024
Analyzing Neural Network-Based Generative Diffusion Models through Convex Optimization Fangzhao Zhang Mert Pilanci DiffM 207 5 0 03 Feb 2024
Fixing the NTK: From Neural Network Linearizations to Exact Convex ProgramsNeural Information Processing Systems (NeurIPS), 2023 Rajat Vadiraj Dwaraknath Tolga Ergen Mert Pilanci 196 0 0 26 Sep 2023
ReLU Neural Networks with Linear Layers are Biased Towards Single- and Multi-Index ModelsSIAM Journal on Mathematics of Data Science (SIMODS), 2023 Suzanna Parkinson Greg Ongie Rebecca Willett 282 7 0 24 May 2023
When Deep Learning Meets Polyhedral Theory: A Survey Joey Huchette Gonzalo Muñoz Thiago Serra Calvin Tsay AI4CE 394 43 0 29 Apr 2023
Globally Optimal Training of Neural Networks with Threshold Activation FunctionsInternational Conference on Learning Representations (ICLR), 2023 Tolga Ergen Halil Ibrahim Gulluk Jonathan Lacotte Mert Pilanci 171 9 0 06 Mar 2023
The Lazy Neuron Phenomenon: On Emergence of Activation Sparsity in TransformersInternational Conference on Learning Representations (ICLR), 2022 Zong-xiao Li Chong You Srinadh Bhojanapalli Daliang Li A. S. Rawat ... Kenneth Q Ye Felix Chern Felix X. Yu Ruiqi Guo Surinder Kumar MoE 165 113 0 12 Oct 2022
Deep Learning meets Nonparametric Regression: Are Weight-Decayed DNNs Locally Adaptive?International Conference on Learning Representations (ICLR), 2022 Kaiqi Zhang Yu Wang 249 12 0 20 Apr 2022
Parallel Deep Neural Networks Have Zero Duality Gap Yifei Wang Tolga Ergen Mert Pilanci 307 10 0 13 Oct 2021
Hidden Convexity of Wasserstein GANs: Interpretable Generative Models with Closed-Form Solutions Arda Sahiner Tolga Ergen Batu Mehmet Ozturkler Burak Bartan John M. Pauly Morteza Mardani Mert Pilanci GAN 199 21 0 12 Jul 2021
Demystifying Batch Normalization in ReLU Networks: Equivalent Convex Optimization Models and Implicit RegularizationInternational Conference on Learning Representations (ICLR), 2021 Tolga Ergen Arda Sahiner Batu Mehmet Ozturkler John M. Pauly Morteza Mardani Mert Pilanci 249 32 0 02 Mar 2021
Xception: Deep Learning with Depthwise Separable ConvolutionsComputer Vision and Pattern Recognition (CVPR), 2016 François Chollet MDE BDL PINN 2.2K 16,169 0 07 Oct 2016

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.