Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2002.10553
Cited By
v1
v2 (latest)
Neural Networks are Convex Regularizers: Exact Polynomial-time Convex Optimization Formulations for Two-layer Networks
International Conference on Machine Learning (ICML), 2020
24 February 2020
Mert Pilanci
Tolga Ergen
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Neural Networks are Convex Regularizers: Exact Polynomial-time Convex Optimization Formulations for Two-layer Networks"
50 / 85 papers shown
SGFusion: Stochastic Geographic Gradient Fusion in Federated Learning
K. Nguyen
Khang Tran
Nhathai Phan
Cristian Borcea
R. Jin
Issa M. Khalil
FedML
393
0
0
27 Oct 2025
A Recovery Guarantee for Sparse Neural Networks
Sara Fridovich-Keil
Mert Pilanci
122
1
0
24 Sep 2025
Algebraic Approach to Ridge-Regularized Mean Squared Error Minimization in Minimal ReLU Neural Network
Ryoya Fukasaku
Y. Kabata
Akifumi Okuno
236
0
0
25 Aug 2025
Computational Advantages of Multi-Grade Deep Learning: Convergence Analysis and Performance Insights
Ronglong Fang
Yuesheng Xu
142
3
0
27 Jul 2025
Flows and Diffusions on the Neural Manifold
Daniel Saragih
Deyu Cao
Tejas Balaji
DiffM
AI4CE
297
2
0
14 Jul 2025
Asymptotic convexity of wide and shallow neural networks
Vivek Borkar
Parthe Pandit
300
0
0
23 Jun 2025
Benignity of loss landscape with weight decay requires both large overparametrization and initialization
Etienne Boursier
Matthew Bowditch
Matthias Englert
R. Lazic
267
0
0
28 May 2025
Global Minimizers of
ℓ
p
\ell^p
ℓ
p
-Regularized Objectives Yield the Sparsest ReLU Neural Networks
Julia B. Nakhleh
Robert D. Nowak
354
0
0
27 May 2025
AltLoRA: Towards Better Gradient Approximation in Low-Rank Adaptation with Alternating Projections
Xin Yu
Yujia Wang
Jinghui Chen
Lingzhou Xue
410
5
0
18 May 2025
Sliced-Wasserstein Distance-based Data Selection
Julien Pallage
Antoine Lesage-Landry
294
1
0
17 Apr 2025
SAPPHIRE: Preconditioned Stochastic Variance Reduction for Faster Large-Scale Statistical Learning
Jingruo Sun
Zachary Frangella
Madeleine Udell
308
3
0
28 Jan 2025
Implicit Bias in Matrix Factorization and its Explicit Realization in a New Architecture
Yikun Hou
Suvrit Sra
A. Yurtsever
407
0
0
27 Jan 2025
Geometric Algebra Planes: Convex Implicit Neural Volumes
Irmak Sivgin
Sara Fridovich-Keil
Gordon Wetzstein
Mert Pilanci
487
3
0
20 Nov 2024
Generative Feature Training of Thin 2-Layer Networks
J. Hertrich
Sebastian Neumayer
GAN
502
3
0
11 Nov 2024
CRONOS: Enhancing Deep Learning with Scalable GPU Accelerated Convex Neural Networks
Neural Information Processing Systems (NeurIPS), 2024
Miria Feng
Zachary Frangella
Mert Pilanci
BDL
470
4
0
02 Nov 2024
Convex Distillation: Efficient Compression of Deep Networks via Convex Optimization
Prateek Varshney
Mert Pilanci
472
0
0
09 Oct 2024
ConvexECG: Lightweight and Explainable Neural Networks for Personalized, Continuous Cardiac Monitoring
IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2024
Rayan Ansari
John Cao
Sabyasachi Bandyopadhyay
Sanjiv M. Narayan
Albert J. Rogers
Mert Pilanci
BDL
178
1
0
19 Sep 2024
Understanding Data Reconstruction Leakage in Federated Learning from a Theoretical Perspective
Zifan Wang
Binghui Zhang
Meng Pang
Yuan Hong
Binghui Wang
FedML
310
0
0
22 Aug 2024
Randomized Geometric Algebra Methods for Convex Neural Networks
Yifei Wang
Sungyoon Kim
Paul Chu
Indu Subramaniam
Mert Pilanci
AAML
378
3
0
04 Jun 2024
Adversarial Training of Two-Layer Polynomial and ReLU Activation Networks via Convex Optimization
Daniel Kuelbs
Sanjay Lall
Mert Pilanci
AAML
195
1
0
22 May 2024
Exploring Ordinality in Text Classification: A Comparative Study of Explicit and Implicit Techniques
Siva Rajesh Kasa
Aniket Goel
Karan Gupta
Sumegh Roychowdhury
Anish Bhanushali
Nikhil Pattisapu
Prasanna Srinivasa Murthy
281
7
0
20 May 2024
Learning with Norm Constrained, Over-parameterized, Two-layer Neural Networks
Fanghui Liu
L. Dadi
Volkan Cevher
491
10
0
29 Apr 2024
Deep Reinforcement Learning: A Convex Optimization Approach
Ather Gattami
391
1
0
29 Feb 2024
LoRA Training in the NTK Regime has No Spurious Local Minima
Uijeong Jang
Jason D. Lee
Ernest K. Ryu
446
39
0
19 Feb 2024
Depth Separation in Norm-Bounded Infinite-Width Neural Networks
Suzanna Parkinson
Greg Ongie
Rebecca Willett
Ohad Shamir
Nathan Srebro
MDE
272
2
0
13 Feb 2024
Convex Relaxations of ReLU Neural Networks Approximate Global Optima in Polynomial Time
International Conference on Machine Learning (ICML), 2024
Sungyoon Kim
Mert Pilanci
588
10
0
06 Feb 2024
Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models
Fangzhao Zhang
Mert Pilanci
AI4CE
522
40
0
04 Feb 2024
Analyzing Neural Network-Based Generative Diffusion Models through Convex Optimization
Fangzhao Zhang
Mert Pilanci
DiffM
365
6
0
03 Feb 2024
The Convex Landscape of Neural Networks: Characterizing Global Optima and Stationary Points via Lasso Models
Tolga Ergen
Mert Pilanci
245
7
0
19 Dec 2023
Polynomial-Time Solutions for ReLU Network Training: A Complexity Classification via Max-Cut and Zonotopes
Yifei Wang
Mert Pilanci
276
3
0
18 Nov 2023
From Complexity to Clarity: Analytical Expressions of Deep Neural Network Weights via Clifford's Geometric Algebra and Convexity
Mert Pilanci
407
4
0
28 Sep 2023
Fixing the NTK: From Neural Network Linearizations to Exact Convex Programs
Neural Information Processing Systems (NeurIPS), 2023
Rajat Vadiraj Dwaraknath
Tolga Ergen
Mert Pilanci
337
0
0
26 Sep 2023
On the Global Convergence of Natural Actor-Critic with Two-layer Neural Network Parametrization
Mudit Gaur
Amrit Singh Bedi
Di-di Wang
Vaneet Aggarwal
301
8
0
18 Jun 2023
Optimal Sets and Solution Paths of ReLU Networks
International Conference on Machine Learning (ICML), 2023
Aaron Mishkin
Mert Pilanci
386
7
0
31 May 2023
ReLU Neural Networks with Linear Layers are Biased Towards Single- and Multi-Index Models
SIAM Journal on Mathematics of Data Science (SIMODS), 2023
Suzanna Parkinson
Greg Ongie
Rebecca Willett
593
8
0
24 May 2023
Accelerated Algorithms for a Class of Optimization Problems with Equality and Box Constraints
American Control Conference (ACC), 2023
Anjali Parashar
P. Srivastava
Anuradha M. Annaswamy
122
0
0
08 May 2023
When Deep Learning Meets Polyhedral Theory: A Survey
Joey Huchette
Gonzalo Muñoz
Thiago Serra
Calvin Tsay
AI4CE
788
47
0
29 Apr 2023
Convex Dual Theory Analysis of Two-Layer Convolutional Neural Networks with Soft-Thresholding
IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2023
Chunyan Xiong
Meng Lu
Xiaotong Yu
JIAN-PENG Cao
Zhong Chen
D. Guo
X. Qu
MLT
383
3
0
14 Apr 2023
Function Space and Critical Points of Linear Convolutional Networks
SIAM Journal on applied algebra and geometry (SIAM J. Appl. Algebra Geom.), 2023
Kathlén Kohn
Guido Montúfar
Vahid Shahverdi
Matthew Trager
362
21
0
12 Apr 2023
Training a Two Layer ReLU Network Analytically
Italian National Conference on Sensors (INS), 2023
Adrian Barbu
319
9
0
06 Apr 2023
Training Neural Networks is NP-Hard in Fixed Dimension
Neural Information Processing Systems (NeurIPS), 2023
Vincent Froese
Christoph Hertrich
345
22
0
29 Mar 2023
Globally Optimal Training of Neural Networks with Threshold Activation Functions
International Conference on Learning Representations (ICLR), 2023
Tolga Ergen
Halil Ibrahim Gulluk
Jonathan Lacotte
Mert Pilanci
352
10
0
06 Mar 2023
Implicit Regularization for Group Sparsity
International Conference on Learning Representations (ICLR), 2023
Jiangyuan Li
THANH VAN NGUYEN
Chinmay Hegde
Raymond K. W. Wong
335
12
0
29 Jan 2023
Deep Learning Meets Sparse Regularization: A Signal Processing Perspective
IEEE Signal Processing Magazine (IEEE Signal Process. Mag.), 2023
Rahul Parhi
Robert D. Nowak
408
37
0
23 Jan 2023
Convexifying Transformers: Improving optimization and understanding of transformer networks
Tolga Ergen
Behnam Neyshabur
Harsh Mehta
MLT
261
15
0
20 Nov 2022
On the Global Convergence of Fitted Q-Iteration with Two-layer Neural Network Parametrization
International Conference on Machine Learning (ICML), 2022
Mudit Gaur
Vaneet Aggarwal
Mridul Agarwal
MLT
465
3
0
14 Nov 2022
PathProx: A Proximal Gradient Algorithm for Weight Decay Regularized Deep Neural Networks
Liu Yang
Jifan Zhang
Joseph Shenouda
Dimitris Papailiopoulos
Kangwook Lee
Robert D. Nowak
445
2
0
06 Oct 2022
A Combinatorial Perspective on the Optimization of Shallow ReLU Networks
Neural Information Processing Systems (NeurIPS), 2022
Michael Matena
Colin Raffel
273
3
0
01 Oct 2022
Fast Neural Kernel Embeddings for General Activations
Neural Information Processing Systems (NeurIPS), 2022
Insu Han
A. Zandieh
Jaehoon Lee
Roman Novak
Lechao Xiao
Amin Karbasi
327
23
0
09 Sep 2022
On the Implicit Bias in Deep-Learning Algorithms
Communications of the ACM (CACM), 2022
Gal Vardi
FedML
AI4CE
446
115
0
26 Aug 2022
1
2
Next
Page 1 of 2
