Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2001.06938
Cited By
v1
v2 (latest)
Memory capacity of neural networks with threshold and ReLU activations
20 January 2020
Roman Vershynin
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Memory capacity of neural networks with threshold and ReLU activations"
18 / 18 papers shown
Memorization Capacity for Additive Fine-Tuning with Small ReLU Networks
Conference on Uncertainty in Artificial Intelligence (UAI), 2024
Jy-yong Sohn
Dohyun Kwon
Seoyeon An
Kangwook Lee
405
0
0
01 Aug 2024
Fixed width treelike neural networks capacity analysis -- generic activations
M. Stojnic
229
3
0
08 Feb 2024
\emph{Lifted} RDT based capacity analysis of the 1-hidden layer treelike \emph{sign} perceptrons neural networks
M. Stojnic
258
2
0
13 Dec 2023
Capacity of the treelike sign perceptrons neural networks with one hidden layer -- RDT based upper bounds
M. Stojnic
350
4
0
13 Dec 2023
Memorization with neural nets: going beyond the worst case
S. Dirksen
Patrick Finke
Martin Genzel
383
1
0
30 Sep 2023
Memorization Capacity of Multi-Head Attention in Transformers
International Conference on Learning Representations (ICLR), 2023
Sadegh Mahdavi
Renjie Liao
Christos Thrampoulidis
585
33
0
03 Jun 2023
Globally Optimal Training of Neural Networks with Threshold Activation Functions
International Conference on Learning Representations (ICLR), 2023
Tolga Ergen
Halil Ibrahim Gulluk
Jonathan Lacotte
Mert Pilanci
349
10
0
06 Mar 2023
Task Discovery: Finding the Tasks that Neural Networks Generalize on
Neural Information Processing Systems (NeurIPS), 2022
Andrei Atanov
Andrei Filatov
Teresa Yeo
Ajay Sohmshetty
Amir Zamir
OOD
433
11
0
01 Dec 2022
On the Optimal Memorization Power of ReLU Neural Networks
Gal Vardi
Gilad Yehudai
Ohad Shamir
215
42
0
07 Oct 2021
Statistically Meaningful Approximation: a Case Study on Approximating Turing Machines with Transformers
Neural Information Processing Systems (NeurIPS), 2021
Colin Wei
Yining Chen
Tengyu Ma
431
109
0
28 Jul 2021
Provable Memorization via Deep Neural Networks using Sub-linear Parameters
Annual Conference Computational Learning Theory (COLT), 2020
Sejun Park
Jaeho Lee
Chulhee Yun
Jinwoo Shin
FedML
MDE
216
44
0
26 Oct 2020
Random Vector Functional Link Networks for Function Approximation on Manifolds
Deanna Needell
Aaron A. Nelson
Rayan Saab
Palina Salanevich
Olov Schavemaker
308
37
0
30 Jul 2020
The Interpolation Phase Transition in Neural Networks: Memorization and Generalization under Lazy Training
Annals of Statistics (Ann. Stat.), 2020
Andrea Montanari
Yiqiao Zhong
457
107
0
25 Jul 2020
Universal Approximation Power of Deep Residual Neural Networks via Nonlinear Control Theory
International Conference on Learning Representations (ICLR), 2020
Paulo Tabuada
Bahman Gharesifard
331
30
0
12 Jul 2020
Minimum Width for Universal Approximation
Sejun Park
Chulhee Yun
Jaeho Lee
Jinwoo Shin
273
147
0
16 Jun 2020
Approximation in shift-invariant spaces with deep ReLU neural networks
Neural Networks (NN), 2020
Yunfei Yang
Zhen Li
Yang Wang
290
15
0
25 May 2020
Global Convergence of Deep Networks with One Wide Layer Followed by Pyramidal Topology
Neural Information Processing Systems (NeurIPS), 2020
Quynh N. Nguyen
Marco Mondelli
ODL
AI4CE
411
78
0
18 Feb 2020
NEU: A Meta-Algorithm for Universal UAP-Invariant Feature Representation
Anastasis Kratsios
Cody B. Hyndman
OOD
573
21
0
31 Aug 2018
1
Page 1 of 1
