Activation function dependence of the storage capacity of treelike
neural networks

v1v2v3 (latest)

Activation function dependence of the storage capacity of treelike neural networks

21 July 2020

Jacob A. Zavatone-Veth

Cengiz Pehlevan

ArXiv (abs)PDF HTML

Papers citing "Activation function dependence of the storage capacity of treelike neural networks"

11 / 11 papers shown

Title
Exact full-RSB SAT/UNSAT transition in infinitely wide two-layer neural networks B. Annesi Enrico M. Malatesta Francesco Zamponi 131 5 0 09 Oct 2024
Solution space and storage capacity of fully connected two-layer neural networks with generic activation functions Sota Nishiyama Masayuki Ohzeki 121 2 0 20 Apr 2024
Exact objectives of random linear programs and mean widths of random polyhedrons M. Stojnic 57 0 0 06 Mar 2024
Fixed width treelike neural networks capacity analysis -- generic activations M. Stojnic 94 3 0 08 Feb 2024
$\emph{Lifted} RDT based capacity analysis of the 1-hidden layer treelike \emph{sign} perceptrons neural networks$ \emph{Lifted} RDT based capacity analysis of the 1-hidden layer treelike \emph{sign} perceptrons neural networks M. Stojnic 95 1 0 13 Dec 2023
Capacity of the treelike sign perceptrons neural networks with one hidden layer -- RDT based upper bounds M. Stojnic 107 4 0 13 Dec 2023
Long Sequence Hopfield Memory Hamza Tahir Chaudhry Jacob A. Zavatone-Veth Dmitry Krotov Cengiz Pehlevan 164 20 0 07 Jun 2023
Neural networks learn to magnify areas near decision boundaries Jacob A. Zavatone-Veth Sheng Yang Julian Rubinfien Cengiz Pehlevan MLT AI4CE 125 6 0 26 Jan 2023
Contrasting random and learned features in deep Bayesian linear regression Jacob A. Zavatone-Veth William L. Tong Cengiz Pehlevan BDL MLT 158 30 0 01 Mar 2022
On neural network kernels and the storage capacity problem Jacob A. Zavatone-Veth Cengiz Pehlevan 77 7 0 12 Jan 2022
Properties of the geometry of solutions and capacity of multi-layer neural networks with Rectified Linear Units activations Carlo Baldassi Enrico M. Malatesta R. Zecchina MLT 244 48 0 17 Jul 2019