The Expressive Power of Tuning Only the Normalization Layers

15 February 2023

Papers citing "The Expressive Power of Tuning Only the Normalization Layers"

4 / 4 papers shown

Title
The impact of allocation strategies in subset learning on the expressive power of neural networks Ofir Schlisselberg Ran Darshan 83 0 0 10 Feb 2025
Expressivity of Neural Networks with Random Weights and Learned Biases Ezekiel Williams Avery Hee-Woon Ryoo Thomas Jiralerspong Alexandre Payeur M. Perich Luca Mazzucato Guillaume Lajoie 24 1 0 01 Jul 2024
Exploring Low Rank Training of Deep Neural Networks Siddhartha Rao Kamalakara Acyr F. Locatelli Bharat Venkitesh Jimmy Ba Y. Gal Aidan N. Gomez 48 22 0 27 Sep 2022
$Approximation by Combinations of ReLU and Squared ReLU Ridge Functions with $ \ell^1 $ and $ \ell^0 $ Controls$ Approximation by Combinations of ReLU and Squared ReLU Ridge Functions with $\ell^1$ and $\ell^0$ Controls Jason M. Klusowski Andrew R. Barron 117 142 0 26 Jul 2016