Implicit Regularization in Hierarchical Tensor Factorization and Deep
Convolutional Neural Networks

v1v2v3v4v5 (latest)

Implicit Regularization in Hierarchical Tensor Factorization and Deep Convolutional Neural Networks

27 January 2022

ArXiv (abs)PDF HTML

Papers citing "Implicit Regularization in Hierarchical Tensor Factorization and Deep Convolutional Neural Networks"

13 / 13 papers shown

Title
Understanding Learning Dynamics Through Structured Representations Saleh Nikooroo Thomas Engel 76 1 0 04 Aug 2025
Structured Transformations for Stable and Interpretable Neural Computation Saleh Nikooroo Thomas Engel 40 2 0 31 Jul 2025
TensorGRaD: Tensor Gradient Robust Decomposition for Memory-Efficient Neural Operator Training Robert Joseph George David Pitt Jiawei Zhao Jean Kossaifi Cheng Luo Yuandong Tian Julius Berner Anima Anandkumar 130 2 0 04 Jan 2025
Sparse Mean Estimation in Adversarial Settings via Incremental Learning Jianhao Ma Ruidi Chen Yinghui He Salar Fattahi Wei Hu 127 0 0 24 May 2023
Understanding Incremental Learning of Gradient Descent: A Fine-grained Analysis of Matrix Sensing Jikai Jin Zhiyuan Li Kaifeng Lyu S. Du Jason D. Lee MLT 162 41 0 27 Jan 2023
On the Ability of Graph Neural Networks to Model Interactions Between Vertices Noam Razin Tom Verbin Nadav Cohen 239 13 0 29 Nov 2022
Learning Low Dimensional State Spaces with Overparameterized Recurrent Neural Nets Edo Cohen-Karlik Itamar Menuhin-Gruman Raja Giryes Nadav Cohen Amir Globerson 223 7 0 25 Oct 2022
Incremental Learning in Diagonal Linear Networks Raphael Berthier CLL AI4CE 141 21 0 31 Aug 2022
On the Implicit Bias in Deep-Learning Algorithms Gal Vardi FedML AI4CE 180 95 0 26 Aug 2022
Implicit Regularization with Polynomial Growth in Deep Tensor Factorization Kais Hariz Hachem Kadri Stéphane Ayache Maher Moakher Thierry Artières 96 4 0 18 Jul 2022
Implicit Bias of Gradient Descent on Reparametrized Models: On Equivalence to Mirror Descent Zhiyuan Li Tianhao Wang Jason D. Lee Sanjeev Arora 137 33 0 08 Jul 2022
Understanding the Generalization Benefit of Normalization Layers: Sharpness Reduction Kaifeng Lyu Zhiyuan Li Sanjeev Arora FAtt 179 78 0 14 Jun 2022
More is Less: Inducing Sparsity via Overparameterization H. Chou J. Maly Holger Rauhut 228 28 0 21 Dec 2021