Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2201.11729
Cited By
v1
v2
v3
v4
v5 (latest)
Implicit Regularization in Hierarchical Tensor Factorization and Deep Convolutional Neural Networks
International Conference on Machine Learning (ICML), 2022
27 January 2022
Noam Razin
Asaf Maman
Nadav Cohen
Re-assign community
ArXiv (abs)
PDF
HTML
Github (4★)
Papers citing
"Implicit Regularization in Hierarchical Tensor Factorization and Deep Convolutional Neural Networks"
26 / 26 papers shown
Neural Collapse under Gradient Flow on Shallow ReLU Networks for Orthogonally Separable Data
Hancheng Min
Zhihui Zhu
Rene Vidal
199
1
0
24 Oct 2025
Understanding Learning Dynamics Through Structured Representations
Saleh Nikooroo
Thomas Engel
400
1
0
04 Aug 2025
Structured Transformations for Stable and Interpretable Neural Computation
Saleh Nikooroo
Thomas Engel
286
2
0
31 Jul 2025
Why is Your Language Model a Poor Implicit Reward Model?
Noam Razin
Yong Lin
Jiarui Yao
Sanjeev Arora
LRM
297
4
0
10 Jul 2025
TensorGRaD: Tensor Gradient Robust Decomposition for Memory-Efficient Neural Operator Training
Robert Joseph George
David Pitt
Jiawei Zhao
Jean Kossaifi
Cheng Luo
Yuandong Tian
Julius Berner
Anima Anandkumar
358
2
0
04 Jan 2025
Lecture Notes on Linear Neural Networks: A Tale of Optimization and Generalization in Deep Learning
Nadav Cohen
Noam Razin
301
2
0
25 Aug 2024
Algorithmic Regularization in Tensor Optimization: Towards a Lifted Approach in Matrix Sensing
Neural Information Processing Systems (NeurIPS), 2023
Ziye Ma
Javad Lavaei
Somayeh Sojoudi
232
4
0
24 Oct 2023
A Quadratic Synchronization Rule for Distributed Deep Learning
International Conference on Learning Representations (ICLR), 2023
Xinran Gu
Kaifeng Lyu
Sanjeev Arora
Jingzhao Zhang
Longbo Huang
355
4
0
22 Oct 2023
Early Neuron Alignment in Two-layer ReLU Networks with Small Initialization
International Conference on Learning Representations (ICLR), 2023
Hancheng Min
Enrique Mallada
René Vidal
MLT
335
31
0
24 Jul 2023
Implicit regularization in AI meets generalized hardness of approximation in optimization -- Sharp results for diagonal linear networks
J. S. Wind
Vegard Antun
A. Hansen
319
6
0
13 Jul 2023
Sparse Mean Estimation in Adversarial Settings via Incremental Learning
Jianhao Ma
Ruidi Chen
Yinghui He
Salar Fattahi
Wei Hu
399
0
0
24 May 2023
Theoretical Analysis of Inductive Biases in Deep Convolutional Networks
Zihao Wang
Lei Wu
374
40
0
15 May 2023
Robust Implicit Regularization via Weight Normalization
Information and Inference A Journal of the IMA (JIII), 2023
H. Chou
Holger Rauhut
Rachel A. Ward
499
8
0
09 May 2023
What Makes Data Suitable for a Locally Connected Neural Network? A Necessary and Sufficient Condition Based on Quantum Entanglement
Neural Information Processing Systems (NeurIPS), 2023
Yotam Alexander
Nimrod De La Vega
Noam Razin
Nadav Cohen
467
6
0
20 Mar 2023
Implicit Regularization Leads to Benign Overfitting for Sparse Linear Regression
International Conference on Machine Learning (ICML), 2023
Mo Zhou
Rong Ge
474
4
0
01 Feb 2023
Understanding Incremental Learning of Gradient Descent: A Fine-grained Analysis of Matrix Sensing
International Conference on Machine Learning (ICML), 2023
Jikai Jin
Zhiyuan Li
Kaifeng Lyu
S. Du
Jason D. Lee
MLT
361
45
0
27 Jan 2023
On the Ability of Graph Neural Networks to Model Interactions Between Vertices
Neural Information Processing Systems (NeurIPS), 2022
Noam Razin
Tom Verbin
Nadav Cohen
477
17
0
29 Nov 2022
Learning Low Dimensional State Spaces with Overparameterized Recurrent Neural Nets
International Conference on Learning Representations (ICLR), 2022
Edo Cohen-Karlik
Itamar Menuhin-Gruman
Raja Giryes
Nadav Cohen
Amir Globerson
439
7
0
25 Oct 2022
Behind the Scenes of Gradient Descent: A Trajectory Analysis via Basis Function Decomposition
International Conference on Learning Representations (ICLR), 2022
Jianhao Ma
Li-Zhen Guo
Salar Fattahi
447
4
0
01 Oct 2022
Incremental Learning in Diagonal Linear Networks
Journal of machine learning research (JMLR), 2022
Raphael Berthier
CLL
AI4CE
359
26
0
31 Aug 2022
On the Implicit Bias in Deep-Learning Algorithms
Communications of the ACM (CACM), 2022
Gal Vardi
FedML
AI4CE
446
115
0
26 Aug 2022
Implicit Regularization with Polynomial Growth in Deep Tensor Factorization
International Conference on Machine Learning (ICML), 2022
Kais Hariz
Hachem Kadri
Stéphane Ayache
Maher Moakher
Thierry Artières
210
4
0
18 Jul 2022
Implicit Bias of Gradient Descent on Reparametrized Models: On Equivalence to Mirror Descent
Neural Information Processing Systems (NeurIPS), 2022
Zhiyuan Li
Tianhao Wang
Jason D. Lee
Sanjeev Arora
368
37
0
08 Jul 2022
Understanding the Generalization Benefit of Normalization Layers: Sharpness Reduction
Neural Information Processing Systems (NeurIPS), 2022
Kaifeng Lyu
Zhiyuan Li
Sanjeev Arora
FAtt
485
92
0
14 Jun 2022
Permutation Search of Tensor Network Structures via Local Sampling
International Conference on Machine Learning (ICML), 2022
Chong Li
Junhua Zeng
Zerui Tao
Qianchuan Zhao
298
30
0
14 Jun 2022
More is Less: Inducing Sparsity via Overparameterization
Information and Inference A Journal of the IMA (JIII), 2021
H. Chou
J. Maly
Holger Rauhut
575
31
0
21 Dec 2021
1
Page 1 of 1
