Inductive Bias of Multi-Channel Linear Convolutional Networks with
Bounded Weight Norm

v1v2v3v4 (latest)

Inductive Bias of Multi-Channel Linear Convolutional Networks with Bounded Weight Norm

24 February 2021

Meena Jagadeesan

Ilya P. Razenshteyn

Suriya Gunasekar

ArXiv (abs)PDF HTML

Papers citing "Inductive Bias of Multi-Channel Linear Convolutional Networks with Bounded Weight Norm"

13 / 13 papers shown

Title
A Mathematical Abstraction for Balancing the Trade-off Between Creativity and Reality in Large Language Models Ritwik Sinha Zhao Song Dinesh Manocha 102 25 0 04 Jun 2023
On the Training Instability of Shuffling SGD with Batch Normalization David Wu Chulhee Yun S. Sra 79 5 0 24 Feb 2023
Implicit Regularization for Group Sparsity Jiangyuan Li THANH VAN NGUYEN Chinmay Hegde Raymond K. W. Wong 96 9 0 29 Jan 2023
Vision Transformers provably learn spatial structure Samy Jelassi Michael E. Sander Yuan-Fang Li ViT MLT 100 83 0 13 Oct 2022
Testing predictions of representation cost theory with CNNs Charles Godfrey Elise Bishoff Myles Mckay Davis Brown Grayson Jorgenson Henry Kvinge E. Byler 76 0 0 03 Oct 2022
Deep Linear Networks can Benignly Overfit when Shallow Ones Do Niladri S. Chatterji Philip M. Long 96 8 0 19 Sep 2022
On the Implicit Bias in Deep-Learning Algorithms Gal Vardi FedML AI4CE 101 81 0 26 Aug 2022
Implicit Regularization Towards Rank Minimization in ReLU Networks Nadav Timor Gal Vardi Ohad Shamir 93 51 0 30 Jan 2022
Implicit Regularization in Hierarchical Tensor Factorization and Deep Convolutional Neural Networks Noam Razin Asaf Maman Nadav Cohen 132 29 0 27 Jan 2022
Implicit Bias of Linear Equivariant Networks Hannah Lawrence Kristian Georgiev A. Dienes B. Kiani AI4CE 119 15 0 12 Oct 2021
On Margin Maximization in Linear and ReLU Networks Gal Vardi Ohad Shamir Nathan Srebro 162 30 0 06 Oct 2021
A Geometric Analysis of Neural Collapse with Unconstrained Features Zhihui Zhu Tianyu Ding Jinxin Zhou Xiao Li Chong You Jeremias Sulam Qing Qu 88 204 0 06 May 2021
A Unifying View on Implicit Bias in Training Linear Neural Networks Chulhee Yun Shankar Krishnan H. Mobahi MLT 125 82 0 06 Oct 2020