Dropout as a Low-Rank Regularizer for Matrix Factorization

Dropout as a Low-Rank Regularizer for Matrix Factorization

13 October 2017

Vittorio Murino

ArXiv (abs)PDF HTML

Papers citing "Dropout as a Low-Rank Regularizer for Matrix Factorization"

16 / 16 papers shown

Title
Reasoning Bias of Next Token Prediction Training Pengxiao Lin Zhongwang Zhang Zhi-Qin John Xu LRM 191 2 0 21 Feb 2025
The good, the bad and the ugly sides of data augmentation: An implicit spectral regularization perspective Chi-Heng Lin Chiraag Kaushik Eva L. Dyer Vidya Muthukumar 85 31 0 10 Oct 2022
Implicit regularization of dropout Zhongwang Zhang Zhi-Qin John Xu 67 29 0 13 Jul 2022
Exact Solutions of a Deep Linear Network Liu Ziyin Botao Li Xiangmin Meng ODL 58 22 0 10 Feb 2022
Stochastic Neural Networks with Infinite Width are Deterministic Liu Ziyin Hanlin Zhang Xiangming Meng Yuting Lu Eric P. Xing Masakuni Ueda 84 3 0 30 Jan 2022
Avoiding Overfitting: A Survey on Regularization Methods for Convolutional Neural Networks C. F. G. Santos João Paulo Papa 80 231 0 10 Jan 2022
Regularization in ResNet with Stochastic Depth Soufiane Hayou Fadhel Ayed 55 10 0 06 Jun 2021
Asymptotic convergence rate of Dropout on shallow linear neural networks Albert Senen-Cerda J. Sanders 105 8 0 01 Dec 2020
Architectural Adversarial Robustness: The Case for Deep Pursuit George Cazenavette Calvin Murdock Simon Lucey AAML 71 23 0 29 Nov 2020
Deep matrix factorizations Pierre De Handschutter Nicolas Gillis Xavier Siebert BDL 128 46 0 01 Oct 2020
Dropout: Explicit Forms and Capacity Control R. Arora Peter L. Bartlett Poorya Mianjy Nathan Srebro 116 38 0 06 Mar 2020
The Implicit and Explicit Regularization Effects of Dropout Colin Wei Sham Kakade Tengyu Ma 116 118 0 28 Feb 2020
DropCluster: A structured dropout for convolutional networks Liyang Chen P. Gautier Sergul Aydore 47 11 0 07 Feb 2020
On the Regularization Properties of Structured Dropout Ambar Pal Connor Lane René Vidal B. Haeffele 127 14 0 30 Oct 2019
An ETF view of Dropout regularization Dor Bank Raja Giryes 93 4 0 14 Oct 2018
On the Implicit Bias of Dropout Poorya Mianjy R. Arora René Vidal 81 67 0 26 Jun 2018