Compressing Heavy-Tailed Weight Matrices for Non-Vacuous Generalization Bounds

23 May 2021

Papers citing "Compressing Heavy-Tailed Weight Matrices for Non-Vacuous Generalization Bounds"

2 / 2 papers shown

Title
Deep neural networks with dependent weights: Gaussian Process mixture limit, heavy tails, sparsity and compressibility Hoileong Lee Fadhel Ayed Paul Jung Juho Lee Hongseok Yang François Caron 40 10 0 17 May 2022
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 284 2,890 0 15 Sep 2016