Fantastic Generalization Measures and Where to Find Them

4 December 2019

Papers citing "Fantastic Generalization Measures and Where to Find Them"

50 / 179 papers shown

Title
DART: Diversify-Aggregate-Repeat Training Improves Generalization of Neural Networks Samyak Jain Sravanti Addepalli P. Sahu Priyam Dey R. Venkatesh Babu MoMe OOD 61 20 0 28 Feb 2023
The Geometry of Neural Nets' Parameter Spaces Under Reparametrization Agustinus Kristiadi Felix Dangel Philipp Hennig 37 11 0 14 Feb 2023
A Modern Look at the Relationship between Sharpness and Generalization Maksym Andriushchenko Francesco Croce Maximilian Müller Matthias Hein Nicolas Flammarion 3DH 64 56 0 14 Feb 2023
Generalization in Graph Neural Networks: Improved PAC-Bayesian Bounds on Graph Diffusion Haotian Ju Dongyue Li Aneesh Sharma Hongyang R. Zhang 35 40 0 09 Feb 2023
Generalization Bounds with Data-dependent Fractal Dimensions Benjamin Dupuis George Deligiannidis Umut cSimcsekli AI4CE 41 12 0 06 Feb 2023
Exploring the Effect of Multi-step Ascent in Sharpness-Aware Minimization Hoki Kim Jinseong Park Yujin Choi Woojin Lee Jaewook Lee 32 9 0 27 Jan 2023
An SDE for Modeling SAM: Theory and Insights Enea Monzio Compagnoni Luca Biggio Antonio Orvieto F. Proske Hans Kersting Aurelien Lucchi 35 13 0 19 Jan 2023
Stability Analysis of Sharpness-Aware Minimization Hoki Kim Jinseong Park Yujin Choi Jaewook Lee 44 12 0 16 Jan 2023
An Analysis of Attention via the Lens of Exchangeability and Latent Variable Models Yufeng Zhang Boyi Liu Qi Cai Lingxiao Wang Zhaoran Wang 53 11 0 30 Dec 2022
RangeAugment: Efficient Online Augmentation with Range Learning Sachin Mehta Saeid Naderiparizi Fartash Faghri Maxwell Horton Lailin Chen Ali Farhadi Oncel Tuzel Mohammad Rastegari 32 6 0 20 Dec 2022
A Statistical Model for Predicting Generalization in Few-Shot Classification Yassir Bendou Vincent Gripon Bastien Pasdeloup Lukas Mauch Stefan Uhlich Fabien Cardinaux G. B. Hacene Javier Alonso García 44 2 0 13 Dec 2022
Adversarial Weight Perturbation Improves Generalization in Graph Neural Networks Yihan Wu Aleksandar Bojchevski Heng Huang AAML 47 30 0 09 Dec 2022
Learning Options via Compression Yiding Jiang Emmy Liu Benjamin Eysenbach Zico Kolter Chelsea Finn OffRL 42 13 0 08 Dec 2022
Cross-Domain Ensemble Distillation for Domain Generalization Kyung-Jin Lee Sungyeon Kim Suha Kwak FedML OOD 33 38 0 25 Nov 2022
Improving Multi-task Learning via Seeking Task-based Flat Regions Hoang Phan Lam C. Tran Ngoc N. Tran Nhat Ho Tuan Truong Qi Lei Nhat Ho Dinh Q. Phung Trung Le 43 11 0 24 Nov 2022
Quantifying the Impact of Label Noise on Federated Learning Shuqi Ke Chao Huang Xin Liu FedML 45 7 0 15 Nov 2022
Towards A Unified Conformer Structure: from ASR to ASV Task Dexin Liao Tao Jiang Feng Wang Lin Li Q. Hong 59 10 0 14 Nov 2022
How Does Sharpness-Aware Minimization Minimize Sharpness? Kaiyue Wen Tengyu Ma Zhiyuan Li AAML 33 47 0 10 Nov 2022
Do highly over-parameterized neural networks generalize since bad solutions are rare? Julius Martinetz T. Martinetz 47 1 0 07 Nov 2022
Instance-Dependent Generalization Bounds via Optimal Transport Songyan Hou Parnian Kassraie Anastasis Kratsios Andreas Krause Jonas Rothfuss 41 6 0 02 Nov 2022
Same Pre-training Loss, Better Downstream: Implicit Bias Matters for Language Models Hong Liu Sang Michael Xie Zhiyuan Li Tengyu Ma AI4CE 53 50 0 25 Oct 2022
A PAC-Bayesian Generalization Bound for Equivariant Networks Arash Behboodi Gabriele Cesa Taco S. Cohen 63 18 0 24 Oct 2022
K-SAM: Sharpness-Aware Minimization at the Speed of SGD Renkun Ni Ping Yeh-Chiang Jonas Geiping Micah Goldblum A. Wilson Tom Goldstein 26 8 0 23 Oct 2022
Pareto Manifold Learning: Tackling multiple tasks via ensembles of single-task models Nikolaos Dimitriadis P. Frossard Franccois Fleuret 36 25 0 18 Oct 2022
Self-Stabilization: The Implicit Bias of Gradient Descent at the Edge of Stability Alexandru Damian Eshaan Nichani Jason D. Lee 49 78 0 30 Sep 2022
Scale-invariant Bayesian Neural Networks with Connectivity Tangent Kernel Sungyub Kim Si-hun Park Kyungsu Kim Eunho Yang BDL 45 4 0 30 Sep 2022
Learning Gradient-based Mixup towards Flatter Minima for Domain Generalization Danni Peng Sinno Jialin Pan 45 2 0 29 Sep 2022
Why neural networks find simple solutions: the many regularizers of geometric complexity Benoit Dherin Michael Munn M. Rosca David Barrett 65 31 0 27 Sep 2022
The BUTTER Zone: An Empirical Study of Training Dynamics in Fully Connected Neural Networks Charles Edison Tripp J. Perr-Sauer L. Hayne M. Lunacek Jamil Gafur AI4CE 48 1 0 25 Jul 2022
An Impartial Take to the CNN vs Transformer Robustness Contest Francesco Pinto Philip Torr P. Dokania UQCV AAML 38 49 0 22 Jul 2022
On the Strong Correlation Between Model Invariance and Generalization Weijian Deng Stephen Gould Liang Zheng OOD 39 17 0 14 Jul 2022
PAC-Bayesian Domain Adaptation Bounds for Multiclass Learners Anthony Sicilia Katherine Atwell Malihe Alikhani Seong Jae Hwang BDL 63 9 0 12 Jul 2022
Models Out of Line: A Fourier Lens on Distribution Shift Robustness Sara Fridovich-Keil Brian Bartoldson James Diffenderfer B. Kailkhura P. Bremer OOD 61 0 0 08 Jul 2022
Aug-NeRF: Training Stronger Neural Radiance Fields with Triple-Level Physically-Grounded Augmentations Tianlong Chen Peihao Wang Zhiwen Fan Zhangyang Wang 43 55 0 04 Jul 2022
Integral Probability Metrics PAC-Bayes Bounds Ron Amit Baruch Epstein Shay Moran Ron Meir 37 18 0 01 Jul 2022
Understanding the effect of sparsity on neural networks robustness Lukas Timpl R. Entezari Hanie Sedghi Behnam Neyshabur O. Saukh 51 12 0 22 Jun 2022
Sparse Double Descent: Where Network Pruning Aggravates Overfitting Zhengqi He Zeke Xie Quanzhi Zhu Zengchang Qin 86 27 0 17 Jun 2022
Benefits of Additive Noise in Composing Classes with Bounded Capacity A. F. Pour H. Ashtiani 48 3 0 14 Jun 2022
Towards Understanding Sharpness-Aware Minimization Maksym Andriushchenko Nicolas Flammarion AAML 49 135 0 13 Jun 2022
Trajectory-dependent Generalization Bounds for Deep Neural Networks via Fractional Brownian Motion Chengli Tan Jiang Zhang Junmin Liu 51 1 0 09 Jun 2022
Sharp-MAML: Sharpness-Aware Model-Agnostic Meta Learning Momin Abbas Quan-Wu Xiao Lisha Chen Pin-Yu Chen Tianyi Chen 31 78 0 08 Jun 2022
CNNs Avoid Curse of Dimensionality by Learning on Patches Vamshi C. Madala S. Chandrasekaran Jason Bunk UQCV 55 5 0 22 May 2022
Investigating Generalization by Controlling Normalized Margin Alexander R. Farhang Jeremy Bernstein Kushal Tirumala Yang Liu Yisong Yue 36 6 0 08 May 2022
Topology and geometry of data manifold in deep learning German Magai A. Ayzenberg AAML 33 11 0 19 Apr 2022
Enhancing Adversarial Training with Second-Order Statistics of Weights Gao Jin Xinping Yi Wei Huang S. Schewe Xiaowei Huang AAML 40 47 0 11 Mar 2022
QDrop: Randomly Dropping Quantization for Extremely Low-bit Post-Training Quantization Xiuying Wei Ruihao Gong Yuhang Li Xianglong Liu F. Yu MQ VLM 45 171 0 11 Mar 2022
PACTran: PAC-Bayesian Metrics for Estimating the Transferability of Pretrained Models to Classification Tasks Nan Ding Xi Chen Tomer Levinboim Soravit Changpinyo Radu Soricut 40 26 0 10 Mar 2022
Generalization Through The Lens Of Leave-One-Out Error Gregor Bachmann Thomas Hofmann Aurelien Lucchi 97 7 0 07 Mar 2022
Adversarial robustness of sparse local Lipschitz predictors Ramchandran Muthukumar Jeremias Sulam AAML 39 13 0 26 Feb 2022
Bayesian Model Selection, the Marginal Likelihood, and Generalization Sanae Lotfi Pavel Izmailov Gregory W. Benton Micah Goldblum A. Wilson UQCV BDL 75 56 0 23 Feb 2022