Sharpness-Aware Minimization for Efficiently Improving Generalization

3 October 2020

Papers citing "Sharpness-Aware Minimization for Efficiently Improving Generalization"

50 / 867 papers shown

Title
QGen: On the Ability to Generalize in Quantization Aware Training Mohammadhossein Askarihemmat Ahmadreza Jeddi Reyhane Askari Hemmat Ivan Lazarevich Alexander Hoffman Sudhakar Sah Ehsan Saboori Yvon Savaria Jean-Pierre David MQ 21 0 0 17 Apr 2024
Improved Generalization Bounds for Communication Efficient Federated Learning Peyman Gholami H. Seferoglu FedML AI4CE 23 6 0 17 Apr 2024
Resolve Domain Conflicts for Generalizable Remote Physiological Measurement Weiyu Sun Xinyu Zhang Hao Lu Ying Chen Yun Ge Xiao-Lin Huang Jie Yuan Yingcong Chen 31 11 0 11 Apr 2024
Flatness Improves Backbone Generalisation in Few-shot Classification Rui Li Martin Trapp Marcus Klasson Arno Solin 45 0 0 11 Apr 2024
Slax: A Composable JAX Library for Rapid and Flexible Prototyping of Spiking Neural Networks Thomas M. Summe Siddharth Joshi 36 2 0 08 Apr 2024
Continual Learning with Weight Interpolation Jkedrzej Kozal Jan Wasilewski Bartosz Krawczyk Michal Wo'zniak CLL MoMe 34 6 0 05 Apr 2024
DeiT-LT Distillation Strikes Back for Vision Transformer Training on Long-Tailed Datasets Harsh Rangwani Pradipto Mondal Mayank Mishra Ashish Ramayee Asokan R. V. Babu 29 8 0 03 Apr 2024
Make Continual Learning Stronger via C-Flat Ang Bian Wei Li Hangjie Yuan Chengrong Yu Zixiang Zhao Mang Wang Aojun Lu Tao Feng 26 9 0 01 Apr 2024
AETTA: Label-Free Accuracy Estimation for Test-Time Adaptation Taeckyung Lee Sorn Chottananurak Taesik Gong Sung-Ju Lee 34 1 0 01 Apr 2024
From Robustness to Improved Generalization and Calibration in Pre-trained Language Models Josip Jukić Jan Snajder 37 0 0 31 Mar 2024
CHAIN: Enhancing Generalization in Data-Efficient GANs via lipsCHitz continuity constrAIned Normalization Yao Ni Piotr Koniusz AI4CE GAN 40 1 0 31 Mar 2024
Revisiting Random Weight Perturbation for Efficiently Improving Generalization Tao Li Qinghua Tao Weihao Yan Zehao Lei Yingwen Wu Kun Fang M. He Xiaolin Huang AAML 37 5 0 30 Mar 2024
Long-Tailed Recognition on Binary Networks by Calibrating A Pre-trained Model Jihun Kim Dahyun Kim Hyungrok Jung Taeil Oh Jonghyun Choi MQ 47 0 0 30 Mar 2024
MedBN: Robust Test-Time Adaptation against Malicious Test Samples Hyejin Park Jeongyeon Hwang Sunung Mun Sangdon Park Jungseul Ok AAML TTA OOD 37 5 0 28 Mar 2024
Deep Support Vectors Junhoo Lee Hyunho Lee Kyomin Hwang Nojun Kwak 46 0 0 26 Mar 2024
Diversity-Aware Agnostic Ensemble of Sharpness Minimizers Anh-Vu Bui Vy Vo Tung Pham Dinh Q. Phung Trung Le FedML UQCV 34 1 0 19 Mar 2024
Friendly Sharpness-Aware Minimization Tao Li Pan Zhou Zhengbao He Xinwen Cheng Xiaolin Huang AAML 46 15 0 19 Mar 2024
Robust Light-Weight Facial Affective Behavior Recognition with CLIP Li Lin Sarah Papabathini Xin Eric Wang Shu Hu CVBM 33 15 0 14 Mar 2024
Robust COVID-19 Detection in CT Images with CLIP Li Lin Yamini Sri Krubha Zhenhuan Yang Cheng Ren Thuc Duy Le Irene Amerini Xin Eric Wang Shu Hu 29 10 0 13 Mar 2024
DAM: Dynamic Adapter Merging for Continual Video QA Learning Feng Cheng Ziyang Wang Yi-Lin Sung Yan-Bo Lin Mohit Bansal Gedas Bertasius CLL MoMe 31 10 0 13 Mar 2024
Deep Submodular Peripteral Networks Gantavya Bhatt Arnav M. Das Jeff Bilmes 38 1 0 13 Mar 2024
Towards Model Extraction Attacks in GAN-Based Image Translation via Domain Shift Mitigation Di Mi Yanjun Zhang Leo Yu Zhang Shengshan Hu Qi Zhong Haizhuan Yuan Shirui Pan AAML 46 2 0 12 Mar 2024
Unknown Domain Inconsistency Minimization for Domain Generalization Seungjae Shin Heesun Bae Byeonghu Na Yoon-Yeong Kim Il-Chul Moon 36 1 0 12 Mar 2024
A New Machine Learning Dataset of Bulldog Nostril Images for Stenosis Degree Classification G. Higa Joyce Katiuccia Medeiros Ramos Carvalho Paolo Brito Pascoalini Zanoni Gisele Braziliano de Andrade H. Pistori 19 1 0 11 Mar 2024
Unveiling the Significance of Toddler-Inspired Reward Transition in Goal-Oriented Reinforcement Learning Junseok Park Yoonsung Kim Hee Bin Yoo Min Whoo Lee Kibeom Kim Won-Seok Choi Minsu Lee Byoung-Tak Zhang OffRL 35 1 0 11 Mar 2024
PeerAiD: Improving Adversarial Distillation from a Specialized Peer Tutor Jaewon Jung Hongsun Jang Jaeyong Song Jinho Lee OOD AAML 176 4 0 11 Mar 2024
Towards Robust Out-of-Distribution Generalization Bounds via Sharpness Yingtian Zou Kenji Kawaguchi Yingnan Liu Jiashuo Liu M. Lee W. Hsu 45 5 0 11 Mar 2024
Reset & Distill: A Recipe for Overcoming Negative Transfer in Continual Reinforcement Learning Hongjoon Ahn Jinu Hyeon Youngmin Oh Bosun Hwang Taesup Moon CLL OnRL 29 2 0 08 Mar 2024
GRAWA: Gradient-based Weighted Averaging for Distributed Training of Deep Learning Models Tolga Dimlioglu A. Choromańska 39 3 0 07 Mar 2024
Revisiting Confidence Estimation: Towards Reliable Failure Prediction Fei Zhu Xu-Yao Zhang Zhen Cheng Cheng-Lin Liu UQCV 49 10 0 05 Mar 2024
DPAdapter: Improving Differentially Private Deep Learning through Noise Tolerance Pre-training Zihao Wang Rui Zhu Dongruo Zhou Zhikun Zhang John C. Mitchell Haixu Tang XiaoFeng Wang AAML 43 6 0 05 Mar 2024
Level Set Teleportation: An Optimization Perspective Aaron Mishkin A. Bietti Robert Mansel Gower 33 1 0 05 Mar 2024
A Survey on Evaluation of Out-of-Distribution Generalization Han Yu Jiashuo Liu Xingxuan Zhang Jiayun Wu Peng Cui OOD 44 8 0 04 Mar 2024
A Case for Validation Buffer in Pessimistic Actor-Critic Michal Nauman M. Ostaszewski Marek Cygan 34 0 0 01 Mar 2024
Beyond Single-Model Views for Deep Learning: Optimization versus Generalizability of Stochastic Optimization Algorithms Toki Tahmid Inan Mingrui Liu Amarda Shehu 32 0 0 01 Mar 2024
Flatten Long-Range Loss Landscapes for Cross-Domain Few-Shot Learning Yixiong Zou Yicong Liu Yiman Hu Yuhua Li Ruixuan Li 43 3 0 01 Mar 2024
SURE: SUrvey REcipes for building reliable and robust deep networks Yuting Li Yingyi Chen Xuanlong Yu Dexiong Chen Xi Shen UQCV OOD 38 4 0 01 Mar 2024
Overestimation, Overfitting, and Plasticity in Actor-Critic: the Bitter Lesson of Reinforcement Learning Michal Nauman Michal Bortkiewicz Piotr Milo's Tomasz Trzciñski M. Ostaszewski Marek Cygan OffRL 24 17 0 01 Mar 2024
FlatNAS: optimizing Flatness in Neural Architecture Search for Out-of-Distribution Robustness Matteo Gambella Fabrizio Pittorino Manuel Roveri OOD 42 3 0 29 Feb 2024
Improving Group Connectivity for Generalization of Federated Deep Learning Zexi Li Jie Lin Zhiqi Li Didi Zhu Chao Wu AI4CE FedML 38 0 0 29 Feb 2024
Gradient Alignment for Cross-Domain Face Anti-Spoofing B. Le Simon S. Woo CVBM 38 19 0 29 Feb 2024
Pre-training Differentially Private Models with Limited Public Data Zhiqi Bu Xinwei Zhang Mingyi Hong Sheng Zha George Karypis 79 3 0 28 Feb 2024
Unveiling Privacy, Memorization, and Input Curvature Links Deepak Ravikumar Efstathia Soufleri Abolfazl Hashemi Kaushik Roy 54 5 0 28 Feb 2024
Out-of-Domain Generalization in Dynamical Systems Reconstruction Niclas Alexander Göring Florian Hess Manuel Brenner Zahra Monfared Daniel Durstewitz AI4CE 32 10 0 28 Feb 2024
Variational Learning is Effective for Large Deep Networks Yuesong Shen Nico Daheim Bai Cong Peter Nickl Gian Maria Marconi ... Rio Yokota Iryna Gurevych Daniel Cremers Mohammad Emtiyaz Khan Thomas Möllenhoff 40 22 0 27 Feb 2024
Preserving Fairness Generalization in Deepfake Detection Li Lin Xinan He Yan Ju Xin Eric Wang Feng Ding Shu Hu 42 35 0 27 Feb 2024
A priori Estimates for Deep Residual Network in Continuous-time Reinforcement Learning Shuyu Yin Qixuan Zhou Fei Wen Tao Luo 30 0 0 24 Feb 2024
Effective Gradient Sample Size via Variation Estimation for Accelerating Sharpness aware Minimization Jiaxin Deng Junbiao Pang Baochang Zhang Tian Wang 40 1 0 24 Feb 2024
Helen: Optimizing CTR Prediction Models with Frequency-wise Hessian Eigenvalue Regularization Zirui Zhu Yong Liu Zangwei Zheng Huifeng Guo Yang You 35 0 0 23 Feb 2024
On the Duality Between Sharpness-Aware Minimization and Adversarial Training Yihao Zhang Hangzhou He Jingyu Zhu Huanran Chen Yifei Wang Zeming Wei AAML 29 9 0 23 Feb 2024