Sharpness-Aware Minimization for Efficiently Improving Generalization

3 October 2020

Papers citing "Sharpness-Aware Minimization for Efficiently Improving Generalization"

50 / 867 papers shown

Title
Enhancing Sharpness-Aware Minimization by Learning Perturbation Radius Xuehao Wang Weisen Jiang Shuai Fu Yu Zhang AAML 42 0 0 15 Aug 2024
The Ungrounded Alignment Problem Marc Pickett Aakash Kumar Nain Joseph Modayil Llion Jones 22 0 0 08 Aug 2024
Do Sharpness-based Optimizers Improve Generalization in Medical Image Analysis? Mohamed Hassan Aleksandar Vakanski Min Xian AAML MedIm 41 1 0 07 Aug 2024
Making Robust Generalizers Less Rigid with Soft Ascent-Descent Matthew J. Holland Toma Hamada OOD 28 0 0 07 Aug 2024
What comes after transformers? -- A selective survey connecting ideas in deep learning Johannes Schneider AI4CE 35 2 0 01 Aug 2024
Deep Companion Learning: Enhancing Generalization Through Historical Consistency Ruizhao Zhu Venkatesh Saligrama FedML 29 0 0 26 Jul 2024
Parameter-Efficient Fine-Tuning for Continual Learning: A Neural Tangent Kernel Perspective Jingren Liu Zhong Ji Yunlong Yu Jiale Cao Yanwei Pang Jungong Han Xuelong Li CLL 32 3 0 24 Jul 2024
CloudFixer: Test-Time Adaptation for 3D Point Clouds via Diffusion-Guided Geometric Transformation Hajin Shim Changhun Kim Eunho Yang TTA 31 5 0 23 Jul 2024
STAMP: Outlier-Aware Test-Time Adaptation with Stable Memory Replay Yongcan Yu Lijun Sheng R. He Jian Liang TTA 42 2 0 22 Jul 2024
Flatness-aware Sequential Learning Generates Resilient Backdoors Hoang Pham The-Anh Ta Anh Tran Khoa D. Doan FedML AAML 34 0 0 20 Jul 2024
LIDIA: Precise Liver Tumor Diagnosis on Multi-Phase Contrast-Enhanced CT via Iterative Fusion and Asymmetric Contrastive Learning Wei Huang Wei Liu Xiaoming Zhang Xiaoli Yin Xu Han ... Yu Shi Le Lu Ling Zhang Lei Zhang Ke Yan 24 0 0 18 Jul 2024
Sharpness-diversity tradeoff: improving flat ensembles with SharpBalance Haiquan Lu Xiaotian Liu Yefan Zhou Qunli Li Kurt Keutzer Michael W. Mahoney Yujun Yan Huanrui Yang Yaoqing Yang 38 1 0 17 Jul 2024
Improving SAM Requires Rethinking its Optimization Formulation Wanyun Xie Fabian Latorre Kimon Antonakopoulos Thomas Pethick V. Cevher 34 1 0 17 Jul 2024
This Probably Looks Exactly Like That: An Invertible Prototypical Network Zachariah Carmichael Timothy Redgrave Daniel Gonzalez Cedre Walter J. Scheirer BDL 39 2 0 16 Jul 2024
Exploring Quantization for Efficient Pre-Training of Transformer Language Models Kamran Chitsaz Quentin Fournier Gonccalo Mordido Sarath Chandar MQ 44 3 0 16 Jul 2024
Augmented Neural Fine-Tuning for Efficient Backdoor Purification Nazmul Karim Abdullah Al Arafat Umar Khalid Zhishan Guo Nazanin Rahnavard AAML 40 0 0 14 Jul 2024
Pareto Low-Rank Adapters: Efficient Multi-Task Learning with Preferences Nikolaos Dimitriadis Pascal Frossard F. Fleuret MoE 59 6 0 10 Jul 2024
Threats and Defenses in Federated Learning Life Cycle: A Comprehensive Survey and Challenges Yanli Li Zhongliang Guo Nan Yang Huaming Chen Dong Yuan Weiping Ding FedML 34 2 0 09 Jul 2024
Shedding More Light on Robust Classifiers under the lens of Energy-based Models Mujtaba Hussain Mirza Maria Rosaria Briglia Senad Beadini I. Masi AAML 28 1 0 08 Jul 2024
Understanding Visual Feature Reliance through the Lens of Complexity Thomas Fel Louis Bethune Andrew Kyle Lampinen Thomas Serre Katherine Hermann FAtt CoGe 30 6 0 08 Jul 2024
Multimodal Classification via Modal-Aware Interactive Enhancement Qing-Yuan Jiang Zhouyang Chi Yang Yang 31 3 0 05 Jul 2024
An Adaptive Stochastic Gradient Method with Non-negative Gauss-Newton Stepsizes Antonio Orvieto Lin Xiao 39 2 0 05 Jul 2024
Batch Transformer: Look for Attention in Batch Myung Beom Her Jisu Jeong Hojoon Song Ji-Hyeong Han ViT 32 2 0 05 Jul 2024
C $^3$ DG: Conditional Domain Generalization for Hyperspectral Imagery Classification with Convergence and Constrained-risk Theories Zhe Gao Bin Pan Zhenwei Shi 40 0 0 04 Jul 2024
Bias of Stochastic Gradient Descent or the Architecture: Disentangling the Effects of Overparameterization of Neural Networks Amit Peleg Matthias Hein 26 0 0 04 Jul 2024
Fisher-aware Quantization for DETR Detectors with Critical-category Objectives Huanrui Yang Yafeng Huang Zhen Dong Denis A. Gudovskiy Tomoyuki Okuno Yohei Nakata Yuan Du Kurt Keutzer Shanghang Zhang MQ 49 0 0 03 Jul 2024
Curvature Clues: Decoding Deep Learning Privacy with Input Loss Curvature Deepak Ravikumar Efstathia Soufleri Kaushik Roy 29 0 0 03 Jul 2024
OxonFair: A Flexible Toolkit for Algorithmic Fairness Eoin Delaney Zihao Fu Sandra Wachter Brent Mittelstadt Chris Russell FaML 54 3 0 30 Jun 2024
On the Trade-off between Flatness and Optimization in Distributed Learning Ying Cao Zhaoxian Wu Kun Yuan Ali H. Sayed 30 1 0 28 Jun 2024
Exploring Energy-Based Models for Out-of-Distribution Detection in Dialect Identification Yaqian Hao Chenguang Hu Yingying Gao Shilei Zhang Junlan Feng 21 0 0 26 Jun 2024
Toward Universal Medical Image Registration via Sharpness-Aware Meta-Continual Learning Bomin Wang Xinzhe Luo Xiahai Zhuang CLL FedML 31 0 0 25 Jun 2024
Beyond Silence: Bias Analysis through Loss and Asymmetric Approach in Audio Anti-Spoofing Hye-jin Shim Md. Sahidullah Jee-weon Jung Shinji Watanabe Tomi Kinnunen 27 2 0 25 Jun 2024
Improving robustness to corruptions with multiplicative weight perturbations Trung Trinh Markus Heinonen Luigi Acerbi Samuel Kaski 41 0 0 24 Jun 2024
MD tree: a model-diagnostic tree grown on loss landscape Yefan Zhou Jianlong Chen Qinxue Cao Konstantin Schürholt Yaoqing Yang 29 2 0 24 Jun 2024
DataFreeShield: Defending Adversarial Attacks without Training Data Hyeyoon Lee Kanghyun Choi Dain Kwon Sunjong Park Mayoore S. Jaiswal Noseong Park Jonghyun Choi Jinho Lee 30 0 0 21 Jun 2024
Flat Posterior Does Matter For Bayesian Model Averaging Sungjun Lim Jeyoon Yeom Sooyon Kim Hoyoon Byun Jinho Kang Yohan Jung Jiyoung Jung Kyungwoo Song AAML BDL 48 0 0 21 Jun 2024
Adaptive Adversarial Cross-Entropy Loss for Sharpness-Aware Minimization Tanapat Ratchatorn Masayuki Tanaka AAML 28 0 0 20 Jun 2024
DPO: Dual-Perturbation Optimization for Test-time Adaptation in 3D Object Detection Zhuoxiao Chen Zixin Wang Yadan Luo Sen Wang Zi Huang AAML 3DPC 30 0 0 19 Jun 2024
Efficient Sharpness-Aware Minimization for Molecular Graph Transformer Models Yili Wang Kaixiong Zhou Ninghao Liu Ying Wang Xin Wang 38 10 0 19 Jun 2024
PromptDSI: Prompt-based Rehearsal-free Instance-wise Incremental Learning for Document Retrieval Tuan-Luc Huynh Thuy-Trang Vu Weiqing Wang Yinwei Wei Trung Le D. Gašević Yuan-Fang Li Thanh-Toan Do VLM CLL 38 0 0 18 Jun 2024
Just How Flexible are Neural Networks in Practice? Ravid Shwartz-Ziv Micah Goldblum Arpit Bansal C. B. Bruss Yann LeCun Andrew Gordon Wilson 37 4 0 17 Jun 2024
Memory Faults in Activation-sparse Quantized Deep Neural Networks: Analysis and Mitigation using Sharpness-aware Training Akul Malhotra S. Gupta 13 0 0 15 Jun 2024
What Does Softmax Probability Tell Us about Classifiers Ranking Across Diverse Test Conditions? Weijie Tu Weijian Deng Liang Zheng Tom Gedeon 37 0 0 14 Jun 2024
When Will Gradient Regularization Be Harmful? Yang Zhao Hao Zhang Xiuyuan Hu AI4CE 21 1 0 14 Jun 2024
Enhancing Domain Adaptation through Prompt Gradient Alignment Hoang Phan Lam C. Tran Quyen Tran Trung Le 52 0 0 13 Jun 2024
Asymptotic Unbiased Sample Sampling to Speed Up Sharpness-Aware Minimization Jiaxin Deng Junbiao Pang Baochang Zhang 64 1 0 12 Jun 2024
Agnostic Sharpness-Aware Minimization Van-Anh Nguyen Quyen Tran Tuan Truong Thanh-Toan Do Dinh Q. Phung Trung Le 38 0 0 11 Jun 2024
Loss Gradient Gaussian Width based Generalization and Optimization Guarantees A. Banerjee Qiaobo Li Yingxue Zhou 44 0 0 11 Jun 2024
Forget Sharpness: Perturbed Forgetting of Model Biases Within SAM Dynamics Ankit Vani Frederick Tung Gabriel L. Oliveira Hossein Sharifi-Noghabi AAML 31 0 0 10 Jun 2024
Revisiting Catastrophic Forgetting in Large Language Model Tuning Hongyu Li Liang Ding Meng Fang Dacheng Tao CLL KELM 45 15 0 07 Jun 2024