Sharpness-Aware Minimization for Efficiently Improving Generalization

3 October 2020

Papers citing "Sharpness-Aware Minimization for Efficiently Improving Generalization"

50 / 867 papers shown

Title
Incorporating brain-inspired mechanisms for multimodal learning in artificial intelligence Xiang-Yu He Dongcheng Zhao Yang Li Qingqun Kong Xin Yang Yi Zeng 19 0 0 15 May 2025
SEAL: Searching Expandable Architectures for Incremental Learning Matteo Gambella Vicente Javier Castro Solar Manuel Roveri CLL 29 0 0 15 May 2025
Towards the Three-Phase Dynamics of Generalization Power of a DNN Yuxuan He Junpeng Zhang Hongyuan Zhang Quanshi Zhang AI4CE 26 0 0 11 May 2025
Improving Generalization of Medical Image Registration Foundation Model Jing Hu Kaiwei Yu Hongjiang Xian Shu Hu Xin Wang MedIm 31 0 0 10 May 2025
Learning from Loss Landscape: Generalizable Mixed-Precision Quantization via Adaptive Sharpness-Aware Gradient Aligning Lianbo Ma Jianlun Ma Yuee Zhou Guoyang Xie Qiang He Zhichao Lu MQ 45 0 0 08 May 2025
Sharpness-Aware Minimization with Z-Score Gradient Filtering for Neural Networks Juyoung Yun 38 0 0 05 May 2025
Low-Loss Space in Neural Networks is Continuous and Fully Connected Yongding Tian Zaid Al-Ars Maksim Kitsak P. Hofstee 3DPC 26 0 0 05 May 2025
Robust AI-Generated Face Detection with Imbalanced Data Yamini Sri Krubha Aryana Hou Braden Vester Web Walker X. Wang Li Lin Shu Hu 29 0 0 04 May 2025
Focal-SAM: Focal Sharpness-Aware Minimization for Long-Tailed Classification Sicong Li Qianqian Xu Zhiyong Yang Zitai Wang L. Zhang Xiaochun Cao Q. Huang 67 0 0 03 May 2025
Transferable Adversarial Attacks on Black-Box Vision-Language Models Kai Hu Weichen Yu L. Zhang Alexander Robey Andy Zou Chengming Xu Haoqi Hu Matt Fredrikson AAML VLM 57 0 0 02 May 2025
Seeking Flat Minima over Diverse Surrogates for Improved Adversarial Transferability: A Theoretical Framework and Algorithmic Instantiation Meixi Zheng Kehan Wu Yanbo Fan Rui Huang Baoyuan Wu AAML 37 0 0 23 Apr 2025
How Effective Can Dropout Be in Multiple Instance Learning ? Wenhui Zhu Peijie Qiu Xiwen Chen Zhangsihao Yang Aristeidis Sotiras Abolfazl Razi Y. Wang 32 0 0 21 Apr 2025
Connecting Parameter Magnitudes and Hessian Eigenspaces at Scale using Sketched Methods Andres Fernandez Frank Schneider Maren Mahsereci Philipp Hennig 33 0 0 20 Apr 2025
Mitigating Parameter Interference in Model Merging via Sharpness-Aware Fine-Tuning Yeoreum Lee Jinwook Jung Sungyong Baik MoMe 40 0 0 20 Apr 2025
An overview of condensation phenomenon in deep learning Zhi-Qin John Xu Yaoyu Zhang Zhangchen Zhou AI4CE 29 0 0 13 Apr 2025
Min-Max Optimisation for Nonconvex-Nonconcave Functions Using a Random Zeroth-Order Extragradient Algorithm Amir Ali Farzin Yuen-Man Pun Philipp Braun Antoine Lesage-Landry Youssef Diouane Iman Shames 45 1 0 10 Apr 2025
Domain Generalization via Discrete Codebook Learning Shaocong Long Qianyu Zhou Xikun Jiang Chenhao Ying Lizhuang Ma Yuan Luo 41 0 0 09 Apr 2025
Sharpness-Aware Parameter Selection for Machine Unlearning Saber Malekmohammadi Hong kyu Lee Li Xiong MU 151 0 0 08 Apr 2025
SelfMAD: Enhancing Generalization and Robustness in Morphing Attack Detection via Self-Supervised Learning Marija Ivanovska Leon Todorov Naser Damer Deepak Kumar Jain Peter Peer Vitomir Štruc AAML 30 0 0 07 Apr 2025
DiCoTTA: Domain-invariant Learning for Continual Test-time Adaptation Sohyun Lee N. Kim Juwon Kang Seong Joon Oh Suha Kwak 89 0 0 07 Apr 2025
From Specificity to Generality: Revisiting Generalizable Artifacts in Detecting Face Deepfakes Long Ma Zhiyuan Yan Yize Chen Jin Xu Qinglang Guo Hu Huang Yong Liao Hui Lin CVBM 41 0 0 07 Apr 2025
Generative Classifier for Domain Generalization Shaocong Long Qianyu Zhou X. Li Chenhao Ying Yunhai Tong Lizhuang Ma Yuan Luo Dacheng Tao 41 0 0 03 Apr 2025
Hessian-aware Training for Enhancing DNNs Resilience to Parameter Corruptions Tahmid Hasan Prato Seijoon Kim Lizhong Chen Sanghyun Hong AAML 35 0 0 02 Apr 2025
DGSAM: Domain Generalization via Individual Sharpness-Aware Minimization Youngjun Song Youngsik Hwang Jonghun Lee Heechang Lee Dong-Young Lim AAML 49 0 0 30 Mar 2025
FairSAM: Fair Classification on Corrupted Data Through Sharpness-Aware Minimization Yucong Dai Jie Ji Xiaolong Ma Yongkai Wu 46 0 0 29 Mar 2025
Breach in the Shield: Unveiling the Vulnerabilities of Large Language Models Runpeng Dai Run Yang Fan Zhou Hongtu Zhu 28 0 0 28 Mar 2025
RLDBF: Enhancing LLMs Via Reinforcement Learning With DataBase FeedBack Weichen Dai Zijie Dai Zhijie Huang Yixuan Pan Xinhe Li Xi Li Yi Zhou Ji Qi Wu Jiang 24 0 0 28 Mar 2025
The Devil is in Low-Level Features for Cross-Domain Few-Shot Segmentation Yuhan Liu Yixiong Zou Yuhua Li Ruixuan Li 43 0 0 27 Mar 2025
EasyRobust: A Comprehensive and Easy-to-use Toolkit for Robust and Generalized Vision Xiaofeng Mao YueFeng Chen Rong Zhang Hui Xue Zhao Li Hang Su AAML VLM 43 0 0 21 Mar 2025
Variance-Aware Noisy Training: Hardening DNNs against Unstable Analog Computations Xiao Wang Hendrik Borras Bernhard Klein Holger Fröning 65 0 0 20 Mar 2025
Layer-wise Adaptive Gradient Norm Penalizing Method for Efficient and Accurate Deep Learning Sunwoo Lee 100 0 0 18 Mar 2025
Understanding Flatness in Generative Models: Its Role and Benefits Taehwan Lee Kyeongkook Seo Jaejun Yoo Sung Whan Yoon DiffM 55 0 0 14 Mar 2025
Stabilizing Quantization-Aware Training by Implicit-Regularization on Hessian Matrix Junbiao Pang Tianyang Cai 39 1 0 14 Mar 2025
Architecture-Aware Minimization (A $^2$ M): How to Find Flat Minima in Neural Architecture Search Matteo Gambella Fabrizio Pittorino Manuel Roveri 61 0 0 13 Mar 2025
A New Benchmark for Few-Shot Class-Incremental Learning: Redefining the Upper Bound Shiwon Kim Dongjun Hwang Sungwon Woo Rita Singh CLL 52 0 0 13 Mar 2025
A Frustratingly Simple Yet Highly Effective Attack Baseline: Over 90% Success Rate Against the Strong Black-box Models of GPT-4.5/4o/o1 Zhaoyi Li Xiaohan Zhao Dong-Dong Wu Jiacheng Cui Zhiqiang Shen AAML VLM 69 0 0 13 Mar 2025
Differential Privacy Personalized Federated Learning Based on Dynamically Sparsified Client Updates Chuanyin Wang Yifei Zhang Neng Gao Qiang Luo FedML 66 0 0 12 Mar 2025
Fair Federated Medical Image Classification Against Quality Shift via Inter-Client Progressive State Matching Nannan Wu Zhuo Kuang Zengqiang Yan Ping Wang Li Yu FedML 49 0 0 12 Mar 2025
Single Domain Generalization with Adversarial Memory Hao Yan Marzi Heidari Yuhong Guo 97 0 0 08 Mar 2025
Continual Optimization with Symmetry Teleportation for Multi-Task Learning Zhipeng Zhou Ziqiao Meng Pengcheng Wu Peilin Zhao Chunyan Miao 47 0 0 06 Mar 2025
Effective LLM Knowledge Learning via Model Generalization Mingkang Zhu Xi Chen Z. Wang Bei Yu Hengshuang Zhao Jiaya Jia 60 0 0 05 Mar 2025
Convergence Analysis of Federated Learning Methods Using Backward Error Analysis Jinwoo Lim Suhyun Kim Soo-Mook Moon FedML 55 0 0 05 Mar 2025
Sharpness-Aware Minimization: General Analysis and Improved Rates Dimitris Oikonomou Nicolas Loizou 65 0 0 04 Mar 2025
STAR: Stability-Inducing Weight Perturbation for Continual Learning Masih Eskandar Tooba Imtiaz Davin Hill Zifeng Wang Jennifer Dy CLL 36 0 0 03 Mar 2025
Deep Learning is Not So Mysterious or Different Andrew Gordon Wilson 41 2 0 03 Mar 2025
Advancing Prompt-Based Methods for Replay-Independent General Continual Learning Zhiqi Kang Liyuan Wang Xingxing Zhang Karteek Alahari CLL VLM 38 1 0 02 Mar 2025
Precise Event Spotting in Sports Videos: Solving Long-Range Dependency and Class Imbalance Sanchayan Santra Vishal M. Chudasama Pankaj Wasnik Vineeth N. Balasubramanian AI4TS 34 0 0 28 Feb 2025
Gradient-Guided Annealing for Domain Generalization Aristotelis Ballas Christos Diou OOD 165 0 0 27 Feb 2025
Revisit the Stability of Vanilla Federated Learning Under Diverse Conditions Youngjoon Lee J. Gong Sun Choi Joonhyuk Kang FedML Presented at ResearchTrend Connect \| FedML on 23 Apr 2025 122 1 0 27 Feb 2025
LORENZA: Enhancing Generalization in Low-Rank Gradient LLM Training via Efficient Zeroth-Order Adaptive SAM Yehonathan Refael Iftach Arbel Ofir Lindenbaum Tom Tirer 66 0 0 26 Feb 2025