ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2203.08065
  4. Cited By
Surrogate Gap Minimization Improves Sharpness-Aware Training
v1v2 (latest)

Surrogate Gap Minimization Improves Sharpness-Aware Training

International Conference on Learning Representations (ICLR), 2022
15 March 2022
Juntang Zhuang
Boqing Gong
Liangzhe Yuan
Huayu Chen
Hartwig Adam
Nicha Dvornek
S. Tatikonda
James Duncan
Ting Liu
ArXiv (abs)PDFHTML

Papers citing "Surrogate Gap Minimization Improves Sharpness-Aware Training"

50 / 132 papers shown
Flat Minima and Generalization: Insights from Stochastic Convex Optimization
Flat Minima and Generalization: Insights from Stochastic Convex Optimization
Matan Schliserman
Shira Vansover-Hager
Tomer Koren
148
0
0
05 Nov 2025
Modality-Aware SAM: Sharpness-Aware-Minimization Driven Gradient Modulation for Harmonized Multimodal Learning
Modality-Aware SAM: Sharpness-Aware-Minimization Driven Gradient Modulation for Harmonized Multimodal Learning
Hossein R. Nowdeh
Jie Ji
Xiaolong Ma
Fatemeh Afghah
175
0
0
28 Oct 2025
Learning Regularizers: Learning Optimizers that can Regularize
Learning Regularizers: Learning Optimizers that can Regularize
Suraj Kumar Sahoo
Narayanan C Krishnan
178
0
0
10 Oct 2025
Adjusting Initial Noise to Mitigate Memorization in Text-to-Image Diffusion Models
Adjusting Initial Noise to Mitigate Memorization in Text-to-Image Diffusion Models
Hyeonggeun Han
Sehwan Kim
Hyungjun Joo
Sangwoo Hong
Jungwoo Lee
DiffM
213
3
0
08 Oct 2025
Adaptively Sampling-Reusing-Mixing Decomposed Gradients to Speed Up Sharpness Aware Minimization
Adaptively Sampling-Reusing-Mixing Decomposed Gradients to Speed Up Sharpness Aware Minimization
Jiaxin Deng
Junbiao Pang
193
0
0
04 Oct 2025
Beyond Magic Words: Sharpness-Aware Prompt Evolving for Robust Large Language Models with TARE
Beyond Magic Words: Sharpness-Aware Prompt Evolving for Robust Large Language Models with TARE
Guancheng Wan
Lucheng Fu
Haoxin Liu
Yiqiao Jin
Hui Yi Leong
...
Yunpu Ma
Xiangru Tang
B. A. Prakash
Yizhou Sun
Wei Wang
KELM
215
0
0
28 Sep 2025
CoT-Space: A Theoretical Framework for Internal Slow-Thinking via Reinforcement Learning
CoT-Space: A Theoretical Framework for Internal Slow-Thinking via Reinforcement Learning
Zeyu Gan
Hao Yi
Yong Liu
OffRLLRM
315
2
0
04 Sep 2025
VASSO: Variance Suppression for Sharpness-Aware Minimization
Bingcong Li
Yilang Zhang
G. Giannakis
329
1
0
02 Sep 2025
Quantization Meets OOD: Generalizable Quantization-aware Training from a Flatness Perspective
Quantization Meets OOD: Generalizable Quantization-aware Training from a Flatness Perspective
Jiacheng Jiang
Yuan Meng
Chen Tang
Han Yu
Qun Li
Zhi Wang
Wenwu Zhu
MQ
141
1
0
31 Aug 2025
Bi-LoRA: Efficient Sharpness-Aware Minimization for Fine-Tuning Large-Scale Models
Bi-LoRA: Efficient Sharpness-Aware Minimization for Fine-Tuning Large-Scale Models
Yuhang Liu
Tao Li
Zhehao Huang
Zuopeng Yang
Xiaolin Huang
137
0
0
27 Aug 2025
C-Flat++: Towards a More Efficient and Powerful Framework for Continual Learning
C-Flat++: Towards a More Efficient and Powerful Framework for Continual Learning
Wei Li
Hangjie Yuan
Zixiang Zhao
Yifan Zhu
Aojun Lu
Tao Feng
Yanan Sun
215
1
0
26 Aug 2025
Curvature Learning for Generalization of Hyperbolic Neural Networks
Curvature Learning for Generalization of Hyperbolic Neural NetworksInternational Journal of Computer Vision (IJCV), 2025
Xiaomeng Fan
Yuwei Wu
Zhi Gao
Mehrtash Harandi
Yunde Jia
337
3
0
24 Aug 2025
Domain-Generalization to Improve Learning in Meta-Learning Algorithms
Domain-Generalization to Improve Learning in Meta-Learning Algorithms
Usman Anjum
Chris Stockman
Cat Luong
J. Zhan
FedML
260
1
0
13 Aug 2025
Efficiently Seeking Flat Minima for Better Generalization in Fine-Tuning Large Language Models and Beyond
Efficiently Seeking Flat Minima for Better Generalization in Fine-Tuning Large Language Models and Beyond
Jiaxin Deng
Qingcheng Zhu
Junbiao Pang
Linlin Yang
Zhongqian Fu
Baochang Zhang
221
0
0
01 Aug 2025
Communication-Efficient Distributed Training for Collaborative Flat Optima Recovery in Deep Learning
Communication-Efficient Distributed Training for Collaborative Flat Optima Recovery in Deep Learning
Tolga Dimlioglu
A. Choromańska
FedML
311
1
0
27 Jul 2025
DGSAM: Domain Generalization via Individual Sharpness-Aware Minimization
DGSAM: Domain Generalization via Individual Sharpness-Aware Minimization
Youngjun Song
Youngsik Hwang
Jonghun Lee
Heechang Lee
Dong-Young Lim
AAML
341
0
0
01 Jul 2025
Generalized Incremental Learning under Concept Drift across Evolving Data Streams
Generalized Incremental Learning under Concept Drift across Evolving Data Streams
En Yu
Jie Lu
G. Zhang
CLLTTA
269
1
0
06 Jun 2025
LightSAM: Parameter-Agnostic Sharpness-Aware Minimization
LightSAM: Parameter-Agnostic Sharpness-Aware Minimization
Yifei Cheng
Li Shen
Hao Sun
Nan Yin
Xiaochun Cao
Enhong Chen
AAML
267
1
0
30 May 2025
TDVE-Assessor: Benchmarking and Evaluating the Quality of Text-Driven Video Editing with LMMs
TDVE-Assessor: Benchmarking and Evaluating the Quality of Text-Driven Video Editing with LMMs
Juntong Wang
Jiarui Wang
Huiyu Duan
Guangtao Zhai
Xiongkuo Min
278
8
0
26 May 2025
Towards Robust Influence Functions with Flat Validation Minima
Towards Robust Influence Functions with Flat Validation MinimaInternational Conference on Machine Learning (ICML), 2025
Xichen Ye
Yifan Wu
Weizhong Zhang
Cheng Jin
Yifan Chen
TDI
487
3
0
25 May 2025
Optimization-Inspired Few-Shot Adaptation for Large Language Models
Optimization-Inspired Few-Shot Adaptation for Large Language Models
Boyan Gao
Xin Wang
Jianlong Wu
David A. Clifton
335
0
0
25 May 2025
Learning from Loss Landscape: Generalizable Mixed-Precision Quantization via Adaptive Sharpness-Aware Gradient Aligning
Learning from Loss Landscape: Generalizable Mixed-Precision Quantization via Adaptive Sharpness-Aware Gradient Aligning
Lianbo Ma
Jianlun Ma
Yuee Zhou
Guoyang Xie
Qiang He
Zhichao Lu
MQ
361
2
0
08 May 2025
EasyRobust: A Comprehensive and Easy-to-use Toolkit for Robust and Generalized Vision
EasyRobust: A Comprehensive and Easy-to-use Toolkit for Robust and Generalized Vision
Xiaofeng Mao
YueFeng Chen
Rong Zhang
Hui Xue
Zhao Li
Hang Su
AAMLVLM
366
0
0
21 Mar 2025
FedPCA: Noise-Robust Fair Federated Learning via Performance-Capacity Analysis
FedPCA: Noise-Robust Fair Federated Learning via Performance-Capacity Analysis
Nannan Wu
Zengqiang Yan
Nong Sang
Li Yu
Chang Wen Chen
254
1
0
13 Mar 2025
Fair Federated Medical Image Classification Against Quality Shift via Inter-Client Progressive State Matching
Fair Federated Medical Image Classification Against Quality Shift via Inter-Client Progressive State Matching
Nannan Wu
Zhuo Kuang
Zengqiang Yan
Ping Wang
Li Yu
FedML
335
0
0
12 Mar 2025
Sharpness-Aware Minimization: General Analysis and Improved Rates
Sharpness-Aware Minimization: General Analysis and Improved RatesInternational Conference on Learning Representations (ICLR), 2025
Dimitris Oikonomou
Nicolas Loizou
373
8
0
04 Mar 2025
Gradient-Guided Annealing for Domain Generalization
Gradient-Guided Annealing for Domain GeneralizationComputer Vision and Pattern Recognition (CVPR), 2025
Aristotelis Ballas
Christos Diou
OOD
1.4K
9
0
27 Feb 2025
LORENZA: Enhancing Generalization in Low-Rank Gradient LLM Training via Efficient Zeroth-Order Adaptive SAM
LORENZA: Enhancing Generalization in Low-Rank Gradient LLM Training via Efficient Zeroth-Order Adaptive SAM
Yehonathan Refael
Iftach Arbel
Ofir Lindenbaum
Tom Tirer
465
4
0
26 Feb 2025
SASSHA: Sharpness-aware Adaptive Second-order Optimization with Stable Hessian Approximation
SASSHA: Sharpness-aware Adaptive Second-order Optimization with Stable Hessian Approximation
Dahun Shin
Dongyeop Lee
Jinseok Chung
Namhoon Lee
ODLAAML
1.4K
2
0
25 Feb 2025
Explicit Eigenvalue Regularization Improves Sharpness-Aware Minimization
Explicit Eigenvalue Regularization Improves Sharpness-Aware Minimization
Haocheng Luo
Tuan Truong
Tung Pham
Mehrtash Harandi
Dinh Q. Phung
Trung Le
328
17
0
22 Jan 2025
Preconditioned Sharpness-Aware Minimization: Unifying Analysis and a Novel Learning Algorithm
Preconditioned Sharpness-Aware Minimization: Unifying Analysis and a Novel Learning AlgorithmIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2025
Yilang Zhang
Bingcong Li
G. Giannakis
AAML
241
0
0
11 Jan 2025
Seeking Consistent Flat Minima for Better Domain Generalization via Refining Loss Landscapes
Seeking Consistent Flat Minima for Better Domain Generalization via Refining Loss LandscapesComputer Vision and Pattern Recognition (CVPR), 2024
Aodi Li
Liansheng Zhuang
Xiao Long
Minghong Yao
Shafei Wang
1.2K
8
0
18 Dec 2024
Meta Curvature-Aware Minimization for Domain Generalization
Meta Curvature-Aware Minimization for Domain Generalization
Zhaoyu Chen
Yiwen Ye
Feilong Tang
Yongsheng Pan
Yong-quan Xia
BDL
1.1K
1
0
16 Dec 2024
GAQAT: gradient-adaptive quantization-aware training for domain
  generalization
GAQAT: gradient-adaptive quantization-aware training for domain generalization
Jiacheng Jiang
Yuan Meng
Chen Tang
Han Yu
Qun Li
Zhi Wang
Wenwu Zhu
MQ
336
1
0
07 Dec 2024
Dual-Representation Interaction Driven Image Quality Assessment with
  Restoration Assistance
Dual-Representation Interaction Driven Image Quality Assessment with Restoration AssistanceIEEE Workshop/Winter Conference on Applications of Computer Vision (WACV), 2024
Jingtong Yue
Xin Lin
Zijiu Yang
Chao Ren
401
0
0
26 Nov 2024
DiM: $f$-Divergence Minimization Guided Sharpness-Aware Optimization for
  Semi-supervised Medical Image Segmentation
DiM: fff-Divergence Minimization Guided Sharpness-Aware Optimization for Semi-supervised Medical Image Segmentation
Bingli Wang
Houcheng Su
Nan Yin
Mengzhu Wang
Li Shen
360
0
0
19 Nov 2024
Reliable Poisoned Sample Detection against Backdoor Attacks Enhanced by Sharpness Aware Minimization
Ruotong Wang
Mingli Zhu
Zihao Zhu
Baoyuan Wu
AAML
433
4
0
18 Nov 2024
Tilted Sharpness-Aware Minimization
Tilted Sharpness-Aware Minimization
Tian Li
Wanrong Zhu
J. Bilmes
348
0
0
30 Oct 2024
Fast Graph Sharpness-Aware Minimization for Enhancing and Accelerating
  Few-Shot Node Classification
Fast Graph Sharpness-Aware Minimization for Enhancing and Accelerating Few-Shot Node ClassificationNeural Information Processing Systems (NeurIPS), 2024
Yihong Luo
Yuhan Chen
Siya Qiu
Yiwei Wang
Chen Zhang
Yan Zhou
Xiaochun Cao
Jing Tang
AAML
315
6
0
22 Oct 2024
Implicit Regularization of Sharpness-Aware Minimization for
  Scale-Invariant Problems
Implicit Regularization of Sharpness-Aware Minimization for Scale-Invariant ProblemsNeural Information Processing Systems (NeurIPS), 2024
Bingcong Li
Liang Zhang
Niao He
327
9
0
18 Oct 2024
Sharpness-Aware Black-Box Optimization
Sharpness-Aware Black-Box Optimization
Feiyang Ye
Yueming Lyu
Xuehao Wang
Masashi Sugiyama
Yu Zhang
Ivor W. Tsang
AAML
506
5
0
16 Oct 2024
Sharpness-Aware Minimization Efficiently Selects Flatter Minima Late in Training
Sharpness-Aware Minimization Efficiently Selects Flatter Minima Late in TrainingInternational Conference on Learning Representations (ICLR), 2024
Zhanpeng Zhou
Mingze Wang
Yuchen Mao
Bingrui Li
Junchi Yan
AAML
589
14
0
14 Oct 2024
How Learning Dynamics Drive Adversarially Robust Generalization?
How Learning Dynamics Drive Adversarially Robust Generalization?
Yuelin Xu
Xiao Zhang
AAML
557
1
0
10 Oct 2024
Bilateral Sharpness-Aware Minimization for Flatter Minima
Bilateral Sharpness-Aware Minimization for Flatter Minima
Jiaxin Deng
Junbiao Pang
Baochang Zhang
Qingming Huang
AAML
1.0K
1
0
20 Sep 2024
Enhancing Sharpness-Aware Minimization by Learning Perturbation Radius
Enhancing Sharpness-Aware Minimization by Learning Perturbation Radius
Xuehao Wang
Weisen Jiang
Shuai Fu
Yu Zhang
AAML
291
1
0
15 Aug 2024
Do Sharpness-based Optimizers Improve Generalization in Medical Image
  Analysis?
Do Sharpness-based Optimizers Improve Generalization in Medical Image Analysis?IEEE Access (IEEE Access), 2024
Mohamed Hassan
Aleksandar Vakanski
Min Xian
AAMLMedIm
433
3
0
07 Aug 2024
Sharpness-diversity tradeoff: improving flat ensembles with SharpBalance
Sharpness-diversity tradeoff: improving flat ensembles with SharpBalance
Haiquan Lu
Xiaotian Liu
Yefan Zhou
Qunli Li
Kurt Keutzer
Michael W. Mahoney
Yujun Yan
Huanrui Yang
Yaoqing Yang
281
3
0
17 Jul 2024
Improving SAM Requires Rethinking its Optimization Formulation
Improving SAM Requires Rethinking its Optimization Formulation
Wanyun Xie
Fabian Latorre
Kimon Antonakopoulos
Thomas Pethick
Volkan Cevher
406
4
0
17 Jul 2024
Adaptive Adversarial Cross-Entropy Loss for Sharpness-Aware Minimization
Adaptive Adversarial Cross-Entropy Loss for Sharpness-Aware Minimization
Tanapat Ratchatorn
Masayuki Tanaka
AAML
325
1
0
20 Jun 2024
DPO: Dual-Perturbation Optimization for Test-time Adaptation in 3D
  Object Detection
DPO: Dual-Perturbation Optimization for Test-time Adaptation in 3D Object Detection
Zhuoxiao Chen
Zixin Wang
Yadan Luo
Sen Wang
Zi Huang
AAML3DPC
252
6
0
19 Jun 2024
123
Next
Page 1 of 3