ResearchTrend.AI
TRAM: Bridging Trust Regions and Sharpness Aware Minimization
v1v2 (latest)

TRAM: Bridging Trust Regions and Sharpness Aware Minimization

International Conference on Learning Representations (ICLR), 2023
Tom Sherborne
Naomi Saphra
Pradeep Dasigi
Hao Peng
ArXiv (abs)PDFHTML

Papers citing "TRAM: Bridging Trust Regions and Sharpness Aware Minimization"

5 / 5 papers shown
Zeroth-Order Sharpness-Aware Learning with Exponential Tilting
Zeroth-Order Sharpness-Aware Learning with Exponential Tilting
Xuchen Gong
Tian Li
148
0
0
17 Oct 2025
Implicit Regularization of Sharpness-Aware Minimization for Scale-Invariant Problems
Implicit Regularization of Sharpness-Aware Minimization for Scale-Invariant ProblemsNeural Information Processing Systems (NeurIPS), 2024
Bingcong Li
Liang Zhang
Niao He
293
9
0
18 Oct 2024
Convergence of Sharpness-Aware Minimization Algorithms using Increasing Batch Size and Decaying Learning Rate
Convergence of Sharpness-Aware Minimization Algorithms using Increasing Batch Size and Decaying Learning Rate
Hinata Harada
Hideaki Iiduka
262
1
0
16 Sep 2024
Fast Forwarding Low-Rank Training
Fast Forwarding Low-Rank TrainingConference on Empirical Methods in Natural Language Processing (EMNLP), 2024
Adir Rahamim
Naomi Saphra
Sara Kangaslahti
Yonatan Belinkov
123
0
0
06 Sep 2024
From Robustness to Improved Generalization and Calibration in Pre-trained Language Models
From Robustness to Improved Generalization and Calibration in Pre-trained Language Models
Josip Jukić
Jan Snajder
370
2
0
31 Mar 2024