Dynamic Regularized Sharpness Aware Minimization in Federated Learning: Approaching Global Consistency and Smooth Landscape

19 May 2023

Li Shen

Liang Ding

Papers citing "Dynamic Regularized Sharpness Aware Minimization in Federated Learning: Approaching Global Consistency and Smooth Landscape"

27 / 27 papers shown

Title
A Unified Benchmark of Federated Learning with Kolmogorov-Arnold Networks for Medical Imaging Youngjoon Lee J. Gong Joonhyuk Kang FedML 50 1 0 28 Apr 2025
Fair Federated Medical Image Classification Against Quality Shift via Inter-Client Progressive State Matching Nannan Wu Zhuo Kuang Zengqiang Yan Ping Wang Li Yu FedML 49 0 0 12 Mar 2025
Federated Learning for Diffusion Models Zihao Peng Xijun Wang Shengbo Chen Hong Rao Cong Shen DiffM FedML 46 0 0 09 Mar 2025
Revisit the Stability of Vanilla Federated Learning Under Diverse Conditions Youngjoon Lee J. Gong Sun Choi Joonhyuk Kang FedML Presented at ResearchTrend Connect \| FedML on 23 Apr 2025 112 1 0 27 Feb 2025
A Method for Enhancing Generalization of Adam by Multiple Integrations Long Jin Han Nong Liangming Chen Zhenming Su 63 0 0 17 Dec 2024
Review of Mathematical Optimization in Federated Learning Shusen Yang Fangyuan Zhao Zihao Zhou Liang Shi Xuebin Ren Zongben Xu FedML AI4CE 67 0 0 02 Dec 2024
Understanding Generalization of Federated Learning: the Trade-off between Model Stability and Optimization Dun Zeng Zheshun Wu Shiyu Liu Yu Pan Xiaoying Tang Zenglin Xu MLT FedML 73 1 0 25 Nov 2024
Federated Learning with Relative Fairness Shogo H. Nakakita Tatsuya Kaneko Shinya Takamaeda-Yamazaki Masaaki Imaizumi FedML 21 2 0 02 Nov 2024
FuseFL: One-Shot Federated Learning through the Lens of Causality with Progressive Model Fusion Zhenheng Tang Yonggang Zhang Peijie Dong Y. Cheung Amelie Chi Zhou Bo Han Xiaowen Chu FedML MoMe AI4CE 45 6 0 27 Oct 2024
A-FedPD: Aligning Dual-Drift is All Federated Primal-Dual Learning Needs Yan Sun Li Shen Dacheng Tao FedML 18 0 0 27 Sep 2024
Harmful Fine-tuning Attacks and Defenses for Large Language Models: A Survey Tiansheng Huang Sihao Hu Fatih Ilhan Selim Furkan Tekin Ling Liu AAML 40 21 0 26 Sep 2024
DP $^2$ -FedSAM: Enhancing Differentially Private Federated Learning Through Personalized Sharpness-Aware Minimization Zhenxiao Zhang Yuanxiong Guo Yanmin Gong FedML 20 0 0 20 Sep 2024
Neighborhood and Global Perturbations Supported SAM in Federated Learning: From Local Tweaks To Global Awareness Boyuan Li Zihao Peng Yafei Li Mingliang Xu Shengbo Chen Baofeng Ji Cong Shen FedML 58 0 0 26 Aug 2024
Locally Estimated Global Perturbations are Better than Local Perturbations for Federated Sharpness-aware Minimization Ziqing Fan Shengchao Hu Jiangchao Yao Gang Niu Ya-Qin Zhang Masashi Sugiyama Yanfeng Wang FedML 36 11 0 29 May 2024
SADDLe: Sharpness-Aware Decentralized Deep Learning with Heterogeneous Data Sakshi Choudhary Sai Aparna Aketi Kaushik Roy FedML 37 0 0 22 May 2024
From Optimization to Generalization: Fair Federated Learning against Quality Shift via Inter-Client Sharpness Matching Nannan Wu Zhuo Kuang Zengqiang Yan Li Yu FedML 21 4 0 27 Apr 2024
Lightweight Unsupervised Federated Learning with Pretrained Vision Language Model Hao Yan Yuhong Guo VLM FedML 24 2 0 17 Apr 2024
Improving Group Connectivity for Generalization of Federated Deep Learning Zexi Li Jie Lin Zhiqi Li Didi Zhu Chao Wu AI4CE FedML 35 0 0 29 Feb 2024
FedImpro: Measuring and Improving Client Update in Federated Learning Zhenheng Tang Yonggang Zhang S. Shi Xinmei Tian Tongliang Liu Bo Han Xiaowen Chu FedML 13 13 0 10 Feb 2024
Federated Learning with Manifold Regularization and Normalized Update Reaggregation Xuming An Li Shen Han Hu Yong Luo FedML 36 4 0 10 Nov 2023
Diversifying the Mixture-of-Experts Representation for Language Models with Orthogonal Optimizer Boan Liu Liang Ding Li Shen Keqin Peng Yu Cao Dazhao Cheng Dacheng Tao MoE 34 7 0 15 Oct 2023
Window-based Model Averaging Improves Generalization in Heterogeneous Federated Learning Debora Caldarola Barbara Caputo Marco Ciccone FedML 13 7 0 02 Oct 2023
FedSOL: Stabilized Orthogonal Learning with Proximal Restrictions in Federated Learning Gihun Lee Minchan Jeong Sangmook Kim Jaehoon Oh Se-Young Yun FedML 17 8 0 24 Aug 2023
Understanding How Consistency Works in Federated Learning via Stage-wise Relaxed Initialization Yan Sun Li Shen Dacheng Tao FedML 9 14 0 09 Jun 2023
FedSpeed: Larger Local Interval, Less Communication Round, and Higher Generalization Accuracy Yan Sun Li Shen Tiansheng Huang Liang Ding Dacheng Tao FedML 29 51 0 21 Feb 2023
Towards Personalized Federated Learning A. Tan Han Yu Li-zhen Cui Qiang Yang FedML AI4CE 183 840 0 01 Mar 2021
Survey of Personalization Techniques for Federated Learning V. Kulkarni Milind Kulkarni Aniruddha Pant FedML 168 324 0 19 Mar 2020