FedNest: Federated Bilevel, Minimax, and Compositional Optimization

4 May 2022

Davoud Ataee Tarzanagh

Mingchen Li

Christos Thrampoulidis

Samet Oymak

FedML

ArXiv PDF HTML

Papers citing "FedNest: Federated Bilevel, Minimax, and Compositional Optimization"

50 / 55 papers shown

Title
Randomized Block-Coordinate Optimistic Gradient Algorithms for Root-Finding Problems Quoc Tran-Dinh Yang Luo 81 6 0 28 Jan 2025
On Penalty-based Bilevel Gradient Descent Method Han Shen Quan-Wu Xiao Tianyi Chen 47 50 0 08 Jan 2025
Review of Mathematical Optimization in Federated Learning Shusen Yang Fangyuan Zhao Zihao Zhou Liang Shi Xuebin Ren Zongben Xu FedML AI4CE 67 0 0 02 Dec 2024
Exploring the Generalization Capabilities of AID-based Bi-level Optimization C. L. Philip Chen Li Shen Zhiqiang Xu W. Liu Zhi-Quan Luo Peilin Zhao 60 0 0 25 Nov 2024
Federated Learning with Relative Fairness Shogo H. Nakakita Tatsuya Kaneko Shinya Takamaeda-Yamazaki Masaaki Imaizumi FedML 16 2 0 02 Nov 2024
Fully First-Order Methods for Decentralized Bilevel Optimization Xiaoyu Wang Xuxing Chen Shiqian Ma Tong Zhang 26 0 0 25 Oct 2024
A Communication and Computation Efficient Fully First-order Method for Decentralized Bilevel Optimization Min Wen Chengchang Liu Ahmed Abdelmoniem Yipeng Zhou Yuedong Xu 19 0 0 18 Oct 2024
Achieving Near-Optimal Convergence for Distributed Minimax Optimization with Adaptive Stepsizes Yan Huang Xiang Li Yipeng Shen Niao He Jinming Xu 30 1 0 05 Jun 2024
Constrained Bi-Level Optimization: Proximal Lagrangian Value function Approach and Hessian-free Algorithm Wei-Ting Yao Chengming Yu Shangzhi Zeng Jin Zhang 16 13 0 29 Jan 2024
Central Limit Theorem for Two-Timescale Stochastic Approximation with Markovian Noise: Theory and Applications Jie Hu Vishwaraj Doshi Do Young Eun 20 4 0 17 Jan 2024
Provably Convergent Federated Trilevel Learning Yang Jiao Kai Yang Tiancheng Wu Chen Jian Jianwei Huang FedML 11 3 0 19 Dec 2023
FedDRO: Federated Compositional Optimization for Distributionally Robust Learning Prashant Khanduri Chengyin Li Rafi Ibn Sultan Yao Qiang Joerg Kliewer Dongxiao Zhu 32 0 0 21 Nov 2023
On the Communication Complexity of Decentralized Bilevel Optimization Yihan Zhang My T. Thai Jie Wu Hongchang Gao 12 3 0 19 Nov 2023
Stochastic Smoothed Gradient Descent Ascent for Federated Minimax Optimization Wei Shen Minhui Huang Jiawei Zhang Cong Shen FedML 25 0 0 02 Nov 2023
Federated Multi-Objective Learning Haibo Yang Zhuqing Liu Jia-Wei Liu Chaosheng Dong Michinari Momma FedML 15 1 0 15 Oct 2023
Federated Multi-Level Optimization over Decentralized Networks Shuoguang Yang Xuezhou Zhang Mengdi Wang AI4CE 15 0 0 10 Oct 2023
Solving a Class of Non-Convex Minimax Optimization in Federated Learning Xidong Wu Jianhui Sun Zhengmian Hu Aidong Zhang Heng-Chiao Huang FedML 89 10 0 05 Oct 2023
Fair Canonical Correlation Analysis Zhuoping Zhou Davoud Ataee Tarzanagh Bojian Hou Boning Tong Jia Xu Yanbo Feng Jinjin Yu Li Shen 47 5 0 27 Sep 2023
Faster Stochastic Variance Reduction Methods for Compositional MiniMax Optimization Jin Liu Xiaokang Pan Junwen Duan Hongdong Li Youqi Li Zhe Qu 22 1 0 18 Aug 2023
FedPop: Federated Population-based Hyperparameter Tuning Haokun Chen Denis Krompass Jindong Gu Volker Tresp FedML 22 0 0 16 Aug 2023
Achieving Linear Speedup in Decentralized Stochastic Compositional Minimax Optimization Hongchang Gao 24 1 0 25 Jul 2023
Near-Optimal Nonconvex-Strongly-Convex Bilevel Optimization with Fully First-Order Oracles Le‐Yu Chen Yaohua Ma J. Zhang 76 2 0 26 Jun 2023
Communication-Efficient Gradient Descent-Accent Methods for Distributed Variational Inequalities: Unified Analysis and Local Updates Siqi Zhang S. Choudhury Sebastian U. Stich Nicolas Loizou FedML 11 3 0 08 Jun 2023
A Generalized Alternating Method for Bilevel Learning under the Polyak-Łojasiewicz Condition Quan-Wu Xiao Songtao Lu Tianyi Chen 13 2 0 04 Jun 2023
Federated Multi-Sequence Stochastic Approximation with Local Hypergradient Estimation Davoud Ataee Tarzanagh Mingchen Li Pranay Sharma Samet Oymak 16 0 0 02 Jun 2023
SimFBO: Towards Simple, Flexible and Communication-efficient Federated Bilevel Learning Yifan Yang Peiyao Xiao Kaiyi Ji FedML 16 14 0 30 May 2023
Partially Personalized Federated Learning: Breaking the Curse of Data Heterogeneity Konstantin Mishchenko Rustem Islamov Eduard A. Gorbunov Samuel Horváth FedML 25 11 0 29 May 2023
Federated Compositional Deep AUC Maximization Xinwen Zhang Yihang Zhang Tianbao Yang Richard Souvenir Hongchang Gao FedML 12 7 0 20 Apr 2023
Communication-Efficient Federated Bilevel Optimization with Local and Global Lower Level Problems Junyi Li Feihu Huang Heng Huang FedML 19 6 0 13 Feb 2023
Achieving Linear Speedup in Non-IID Federated Bilevel Learning Minhui Huang Dewei Zhang Kaiyi Ji FedML 22 18 0 10 Feb 2023
Communication-Efficient Federated Hypergradient Computation via Aggregated Iterative Differentiation Peiyao Xiao Kaiyi Ji FedML 16 10 0 09 Feb 2023
Federated Automatic Differentiation Keith Rush Zachary B. Charles Zachary Garrett FedML 19 1 0 18 Jan 2023
Recent Advances on Federated Learning: A Systematic Survey Bingyan Liu Nuoyan Lv Yuanchun Guo Yawen Li FedML 52 74 0 03 Jan 2023
Adaptive Federated Minimax Optimization with Lower Complexities Feihu Huang Xinrui Wang Junyi Li Songcan Chen FedML 11 5 0 14 Nov 2022
Alternating Implicit Projected SGD and Its Efficient Variants for Equality-constrained Bilevel Optimization Quan-Wu Xiao Han Shen W. Yin Tianyi Chen 13 8 0 14 Nov 2022
A Penalty-Based Method for Communication-Efficient Decentralized Bilevel Programming Parvin Nazari Ahmad Mousavi Davoud Ataee Tarzanagh George Michailidis 11 4 0 08 Nov 2022
Faster Adaptive Momentum-Based Federated Methods for Distributed Composition Optimization Feihu Huang FedML 10 1 0 03 Nov 2022
Fast Adaptive Federated Bilevel Optimization Feihu Huang FedML 15 7 0 02 Nov 2022
FeDXL: Provable Federated Learning for Deep X-Risk Optimization Zhishuai Guo R. L. Jin Jiebo Luo Tianbao Yang FedML 27 7 0 26 Oct 2022
Decentralized Stochastic Bilevel Optimization with Improved per-Iteration Complexity Xuxing Chen Minhui Huang Shiqian Ma Krishnakumar Balasubramanian 8 23 0 23 Oct 2022
Decentralized Hyper-Gradient Computation over Time-Varying Directed Networks Naoyuki Terashita Satoshi Hara FedML 8 1 0 05 Oct 2022
Federated Learning on Adaptively Weighted Nodes by Bilevel Optimization Yan Huang Qihang Lin N. Street Stephen Seung-Yeob Baek FedML 10 9 0 21 Jul 2022
Online Bilevel Optimization: Regret Analysis of Online Alternating Gradient Methods Davoud Ataee Tarzanagh Parvin Nazari Bojian Hou Li Shen Laura Balzano 30 10 0 06 Jul 2022
Decentralized Gossip-Based Stochastic Bilevel Optimization over Communication Networks Shuoguang Yang Xuezhou Zhang Mengdi Wang 24 41 0 22 Jun 2022
On the Convergence of Momentum-Based Algorithms for Federated Bilevel Optimization Problems Hongchang Gao FedML 8 1 0 28 Apr 2022
Efficiently Escaping Saddle Points in Bilevel Optimization Minhui Huang Xuxing Chen Kaiyi Ji Shiqian Ma Lifeng Lai 11 20 0 08 Feb 2022
A framework for bilevel optimization that enables stochastic and global variance reduction algorithms Mathieu Dagréou Pierre Ablin Samuel Vaiter Thomas Moreau 129 73 0 31 Jan 2022
FedMM: Saddle Point Optimization for Federated Adversarial Domain Adaptation Yan Shen Jianguo Du Hao Zhang Benyu Zhang Zhanghexuan Ji Mingchen Gao FedML 21 13 0 16 Oct 2021
Solving a class of non-convex min-max games using adaptive momentum methods Babak Barazandeh Davoud Ataee Tarzanagh George Michailidis 24 13 0 26 Apr 2021
Linear Convergence in Federated Learning: Tackling Client Heterogeneity and Sparse Gradients A. Mitra Rayana H. Jaafar George J. Pappas Hamed Hassani FedML 55 157 0 14 Feb 2021