Federated Reinforcement Learning with Environment Heterogeneity

6 April 2022

Hao Jin

Yang Peng

Wenhao Yang

Shusen Wang

Zhihua Zhang

ArXiv PDF HTML

Papers citing "Federated Reinforcement Learning with Environment Heterogeneity"

36 / 36 papers shown

Title
Approximated Behavioral Metric-based State Projection for Federated Reinforcement Learning Zengxia Guo Bohui An Zhongqi Lu FedML 17 0 0 15 May 2025
Achieving Tighter Finite-Time Rates for Heterogeneous Federated Stochastic Approximation under Markovian Sampling Feng Zhu Aritra Mitra Robert W. Heath FedML 36 0 0 15 Apr 2025
Provably Robust Federated Reinforcement Learning Minghong Fang Xilong Wang Neil Zhenqiang Gong FedML 65 0 0 12 Feb 2025
On the Linear Speedup of Personalized Federated Reinforcement Learning with Shared Representations Guojun Xiong Shufan Wang Daniel Jiang Jian Li FedML 73 1 0 22 Nov 2024
Federated UCBVI: Communication-Efficient Federated Regret Minimization with Heterogeneous Agents Safwan Labbi D. Tiapkin Lorenzo Mancini Paul Mangold Eric Moulines FedML 68 0 0 30 Oct 2024
Towards Fast Rates for Federated and Multi-Task Reinforcement Learning Feng Zhu Robert W. Heath Jr. Aritra Mitra 35 1 0 09 Sep 2024
On the Convergence Rates of Federated Q-Learning across Heterogeneous Environments Muxing Wang Pengkun Yang Lili Su FedML 29 1 0 05 Sep 2024
When Swarm Learning meets energy series data: A decentralized collaborative learning design based on blockchain Lei Xu Yulong Chen Yuntian Chen Longfeng Nie Xuetao Wei Liang Xue Dongxiao Zhang 20 0 0 07 Jun 2024
Momentum for the Win: Collaborative Federated Reinforcement Learning across Heterogeneous Environments Han Wang Sihong He Zhili Zhang Fei Miao James Anderson 46 3 0 29 May 2024
Federated Control in Markov Decision Processes Hao Jin Yang Peng Liangyu Zhang Zhihua Zhang FedML 37 0 0 07 May 2024
Federated Reinforcement Learning with Constraint Heterogeneity Hao Jin Liangyu Zhang Zhihua Zhang 30 0 0 06 May 2024
Asynchronous Federated Reinforcement Learning with Policy Gradient Updates: Algorithm Design and Convergence Analysis Guangchen Lan Dong-Jun Han Abolfazl Hashemi Vaneet Aggarwal Christopher G. Brinton 122 15 0 09 Apr 2024
Compressed Federated Reinforcement Learning with a Generative Model Ali Beikmohammadi Sarit Khirirat Sindri Magnússon FedML 35 2 0 26 Mar 2024
Global Convergence Guarantees for Federated Policy Gradient Methods with Adversaries Swetha Ganesh Jiayu Chen Gugan Thoppe Vaneet Aggarwal FedML 56 1 0 15 Mar 2024
Non-Convex Stochastic Composite Optimization with Polyak Momentum Yuan Gao Anton Rodomanov Sebastian U. Stich 21 6 0 05 Mar 2024
Federated Prompt-based Decision Transformer for Customized VR Services in Mobile Edge Computing System Tailin Zhou Jiadong Yu Jun Zhang Danny H. K. Tsang 16 1 0 15 Feb 2024
Federated Offline Reinforcement Learning: Collaborative Single-Policy Coverage Suffices Jiin Woo Laixi Shi Gauri Joshi Yuejie Chi OffRL 24 3 0 08 Feb 2024
SCAFFLSA: Taming Heterogeneity in Federated Linear Stochastic Approximation and TD Learning Paul Mangold S. Samsonov Safwan Labbi I. Levin Réda Alami Alexey Naumov Eric Moulines 38 1 0 06 Feb 2024
Finite-Time Analysis of On-Policy Heterogeneous Federated Reinforcement Learning Chenyu Zhang Han Wang Aritra Mitra James Anderson 29 18 0 27 Jan 2024
Harnessing the Power of Federated Learning in Federated Contextual Bandits Chengshuai Shi Ruida Zhou Kun Yang Cong Shen FedML 19 0 0 26 Dec 2023
Epidemic Decision-making System Based Federated Reinforcement Learning Yangxi Zhou Junping Du Zhe Xue Zhenhui Pan Weikang Chen 6 0 0 03 Nov 2023
Improved Communication Efficiency in Federated Natural Policy Gradient via ADMM-based Gradient Updates Guangchen Lan Han Wang James Anderson Christopher G. Brinton Vaneet Aggarwal FedML 19 27 0 09 Oct 2023
Provably Efficient Offline Reinforcement Learning with Perturbed Data Sources Chengshuai Shi Wei Xiong Cong Shen Jing Yang OffRL 30 3 0 14 Jun 2023
Momentum Provably Improves Error Feedback! Ilyas Fatkhullin A. Tyurin Peter Richtárik 26 19 0 24 May 2023
Client Selection for Federated Policy Optimization with Environment Heterogeneity Zhijie Xie S. H. Song 13 3 0 18 May 2023
The Blessing of Heterogeneity in Federated Q-Learning: Linear Speedup and Beyond Jiin Woo Gauri Joshi Yuejie Chi FedML 27 19 0 18 May 2023
Cooperative Multi-Agent Reinforcement Learning: Asynchronous Communication and Linear Function Approximation Yifei Min Jiafan He Tianhao Wang Quanquan Gu 38 7 0 10 May 2023
Federated Temporal Difference Learning with Linear Function Approximation under Environmental Heterogeneity Han Wang A. Mitra Hamed Hassani George J. Pappas James Anderson FedML 19 21 0 04 Feb 2023
FedHQL: Federated Heterogeneous Q-Learning Flint Xiaofeng Fan Yining Ma Zhongxiang Dai Cheston Tan Bryan Kian Hsiang Low Roger Wattenhofer FedML 18 7 0 26 Jan 2023
Temporal Difference Learning with Compressed Updates: Error-Feedback meets Reinforcement Learning A. Mitra George J. Pappas Hamed Hassani 19 12 0 03 Jan 2023
Stateful active facilitator: Coordination and Environmental Heterogeneity in Cooperative Multi-Agent Reinforcement Learning Dianbo Liu Vedant Shah Oussama Boussif Cristian Meo Anirudh Goyal Tianmin Shu Michael C. Mozer N. Heess Yoshua Bengio 22 7 0 04 Oct 2022
Federated Reinforcement Learning for Real-Time Electric Vehicle Charging and Discharging Control Zixuan Zhang Yuning Jiang Yuanming Shi Ye Shi Wei Chen 46 13 0 04 Oct 2022
FedKL: Tackling Data Heterogeneity in Federated Reinforcement Learning by Penalizing KL Divergence Zhijie Xie Shenghui Song FedML 17 44 0 18 Apr 2022
Linear Stochastic Bandits over a Bit-Constrained Channel A. Mitra Hamed Hassani George J. Pappas 21 8 0 02 Mar 2022
Emerging Trends in Federated Learning: From Model Fusion to Federated X Learning Shaoxiong Ji Yue Tan Teemu Saravirta Zhiqin Yang Yixin Liu Lauri Vasankari Shirui Pan Guodong Long A. Walid FedML 29 76 0 25 Feb 2021
Adaptive Personalized Federated Learning Yuyang Deng Mohammad Mahdi Kamani M. Mahdavi FedML 186 542 0 30 Mar 2020