Faster Last-iterate Convergence of Policy Optimization in Zero-Sum Markov Games

3 October 2022

Papers citing "Faster Last-iterate Convergence of Policy Optimization in Zero-Sum Markov Games"

28 / 28 papers shown

Title
Incentivize without Bonus: Provably Efficient Model-based Online Multi-agent RL for Markov Games Tong Yang Bo Dai Lin Xiao Yuejie Chi OffRL 56 2 0 13 Feb 2025
Last Iterate Convergence in Monotone Mean Field Games Noboru Isobe Kenshi Abe Kaito Ariu 27 0 0 07 Oct 2024
Improving Thompson Sampling via Information Relaxation for Budgeted Multi-armed Bandits Woojin Jeong Seungki Min 38 0 0 28 Aug 2024
Policy Gradient Methods for Risk-Sensitive Distributional Reinforcement Learning with Provable Convergence Minheng Xiao Xian Yu Lei Ying 32 2 0 23 May 2024
Configurable Mirror Descent: Towards a Unification of Decision Making Pengdeng Li Shuxin Li Chang Yang Xinrun Wang Shuyue Hu Xiao Huang Hau Chan Bo An 19 1 0 20 May 2024
Linear Convergence of Independent Natural Policy Gradient in Games with Entropy Regularization Youbang Sun Tao-Wen Liu P. R. Kumar Shahin Shahrampour 24 0 0 04 May 2024
$$\widetilde{O}(T^{-1})$ Convergence to (Coarse) Correlated Equilibria in Full-Information General-Sum Markov Games$ $\widetilde{O}(T^{-1})$ Convergence to (Coarse) Correlated Equilibria in Full-Information General-Sum Markov Games Weichao Mao Haoran Qiu Chen Wang Hubertus Franke Zbigniew T. Kalbarczyk Tamer Basar 13 0 0 02 Feb 2024
Optimistic Policy Gradient in Multi-Player Markov Games with a Single Controller: Convergence Beyond the Minty Property Ioannis Anagnostides Ioannis Panageas Gabriele Farina T. Sandholm 23 3 0 19 Dec 2023
Symmetric Mean-field Langevin Dynamics for Distributional Minimax Problems Juno Kim Kakei Yamamoto Kazusato Oko Zhuoran Yang Taiji Suzuki 15 8 0 02 Dec 2023
Provably Fast Convergence of Independent Natural Policy Gradient for Markov Potential Games Youbang Sun Tao-Wen Liu Ruida Zhou P. R. Kumar Shahin Shahrampour 18 6 0 15 Oct 2023
Global Convergence of Policy Gradient Methods in Reinforcement Learning, Games and Control Shicong Cen Yuejie Chi 31 1 0 08 Oct 2023
Multi-Player Zero-Sum Markov Games with Networked Separable Interactions Chanwoo Park K. Zhang Asuman Ozdaglar 21 8 0 13 Jul 2023
Adaptively Perturbed Mirror Descent for Learning in Games Kenshi Abe Kaito Ariu Mitsuki Sakamoto Atsushi Iwasaki 11 0 0 26 May 2023
Local Optimization Achieves Global Optimality in Multi-Agent Reinforcement Learning Yulai Zhao Zhuoran Yang Zhaoran Wang Jason D. Lee 20 3 0 08 May 2023
Uncoupled and Convergent Learning in Two-Player Zero-Sum Markov Games with Bandit Feedback Yang Cai Haipeng Luo Chen-Yu Wei Weiqiang Zheng 8 17 0 05 Mar 2023
A Finite-Sample Analysis of Payoff-Based Independent Learning in Zero-Sum Stochastic Games Zaiwei Chen K. Zhang Eric Mazumdar Asuman Ozdaglar Adam Wierman 41 6 0 03 Mar 2023
Differentiable Arbitrating in Zero-sum Markov Games Jing Wang Meichen Song Feng Gao Boyi Liu Zhaoran Wang Yi Wu 22 2 0 20 Feb 2023
Breaking the Curse of Multiagents in a Large State Space: RL in Markov Games with Independent Linear Function Approximation Qiwen Cui K. Zhang S. Du 12 23 0 07 Feb 2023
Fast Computation of Optimal Transport via Entropy-Regularized Extragradient Methods Gen Li Yanxi Chen Yu Huang Yuejie Chi H. Vincent Poor Yuxin Chen OT 31 5 0 30 Jan 2023
Asynchronous Gradient Play in Zero-Sum Multi-agent Games Ruicheng Ao Shicong Cen Yuejie Chi 20 5 0 16 Nov 2022
$$O(T^{-1})$ Convergence of Optimistic-Follow-the-Regularized-Leader in Two-Player Zero-Sum Markov Games$ $O(T^{-1})$ Convergence of Optimistic-Follow-the-Regularized-Leader in Two-Player Zero-Sum Markov Games Yuepeng Yang Cong Ma 31 14 0 26 Sep 2022
Minimax-Optimal Multi-Agent RL in Markov Games With a Generative Model Gen Li Yuejie Chi Yuting Wei Yuxin Chen 12 18 0 22 Aug 2022
Regret Minimization and Convergence to Equilibria in General-sum Markov Games Liad Erez Tal Lancewicki Uri Sherman Tomer Koren Yishay Mansour 23 17 0 28 Jul 2022
Fast Policy Extragradient Methods for Competitive Games with Entropy Regularization Shicong Cen Yuting Wei Yuejie Chi 16 77 0 31 May 2021
Policy Mirror Descent for Regularized Reinforcement Learning: A Generalized Framework with Linear Convergence Wenhao Zhan Shicong Cen Baihe Huang Yuxin Chen Jason D. Lee Yuejie Chi 4 76 0 24 May 2021
Provably Efficient Policy Optimization for Two-Player Zero-Sum Markov Games Yulai Zhao Yuandong Tian Jason D. Lee S. Du OffRL 33 16 0 17 Feb 2021
Policy Mirror Descent for Reinforcement Learning: Linear Convergence, New Sampling Complexity, and Generalized Problem Classes Guanghui Lan 87 135 0 30 Jan 2021
Independent Policy Gradient Methods for Competitive Reinforcement Learning C. Daskalakis Dylan J. Foster Noah Golowich 51 158 0 11 Jan 2021