Policy Optimization for Markov Games: Unified Framework and Faster
Convergence

Policy Optimization for Markov Games: Unified Framework and Faster Convergence

6 June 2022

Papers citing "Policy Optimization for Markov Games: Unified Framework and Faster Convergence"

18 / 18 papers shown

Title
Convergence to Nash Equilibrium and No-regret Guarantee in (Markov) Potential Games Jing Dong Baoxiang Wang Yaoliang Yu 52 1 0 04 Apr 2024
$$\widetilde{O}(T^{-1})$ Convergence to (Coarse) Correlated Equilibria in Full-Information General-Sum Markov Games$ $\widetilde{O}(T^{-1})$ Convergence to (Coarse) Correlated Equilibria in Full-Information General-Sum Markov Games Weichao Mao Haoran Qiu Chen Wang Hubertus Franke Zbigniew T. Kalbarczyk Tamer Basar 33 0 0 02 Feb 2024
Near-Optimal Policy Optimization for Correlated Equilibrium in General-Sum Markov Games Yang Cai Haipeng Luo Chen-Yu Wei Weiqiang Zheng 29 7 0 26 Jan 2024
Optimistic Policy Gradient in Multi-Player Markov Games with a Single Controller: Convergence Beyond the Minty Property Ioannis Anagnostides Ioannis Panageas Gabriele Farina T. Sandholm 33 3 0 19 Dec 2023
Zero-sum Polymatrix Markov Games: Equilibrium Collapse and Efficient Computation of Nash Equilibria Fivos Kalogiannis Ioannis Panageas 32 8 0 23 May 2023
Uncoupled and Convergent Learning in Two-Player Zero-Sum Markov Games with Bandit Feedback Yang Cai Haipeng Luo Chen-Yu Wei Weiqiang Zheng 26 17 0 05 Mar 2023
Breaking the Curse of Multiagency: Provably Efficient Decentralized Multi-Agent RL with Function Approximation Yuanhao Wang Qinghua Liu Yunru Bai Chi Jin 27 28 0 13 Feb 2023
Breaking the Curse of Multiagents in a Large State Space: RL in Markov Games with Independent Linear Function Approximation Qiwen Cui Kaipeng Zhang S. Du 28 23 0 07 Feb 2023
Symmetric (Optimistic) Natural Policy Gradient for Multi-agent Learning with Parameter Convergence S. Pattathil Kaipeng Zhang Asuman Ozdaglar 24 12 0 23 Oct 2022
Faster Last-iterate Convergence of Policy Optimization in Zero-Sum Markov Games Shicong Cen Yuejie Chi S. Du Lin Xiao 51 35 0 03 Oct 2022
$$O(T^{-1})$ Convergence of Optimistic-Follow-the-Regularized-Leader in Two-Player Zero-Sum Markov Games$ $O(T^{-1})$ Convergence of Optimistic-Follow-the-Regularized-Leader in Two-Player Zero-Sum Markov Games Yuepeng Yang Cong Ma 37 14 0 26 Sep 2022
Minimax-Optimal Multi-Agent RL in Markov Games With a Generative Model Gen Li Yuejie Chi Yuting Wei Yuxin Chen 32 18 0 22 Aug 2022
Near-Optimal $Φ$ -Regret Learning in Extensive-Form Games Ioannis Anagnostides Gabriele Farina T. Sandholm 28 7 0 20 Aug 2022
Unified Policy Optimization for Continuous-action Reinforcement Learning in Non-stationary Tasks and Games Rongjun Qin Fan Luo Hong Qian Yang Yu 22 2 0 19 Aug 2022
Regret Minimization and Convergence to Equilibria in General-sum Markov Games Liad Erez Tal Lancewicki Uri Sherman Tomer Koren Yishay Mansour 40 25 0 28 Jul 2022
The Complexity of Markov Equilibrium in Stochastic Games C. Daskalakis Noah Golowich Kaipeng Zhang 36 57 0 08 Apr 2022
Independent Policy Gradient Methods for Competitive Reinforcement Learning C. Daskalakis Dylan J. Foster Noah Golowich 62 159 0 11 Jan 2021
No-Regret Learning Dynamics for Extensive-Form Correlated Equilibrium A. Celli A. Marchesi Gabriele Farina N. Gatti 18 45 0 01 Apr 2020