Provably Efficient Reinforcement Learning in Decentralized General-Sum Markov Games

12 October 2021

Papers citing "Provably Efficient Reinforcement Learning in Decentralized General-Sum Markov Games"

40 / 40 papers shown

Title
The Lagrangian Method for Solving Constrained Markov Games Soham Das Santiago Paternain Luiz F. O. Chamon Ceyhun Eksin 45 0 0 13 Mar 2025
Improving LLM General Preference Alignment via Optimistic Online Mirror Descent Yuheng Zhang Dian Yu Tao Ge Linfeng Song Zhichen Zeng Haitao Mi Nan Jiang Dong Yu 58 1 0 24 Feb 2025
Incentivize without Bonus: Provably Efficient Model-based Online Multi-agent RL for Markov Games Tong Yang Bo Dai Lin Xiao Yuejie Chi OffRL 56 2 0 13 Feb 2025
Improving Thompson Sampling via Information Relaxation for Budgeted Multi-armed Bandits Woojin Jeong Seungki Min 52 0 0 28 Aug 2024
Iterative Nash Policy Optimization: Aligning LLMs with General Preferences via No-Regret Learning Yuheng Zhang Dian Yu Baolin Peng Linfeng Song Ye Tian Mingyue Huo Nan Jiang Haitao Mi Dong Yu 35 14 0 30 Jun 2024
Decentralized Online Learning in General-Sum Stackelberg Games Yaolong Yu Haipeng Chen 27 0 0 06 May 2024
Refined Sample Complexity for Markov Games with Independent Linear Function Approximation Yan Dai Qiwen Cui S. S. Du 39 1 0 11 Feb 2024
$$\widetilde{O}(T^{-1})$ Convergence to (Coarse) Correlated Equilibria in Full-Information General-Sum Markov Games$ $\widetilde{O}(T^{-1})$ Convergence to (Coarse) Correlated Equilibria in Full-Information General-Sum Markov Games Weichao Mao Haoran Qiu Chen Wang Hubertus Franke Zbigniew T. Kalbarczyk Tamer Basar 28 0 0 02 Feb 2024
Near-Optimal Policy Optimization for Correlated Equilibrium in General-Sum Markov Games Yang Cai Haipeng Luo Chen-Yu Wei Weiqiang Zheng 18 7 0 26 Jan 2024
Fully Decentralized Cooperative Multi-Agent Reinforcement Learning: A Survey Jiechuan Jiang Kefan Su Zongqing Lu 30 3 0 10 Jan 2024
Improving Sample Efficiency of Model-Free Algorithms for Zero-Sum Markov Games Songtao Feng Ming Yin Yu-Xiang Wang J. Yang Yitao Liang 34 0 0 17 Aug 2023
Efficient Adversarial Attacks on Online Multi-agent Reinforcement Learning Guanlin Liu Lifeng Lai AAML 33 6 0 15 Jul 2023
Multi-Player Zero-Sum Markov Games with Networked Separable Interactions Chanwoo Park K. Zhang Asuman Ozdaglar 28 8 0 13 Jul 2023
Hardness of Independent Learning and Sparse Equilibrium Computation in Markov Games Dylan J. Foster Noah Golowich Sham Kakade 20 10 0 22 Mar 2023
Neural Operators of Backstepping Controller and Observer Gain Functions for Reaction-Diffusion PDEs Miroslav Krstic Luke Bhan Yuanyuan Shi 48 28 0 18 Mar 2023
Learning Strategic Value and Cooperation in Multi-Player Stochastic Games through Side Payments Alan Kuhnle J. Richley Darleen Perez-Lavin 31 1 0 09 Mar 2023
Finite-sample Guarantees for Nash Q-learning with Linear Function Approximation Pedro Cisneros-Velarde Oluwasanmi Koyejo 18 1 0 01 Mar 2023
Breaking the Curse of Multiagency: Provably Efficient Decentralized Multi-Agent RL with Function Approximation Yuanhao Wang Qinghua Liu Yunru Bai Chi Jin 19 28 0 13 Feb 2023
Offline Learning in Markov Games with General Function Approximation Yuheng Zhang Yunru Bai Nan Jiang OffRL 13 8 0 06 Feb 2023
A Reduction-based Framework for Sequential Decision Making with Delayed Feedback Yunchang Yang Hangshi Zhong Tianhao Wu B. Liu Liwei Wang S. Du OffRL 27 8 0 03 Feb 2023
Decentralized model-free reinforcement learning in stochastic games with average-reward objective Romain Cravic Nicolas Gast B. Gaujal 21 2 0 13 Jan 2023
Multi-Agent Reinforcement Learning with Reward Delays Yuyang Zhang Runyu Zhang Yu Gu Na Li 16 8 0 02 Dec 2022
Provably Efficient Model-free RL in Leader-Follower MDP with Linear Function Approximation A. Ghosh 15 1 0 28 Nov 2022
Decentralized Policy Gradient for Nash Equilibria Learning of General-sum Stochastic Games Yan Chen Taoying Li 16 2 0 14 Oct 2022
Minimax-Optimal Multi-Agent RL in Markov Games With a Generative Model Gen Li Yuejie Chi Yuting Wei Yuxin Chen 30 18 0 22 Aug 2022
Regret Minimization and Convergence to Equilibria in General-sum Markov Games Liad Erez Tal Lancewicki Uri Sherman Tomer Koren Yishay Mansour 36 25 0 28 Jul 2022
A Survey of Decision Making in Adversarial Games Xiuxian Li Min Meng Yiguang Hong Jie-bin Chen AAML 27 12 0 16 Jul 2022
Policy Optimization for Markov Games: Unified Framework and Faster Convergence Runyu Zhang Qinghua Liu Haiquan Wang Caiming Xiong Na Li Yu Bai 13 26 0 06 Jun 2022
Independent Natural Policy Gradient Methods for Potential Games: Finite-time Global Convergence with Entropy Regularization Shicong Cen Fan Chen Yuejie Chi 27 15 0 12 Apr 2022
The Complexity of Markov Equilibrium in Stochastic Games C. Daskalakis Noah Golowich K. Zhang 36 57 0 08 Apr 2022
Efficient Model-based Multi-agent Reinforcement Learning via Optimistic Equilibrium Computation Pier Giuseppe Sessa Maryam Kamgarpour Andreas Krause 18 16 0 14 Mar 2022
Near-Optimal Learning of Extensive-Form Games with Imperfect Information Yunru Bai Chi Jin Song Mei Tiancheng Yu 21 26 0 03 Feb 2022
Can Reinforcement Learning Find Stackelberg-Nash Equilibria in General-Sum Markov Games with Myopic Followers? Han Zhong Zhuoran Yang Zhaoran Wang Michael I. Jordan 24 30 0 27 Dec 2021
Finite-Sample Analysis of Decentralized Q-Learning for Stochastic Games Zuguang Gao Qianqian Ma Tamer Bacsar J. Birge OffRL 20 7 0 15 Dec 2021
Decentralized Cooperative Reinforcement Learning with Hierarchical Information Structure Hsu Kao Chen-Yu Wei V. Subramanian 13 12 0 01 Nov 2021
V-Learning -- A Simple, Efficient, Decentralized Algorithm for Multiagent RL Chi Jin Qinghua Liu Yuanhao Wang Tiancheng Yu OffRL 18 131 0 27 Oct 2021
On Improving Model-Free Algorithms for Decentralized Multi-Agent Reinforcement Learning Weichao Mao Lin F. Yang K. Zhang Tamer Bacsar 28 57 0 12 Oct 2021
When Can We Learn General-Sum Markov Games with a Large Number of Players Sample-Efficiently? Ziang Song Song Mei Yu Bai 72 67 0 08 Oct 2021
Independent Policy Gradient Methods for Competitive Reinforcement Learning C. Daskalakis Dylan J. Foster Noah Golowich 62 158 0 11 Jan 2021
Model-Based Multi-Agent RL in Zero-Sum Markov Games with Near-Optimal Sample Complexity K. Zhang Sham Kakade Tamer Bacsar Lin F. Yang 39 119 0 15 Jul 2020