Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2506.09477
Cited By
On a few pitfalls in KL divergence gradient estimation for RL
11 June 2025
Yunhao Tang
Rémi Munos
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"On a few pitfalls in KL divergence gradient estimation for RL"
6 / 6 papers shown
Principled RL for Diffusion LLMs Emerges from a Sequence-Level Perspective
Jingyang Ou
Jiaqi Han
Minkai Xu
Shaoxuan Xu
Jianwen Xie
Stefano Ermon
Yi Wu
Chongxuan Li
DiffM
119
0
0
03 Dec 2025
KL-Regularized Reinforcement Learning is Designed to Mode Collapse
Anthony GX-Chen
Jatin Prakash
Jeff Guo
Rob Fergus
Rajesh Ranganath
136
2
0
23 Oct 2025
Stabilizing Policy Gradients for Sample-Efficient Reinforcement Learning in LLM Reasoning
Luckeciano C. Melo
Alessandro Abate
Yarin Gal
LRM
101
0
0
01 Oct 2025
Rethinking Large Language Model Distillation: A Constrained Markov Decision Process Perspective
Matthieu Zimmer
Xiaotong Ji
Tu Nguyen
Haitham Bou-Ammar
89
0
0
26 Sep 2025
Outcome-based Exploration for LLM Reasoning
Yuda Song
Julia Kempe
Remi Munos
OffRL
LRM
279
30
0
08 Sep 2025
Can Large Reasoning Models Self-Train?
Sheikh Shafayat
Fahim Tajwar
Ruslan Salakhutdinov
J. Schneider
Andrea Zanette
ReLM
OffRL
LRM
412
21
0
27 May 2025
1
