Batch size-invariance for policy optimization

1 October 2021

Papers citing "Batch size-invariance for policy optimization"

10 / 10 papers shown

Title
Time Transfer: On Optimal Learning Rate and Batch Size In The Infinite Data Limit Oleg Filatov Jan Ebert Jiangtao Wang Stefan Kesselheim 46 4 0 10 Jan 2025
Normalization Layer Per-Example Gradients are Sufficient to Predict Gradient Noise Scale in Transformers Gavia Gray Aman Tiwari Shane Bergsma Joel Hestness 30 1 0 01 Nov 2024
How Does Critical Batch Size Scale in Pre-training? Hanlin Zhang Depen Morwani Nikhil Vyas Jingfeng Wu Difan Zou Udaya Ghai Dean Phillips Foster Sham Kakade 88 11 0 29 Oct 2024
Batch size invariant Adam Xi Wang Laurence Aitchison 46 2 0 29 Feb 2024
Guaranteed Trust Region Optimization via Two-Phase KL Penalization K.R. Zentner Ujjwal Puri Zhehui Huang Gaurav Sukhatme OffRL 24 0 0 08 Dec 2023
Small batch deep reinforcement learning J. Obando-Ceron Marc G. Bellemare Pablo Samuel Castro VLM 36 14 0 05 Oct 2023
Scaling laws for single-agent reinforcement learning Jacob Hilton Jie Tang John Schulman 22 20 0 31 Jan 2023
Mastering Diverse Domains through World Models Danijar Hafner J. Pašukonis Jimmy Ba Timothy Lillicrap 38 559 0 10 Jan 2023
Relative Sparsity for Medical Decision Problems Samuel J. Weisenthal Sally W. Thurston Ashkan Ertefaie 30 2 0 29 Nov 2022
VER: Scaling On-Policy RL Leads to the Emergence of Navigation in Embodied Rearrangement Erik Wijmans Irfan Essa Dhruv Batra OffRL 52 13 0 11 Oct 2022