Learning to Drive by Watching YouTube Videos: Action-Conditioned Contrastive Policy Pretraining

5 April 2022

Papers citing "Learning to Drive by Watching YouTube Videos: Action-Conditioned Contrastive Policy Pretraining"

30 / 30 papers shown

Title
Video-Enhanced Offline Reinforcement Learning: A Model-Based Approach Minting Pan Yitao Zheng J. Li Yunbo Wang Xiaokang Yang OffRL 41 0 0 10 May 2025
DrivingWorld: Constructing World Model for Autonomous Driving via Video GPT Xiaotao Hu Wei Yin Mingkai Jia Junyuan Deng Xiaoyang Guo Qian Zhang Xiaoxiao Long Ping Tan VGen 34 10 0 31 Dec 2024
Embodied CoT Distillation From LLM To Off-the-shelf Agents Wonje Choi Woo Kyung Kim Minjong Yoo Honguk Woo OffRL LM&Ro 108 2 0 16 Dec 2024
Efficient Policy Adaptation with Contrastive Prompt Ensemble for Embodied Agents Wonje Choi Woo Kyung Kim SeungHyun Kim Honguk Woo 72 8 0 16 Dec 2024
PROGRESSOR: A Perceptually Guided Reward Estimator with Self-Supervised Online Refinement Tewodros Ayalew Xiao Zhang Kevin Yuanbo Wu Tianchong Jiang Michael Maire Matthew R. Walter OffRL 59 1 0 26 Nov 2024
CityWalker: Learning Embodied Urban Navigation from Web-Scale Videos Xinhao Liu J. Li Yichen Jiang Niranjan Sujay Z. Yang Juexiao Zhang John Abanes Jing Zhang Chen Feng 112 1 0 26 Nov 2024
Pre-trained Visual Dynamics Representations for Efficient Policy Learning Hao Luo Bohan Zhou Zongqing Lu 30 0 0 05 Nov 2024
A Non-Monolithic Policy Approach of Offline-to-Online Reinforcement Learning JaeYoon Kim Junyu Xuan Christy Jie Liang F. Hussain OffRL OnRL 31 0 0 31 Oct 2024
DINO Pre-training for Vision-based End-to-end Autonomous Driving Shubham Juneja P. Daniušis Virginijus Marcinkevičius 38 2 0 15 Jul 2024
SimGen: Simulator-conditioned Driving Scene Generation Yunsong Zhou Michael Simon Zhenghao Peng Sicheng Mo Hongzi Zhu Minyi Guo Bolei Zhou VGen 44 11 0 13 Jun 2024
Enhancing End-to-End Autonomous Driving with Latent World Model Yingyan Li Lue Fan Jiawei He Yuqi Wang Yuntao Chen Zhaoxiang Zhang Tieniu Tan 70 8 0 12 Jun 2024
Learning Action-based Representations Using Invariance Max Rudolph Caleb Chuck Kevin Black Misha Lvovsky S. Niekum Amy Zhang 37 0 0 25 Mar 2024
Generalized Predictive Model for Autonomous Driving Jiazhi Yang Shenyuan Gao Yihang Qiu Li Chen Tianyu Li ... Ping Luo Jun Zhang Andreas Geiger Yu Qiao Hongyang Li VGen 69 57 0 14 Mar 2024
Embodied Understanding of Driving Scenarios Yunsong Zhou Linyan Huang Qingwen Bu Jia Zeng Tianyu Li Hang Qiu Hongzi Zhu Minyi Guo Yu Qiao Hongyang Li LM&Ro 55 31 0 07 Mar 2024
RAG-Driver: Generalisable Driving Explanations with Retrieval-Augmented In-Context Learning in Multi-Modal Large Language Model Jianhao Yuan Shuyang Sun Daniel Omeiza Bo-Lu Zhao Paul Newman Lars Kunze Matthew Gadd LRM 16 47 0 16 Feb 2024
Learning to Act without Actions Dominik Schmidt Minqi Jiang OffRL 26 30 0 17 Dec 2023
GenDeF: Learning Generative Deformation Field for Video Generation Wen Wang Kecheng Zheng Qiuyu Wang Hao Chen Zifan Shi Ceyuan Yang Yujun Shen Chunhua Shen VGen DiffM 46 2 0 07 Dec 2023
GROOT: Learning to Follow Instructions by Watching Gameplay Videos Shaofei Cai Bowei Zhang Zihao Wang Xiaojian Ma Anji Liu Yitao Liang 83 26 0 12 Oct 2023
Learning Modulated Transformation in GANs Ceyuan Yang Qihang Zhang Yinghao Xu Jiapeng Zhu Yujun Shen Bo Dai 22 1 0 29 Aug 2023
Recent Advancements in End-to-End Autonomous Driving using Deep Learning: A Survey Pranav Singh Chib Pravendra Singh 19 107 0 10 Jul 2023
End-to-end Autonomous Driving: Challenges and Frontiers Li Chen Peng Wu Kashyap Chitta Bernhard Jaeger Andreas Geiger Hongyang Li 3DV 34 261 0 29 Jun 2023
TACO: Temporal Latent Action-Driven Contrastive Loss for Visual Reinforcement Learning Ruijie Zheng Xiyao Wang Yanchao Sun Shuang Ma Jieyu Zhao Huazhe Xu Hal Daumé Furong Huang 43 35 0 22 Jun 2023
Pre-training Contextualized World Models with In-the-wild Videos for Reinforcement Learning Jialong Wu Haoyu Ma Chao Deng Mingsheng Long OffRL 19 24 0 29 May 2023
Foundation Models for Decision Making: Problems, Methods, and Opportunities Sherry Yang Ofir Nachum Yilun Du Jason W. Wei Pieter Abbeel Dale Schuurmans LM&Ro OffRL LRM AI4CE 90 154 0 07 Mar 2023
Policy Pre-training for Autonomous Driving via Self-supervised Geometric Modeling Peng Wu Li Chen Hongyang Li Xiaosong Jia Junchi Yan Yu Qiao 84 28 0 03 Jan 2023
Towards Smooth Video Composition Qihang Zhang Ceyuan Yang Yujun Shen Yinghao Xu Bolei Zhou VGen 31 14 0 14 Dec 2022
Pretraining in Deep Reinforcement Learning: A Survey Zhihui Xie Zichuan Lin Junyou Li Shuai Li Deheng Ye OffRL OnRL AI4CE 26 23 0 08 Nov 2022
Instance Localization for Self-supervised Detection Pretraining Ceyuan Yang Zhirong Wu Bolei Zhou Stephen Lin ViT SSL 100 145 0 16 Feb 2021
Decoupling Representation Learning from Reinforcement Learning Adam Stooke Kimin Lee Pieter Abbeel Michael Laskin SSL DRL 280 339 0 14 Sep 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 238 3,367 0 09 Mar 2020