RoboCLIP: One Demonstration is Enough to Learn Robot Policies

Neural Information Processing Systems (NeurIPS), 2023

11 October 2023

Sumedh Anand Sontakke

Jesse Zhang

Sébastien M. R. Arnold

Dorsa Sadigh

Papers citing "RoboCLIP: One Demonstration is Enough to Learn Robot Policies"

49 / 49 papers shown

Title
Goal-Driven Reward by Video Diffusion Models for Reinforcement Learning Q. Wang Mian Wu Y. Zhang Mingqi Yuan Wenyao Zhang Haoxiang You Yunbo Wang Xin Jin Xiaokang Yang Wenjun Zeng VGen 102 0 0 30 Nov 2025
LLM-Driven Stationarity-Aware Expert Demonstrations for Multi-Agent Reinforcement Learning in Mobile Systems Tianyang Duan Zongyuan Zhang Zheng Lin Songxiao Guo Xiuxian Guan ... Xia Du Ji-Zhe Zhou Heming Cui Jun Luo Yue Gao 72 0 0 24 Nov 2025
AutoFocus-IL: VLM-based Saliency Maps for Data-Efficient Visual Imitation Learning without Extra Human Annotations Litian Gong Fatemeh Bahrani Yutai Zhou Amin Banayeeanzade Jiachen Li Erdem Bıyık 128 0 0 23 Nov 2025
$$π^{}_{0.6}$: a VLA That Learns From Experience$ $π^{}_{0.6}$ : a VLA That Learns From Experience Physical Intelligence Ali Amin Raichelle Aniceto Ashwin Balakrishna Kevin Black ... Blake Williams Sukwon Yoo Lili Yu Ury Zhilinsky Zhiyuan Zhou OffRL VLM 607 11 0 18 Nov 2025
PROF: An LLM-based Reward Code Preference Optimization Framework for Offline Imitation Learning Shengjie Sun Jiafei Lyu Runze Liu Mengbei Yan Bo Liu Deheng Ye Xiu Li OffRL 270 0 0 14 Nov 2025
Automated Reward Design for Gran Turismo Michel Ma Takuma Seno K. Subramanian Peter R. Wurman Peter Stone Craig Sherstan 184 1 0 03 Nov 2025
CDE: Concept-Driven Exploration for Reinforcement Learning Le Mao Andrew H. Liu Renos Zabounidis Zachary Kingston Joseph Campbell 89 0 0 09 Oct 2025
Deterministic algorithms for inhomogeneous Bernoulli trials: Shapley value of network devices Jesse D Wei Guo Wei FAtt 212 0 0 08 Oct 2025
LAGEA: Language Guided Embodied Agents for Robotic Manipulation Abdul Monaf Chowdhury Akm Moshiur Rahman Mazumder Rabeya Akter S. Arib LM&Ro 100 0 0 27 Sep 2025
ReLAM: Learning Anticipation Model for Rewarding Visual Robotic Manipulation Nan Tang Jing-Cheng Pang Guanlin Li Chao Qian Yang Yu 156 0 0 26 Sep 2025
DesignCLIP: Multimodal Learning with CLIP for Design Patent Understanding Zhu Wang Homaira Huda Shomee Sathya Ravi Sourav Medya VLM 172 0 0 21 Aug 2025
Policy Learning from Large Vision-Language Model Feedback without Reward Modeling Tung M. Luu Donghoon Lee Younghwan Lee Chang D. Yoo OffRL 139 0 0 31 Jul 2025
GoalLadder: Incremental Goal Discovery with Vision-Language Models Alexey Zakharov Shimon Whiteson 180 1 0 19 Jun 2025
RobotSmith: Generative Robotic Tool Design for Acquisition of Complex Manipulation Skills Chunru Lin Haotian Yuan Yian Wang Xiaowen Qiu Tsun-Hsuan Wang Minghao Guo Bohan Wang Yashraj S. Narang Dieter Fox Chuang Gan 190 2 0 17 Jun 2025
DriveMind: A Dual-VLM based Reinforcement Learning Framework for Autonomous Driving Dawood Wasif T. Moore Chandan K Reddy Jin-Hee Cho VLM 187 0 0 01 Jun 2025
TeViR: Text-to-Video Reward with Diffusion Models for Efficient Reinforcement Learning Yuhui Chen Haoran Li Zhennan Jiang Haowei Wen Dongbin Zhao 246 3 0 26 May 2025
ReWiND: Language-Guided Rewards Teach Robot Policies without New Demonstrations Jiahui Zhang Yusen Luo Abrar Anwar Sumedh Anand Sontakke Joseph J Lim Jesse Thomason Erdem Biyik Jesse Zhang OffRL LM&Ro 384 16 0 16 May 2025
AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and ChallengesInformation Fusion (Inf. Fusion), 2025 Ranjan Sapkota Konstantinos I. Roumeliotis Manoj Karkee AI4TS 918 140 0 15 May 2025
Reward Generation via Large Vision-Language Model in Offline Reinforcement LearningIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2025 Younghwan Lee Tung M. Luu Donghoon Lee Chang D. Yoo 3DV VLM OffRL 274 1 0 03 Apr 2025
IMPACT: Intelligent Motion Planning with Acceptable Contact Trajectories via Vision-Language Models Yiyang Ling Karan Owalekar Oluwatobiloba Adesanya Erdem Bıyık Daniel Seita 320 5 0 13 Mar 2025
Provably Correct Automata Embeddings for Optimal Automata-Conditioned Reinforcement Learning Beyazit Yalcinkaya Niklas Lauffer Marcell Vazquez-Chanlatte Sanjit A. Seshia OffRL 339 3 0 06 Mar 2025
SENSEI: Semantic Exploration Guided by Foundation Models to Learn Versatile World Models Cansu Sancaktar Christian Gumbsch Antonios Tragoudaras Pavel Kolev Georg Martius LM&Ro VLM 695 4 0 03 Mar 2025
Offline RLAIF: Piloting VLM Feedback for RL via SFO Jacob Beck OffRL 461 0 0 02 Mar 2025
MILE: Model-based Intervention LearningIEEE International Conference on Robotics and Automation (ICRA), 2025 Yigit Korkmaz Erdem Bıyık 317 7 0 21 Feb 2025
HAMSTER: Hierarchical Action Models For Open-World Robot ManipulationInternational Conference on Learning Representations (ICLR), 2025 Yi Li Yuquan Deng Jing Zhang Joel Jang Marius Memme ... Fabio Ramos Dieter Fox Anqi Li Abhishek Gupta Ankit Goyal LM&Ro 687 64 0 08 Feb 2025
Imitation Learning from a Single Temporally Misaligned Video William Huey Huaxiaoyue Wang Anne Wu Yoav Artzi Sanjiban Choudhury AI4TS 309 1 0 08 Feb 2025
Demonstrating CavePI: Autonomous Exploration of Underwater Caves by Semantic Guidance Alankrit Gupta Adnan Abdullah Xianyao Li Vaishnav Ramesh Ioannis M. Rekleitis Md Jahidul Islam 710 6 0 07 Feb 2025
The "Law" of the Unconscious Contrastive Learner: Probabilistic Alignment of Unpaired ModalitiesInternational Conference on Learning Representations (ICLR), 2025 Yongwei Che Benjamin Eysenbach 290 1 0 20 Jan 2025
Contrastive Learning from Exploratory Actions: Leveraging Natural Interactions for Preference ElicitationIEEE/ACM International Conference on Human-Robot Interaction (HRI), 2025 N. Dennler Stefanos Nikolaidis Maja J. Matarić 889 1 0 03 Jan 2025
ELEMENTAL: Interactive Learning from Demonstrations and Vision-Language Models for Reward Design in Robotics Letian Chen Nina Moorman Matthew C. Gombolay OffRL LM&Ro 560 2 0 27 Nov 2024
Compositional Automata Embeddings for Goal-Conditioned Reinforcement LearningNeural Information Processing Systems (NeurIPS), 2024 Beyazit Yalcinkaya Niklas Lauffer Marcell Vazquez-Chanlatte Sanjit A. Seshia AI4CE 441 13 0 31 Oct 2024
Scaling Robot Policy Learning via Zero-Shot Labeling with Foundation ModelsConference on Robot Learning (CoRL), 2024 Nils Blank Moritz Reuss Marcel Rühle Ömer Erdinç Yagmurlu Fabian Wenzel Oier Mees Rudolf Lioutikov LM&Ro OffRL 276 13 0 23 Oct 2024
SDS -- See it, Do it, Sorted: Quadruped Skill Synthesis from Single Video Demonstration Maria Stamatopoulou Jeffrey Li Dimitrios Kanoulas 195 8 0 15 Oct 2024
KOI: Accelerating Online Imitation Learning via Hybrid Key-state GuidanceConference on Robot Learning (CoRL), 2024 Jingxian Lu Wenke Xia Dong Wang Zhigang Wang Bin Zhao Di Hu Xuelong Li 155 5 0 06 Aug 2024
ExpertAF: Expert Actionable Feedback from VideoComputer Vision and Pattern Recognition (CVPR), 2024 Kumar Ashutosh Tushar Nagarajan Georgios Pavlakos Kris Kitani Kristen Grauman VGen 418 8 0 01 Aug 2024
Mitigating the Human-Robot Domain Discrepancy in Visual Pre-training for Robotic Manipulation Jiaming Zhou Teli Ma Kun-Yu Lin Ronghe Qiu Zifan Wang Junwei Liang 406 17 0 20 Jun 2024
Video-Language Critic: Transferable Reward Functions for Language-Conditioned Robotics Minttu Alakuijala Reginald McLean Isaac Woungang Nariman Farsad Samuel Kaski Pekka Marttinen Kai Yuan LM&Ro 303 8 0 30 May 2024
VICtoR: Learning Hierarchical Vision-Instruction Correlation Rewards for Long-horizon Manipulation Kuo-Han Hung Pang-Chi Lo Jia-Fong Yeh Han-Yuan Hsu Yi-Ting Chen Winston H. Hsu 365 2 0 26 May 2024
Model-free reinforcement learning with noisy actions for automated experimental control in optics Lea Richtmann Viktoria-S. Schmiesing Dennis Wilken Jan Heine Aaron Tranter Avishek Anand Tobias J. Osborne M. Heurs 338 3 0 24 May 2024
Learning Manipulation Skills through Robot Chain-of-Thought with Sparse Failure Guidance Kaifeng Zhang Zhao-Heng Yin Weirui Ye Yang Gao 379 7 0 22 May 2024
One-Shot Transfer of Long-Horizon Extrinsic Manipulation Through Contact Retargeting Albert Wu Ruocheng Wang Sirui Chen Clemens Eppner Chenxi Liu 259 9 0 11 Apr 2024
LORD: Large Models based Opposite Reward Design for Autonomous Driving Xin Ye Feng Tao Abhirup Mallik Burhaneddin Yaman Liu Ren OffRL 274 7 0 27 Mar 2024
Sora as an AGI World Model? A Complete Survey on Text-to-Video Generation Joseph Cho Fachrina Dewi Puspitasari Sheng Zheng Jingyao Zheng Lik-Hang Lee Tae-Ho Kim Choong Seon Hong Chaoning Zhang EGVM VGen 266 65 0 08 Mar 2024
$L^*LM$ : Learning Automata from Examples using Natural Language Oracles Marcell Vazquez-Chanlatte Karim Elmaaroufi Stefan J. Witwicki Matei A. Zaharia Sanjit A. Seshia 291 4 0 10 Feb 2024
RL-VLM-F: Reinforcement Learning from Vision Language Foundation Model FeedbackInternational Conference on Machine Learning (ICML), 2024 Yufei Wang Zhanyi Sun Jesse Zhang Zhou Xian Erdem Biyik David Held Zackory M. Erickson VLM 325 104 0 06 Feb 2024
Mementos: A Comprehensive Benchmark for Multimodal Large Language Model Reasoning over Image Sequences Xiyao Wang Yuhang Zhou Xiaoyu Liu Hongjin Lu Yuancheng Xu ... Taixi Lu Gedas Bertasius Mohit Bansal Huaxiu Yao Furong Huang LRM VLM 345 95 0 19 Jan 2024
Spacewalk-18: A Benchmark for Multimodal and Long-form Procedural Video Understanding in Novel Domains Rohan Myer Krishnan Zitian Tang Zhiqiu Yu Chen Sun 451 2 0 30 Nov 2023
Large Language Models for Robotics: A Survey Fanlong Zeng Wensheng Gan Zezheng Huai Lichao Sun Hechang Chen Yongheng Wang Ning Liu Philip S. Yu LM&Ro 340 195 0 13 Nov 2023
Vision-Language Models are Zero-Shot Reward Models for Reinforcement Learning Juan Rocamonde Victoriano Montesinos Elvis Nava Ethan Perez David Lindner VLM 325 130 0 19 Oct 2023