v1v2 (latest)

Behavior Generation with Latent Actions

5 March 2024

ArXiv (abs)PDF HTML HuggingFace (1 upvotes)

Papers citing "Behavior Generation with Latent Actions"

39 / 89 papers shown

Title
VaViM and VaVAM: Autonomous Driving through Video Generative Modeling Florent Bartoccioni Elias Ramzi Victor Besnier Shashanka Venkataramanan Tuan-Hung Vu ... Mickael Chen Éloi Zablocki Andrei Bursuc Eduardo Valle Matthieu Cord VGen 288 11 0 24 Feb 2025
X-IL: Exploring the Design Space of Imitation Learning Policies Xiaogang Jia Atalay Donat Xi Huang Xuan Zhao Denis Blessing ... Han A. Wang Hanyi Zhang Qian Wang Rudolf Lioutikov Gerhard Neumann 252 3 0 20 Feb 2025
IMLE Policy: Fast and Sample Efficient Visuomotor Policy Learning via Implicit Maximum Likelihood Estimation Krishan Rana Robert Lee David Pershouse Niko Suenderhauf VGen 336 5 0 17 Feb 2025
ImitDiff: Transferring Foundation-Model Priors for Distraction Robust Visuomotor PolicyIEEE Robotics and Automation Letters (IEEE RA-L), 2025 Yuhang Dong Haizhou Ge Yupei Zeng Jing Zhang Beiwen Tian ... Ruixiang Wang Ruixiang Wang Ran Yi Longhua Ma Longhua Ma 271 1 0 11 Feb 2025
How Vulnerable Is My Learned Policy? Universal Adversarial Perturbation Attacks On Modern Behavior Cloning Policies Akansha Kalra Basavasagar Patil Guanhong Tao Daniel S. Brown AAML 278 0 0 06 Feb 2025
VILP: Imitation Learning with Latent Video PlanningIEEE Robotics and Automation Letters (IEEE RA-L), 2025 Zhengtong Xu Qiang Qiu Yu She VGen 241 4 0 03 Feb 2025
Strengthening Generative Robot Policies through Predictive World Modeling Han Qi Haocheng Yin Aris Zhu Yilun Du Heng Yang 558 15 0 02 Feb 2025
Policy Decorator: Model-Agnostic Online Refinement for Large Policy ModelInternational Conference on Learning Representations (ICLR), 2024 Xiu Yuan Tongzhou Mu Stone Tao Yunhao Fang Mengke Zhang H. Su OffRL 375 23 0 18 Dec 2024
Efficient Diffusion Transformer Policies with Mixture of Expert Denoisers for Multitask LearningInternational Conference on Learning Representations (ICLR), 2024 Moritz Reuss Jyothish Pari Pulkit Agrawal Rudolf Lioutikov DiffM MoE 248 25 0 17 Dec 2024
TidyBot++: An Open-Source Holonomic Mobile Manipulator for Robot LearningConference on Robot Learning (CoRL), 2024 Jimmy Wu William Chong Robert Holmberg Aaditya Prasad Yihuai Gao O. Khatib Shuran Song Szymon Rusinkiewicz Jeannette Bohg 321 20 0 11 Dec 2024
RoboTron-Mani: All-in-One Multimodal Large Model for Robotic Manipulation Feng Yan Fanfan Liu Liming Zheng Yufeng Zhong Yiyang Huang Zechao Guan Chengjian Feng Lin Ma 272 12 0 10 Dec 2024
Inference-Time Policy Steering through Human InteractionsIEEE International Conference on Robotics and Automation (ICRA), 2024 Yanwei Wang Lirui Wang Yilun Du Balakumar Sundaralingam Xuning Yang Yu-Wei Chao Claudia Pérez-DÁrpino Dieter Fox Julie Shah VGen 401 23 0 25 Nov 2024
DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planning G. Zhou Hengkai Pan Yann LeCun Lerrel Pinto VGen LM&Ro OffRL 318 99 0 07 Nov 2024
VQ-ACE: Efficient Policy Search for Dexterous Robotic Manipulation via Action Chunking Embedding Chenyu Yang Davide Liconti Robert K. Katzschmann 352 4 0 05 Nov 2024
STEER: Flexible Robotic Manipulation via Dense Language GroundingIEEE International Conference on Robotics and Automation (ICRA), 2024 Laura Smith A. Irpan Montserrat Gonzalez Arenas Sean Kirmani Dmitry Kalashnikov Dhruv Shah Ted Xiao LLMSV 269 7 0 05 Nov 2024
Bridging the Human to Robot Dexterity Gap through Object-Oriented RewardsIEEE International Conference on Robotics and Automation (ICRA), 2024 Irmak Güzey Yinlong Dai Georgy Savva Raunaq M. Bhirangi Lerrel Pinto 245 18 0 30 Oct 2024
Self-Improving Autonomous Underwater ManipulationIEEE International Conference on Robotics and Automation (ICRA), 2024 Ruoshi Liu Huy Ha Mengxue Hou Shuran Song Carl Vondrick 241 4 0 24 Oct 2024
SPIRE: Synergistic Planning, Imitation, and Reinforcement Learning for Long-Horizon ManipulationConference on Robot Learning (CoRL), 2024 Zihan Zhou Animesh Garg Dieter Fox Caelan Reed Garrett Ajay Mandlekar 309 12 0 23 Oct 2024
Guided Reinforcement Learning for Robust Multi-Contact Loco-ManipulationConference on Robot Learning (CoRL), 2024 Jean-Pierre Sleiman Mayank Mittal Marco Hutter 144 12 0 17 Oct 2024
Just Add Force for Contact-Rich Robot Policies William Xie Stefan Caldararu N. Correll OffRL 125 0 0 17 Oct 2024
Latent Action Pretraining from VideosInternational Conference on Learning Representations (ICLR), 2024 Seonghyeon Ye Joel Jang Byeongguk Jeon Sejune Joo Jianwei Yang ... Kimin Lee J. Gao Luke Zettlemoyer Dieter Fox Minjoon Seo 396 129 0 15 Oct 2024
Learning from 10 Demos: Generalisable and Sample-Efficient Policy Learning with Oriented Affordance Frames Krishan Rana Jad Abou-Chakra Sourav Garg Robert Lee Ian Reid Niko Suenderhauf 239 6 0 15 Oct 2024
CANVAS: Commonsense-Aware Navigation System for Intuitive Human-Robot InteractionIEEE International Conference on Robotics and Automation (ICRA), 2024 Suhwan Choi Yongjun Cho Minchan Kim Jaeyoon Jung Myunchul Joe ... Sungwoong Kim Sungjae Lee Hwiseong Park Jiwan Chung Youngjae Yu 277 2 0 02 Oct 2024
Scaling Proprioceptive-Visual Learning with Heterogeneous Pre-trained TransformersNeural Information Processing Systems (NeurIPS), 2024 Lirui Wang Xinlei Chen Jialiang Zhao Kaiming He 229 104 0 30 Sep 2024
Active Vision Might Be All You Need: Exploring Active Vision in Bimanual Robotic ManipulationIEEE International Conference on Robotics and Automation (ICRA), 2024 Ian Chuang Andrew Lee Dechen Gao M-Mahdi Naddaf-Sh Iman Soltani 361 19 0 26 Sep 2024
DiSPo: Diffusion-SSM based Policy Learning for Coarse-to-Fine Action Discretization Nayoung Oh Jaehyeong Jang Moonkyeong Jung Daehyung Park 938 0 0 23 Sep 2024
DynaMo: In-Domain Dynamics Pretraining for Visuo-Motor ControlNeural Information Processing Systems (NeurIPS), 2024 Zichen Jeff Cui Hengkai Pan Aadhithya Iyer Siddhant Haldar Lerrel Pinto VGen 363 31 0 18 Sep 2024
Robot Utility Models: General Policies for Zero-Shot Deployment in New EnvironmentsIEEE International Conference on Robotics and Automation (ICRA), 2024 Haritheja Etukuru Norihito Naka Zijin Hu Seungjae Lee Julian Mehu Aaron Edsinger Chris Paxton Soumith Chintala Lerrel Pinto Nur Muhammad (Mahi) Shafiullah LM&Ro 221 42 0 09 Sep 2024
Diffusion Policy Policy OptimizationInternational Conference on Learning Representations (ICLR), 2024 Allen Z. Ren Justin Lidard Lars L. Ankile Anthony Simeonov Pulkit Agrawal Anirudha Majumdar Benjamin Burchfiel Hongkai Dai Max Simchowitz 392 125 0 01 Sep 2024
Bidirectional Decoding: Improving Action Chunking via Guided Test-Time SamplingInternational Conference on Learning Representations (ICLR), 2024 Yuejiang Liu Jubayer Ibn Hamid Annie Xie Yoonho Lee Maximilian Du Chelsea Finn OffRL 293 5 0 30 Aug 2024
Efficient Exploration and Discriminative World Model Learning with an Object-Centric AbstractionInternational Conference on Learning Representations (ICLR), 2024 Anthony GX-Chen Kenneth Marino Rob Fergus OCL 421 1 0 21 Aug 2024
From Imitation to Refinement -- Residual RL for Precise Visual Assembly Lars Ankile Anthony Simeonov Idan Shenfeld M. Torné Pulkit Agrawal OffRL 340 5 0 23 Jul 2024
QueST: Self-Supervised Skill Abstractions for Learning Continuous Control Atharva Mete Haotian Xue Albert Wilcox Yongxin Chen Animesh Garg SSL 328 33 0 22 Jul 2024
Dreamitate: Real-World Visuomotor Policy Learning via Video Generation Junbang Liang Ruoshi Liu Ege Ozguroglu Sruthi Sudhakar Achal Dave P. Tokmakov Shuran Song Carl Vondrick VGen 213 54 0 24 Jun 2024
MaIL: Improving Imitation Learning with Mamba Xiaogang Jia Qian Wang Atalay Donat Bowen Xing Ge Li Hongyi Zhou Onur Celik Denis Blessing Rudolf Lioutikov Gerhard Neumann Mamba 193 18 0 12 Jun 2024
Grounding Multimodal Large Language Models in Actions Andrew Szot Bogdan Mazoure Harsh Agrawal Devon Hjelm Z. Kira Alexander Toshev LM&Ro 213 28 0 12 Jun 2024
BAKU: An Efficient Transformer for Multi-Task Policy Learning Siddhant Haldar Zhuoran Peng Lerrel Pinto OffRL 350 79 0 11 Jun 2024
A Survey on Vision-Language-Action Models for Embodied AI Yueen Ma Zixing Song Yuzheng Zhuang Jianye Hao Irwin King LM&Ro 820 157 0 23 May 2024
MMP++: Motion Manifold Primitives with Parametric Curve ModelsIEEE Transactions on robotics (TRO), 2023 Yonghyeon Lee 245 6 0 26 Oct 2023