What Matters in Language Conditioned Robotic Imitation Learning over Unstructured Data

13 April 2022

Wolfram Burgard

Papers citing "What Matters in Language Conditioned Robotic Imitation Learning over Unstructured Data"

50 / 105 papers shown

Title
BBSEA: An Exploration of Brain-Body Synchronization for Embodied Agents Sizhe Yang Qian Luo Anumpam Pani Yanchao Yang 20 2 0 13 Feb 2024
MResT: Multi-Resolution Sensing for Real-Time Control with Vision-Language Models Saumya Saxena Mohit Sharma Oliver Kroemer 22 4 0 25 Jan 2024
Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulation Hongtao Wu Ya Jing Chi-Hou Cheang Guangzeng Chen Jiafeng Xu Xinghang Li Minghuan Liu Hang Li Tao Kong 19 92 0 20 Dec 2023
DiffVL: Scaling Up Soft Body Manipulation using Vision-Language Driven Differentiable Physics Zhiao Huang Feng Chen Yewen Pu Chun-Tse Lin Hao Su Chuang Gan 11 4 0 11 Dec 2023
Language-Conditioned Semantic Search-Based Policy for Robotic Manipulation Tasks Jannik Sheikh Andrew Melnik G. C. Nandi R. Haschke OffRL LM&Ro 11 3 0 10 Dec 2023
PlayFusion: Skill Acquisition via Diffusion from Language-Annotated Play Lili Chen Shikhar Bahl Deepak Pathak 13 41 0 07 Dec 2023
SAGE: Bridging Semantic and Actionable Parts for GEneralizable Manipulation of Articulated Objects Haoran Geng Songlin Wei Congyue Deng Bokui Shen He-Nan Wang Leonidas J. Guibas LM&Ro 29 3 0 03 Dec 2023
Kinematic-aware Prompting for Generalizable Articulated Object Manipulation with LLMs Wenke Xia Dong Wang Xincheng Pang Zhigang Wang Bin Zhao Di Hu Xuelong Li LM&Ro 27 19 0 06 Nov 2023
Vision-Language Foundation Models as Effective Robot Imitators Xinghang Li Minghuan Liu Hanbo Zhang Cunjun Yu Jie Xu ... Ya Jing Weinan Zhang Huaping Liu Hang Li Tao Kong LM&Ro 16 132 0 02 Nov 2023
Zero-Shot Robotic Manipulation with Pretrained Image-Editing Diffusion Models Kevin Black Mitsuhiko Nakamoto P. Atreya Homer Walke Chelsea Finn Aviral Kumar Sergey Levine DiffM LM&Ro 18 130 0 16 Oct 2023
Open X-Embodiment: Robotic Learning Datasets and RT-X Models Open X-Embodiment Collaboration Abby OÑeill Abdul Rehman Abhinav Gupta Abhiram Maddukuri ... Zhuo Xu Zichen Jeff Cui Zichen Zhang Zipeng Fu Zipeng Lin LM&Ro 25 451 0 13 Oct 2023
MUTEX: Learning Unified Policies from Multimodal Task Specifications Rutav Shah Roberto Martín-Martín Yuke Zhu OffRL 39 54 0 25 Sep 2023
Prompt, Plan, Perform: LLM-based Humanoid Control via Quantized Imitation Learning Jingkai Sun Qiang Zhang Yiqun Duan Xiaoyang Jiang Chong Cheng Renjing Xu LM&Ro 33 22 0 20 Sep 2023
Compositional Diffusion-Based Continuous Constraint Solvers Zhutian Yang Jiayuan Mao Yilun Du Jiajun Wu J. Tenenbaum Tomás Lozano-Pérez L. Kaelbling DiffM 52 31 0 02 Sep 2023
RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control Anthony Brohan Noah Brown Justice Carbajal Yevgen Chebotar Xi Chen ... Ted Xiao Peng-Tao Xu Sichun Xu Tianhe Yu Brianna Zitkovich LM&Ro LRM 11 1,074 0 28 Jul 2023
Scaling Up and Distilling Down: Language-Guided Robot Skill Acquisition Huy Ha Peter R. Florence Shuran Song LM&Ro 34 148 0 26 Jul 2023
"Tidy Up the Table": Grounding Common-sense Objective for Tabletop Object Rearrangement Yiqing Xu David Hsu LM&Ro LMTD 16 0 0 21 Jul 2023
VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Models Wenlong Huang Chen Wang Ruohan Zhang Yunzhu Li Jiajun Wu Li Fei-Fei LM&Ro 19 474 0 12 Jul 2023
KITE: Keypoint-Conditioned Policies for Semantic Manipulation Priya Sundaresan Suneel Belkhale Dorsa Sadigh Jeannette Bohg LM&Ro 25 24 0 29 Jun 2023
RVT: Robotic View Transformer for 3D Object Manipulation Ankit Goyal Jie Xu Yijie Guo Valts Blukis Yu-Wei Chao D. Fox LM&Ro 31 115 0 26 Jun 2023
SayTap: Language to Quadrupedal Locomotion Yujin Tang Wenhao Yu Jie Tan Heiga Zen Aleksandra Faust Tatsuya Harada 17 40 0 13 Jun 2023
Transferring Foundation Models for Generalizable Robotic Manipulation Jiange Yang Wenhui Tan Chuhao Jin Keling Yao Bei Liu Jianlong Fu Ruihua Song Gangshan Wu Limin Wang LM&Ro 45 6 0 09 Jun 2023
LIV: Language-Image Representations and Rewards for Robotic Control Yecheng Jason Ma William Liang Vaidehi Som Vikash Kumar Amy Zhang Osbert Bastani Dinesh Jayaraman LM&Ro 12 119 0 01 Jun 2023
Language-Conditioned Imitation Learning with Base Skill Priors under Unstructured Data Hongkuan Zhou Zhenshan Bing Xiangtong Yao Xiaojie Su Chenguang Yang Kai-Qi Huang Alois C. Knoll LM&Ro 26 18 0 30 May 2023
AlphaBlock: Embodied Finetuning for Vision-Language Reasoning in Robot Manipulation Chuhao Jin Wenhui Tan Jiange Yang Bei Liu Ruihua Song Limin Wang Jianlong Fu LM&Ro LRM 17 17 0 30 May 2023
Diffusion Model is an Effective Planner and Data Synthesizer for Multi-Task Reinforcement Learning Haoran He Chenjia Bai Kang Xu Zhuoran Yang Weinan Zhang Dong Wang Bingyan Zhao Xuelong Li DiffM OffRL 13 88 0 29 May 2023
Policy Representation via Diffusion Probability Model for Reinforcement Learning Long Yang Zhixiong Huang Fenghao Lei Yucun Zhong Yiming Yang Cong Fang Shiting Wen Binbin Zhou Zhouchen Lin DiffM 16 37 0 22 May 2023
Learning Video-Conditioned Policies for Unseen Manipulation Tasks Elliot Chane-Sane Cordelia Schmid Ivan Laptev 17 16 0 10 May 2023
A Glimpse in ChatGPT Capabilities and its impact for AI research Frank Joublin Antonello Ceravola Joerg Deigmoeller Michael Gienger M. Franzius Julian Eggert SILM AI4MH ALM ELM 8 14 0 10 May 2023
Contrastive Language, Action, and State Pre-training for Robot Learning Krishan Rana Andrew Melnik Niko Sünderhauf 10 12 0 21 Apr 2023
ARNOLD: A Benchmark for Language-Grounded Task Learning With Continuous States in Realistic 3D Scenes Ran Gong Jiangyong Huang Yizhou Zhao Haoran Geng Xiaofeng Gao ... Ziheng Zhou D. Terzopoulos Song-Chun Zhu Baoxiong Jia Siyuan Huang LM&Ro 37 45 0 09 Apr 2023
Goal-Conditioned Imitation Learning using Score-based Diffusion Policies Moritz Reuss M. Li Xiaogang Jia Rudolf Lioutikov DiffM 10 153 0 05 Apr 2023
Grounding Object Relations in Language-Conditioned Robotic Manipulation with Semantic-Spatial Reasoning Qian Luo Yunfei Li Yi Wu LM&Ro 35 5 0 31 Mar 2023
Information Maximizing Curriculum: A Curriculum-Based Approach for Imitating Diverse Skills Denis Blessing Onur Celik Xiaogang Jia Moritz Reuss M. Li Rudolf Lioutikov Gerhard Neumann 17 0 0 27 Mar 2023
PLEX: Making the Most of the Available Data for Robotic Manipulation Pretraining G. Thomas Ching-An Cheng Ricky Loynd Felipe Vieira Frujeri Vibhav Vineet Mihai Jalobeanu Andrey Kolobov SSL 9 8 0 15 Mar 2023
Audio Visual Language Maps for Robot Navigation Chen Huang Oier Mees Andy Zeng Wolfram Burgard VGen 60 32 0 13 Mar 2023
Open-World Object Manipulation using Pre-trained Vision-Language Models Austin Stone Ted Xiao Yao Lu K. Gopalakrishnan Kuang-Huei Lee ... Sean Kirmani Brianna Zitkovich F. Xia Chelsea Finn Karol Hausman LM&Ro 142 144 0 02 Mar 2023
Combining Reconstruction and Contrastive Methods for Multimodal Representations in RL P. Becker Sebastian Mossburger Fabian Otto Gerhard Neumann SSL 8 2 0 10 Feb 2023
"No, to the Right" -- Online Language Corrections for Robotic Manipulation via Shared Autonomy Yuchen Cui Siddharth Karamcheti Raj Palleti Nidhya Shivakumar Percy Liang Dorsa Sadigh LM&Ro 13 75 0 06 Jan 2023
Policy Adaptation from Foundation Model Feedback Yuying Ge Annabella Macaluso Erran L. Li Ping Luo Xiaolong Wang LM&Ro 14 11 0 14 Dec 2022
OpenD: A Benchmark for Language-Driven Door and Drawer Opening Yizhou Zhao Qiaozi Gao Liang Qiu Govind Thattai Gaurav Sukhatme 16 5 0 10 Dec 2022
User-Conditioned Neural Control Policies for Mobile Robotics L. Bauersfeld Elia Kaufmann Davide Scaramuzza 14 6 0 22 Nov 2022
Robotic Skill Acquisition via Instruction Augmentation with Vision-Language Models Ted Xiao Harris Chan P. Sermanet Ayzaan Wahid Anthony Brohan Karol Hausman Sergey Levine Jonathan Tompson VLM LM&Ro 22 65 0 21 Nov 2022
StructDiffusion: Language-Guided Creation of Physically-Valid Structures using Unseen Objects Weiyu Liu Yilun Du Tucker Hermans Sonia Chernova Chris Paxton DiffM 15 53 0 08 Nov 2022
Language Control Diffusion: Efficiently Scaling through Space, Time, and Tasks Edwin Zhang Yujie Lu William Wang Amy Zhang DiffM LM&Ro 14 16 0 27 Oct 2022
Visual Language Maps for Robot Navigation Chen Huang Oier Mees Andy Zeng Wolfram Burgard LM&Ro 145 337 0 11 Oct 2022
Understanding Embodied Reference with Touch-Line Transformer Y. Li Xiaoxue Chen Hao Zhao Jiangtao Gong Guyue Zhou Federico Rossano Yixin Zhu 150 15 0 11 Oct 2022
Grounding Language with Visual Affordances over Unstructured Data Oier Mees Jessica Borja-Diaz Wolfram Burgard LM&Ro 121 106 0 04 Oct 2022
Latent Plans for Task-Agnostic Offline Reinforcement Learning Erick Rosete-Beas Oier Mees Gabriel Kalweit Joschka Boedecker Wolfram Burgard OffRL 12 79 0 19 Sep 2022
Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulation Mohit Shridhar Lucas Manuelli D. Fox LM&Ro 143 449 0 12 Sep 2022