Multi-skill Mobile Manipulation for Object Rearrangement

6 September 2022

Jiayuan Gu

Devendra Singh Chaplot

Hao Su

Jitendra Malik

ArXiv PDF HTML

Papers citing "Multi-skill Mobile Manipulation for Object Rearrangement"

47 / 47 papers shown

Title
MoManipVLA: Transferring Vision-language-action Models for General Mobile Manipulation Zhenyu Wu Yuheng Zhou Xiuwei Xu Z. Wang Haibin Yan 41 2 0 17 Mar 2025
EMMOE: A Comprehensive Benchmark for Embodied Mobile Manipulation in Open Environments Dongping Li Tielong Cai Tianci Tang Wenhao Chai Katherine Rose Driggs-Campbell Gaoang Wang LM&Ro 56 0 0 11 Mar 2025
A Real-to-Sim-to-Real Approach to Robotic Manipulation with VLM-Generated Iterative Keypoint Rewards Shivansh Patel Xinchen Yin Wenlong Huang Shubham Garg H. Nayyeri Li Fei-Fei Svetlana Lazebnik Y. Li 89 0 0 12 Feb 2025
When Should We Prefer State-to-Visual DAgger Over Visual Reinforcement Learning? Tongzhou Mu Zhaoyang Li Stanisław Wiktor Strzelecki Xiu Yuan Yunchao Yao Litian Liang H. Su OffRL 67 1 0 18 Dec 2024
ManiSkill-HAB: A Benchmark for Low-Level Manipulation in Home Rearrangement Tasks Arth Shukla Stone Tao Hao Su 85 6 0 09 Dec 2024
Hierarchical Object-Oriented POMDP Planning for Object Rearrangement Rajesh Mangannavar Alan Fern Prasad Tadepalli OCL 73 0 0 02 Dec 2024
M2Diffuser: Diffusion-based Trajectory Optimization for Mobile Manipulation in 3D Scenes Sixu Yan Zeyu Zhang Muzhi Han Zaijin Wang Qi Xie Zhitian Li Zhehan Li Hangxin Liu Xinggang Wang Song-Chun Zhu 52 4 0 15 Oct 2024
Combining Planning and Diffusion for Mobility with Unknown Dynamics Yajvan Ravan Zhutian Yang Tao Chen Tomás Lozano-Pérez Leslie Pack Kaelbling 26 3 0 09 Oct 2024
M3Bench: Benchmarking Whole-body Motion Generation for Mobile Manipulation in 3D Scenes Zeyu Zhang Sixu Yan Muzhi Han Zaijin Wang Xinggang Wang Song-Chun Zhu Hangxin Liu 49 2 0 09 Oct 2024
Learning the Generalizable Manipulation Skills on Soft-body Tasks via Guided Self-attention Behavior Cloning Policy XueTao Li Fang Gao Jun Yu Shaodong Li Feng Shuang LM&Ro 16 0 0 08 Oct 2024
Continuously Improving Mobile Manipulation with Autonomous Real-World RL Russell Mendonca Emmanuel Panov Bernadette Bucher Jiuguang Wang Deepak Pathak OffRL 33 4 0 30 Sep 2024
MHRC: Closed-loop Decentralized Multi-Heterogeneous Robot Collaboration with Large Language Models Wenhao Yu Jie Peng Yueliang Ying Sai Li Jianmin Ji Yanyong Zhang 41 4 0 24 Sep 2024
Theia: Distilling Diverse Vision Foundation Models for Robot Learning Jinghuan Shang Karl Schmeckpeper Brandon B. May M. Minniti Tarik Kelestemur David Watkins Laura Herlant VLM 32 23 0 29 Jul 2024
Collaborative Fall Detection and Response using Wi-Fi Sensing and Mobile Companion Robot Yunwang Chen Yaozhong Kang Ziqi Zhao Yue Hong Lingxiao Meng Max Q.-H. Meng 22 0 0 17 Jul 2024
PoliFormer: Scaling On-Policy RL with Transformers Results in Masterful Navigators Kuo-Hao Zeng Zichen Zhang Kiana Ehsani Rose Hendrix Jordi Salvador Alvaro Herrasti Ross Girshick Aniruddha Kembhavi Luca Weihs LM&Ro OffRL 29 17 0 28 Jun 2024
Reinforcement Learning via Auxiliary Task Distillation Abhinav Harish Larry Heck Josiah P. Hanna Z. Kira Andrew Szot 26 0 0 24 Jun 2024
TRANSIC: Sim-to-Real Policy Transfer by Learning from Online Correction Yunfan Jiang Chen Wang Ruohan Zhang Jiajun Wu Fei-Fei Li OnRL 30 25 0 16 May 2024
DrS: Learning Reusable Dense Rewards for Multi-Stage Tasks Tongzhou Mu Minghua Liu Hao Su OffRL 29 2 0 25 Apr 2024
Closed-Loop Open-Vocabulary Mobile Manipulation with GPT-4V Peiyuan Zhi Zhiyuan Zhang Muzhi Han Zeyu Zhang Zhitian Li Ziyuan Jiao Ziyuan Jiao Siyuan Huang Siyuan Huang LRM LM&Ro 38 28 0 16 Apr 2024
Visual Whole-Body Control for Legged Loco-Manipulation Minghuan Liu Zixuan Chen Xuxin Cheng Yandong Ji Ri-Zhao Qiu Ruihan Yang Xiaolong Wang 53 43 0 25 Mar 2024
Learning Generalizable Feature Fields for Mobile Manipulation Ri-Zhao Qiu Yafei Hu Ge Yang Yuchen Song Yang Fu ... Jiteng Mu Ruihan Yang Nikolay A. Atanasov Sebastian Scherer Xiaolong Wang 29 25 0 12 Mar 2024
Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperation Zipeng Fu Tony Zhao Chelsea Finn 100 281 0 04 Jan 2024
Harmonic Mobile Manipulation Ruihan Yang Yejin Kim Aniruddha Kembhavi Xiaolong Wang Kiana Ehsani 23 13 0 11 Dec 2023
Robot Learning in the Era of Foundation Models: A Survey Xuan Xiao Jiahang Liu Zhipeng Wang Yanmin Zhou Yong Qi Qian Cheng Bin He Shuo Jiang AI4CE LM&Ro 16 25 0 24 Nov 2023
GOAT: GO to Any Thing Matthew Chang Théophile Gervet Mukul Khanna Sriram Yenamandra Dhruv Shah ... Saurabh Gupta Dhruv Batra Roozbeh Mottaghi Jitendra Malik Devendra Singh Chaplot 21 65 0 10 Nov 2023
Large Language Models as Generalizable Policies for Embodied Tasks Andrew Szot Max Schwarzer Harsh Agrawal Bogdan Mazoure Walter A. Talbott Katherine Metcalf Natalie Mackraz Devon Hjelm Alexander Toshev LM&Ro 16 57 0 26 Oct 2023
Habitat 3.0: A Co-Habitat for Humans, Avatars and Robots Xavi Puig Eric Undersander Andrew Szot Mikael Dallaire Cote Tsung-Yen Yang ... Singh Chaplot Unnat Jain Dhruv Batra †. AksharaRai †. RoozbehMottaghi 11 114 0 19 Oct 2023
GAMMA: Graspability-Aware Mobile MAnipulation Policy Learning based on Online Grasping Pose Fusion Jiazhao Zhang Nandiraju Gireesh Jilong Wang Xiaomeng Fang Chaoyi Xu Weiguang Chen Liu Dai He Wang 13 18 0 27 Sep 2023
Skill Transformer: A Monolithic Policy for Mobile Manipulation Xiaoyu Huang Dhruv Batra Akshara Rai Andrew Szot LM&Ro 14 21 0 19 Aug 2023
Symbolic State Space Optimization for Long Horizon Mobile Manipulation Planning Xiaohan Zhang Yifeng Zhu Yan Ding Yuqian Jiang Yuke Zhu Peter Stone Shiqi Zhang 23 4 0 21 Jul 2023
Learning Hierarchical Interactive Multi-Object Search for Mobile Manipulation F. Schmalstieg Daniel Honerkamp Tim Welschehold Abhinav Valada 11 13 0 12 Jul 2023
Optimal and Stable Multi-Layer Object Rearrangement on a Tabletop Andy Xu Kai-Xin Gao S. Feng Jingjin Yu 19 1 0 25 Jun 2023
Effectively Rearranging Heterogeneous Objects on Cluttered Tabletops Kai-Xin Gao Justin Yu Tanay Sandeep Punjabi Jingjin Yu 30 4 0 25 Jun 2023
Galactic: Scaling End-to-End Reinforcement Learning for Rearrangement at 100k Steps-Per-Second Vincent-Pierre Berges Andrew Szot Devendra Singh Chaplot Aaron Gokaslan Roozbeh Mottaghi Dhruv Batra Eric Undersander LRM LM&Ro 14 5 0 13 Jun 2023
Adaptive Coordination in Social Embodied Rearrangement Andrew Szot Unnat Jain Dhruv Batra Z. Kira Ruta Desai Akshara Rai 31 12 0 31 May 2023
Large Language Models as Commonsense Knowledge for Large-Scale Task Planning Zirui Zhao W. Lee David Hsu LRM LLMAG LM&Ro 31 192 0 23 May 2023
A Closer Look at Reward Decomposition for High-Level Robotic Explanations Wenhao Lu Xufeng Zhao S. Magg M. Gromniak Mengdi Li S. Wermter 17 7 0 25 Apr 2023
ARNOLD: A Benchmark for Language-Grounded Task Learning With Continuous States in Realistic 3D Scenes Ran Gong Jiangyong Huang Yizhou Zhao Haoran Geng Xiaofeng Gao ... Ziheng Zhou D. Terzopoulos Song-Chun Zhu Baoxiong Jia Siyuan Huang LM&Ro 37 45 0 09 Apr 2023
Chain-of-Thought Predictive Control Zhiwei Jia Vineet Thumuluri Fangchen Liu Ling-Hao Chen Zhiao Huang H. Su LM&Ro 23 20 0 03 Apr 2023
ASC: Adaptive Skill Coordination for Robotic Mobile Manipulation Naoki Yokoyama Alexander William Clegg Joanne Truong Eric Undersander Tsung-Yen Yang Sergio Arnaud Sehoon Ha Dhruv Batra Akshara Rai 8 32 0 01 Apr 2023
Where are we in the search for an Artificial Visual Cortex for Embodied Intelligence? Arjun Majumdar Karmesh Yadav Sergio Arnaud Yecheng Jason Ma Claire Chen ... Dhruv Batra Yixin Lin Oleksandr Maksymets Aravind Rajeswaran Franziska Meier LM&Ro 14 171 0 31 Mar 2023
Task and Motion Planning with Large Language Models for Object Rearrangement Yan Ding Xiaohan Zhang Chris Paxton Shiqi Zhang LM&Ro LRM 22 177 0 10 Mar 2023
ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skills Jiayuan Gu Fanbo Xiang Xuanlin Li Z. Ling Xiqiang Liu ... Xiao Yuan P. Xie Zhiao Huang Rui Chen Hao Su 25 173 0 09 Feb 2023
Comparison of Model-Free and Model-Based Learning-Informed Planning for PointGoal Navigation Yimeng Li Arnab Debnath Gregory J. Stein Jana Kosecka 3DPC 16 3 0 17 Dec 2022
Learning-Augmented Model-Based Planning for Visual Exploration Yimeng Li Arnab Debnath Gregory J. Stein Jana Kosecka 17 8 0 15 Nov 2022
Towards Disturbance-Free Visual Mobile Manipulation Tianwei Ni Kiana Ehsani Luca Weihs Jordi Salvador 16 9 0 17 Dec 2021
ManipulaTHOR: A Framework for Visual Object Manipulation Kiana Ehsani Winson Han Alvaro Herrasti Eli VanderBilt Luca Weihs Eric Kolve Aniruddha Kembhavi Roozbeh Mottaghi LM&Ro 155 124 0 22 Apr 2021