Leveraging Language for Accelerated Learning of Tool Manipulation

27 June 2022

Allen Z. Ren

Anirudha Majumdar

Papers citing "Leveraging Language for Accelerated Learning of Tool Manipulation"

32 / 32 papers shown

Title
KUDA: Keypoints to Unify Dynamics Learning and Visual Prompting for Open-Vocabulary Robotic Manipulation Zixian Liu Mingtong Zhang Yunzhu Li 49 0 0 13 Mar 2025
Generative Artificial Intelligence in Robotic Manipulation: A Survey Kun Zhang Peng Yun Jun Cen Junhao Cai DiDi Zhu ... Qifeng Chen Jia Pan Wei K. Zhang Bo Yang Hua Chen 59 1 0 05 Mar 2025
Generative AI Agents in Autonomous Machines: A Safety Perspective Jason J. Jabbour Vijay Janapa Reddi AI4CE 38 3 0 20 Oct 2024
Emotion-Agent: Unsupervised Deep Reinforcement Learning with Distribution-Prototype Reward for Continuous Emotional EEG Analysis Zhihao Zhou Qile Liu Jiyuan Wang Zhen Liang 21 0 0 22 Aug 2024
What Foundation Models can Bring for Robot Learning in Manipulation : A Survey Dingzhe Li Yixiang Jin A. Yong Hongze Yu Jun Shi Xiaoshuai Hao Peng Hao Huaping Liu Fuchun Sun Bin Fang AI4CE LM&Ro 64 12 0 28 Apr 2024
FoundationGrasp: Generalizable Task-Oriented Grasping with Foundation Models Chao Tang Dehao Huang Wenlong Dong Ruinian Xu Hong Zhang 24 9 0 16 Apr 2024
MANGO: A Benchmark for Evaluating Mapping and Navigation Abilities of Large Language Models Peng Ding Jiading Fang Peng Li Kangrui Wang Xiaochen Zhou Mo Yu Jing Li Matthew R. Walter Hongyuan Mei RALM ELM 40 5 0 29 Mar 2024
PoCo: Policy Composition from and for Heterogeneous Robot Learning Lirui Wang Jialiang Zhao Yilun Du Edward H. Adelson Russ Tedrake 71 26 0 04 Feb 2024
LINGO-Space: Language-Conditioned Incremental Grounding for Space Dohyun Kim Nayoung Oh Deokmin Hwang Daehyung Park 20 6 0 02 Feb 2024
True Knowledge Comes from Practice: Aligning LLMs with Embodied Environments via Reinforcement Learning Weihao Tan Wentao Zhang Shanqi Liu Longtao Zheng Xinrun Wang Bo An OffRL 31 16 0 25 Jan 2024
Large Language Models for Robotics: Opportunities, Challenges, and Perspectives Jiaqi Wang Zihao Wu Yiwei Li Hanqi Jiang Peng Shu ... Lin Zhao Bao Ge Xiang Li Tianming Liu Shu Zhang LM&Ro 27 60 0 09 Jan 2024
Transfer Learning in Robotics: An Upcoming Breakthrough? A Review of Promises and Challenges Noémie Jaquier Michael C. Welle A. Gams Kunpeng Yao Bernardo Fichera A. Billard Aleš Ude Tamim Asfour Danica Kragic 20 14 0 29 Nov 2023
Accelerating Reinforcement Learning of Robotic Manipulations via Feedback from Large Language Models Kun-Mo Chu Xufeng Zhao C. Weber Mengdi Li Stefan Wermter LLMAG LM&Ro 22 14 0 04 Nov 2023
Creative Robot Tool Use with Large Language Models Mengdi Xu Peide Huang Wenhao Yu Shiqi Liu Xilun Zhang Yaru Niu Tingnan Zhang Fei Xia Jie Tan Ding Zhao LM&Ro LLMAG 30 39 0 19 Oct 2023
An HCI-Centric Survey and Taxonomy of Human-Generative-AI Interactions Jingyu Shi Rahul Jain Hyungjun Doh Ryo Suzuki Karthik Ramani 3DV 21 21 0 11 Oct 2023
LAN-grasp: Using Large Language Models for Semantic Object Grasping Reihaneh Mirjalili Michael Krawez Simone Silenzi Yannik Blei Wolfram Burgard VLM 59 27 0 08 Oct 2023
Language-Conditioned Affordance-Pose Detection in 3D Point Clouds Toan Tien Nguyen Minh Nhat Vu Baoru Huang Tuan V. Vo Vy Truong Ngan Le T. Vo Bac Le Anh Nguyen DiffM 28 16 0 19 Sep 2023
CoTDet: Affordance Knowledge Prompting for Task Driven Object Detection Jiajin Tang Ge Zheng Jingyi Yu Sibei Yang ObjD 14 22 0 03 Sep 2023
Developmental Scaffolding with Large Language Models Batuhan Celik Alper Ahmetoglu Emre Ugur Erhan Öztop LM&Ro LLMAG 11 3 0 02 Sep 2023
GraspGPT: Leveraging Semantic Knowledge from a Large Language Model for Task-Oriented Grasping Chao Tang Dehao Huang Wenqiang Ge Weiyu Liu Hong Zhang 19 66 0 25 Jul 2023
Robots That Ask For Help: Uncertainty Alignment for Large Language Model Planners Allen Z. Ren Anushri Dixit Alexandra Bodrova Sumeet Singh Stephen Tu ... Jacob Varley Zhenjia Xu Dorsa Sadigh Andy Zeng Anirudha Majumdar LM&Ro 36 219 0 04 Jul 2023
Statler: State-Maintaining Language Models for Embodied Reasoning Takuma Yoneda Jiading Fang Peng Li Huanyu Zhang Tianchong Jiang Shengjie Lin Ben Picker David Yunis Hongyuan Mei Matthew R. Walter LM&Ro 15 32 0 30 Jun 2023
RL $^3$ : Boosting Meta Reinforcement Learning via RL inside RL $^2$ Abhinav Bhatia Samer B. Nashed S. Zilberstein OffRL 17 0 0 28 Jun 2023
Embodied Executable Policy Learning with Language-based Scene Summarization Jielin Qiu Mengdi Xu William Jongwon Han Seungwhan Moon Ding Zhao LM&Ro 19 7 0 09 Jun 2023
TidyBot: Personalized Robot Assistance with Large Language Models Jimmy Wu Rika Antonova Adam Kan Marion Lepert Andy Zeng Shuran Song Jeannette Bohg Szymon Rusinkiewicz Thomas Funkhouser LM&Ro 20 282 0 09 May 2023
AdaptSim: Task-Driven Simulation Adaptation for Sim-to-Real Transfer Allen Z. Ren Hongkai Dai Benjamin Burchfiel Anirudha Majumdar 11 14 0 09 Feb 2023
Transfer Knowledge from Natural Language to Electrocardiography: Can We Detect Cardiovascular Disease Through Language Models? Jielin Qiu William Jongwon Han Jiacheng Zhu Mengdi Xu Michael A. Rosenberg Emerson Liu Douglas Weber Ding Zhao 8 21 0 21 Jan 2023
A Survey of Meta-Reinforcement Learning Jacob Beck Risto Vuorio E. Liu Zheng Xiong L. Zintgraf Chelsea Finn Shimon Whiteson OOD OffRL 25 119 0 19 Jan 2023
How to talk so AI will learn: Instructions, descriptions, and autonomy T. Sumers Robert D. Hawkins Mark K. Ho Thomas L. Griffiths Dylan Hadfield-Menell LM&Ro 26 20 0 16 Jun 2022
Grounding Language to Entities and Dynamics for Generalization in Reinforcement Learning H. Wang Victor Zhong Karthik Narasimhan 76 53 0 19 Jan 2021
Probabilistic Model-Agnostic Meta-Learning Chelsea Finn Kelvin Xu Sergey Levine BDL 165 664 0 07 Jun 2018
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 243 11,568 0 09 Mar 2017