A Survey of Language-Based Communication in Robotics

6 June 2024

William Hunt

Sarvapali D. Ramchurn

Mohammad D. Soorati

LM&Ro

ArXiv PDF HTML

Papers citing "A Survey of Language-Based Communication in Robotics"

44 / 44 papers shown

Title
ReLI: A Language-Agnostic Approach to Human-Robot Interaction Linus Nwankwo Bjoern Ellensohn Ozan Özdenizci Elmar Rueckert LM&Ro 42 0 0 03 May 2025
Large Language Models for Multi-Robot Systems: A Survey Peihan Li Zijian An Shams Abrar Lifeng Zhou LM&Ro LRM 36 4 0 06 Feb 2025
MARLIN: Multi-Agent Reinforcement Learning Guided by Language-Based Inter-Robot Negotiation Toby Godfrey William Hunt Mohammad D. Soorati 41 1 0 18 Oct 2024
Psychomatics -- A Multidisciplinary Framework for Understanding Artificial Minds Giuseppe Riva F. Mantovani B. Wiederhold Antonella Marchetti A. Gaggioli 26 2 0 23 Jul 2024
Large Language Models for Human-Robot Interaction: Opportunities and Risks Jesse Atuhurra LLMAG LM&Ro 27 1 0 26 Mar 2024
Yell At Your Robot: Improving On-the-Fly from Language Corrections Lucy Xiaoyang Shi Zheyuan Hu Tony Zhao Archit Sharma Karl Pertsch Jianlan Luo Sergey Levine Chelsea Finn LM&Ro 81 56 0 19 Mar 2024
Advancing Explainable Autonomous Vehicle Systems: A Comprehensive Review and Research Roadmap Sule Tekkesinoglu Azra Habibovic Lars Kunze 19 1 0 19 Mar 2024
Scaling Instructable Agents Across Many Simulated Worlds Sima Team Maria Abi Raad Arun Ahuja Catarina Barros F. Besse ... Daan Wierstra Duncan Williams Nathaniel Wong Sarah York Nick Young LM&Ro 107 35 0 13 Mar 2024
HILL: A Hallucination Identifier for Large Language Models Florian Leiser S. Eckhardt Valentin Leuthe Merlin Knaeble Alexander Maedche Gerhard Schwabe A. Sunyaev HILM 28 23 0 11 Mar 2024
Conversational Language Models for Human-in-the-Loop Multi-Robot Coordination William Hunt Toby Godfrey Mohammad D. Soorati LM&Ro 26 6 0 29 Feb 2024
In Search of Needles in a 11M Haystack: Recurrent Memory Finds What LLMs Miss Yuri Kuratov Aydar Bulatov Petr Anokhin Dmitry Sorokin Artyom Sorokin Mikhail Burtsev RALM 109 32 0 16 Feb 2024
Grounding LLMs For Robot Task Planning Using Closed-loop State Feedback V. Bhat Ali Umut Kaypak P. Krishnamurthy Ramesh Karri Farshad Khorrami LM&Ro 61 12 0 13 Feb 2024
Large Language Models: A Survey Shervin Minaee Tomáš Mikolov Narjes Nikzad M. Asgari-Chenaghlu R. Socher Xavier Amatriain Jianfeng Gao ALM LM&MA ELM 102 347 0 09 Feb 2024
An Enhanced Prompt-Based LLM Reasoning Scheme via Knowledge Graph-Integrated Collaboration Yihao Li Ru Zhang Jianyi Liu LRM 55 15 0 07 Feb 2024
Explaining Autonomy: Enhancing Human-Robot Interaction through Explanation Generation with Large Language Models David Sobrín-Hidalgo Miguel Ángel González Santamarta Ángel Manuel Guerrero Higueras Francisco J. Rodríguez-Lera Vicente Matellán Olivera 29 4 0 06 Feb 2024
Vision-Language Models Provide Promptable Representations for Reinforcement Learning William Chen Oier Mees Aviral Kumar Sergey Levine VLM LM&Ro 31 21 0 05 Feb 2024
Building Guardrails for Large Language Models Yizhen Dong Ronghui Mu Gao Jin Yi Qi Jinwei Hu Xingyu Zhao Jie Meng Wenjie Ruan Xiaowei Huang OffRL 51 23 0 02 Feb 2024
Pruning for Protection: Increasing Jailbreak Resistance in Aligned LLMs Without Fine-Tuning Adib Hasan Ileana Rugina Alex Wang AAML 41 22 0 19 Jan 2024
Object-Centric Instruction Augmentation for Robotic Manipulation Junjie Wen Yichen Zhu Minjie Zhu Jinming Li Zhiyuan Xu ... Chaomin Shen Yaxin Peng Dong Liu Feifei Feng Jian Tang LM&Ro 56 16 0 05 Jan 2024
Large Language Models for Robotics: A Survey Fanlong Zeng Wensheng Gan Yongheng Wang Ning Liu Philip S. Yu LM&Ro 109 121 0 13 Nov 2023
Video Language Planning Yilun Du Mengjiao Yang Peter R. Florence Fei Xia Ayzaan Wahid ... Pieter Abbeel Josh Tenenbaum L. Kaelbling Andy Zeng Jonathan Tompson PINN LM&Ro 84 83 0 16 Oct 2023
ASSERT: Automated Safety Scenario Red Teaming for Evaluating the Robustness of Large Language Models Alex Mei Sharon Levy William Yang Wang AAML 26 7 0 14 Oct 2023
Reasoning about the Unseen for Efficient Outdoor Object Navigation Quanting Xie Tianyi Zhang Kedi Xu Matthew Johnson-Roberson Yonatan Bisk LRM 42 9 0 18 Sep 2023
MindAgent: Emergent Gaming Interaction Ran Gong Qiuyuan Huang Xiaojian Ma Hoi Vo Zane Durante ... Zilong Zheng Song-Chun Zhu Demetri Terzopoulos Fei-Fei Li Jianfeng Gao LM&Ro 96 61 0 18 Sep 2023
SGP-TOD: Building Task Bots Effortlessly via Schema-Guided LLM Prompting Xiaoying Zhang Baolin Peng Kun Li Jingyan Zhou Helen M. Meng 64 37 0 15 May 2023
Plan, Eliminate, and Track -- Language Models are Good Teachers for Embodied Agents Yu-Chih Chen So Yeon Min Chase Davis Ruslan Salakhutdinov A. Azaria Yuan-Fang Li Tom Michael Mitchell A. Bovik LM&Ro LLMAG 59 26 0 03 May 2023
Using Large Language Models for Interpreting Autonomous Robots Behaviors Miguel Ángel González Santamarta Laura Fernández-Becerra David Sobrín-Hidalgo Ángel Manuel Guerrero Higueras Irene González Francisco J. Rodríguez-Lera 36 11 0 28 Apr 2023
Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyond Jingfeng Yang Hongye Jin Ruixiang Tang Xiaotian Han Qizhang Feng Haoming Jiang Bing Yin Xia Hu LM&MA 123 593 0 26 Apr 2023
Generative Agents: Interactive Simulacra of Human Behavior J. Park Joseph C. O'Brien Carrie J. Cai Meredith Ringel Morris Percy Liang Michael S. Bernstein LM&Ro AI4CE 204 1,701 0 07 Apr 2023
Errors are Useful Prompts: Instruction Guided Task Programming with Verifier-Assisted Iterative Prompting Marta Skreta Naruki Yoshikawa Sebastian Arellano-Rubach Zhi Ji L. B. Kristensen Kourosh Darvish Alán Aspuru-Guzik Florian Shkurti Animesh Garg 54 56 0 24 Mar 2023
Second Thoughts are Best: Learning to Re-Align With Human Values from Text Edits Ruibo Liu Chenyan Jia Ge Zhang Ziyu Zhuang Tony X. Liu Soroush Vosoughi 33 34 0 01 Jan 2023
Visual Language Maps for Robot Navigation Chen Huang Oier Mees Andy Zeng Wolfram Burgard LM&Ro 140 337 0 11 Oct 2022
Mind's Eye: Grounded Language Model Reasoning through Simulation Ruibo Liu Jason W. Wei S. Gu Te-Yen Wu Soroush Vosoughi Claire Cui Denny Zhou Andrew M. Dai ReLM LRM 106 78 0 11 Oct 2022
DALL-E-Bot: Introducing Web-Scale Diffusion Models to Robotics Ivan Kapelyukh Vitalis Vosylius Edward Johns LM&Ro DiffM 91 143 0 05 Oct 2022
ProgPrompt: Generating Situated Robot Task Plans using Large Language Models Ishika Singh Valts Blukis Arsalan Mousavian Ankit Goyal Danfei Xu Jonathan Tremblay D. Fox Jesse Thomason Animesh Garg LM&Ro LLMAG 104 616 0 22 Sep 2022
Meta-Reinforcement Learning via Language Instructions Zhenshan Bing A. Koch Xiangtong Yao Kai-Qi Huang Alois C. Knoll LM&Ro 39 18 0 11 Sep 2022
LM-Nav: Robotic Navigation with Large Pre-Trained Models of Language, Vision, and Action Dhruv Shah B. Osinski Brian Ichter Sergey Levine LM&Ro 136 430 0 10 Jul 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 301 11,730 0 04 Mar 2022
A Systematic Evaluation of Large Language Models of Code Frank F. Xu Uri Alon Graham Neubig Vincent J. Hellendoorn ELM ALM 188 624 0 26 Feb 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 315 8,261 0 28 Jan 2022
TEACh: Task-driven Embodied Agents that Chat Aishwarya Padmakumar Jesse Thomason Ayush Shrivastava P. Lange Anjali Narayan-Chen Spandana Gella Robinson Piramithu Gökhan Tür Dilek Z. Hakkani-Tür LM&Ro 140 179 0 01 Oct 2021
Zero-Shot Text-to-Image Generation Aditya A. Ramesh Mikhail Pavlov Gabriel Goh Scott Gray Chelsea Voss Alec Radford Mark Chen Ilya Sutskever VLM 253 4,735 0 24 Feb 2021
The RobotSlang Benchmark: Dialog-guided Robot Localization and Navigation Shurjo Banerjee Jesse Thomason Jason J. Corso LM&Ro 65 30 0 23 Oct 2020
AI safety via debate G. Irving Paul Christiano Dario Amodei 196 199 0 02 May 2018