Building Cooperative Embodied Agents Modularly with Large Language Models

5 July 2023

Chuang Gan

Papers citing "Building Cooperative Embodied Agents Modularly with Large Language Models"

31 / 131 papers shown

Title
Language Models, Agent Models, and World Models: The LAW for Machine Reasoning and Planning Zhiting Hu Tianmin Shu LLMAG LM&Ro LRM 99 34 0 08 Dec 2023
Digital Life Project: Autonomous 3D Characters with Social Intelligence Zhongang Cai Jian-Dong Jiang Zhongfei Qing Xinying Guo Mingyuan Zhang ... Yukun Wei Xiaogang Wang Chen Change Loy Lei Yang Ziwei Liu VGen 10 24 0 07 Dec 2023
AVA: Towards Autonomous Visualization Agents through Visual Perception-Driven Decision-Making Shusen Liu Haichao Miao Zhimin Li M. Olson Valerio Pascucci P. Bremer 14 8 0 07 Dec 2023
Robot Learning in the Era of Foundation Models: A Survey Xuan Xiao Jiahang Liu Zhipeng Wang Yanmin Zhou Yong Qi Qian Cheng Bin He Shuo Jiang AI4CE LM&Ro 8 25 0 24 Nov 2023
Controlling Large Language Model-based Agents for Large-Scale Decision-Making: An Actor-Critic Approach Bin Zhang Hangyu Mao Jingqing Ruan Ying Wen Yang Li ... Dapeng Li Ziyue Li Rui Zhao Lijuan Li Guoliang Fan LM&Ro LLMAG 11 33 0 23 Nov 2023
FinMem: A Performance-Enhanced LLM Trading Agent with Layered Memory and Character Design Yangyang Yu Haohang Li Zhi Chen Yuechen Jiang Yang Li Denghui Zhang Rong Liu Jordan W. Suchow K. Khashanah 42 44 0 23 Nov 2023
Towards Responsible Generative AI: A Reference Architecture for Designing Foundation Model based Agents Qinghua Lu Liming Zhu Xiwei Xu Zhenchang Xing Stefan Harrer Jon Whittle LM&Ro AI4CE LLMAG 23 11 0 22 Nov 2023
Multi-Agent Consensus Seeking via Large Language Models Huaben Chen Wenkang Ji Lufeng Xu Shiyu Zhao LM&Ro LLMAG 39 20 0 31 Oct 2023
GG-LLM: Geometrically Grounding Large Language Models for Zero-shot Human Activity Forecasting in Human-Aware Task Planning Moritz Graule Volkan Isler LM&Ro 11 14 0 30 Oct 2023
MM-VID: Advancing Video Understanding with GPT-4V(ision) Kevin Qinghong Lin Faisal Ahmed Linjie Li Chung-Ching Lin E. Azarnasab ... Lin Liang Zicheng Liu Yumao Lu Ce Liu Lijuan Wang MLLM 8 62 0 30 Oct 2023
Co-NavGPT: Multi-Robot Cooperative Visual Semantic Navigation Using Vision Language Models Bangguo Yu Qihao Yuan Kailai Li H. Kasaei Ming Cao LM&Ro 31 28 0 11 Oct 2023
LLM-Coordination: Evaluating and Analyzing Multi-agent Coordination Abilities in Large Language Models Saaket Agashe Yue Fan Anthony Reyna Xin Eric Wang LLMAG LRM 84 10 0 05 Oct 2023
Scalable Multi-Robot Collaboration with Large Language Models: Centralized or Decentralized Systems? Yongchao Chen Jacob Arkin Yang Zhang Nicholas Roy Chuchu Fan LLMAG LM&Ro 17 64 0 27 Sep 2023
MindAgent: Emergent Gaming Interaction Ran Gong Qiuyuan Huang Xiaojian Ma Hoi Vo Zane Durante ... Zilong Zheng Song-Chun Zhu Demetri Terzopoulos Fei-Fei Li Jianfeng Gao LM&Ro 96 61 0 18 Sep 2023
Unleashing the Power of Graph Learning through LLM-based Autonomous Agents Lanning Wei Zhiqiang He Huan Zhao Quanming Yao LLMAG 12 9 0 08 Sep 2023
A Survey on Large Language Model based Autonomous Agents Lei Wang Chengbang Ma Xueyang Feng Zeyu Zhang Hao-ran Yang ... Xu Chen Yankai Lin Wayne Xin Zhao Zhewei Wei Ji-Rong Wen LLMAG AI4CE LM&Ro 31 1,088 0 22 Aug 2023
Fast and Adaptive Multi-agent Planning under Collaborative Temporal Logic Tasks via Poset Products Zesen Liu Meng Guo Weimin Bao Zhongkui Li 14 3 0 22 Aug 2023
AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors Weize Chen Yusheng Su Jingwei Zuo Cheng Yang Chenfei Yuan ... Xin Cong Ruobing Xie Zhiyuan Liu Maosong Sun Jie Zhou AI4CE LLMAG LM&Ro 11 129 0 21 Aug 2023
$A^2$ Nav: Action-Aware Zero-Shot Robot Navigation by Exploiting Vision-and-Language Ability of Foundation Models Peihao Chen Xinyu Sun Hongyan Zhi Runhao Zeng Thomas H. Li Gaowen Liu Mingkui Tan Chuang Gan LLMAG LM&Ro 12 32 0 15 Aug 2023
MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework Sirui Hong Mingchen Zhuge Jonathan Chen Xiawu Zheng Yuheng Cheng ... Liyang Zhou Chenyu Ran Lingfeng Xiao Chenglin Wu Jürgen Schmidhuber LLMAG AIFin 13 548 0 01 Aug 2023
Foundational Models Defining a New Era in Vision: A Survey and Outlook Muhammad Awais Muzammal Naseer Salman Khan Rao Muhammad Anwer Hisham Cholakkal M. Shah Ming Yang F. Khan VLM 13 116 0 25 Jul 2023
Improving Factuality and Reasoning in Language Models through Multiagent Debate Yilun Du Shuang Li Antonio Torralba J. Tenenbaum Igor Mordatch LLMAG LRM 10 592 0 23 May 2023
Plan, Eliminate, and Track -- Language Models are Good Teachers for Embodied Agents Yu-Chih Chen So Yeon Min Chase Davis Ruslan Salakhutdinov A. Azaria Yuan-Fang Li Tom Michael Mitchell A. Bovik LM&Ro LLMAG 64 26 0 03 May 2023
Generative Agents: Interactive Simulacra of Human Behavior J. Park Joseph C. O'Brien Carrie J. Cai Meredith Ringel Morris Percy Liang Michael S. Bernstein LM&Ro AI4CE 204 1,701 0 07 Apr 2023
Foundation Models for Decision Making: Problems, Methods, and Opportunities Sherry Yang Ofir Nachum Yilun Du Jason W. Wei Pieter Abbeel Dale Schuurmans LM&Ro OffRL LRM AI4CE 87 148 0 07 Mar 2023
Large Language Models are Zero-Shot Reasoners Takeshi Kojima S. Gu Machel Reid Yutaka Matsuo Yusuke Iwasawa ReLM LRM 291 2,712 0 24 May 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 315 8,261 0 28 Jan 2022
Skill Induction and Planning with Latent Language Pratyusha Sharma Antonio Torralba Jacob Andreas LM&Ro 178 108 0 04 Oct 2021
TEACh: Task-driven Embodied Agents that Chat Aishwarya Padmakumar Jesse Thomason Ayush Shrivastava P. Lange Anjali Narayan-Chen Spandana Gella Robinson Piramithu Gökhan Tür Dilek Z. Hakkani-Tür LM&Ro 140 179 0 01 Oct 2021
Watch-And-Help: A Challenge for Social Perception and Human-AI Collaboration Xavier Puig Tianmin Shu Shuang Li Zilin Wang Yuan-Hong Liao J. Tenenbaum Sanja Fidler Antonio Torralba LM&Ro 91 94 0 19 Oct 2020
SAPIEN: A SimulAted Part-based Interactive ENvironment Fanbo Xiang Yuzhe Qin Kaichun Mo Yikuan Xia Hao Zhu ... He-Nan Wang Li Yi Angel X. Chang Leonidas J. Guibas Hao Su 195 482 0 19 Mar 2020