Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agents

3 February 2023

Xiaojian Ma

Papers citing "Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agents"

50 / 254 papers shown

Title
StoryVerse: Towards Co-authoring Dynamic Plot with LLM-based Character Simulation via Narrative Planning Yi Wang Qian Zhou David Ledo 28 9 0 17 May 2024
Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learning Yuexiang Zhai Hao Bai Zipeng Lin Jiayi Pan Shengbang Tong ... Alane Suhr Saining Xie Yann LeCun Yi-An Ma Sergey Levine LLMAG LRM 29 54 0 16 May 2024
From Persona to Personalization: A Survey on Role-Playing Language Agents Jiangjie Chen Xintao Wang Rui Xu Siyu Yuan Yikai Zhang ... Caiyu Hu Siye Wu Scott Ren Ziquan Fu Yanghua Xiao 50 72 0 28 Apr 2024
RAM: Towards an Ever-Improving Memory System by Learning from Communications Jiaqi Li Xiaobo Wang Wentao Ding Zihao Wang Yipeng Kang Zixia Jia Zilong Zheng 42 1 0 18 Apr 2024
AgentKit: Flow Engineering with Graphs, not Coding Yue Wu Yewen Fan So Yeon Min Shrimai Prabhumoye Stephen Marcus McAleer Yonatan Bisk Ruslan Salakhutdinov Yuanzhi Li Tom Michael Mitchell AI4CE 27 0 0 17 Apr 2024
Empowering Large Language Models on Robotic Manipulation with Affordance Prompting Guangran Cheng Chuheng Zhang Wenzhe Cai Li Zhao Changyin Sun Jiang Bian LM&Ro LLMAG 180 9 0 17 Apr 2024
Explainable Generative AI (GenXAI): A Survey, Conceptualization, and Research Agenda Johannes Schneider 79 26 0 15 Apr 2024
Dynamic Generation of Personalities with Large Language Models Jianzhi Liu Hexiang Gu Tianyu Zheng Liuyu Xiang Huijia Wu Jie Fu Zhaofeng He 37 3 0 10 Apr 2024
Evolving Agents: Interactive Simulation of Dynamic and Diverse Human Personalities Jiale Li Jiayang Li Jiahao Chen Yifan Li Shijie Wang Hugo Zhou Minjun Ye Yunsheng Su AI4CE 40 4 0 03 Apr 2024
Helmsman of the Masses? Evaluate the Opinion Leadership of Large Language Models in the Werewolf Game Silin Du Xiaowei Zhang LLMAG 20 5 0 02 Apr 2024
A Survey on Large Language Model-Based Game Agents Sihao Hu Tiansheng Huang Gaowen Liu Ramana Rao Kompella Gaowen Liu Selim Furkan Tekin Yichang Xu Zachary Yahn Ling Liu LLMAG LM&Ro AI4CE LM&MA 66 49 0 02 Apr 2024
MineLand: Simulating Large-Scale Multi-Agent Interactions with Limited Multimodal Senses and Physical Needs Xianhao Yu Jiaqi Fu Renjia Deng Wenjuan Han 26 5 0 28 Mar 2024
Untangling Knots: Leveraging LLM for Error Resolution in Computational Notebooks Konstantin Grotov Sergey Titov Yaroslav Zharov T. Bryksin 21 0 0 26 Mar 2024
MineDreamer: Learning to Follow Instructions via Chain-of-Imagination for Simulated-World Control Enshen Zhou Yiran Qin Zhen-fei Yin Yuzhou Huang Ruimao Zhang Lu Sheng Yu Qiao Jing Shao LM&Ro AI4CE 37 32 0 18 Mar 2024
EnvGen: Generating and Adapting Environments via LLMs for Training Embodied Agents Abhaysinh Zala Jaemin Cho Han Lin Jaehong Yoon Mohit Bansal 26 13 0 18 Mar 2024
Context-aware LLM-based Safe Control Against Latent Risks Quang Khanh Luu Xiyu Deng Anh Van Ho Yorie Nakahira 51 4 0 18 Mar 2024
DevBench: A Comprehensive Benchmark for Software Development Bowen Li Wenhan Wu Ziwei Tang Lin Shi John Yang ... He Du Ping Yang Dahua Lin Chao Peng Kai Chen 85 10 0 13 Mar 2024
ManiGaussian: Dynamic Gaussian Splatting for Multi-task Robotic Manipulation Guanxing Lu Shiyi Zhang Ziwei Wang Changliu Liu Jiwen Lu Yansong Tang 41 49 0 13 Mar 2024
Hierarchical Auto-Organizing System for Open-Ended Multi-Agent Navigation Zhonghan Zhao Kewei Chen Dongxu Guo Wenhao Chai Tianbo Ye Yanting Zhang Gaoang Wang 53 20 0 13 Mar 2024
TRAD: Enhancing LLM Agents with Step-Wise Thought Retrieval and Aligned Decision Ruiwen Zhou Yingxuan Yang Kangrui Chen Ying Wen Wenhao Wang Chunling Xi Guoqiang Xu Jiliang Tang Lingjuan Lyu LLMAG 21 8 0 10 Mar 2024
Learning to Use Tools via Cooperative and Interactive Agents Zhengliang Shi Shen Gao Xiuyi Chen Zhumin Chen Lingyong Yan Haibo Shi Dawei Yin Pengjie Ren Suzan Verberne Zhaochun Ren LLMAG 24 24 0 05 Mar 2024
OPEx: A Component-Wise Analysis of LLM-Centric Agents in Embodied Instruction Following Haochen Shi Zhiyuan Sun Xingdi Yuan Marc-Alexandre Côté Bang Liu LLMAG 19 10 0 05 Mar 2024
Android in the Zoo: Chain-of-Action-Thought for GUI Agents Jiwen Zhang Jihao Wu Yihua Teng Minghui Liao Nuo Xu Xiao Xiao Zhongyu Wei Duyu Tang LLMAG LM&Ro 27 50 0 05 Mar 2024
Playing NetHack with LLMs: Potential & Limitations as Zero-Shot Agents Dominik Jeurissen Diego Perez-Liebana Jeremy Gow Duygu Cakmak James Kwan LLMAG 16 7 0 01 Mar 2024
RL-GPT: Integrating Reinforcement Learning and Code-as-policy Shaoteng Liu Haoqi Yuan Minda Hu Yanwei Li Yukang Chen Shu Liu Zongqing Lu Jiaya Jia LLMAG 40 14 0 29 Feb 2024
Data Interpreter: An LLM Agent For Data Science Sirui Hong Yizhang Lin Bang Liu Bangbang Liu Binhao Wu ... Xinbing Liang Yaying Fei Yuheng Cheng Zongze Xu Chenglin Wu LLMAG AI4CE 47 58 0 28 Feb 2024
Consistency Matters: Explore LLMs Consistency From a Black-Box Perspective Fufangchen Zhao Guoqiang Jin Jiaheng Huang Rui Zhao Fei Tan 20 1 0 27 Feb 2024
How Can LLM Guide RL? A Value-Based Approach Shenao Zhang Sirui Zheng Shuqi Ke Zhihan Liu Wanxin Jin Jianbo Yuan Yingxiang Yang Hongxia Yang Zhaoran Wang 16 8 0 25 Feb 2024
Large Multimodal Agents: A Survey Junlin Xie Zhihong Chen Ruifei Zhang Xiang Wan Guanbin Li LM&Ro LLMAG 37 38 0 23 Feb 2024
A Survey on Knowledge Distillation of Large Language Models Xiaohan Xu Ming Li Chongyang Tao Tao Shen Reynold Cheng Jinyang Li Can Xu Dacheng Tao Tianyi Zhou KELM VLM 42 94 0 20 Feb 2024
MORE-3S:Multimodal-based Offline Reinforcement Learning with Shared Semantic Spaces Tianyu Zheng Ge Zhang Xingwei Qu Ming Kuang Stephen W. Huang Zhaofeng He OffRL 27 1 0 20 Feb 2024
High-quality Data-to-Text Generation for Severely Under-Resourced Languages with Out-of-the-box Large Language Models Michela Lorandi Anya Belz 6 5 0 19 Feb 2024
On the Roles of LLMs in Planning: Embedding LLMs into Planning Graphs H. Zhuo Xin Chen Rong Pan 26 2 0 18 Feb 2024
AutoGPT+P: Affordance-based Task Planning with Large Language Models Timo Birr Christoph Pohl Abdelrahman Younes Tamim Asfour LM&Ro 24 15 0 16 Feb 2024
PIVOT: Iterative Visual Prompting Elicits Actionable Knowledge for VLMs Soroush Nasiriany Fei Xia Wenhao Yu Ted Xiao Jacky Liang ... Karol Hausman N. Heess Chelsea Finn Sergey Levine Brian Ichter LM&Ro LRM 23 88 0 12 Feb 2024
OS-Copilot: Towards Generalist Computer Agents with Self-Improvement Zhiyong Wu Chengcheng Han Zichen Ding Zhenmin Weng Zhoumianze Liu Shunyu Yao Tao Yu Lingpeng Kong LLMAG LM&Ro 113 83 0 12 Feb 2024
Introspective Planning: Aligning Robots' Uncertainty with Inherent Task Ambiguity Kaiqu Liang Zixu Zhang J. F. Fisac LLMAG 33 5 0 09 Feb 2024
TimeArena: Shaping Efficient Multitasking Language Agents in a Time-Aware Simulation Yikai Zhang Siyu Yuan Caiyu Hu Kyle Richardson Yanghua Xiao Jiangjie Chen AI4CE LLMAG 27 13 0 08 Feb 2024
S-Agents: Self-organizing Agents in Open-ended Environments Jia-Qing Chen Yu-Gang Jiang Jiachen Lu Li Zhang AIFin LLMAG LM&Ro 45 15 0 07 Feb 2024
Read to Play (R2-Play): Decision Transformer with Multimodal Game Instruction Yonggang Jin Ge Zhang Hao Zhao Tianyu Zheng Jiawei Guo Liuyu Xiang Shawn Yue Stephen W. Huang Zhaofeng He Jie Fu OffRL 21 4 0 06 Feb 2024
Professional Agents -- Evolving Large Language Models into Autonomous Experts with Human-Level Competencies Zhixuan Chu Yan Wang Feng Zhu Lu Yu Longfei Li Jinjie Gu LLMAG 16 8 0 06 Feb 2024
Vision-Language Models Provide Promptable Representations for Reinforcement Learning William Chen Oier Mees Aviral Kumar Sergey Levine VLM LM&Ro 39 21 0 05 Feb 2024
PokeLLMon: A Human-Parity Agent for Pokemon Battles with Large Language Models Sihao Hu Tiansheng Huang Ling Liu LM&Ro LLMAG 23 8 0 02 Feb 2024
Executable Code Actions Elicit Better LLM Agents Xingyao Wang Yangyi Chen Lifan Yuan Yizhe Zhang Yunzhu Li Hao Peng Heng Ji ELM LLMAG LM&Ro 26 127 0 01 Feb 2024
True Knowledge Comes from Practice: Aligning LLMs with Embodied Environments via Reinforcement Learning Weihao Tan Wentao Zhang Shanqi Liu Longtao Zheng Xinrun Wang Bo An OffRL 31 16 0 25 Jan 2024
Towards Goal-oriented Prompt Engineering for Large Language Models: A Survey Haochen Li Jonathan Leung Zhiqi Shen LM&MA LLMAG LRM 18 0 0 25 Jan 2024
HAZARD Challenge: Embodied Decision Making in Dynamically Changing Environments Qinhong Zhou Sunli Chen Yisong Wang Haozhe Xu Weihua Du Hongxin Zhang Yilun Du Josh Tenenbaum Chuang Gan AI4CE 20 12 0 23 Jan 2024
CivRealm: A Learning and Reasoning Odyssey in Civilization for Decision-Making Agents Siyuan Qi Shuo Chen Yexin Li Xiangyu Kong Junqi Wang ... Zhaowei Zhang Nian Liu Wei Wang Yaodong Yang Song-Chun Zhu AI4CE LRM 19 17 0 19 Jan 2024
DoraemonGPT: Toward Understanding Dynamic Scenes with Large Language Models (Exemplified as A Video Agent) Zongxin Yang Guikun Chen Xiaodi Li Wenguan Wang Yi Yang LM&Ro LLMAG 45 35 0 16 Jan 2024
Open Models, Closed Minds? On Agents Capabilities in Mimicking Human Personalities through Open Large Language Models Lucio La Cava Andrea Tagarelli LLMAG AI4CE 55 12 0 13 Jan 2024