Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agents

3 February 2023

Xiaojian Ma

Papers citing "Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agents"

50 / 254 papers shown

Title
SymPlanner: Deliberate Planning in Language Models with Symbolic Representation Siheng Xiong Jieyu Zhou Zhangding Liu Yusen Su LLMAG LM&Ro 51 0 0 02 May 2025
UAV-VLN: End-to-End Vision Language guided Navigation for UAVs Pranav Saxena Nishant Raghuvanshi Neena Goveas 69 0 0 30 Apr 2025
Generative AI in Embodied Systems: System-Level Analysis of Performance, Efficiency and Scalability Zishen Wan Jiayi Qian Yuhang Du Jason J. Jabbour Yilun Du Yang Katie Zhao A. Raychowdhury Tushar Krishna Vijay Janapa Reddi LM&Ro 86 0 0 26 Apr 2025
Credible plan-driven RAG method for Multi-hop Question Answering Ningning Zhang Chi Zhang Zhizhong Tan Xingxing Yang Weiping Deng Wenyong Wang LRM 31 0 0 23 Apr 2025
WALL-E 2.0: World Alignment by NeuroSymbolic Learning improves World Model-based LLM Agents Siyu Zhou Tianyi Zhou Yijun Yang Guodong Long Deheng Ye Jing Jiang Chengqi Zhang LM&Ro 20 0 0 22 Apr 2025
Phoenix: A Motion-based Self-Reflection Framework for Fine-grained Robotic Action Correction Wenke Xia Ruoxuan Feng Dong Wang Di Hu 30 0 0 20 Apr 2025
Chain-of-Modality: Learning Manipulation Programs from Multimodal Human Videos with Vision-Language-Models Chen Wang Fei Xia Wenhao Yu Tingnan Zhang Ruohan Zhang Ce Liu Li Fei-Fei Jie Tan Jacky Liang 31 0 0 17 Apr 2025
SEAL: Steerable Reasoning Calibration of Large Language Models for Free Runjin Chen Zhenyu (Allen) Zhang Junyuan Hong Souvik Kundu Zhangyang Wang OffRL LRM 47 2 0 07 Apr 2025
Stochastic Optimization with Optimal Importance Sampling Liviu Aolaritei Bart P. G. Van Parys H. Lam Michael I. Jordan 33 0 0 04 Apr 2025
Adaptive Interactive Navigation of Quadruped Robots using Large Language Models Kangjie Zhou Yao Mu Haoyang Song Yi Zeng Pengying Wu Han Gao Chang Liu 43 0 0 29 Mar 2025
Cultivating Game Sense for Yourself: Making VLMs Gaming Experts Wenxuan Lu Jiangyang He Zhanqiu Zhang Yiwen Guo Tianning Zang 42 0 0 27 Mar 2025
Position: Interactive Generative Video as Next-Generation Game Engine Jiwen Yu Yiran Qin Haoxuan Che Quande Liu Xintao Wang Pengfei Wan Di Zhang Xihui Liu VGen 45 1 0 21 Mar 2025
LLM+MAP: Bimanual Robot Task Planning using Large Language Models and Planning Domain Definition Language Kun-Mo Chu Xufeng Zhao C. Weber Stefan Wermter LLMAG LM&Ro 50 1 0 21 Mar 2025
VIPER: Visual Perception and Explainable Reasoning for Sequential Decision-Making Mohamed Salim Aissi Clemence Grislain Mohamed Chetouani Olivier Sigaud Laure Soulier Nicolas Thome LRM 42 0 0 19 Mar 2025
Mitigating Cross-Modal Distraction and Ensuring Geometric Feasibility via Affordance-Guided, Self-Consistent MLLMs for Food Preparation Task Planning Yu-Hong Shen Chuan-Yu Wu Yi-Ru Yang Yen-Ling Tai Yi-Ting Chen LRM 29 0 0 17 Mar 2025
EmbodiedVSR: Dynamic Scene Graph-Guided Chain-of-Thought Reasoning for Visual Spatial Tasks Yi Zhang Qiang Zhang Xiaozhu Ju Z. Liu Jilei Mao ... Jiaxu Wang Yiqun Duan Jiahang Cao Renjing Xu Jian Tang LM&Ro LRM 51 0 0 14 Mar 2025
How Do Multimodal Large Language Models Handle Complex Multimodal Reasoning? Placing Them in An Extensible Escape Game Z. Wang Yurui Dong Fuwen Luo Minyuan Ruan Zhili Cheng C. L. P. Chen Peng Li Yang Liu LRM 79 0 0 13 Mar 2025
GTR: Guided Thought Reinforcement Prevents Thought Collapse in RL-based VLM Agent Training Tong Wei Yijun Yang Junliang Xing Yuanchun Shi Zongqing Lu Deheng Ye OffRL LRM 42 1 0 11 Mar 2025
Dynamic Path Navigation for Motion Agents with LLM Reasoning Yubo Zhao Qi Wu Yifan Wang Yu-Wing Tai Chi-Keung Tang LRM LLMAG 80 0 0 10 Mar 2025
Less is More: Adaptive Program Repair with Bug Localization and Preference Learning Zhenlong Dai Bingrui Chen Zhuoluo Zhao Xiu Tang Sai Wu Chang Yao Zhipeng Gao Jingyuan Chen KELM 39 2 0 09 Mar 2025
Unified Mind Model: Reimagining Autonomous Agents in the LLM Era Pengbo Hu Xiang Ying LLMAG LM&Ro AI4CE 53 0 0 05 Mar 2025
Collab-Overcooked: Benchmarking and Evaluating Large Language Models as Collaborative Agents Haochen Sun Shuwen Zhang Lei Ren Hao Xu Hao Fu Caixia Yuan Xiaojie Wang LLMAG ELM 63 1 0 27 Feb 2025
Conversational Planning for Personal Plans Konstantina Christakopoulou Iris Qu John Canny Andrew Goodridge Cj Adams Minmin Chen Maja Matarić LLMAG LM&Ro 53 0 0 26 Feb 2025
VeriPlan: Integrating Formal Verification and LLMs into End-User Planning Christine P. Lee David J. Porfirio Xinyu Jessica Wang Kevin Zhao Bilge Mutlu 80 1 0 25 Feb 2025
EvoAgent: Agent Autonomous Evolution with Continual World Model for Long-Horizon Tasks Tongtong Feng X. Wang Zekai Zhou Ren Wang Yuwei Zhan Guangyao Li Qing Li Wenwu Zhu LM&Ro 61 0 0 09 Feb 2025
Plan-Then-Execute: An Empirical Study of User Trust and Team Performance When Using LLM Agents As A Daily Assistant Gaole He Gianluca Demartini U. Gadiraju LLMAG 65 4 0 03 Feb 2025
Recursive Decomposition of Logical Thoughts: Framework for Superior Reasoning and Knowledge Propagation in Large Language Models Kaleem Ullah Qasim Jiashu Zhang Tariq Alsahfi Ateeq Ur Rehman Butt LRM ReLM 61 1 0 03 Jan 2025
Exposing Limitations of Language Model Agents in Sequential-Task Compositions on the Web Hiroki Furuta Yutaka Matsuo Aleksandra Faust Izzeddin Gur CLL 78 13 0 03 Jan 2025
SUTrack: Towards Simple and Unified Single Object Tracking Xin Chen Ben Kang Wanting Geng Jiawen Zhu Y. Liu Dong Wang Huchuan Lu VOT ViT 47 0 0 26 Dec 2024
EscapeBench: Pushing Language Models to Think Outside the Box Cheng Qian Peixuan Han Qinyu Luo Bingxiang He X. Chen ... Jiarui Yao Xiaocheng Yang Denghui Zhang Yunzhu Li Heng Ji LLMAG LRM 80 3 0 18 Dec 2024
TrendSim: Simulating Trending Topics in Social Media Under Poisoning Attacks with LLM-based Multi-agent System Zeyu Zhang Jianxun Lian Chen Ma Yaning Qu Ye Luo ... X. Chen Yankai Lin Le Wu Xing Xie Ji-Rong Wen LLMAG AAML 60 1 0 14 Dec 2024
STEVE-Audio: Expanding the Goal Conditioning Modalities of Embodied Agents in Minecraft Nicholas Lenzen Amogh Raut Andrew Melnik VGen 66 0 0 01 Dec 2024
SPAgent: Adaptive Task Decomposition and Model Selection for General Video Generation and Editing Rong-Cheng Tu Wenhao Sun Zhao Jin Jingyi Liao Jiaxing Huang Dacheng Tao VGen DiffM 92 3 0 28 Nov 2024
CaPo: Cooperative Plan Optimization for Efficient Embodied Multi-Agent Cooperation Jie Liu Pan Zhou Yingjun Du Ah-Hwee Tan Cees G. M. Snoek J. Sonke E. Gavves LLMAG 29 1 0 07 Nov 2024
AI Metropolis: Scaling Large Language Model-based Multi-Agent Simulation with Out-of-order Execution Zhiqiang Xie Hao Kang Ying Sheng Tushar Krishna Kayvon Fatahalian Christos Kozyrakis LRM AI4CE LLMAG LM&Ro 35 1 0 05 Nov 2024
Positive Experience Reflection for Agents in Interactive Text Environments Philip Lippmann Matthijs Spaan Jie-jin Yang LLMAG 33 0 0 04 Nov 2024
CaStL: Constraints as Specifications through LLM Translation for Long-Horizon Task and Motion Planning Weihang Guo Zachary K. Kingston Lydia E. Kavraki 37 2 0 29 Oct 2024
SceneGenAgent: Precise Industrial Scene Generation with Coding Agent Xiao Xia Dan Zhang Zibo Liao Zhenyu Hou Tianrui Sun Jing Li Ling Fu Yuxiao Dong LM&Ro 3DV LLMAG AI4CE 33 2 0 29 Oct 2024
GHIL-Glue: Hierarchical Control with Filtered Subgoal Images Kyle Hatch Ashwin Balakrishna Oier Mees Suraj Nair Seohong Park ... Masha Itkina Benjamin Eysenbach Sergey Levine Thomas Kollar Benjamin Burchfiel 50 1 0 26 Oct 2024
Reinforcement Learning for Aligning Large Language Models Agents with Interactive Environments: Quantifying and Mitigating Prompt Overfitting Mohamed Salim Aissi Clément Romac Thomas Carta Sylvain Lamprier Pierre-Yves Oudeyer Olivier Sigaud Laure Soulier Nicolas Thome 19 2 0 25 Oct 2024
OSCAR: Operating System Control via State-Aware Reasoning and Re-Planning Xiaoqiang Wang Bang Liu LLMAG LM&Ro LRM 31 6 0 24 Oct 2024
WorldSimBench: Towards Video Generation Models as World Simulators Yiran Qin Zhelun Shi Jiwen Yu Xijun Wang Enshen Zhou ... Lu Sheng Jing Shao Lei Bai Wanli Ouyang Ruimao Zhang EGVM VGen 113 364 0 23 Oct 2024
Debug Smarter, Not Harder: AI Agents for Error Resolution in Computational Notebooks Konstantin Grotov Artem Borzilov Maksim Krivobok T. Bryksin Yaroslav Zharov 53 1 0 18 Oct 2024
CLIMB: Language-Guided Continual Learning for Task Planning with Iterative Model Building Walker Byrnes Miroslav Bogdanovic Avi Balakirsky Stephen Balakirsky Animesh Garg LM&Ro 26 0 0 17 Oct 2024
Robust RL with LLM-Driven Data Synthesis and Policy Adaptation for Autonomous Driving Sihao Wu Jiaxu Liu Xiangyu Yin Guangliang Cheng Xingyu Zhao Meng Fang Xinping Yi Xiaowei Huang 23 0 0 16 Oct 2024
SAC-GLAM: Improving Online RL for LLM agents with Soft Actor-Critic and Hindsight Relabeling Loris Gaven Clément Romac Thomas Carta Sylvain Lamprier Olivier Sigaud Pierre-Yves Oudeyer LLMAG OffRL 30 1 0 16 Oct 2024
Language-Model-Assisted Bi-Level Programming for Reward Learning from Internet Videos Harsh Mahesheka Zhixian Xie Z. Wang Wanxin Jin 23 0 0 11 Oct 2024
Words as Beacons: Guiding RL Agents with High-Level Language Prompts Unai Ruiz-Gonzalez Alain Andres Pedro G. Bascoy Javier Del Ser 25 0 0 11 Oct 2024
VoxelPrompt: A Vision-Language Agent for Grounded Medical Image Analysis Andrew Hoopes V. Butoi John Guttag Adrian V. Dalca MedIm LM&MA 32 1 0 10 Oct 2024
Agents Thinking Fast and Slow: A Talker-Reasoner Architecture Konstantina Christakopoulou Shibl Mourad Maja Matarić LLMAG 23 10 0 10 Oct 2024