Papers citing 'PLANET: A Collection of Benchmarks for Evaluating LLMs' Planning Capabilities'

Title
LLM-BABYBENCH: Understanding and Evaluating Grounded Planning and Reasoning in LLMs Omar Choukrani Idriss Malek Daniil Orel Zhuohan Xie Zangir Iklassov Martin Takáč Salem Lahlou LLMAG ELM LRM 177 2 0 17 May 2025
Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models Yang Sui Yu-Neng Chuang Guanchu Wang Jiamu Zhang Tianyi Zhang ... Andrew Wen Shaochen Zhong Hanjie Chen Helen Zhou OffRL ReLM LRM 584 245 0 20 Mar 2025
Haste Makes Waste: Evaluating Planning Abilities of LLMs for Efficient and Feasible Multitasking with Time Constraints Between Actions Zirui Wu Xiao Liu Jiayi Li Lingpeng Kong Yansong Feng 181 3 0 04 Mar 2025
Code to Think, Think to Code: A Survey on Code-Enhanced Reasoning and Reasoning-Driven Code Intelligence in LLMs Dayu Yang Tianyang Liu Daoan Zhang Antoine Simoulin Xiaoyi Liu ... Zhaopu Teng Xin Qian Grey Yang Jiebo Luo Julian McAuley ReLM OffRL LRM 318 30 0 26 Feb 2025
REALM-Bench: A Benchmark for Evaluating Multi-Agent Systems on Real-world, Dynamic Planning and Scheduling Tasks Longling Geng Edward Y. Chang LLMAG 273 8 0 26 Feb 2025
PlanGenLLMs: A Modern Survey of LLM Planning CapabilitiesAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Hui Wei Zihao Zhang Shenghua He Tian Xia Shijia Pan Fei Liu 519 37 0 16 Feb 2025
Robotouille: An Asynchronous Planning Benchmark for LLM AgentsInternational Conference on Learning Representations (ICLR), 2025 Gonzalo Gonzalez-Pumariega Leong Su Yean Neha Sunkara Sanjiban Choudhury LRM LLMAG 205 17 0 06 Feb 2025
TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Tasks Frank F. Xu Yufan Song Boxuan Li Yuxuan Tang Kritanjali Jain ... Wayne Chi Lawrence Jang Yiqing Xie Shuyan Zhou Graham Neubig ELM 567 87 0 18 Dec 2024
CRMArena: Understanding the Capacity of LLM Agents to Perform Professional CRM Tasks in Realistic EnvironmentsNorth American Chapter of the Association for Computational Linguistics (NAACL), 2024 Kung-Hsiang Huang Akshara Prabhakar Sidharth Dhawan Yixin Mao Huan Wang Silvio Savarese Caiming Xiong Philippe Laban Chien-Sheng Wu 388 27 0 04 Nov 2024
Planning Anything with Rigor: General-Purpose Zero-Shot Planning with LLM-based Formalized Programming Yilun Hao Yang Zhang Chuchu Fan LLMAG 361 29 0 15 Oct 2024
TMGBench: A Systematic Game Benchmark for Evaluating Strategic Reasoning Abilities of LLMs Jian Shu Xiachong Feng Lei Li Zhan Qin Dianbo Sui Dianbo Sui Lingpeng Kong LRM ELM 277 10 0 14 Oct 2024
How Far Are We on the Decision-Making of LLMs? Evaluating LLMs' Gaming Ability in Multi-Agent Environments Shu Yang E. Li Man Ho Lam Tian Liang Wenxuan Wang Youliang Yuan Wenxiang Jiao Xing Wang Zhaopeng Tu Michael R. Lyu ELM LLMAG 422 52 0 18 Mar 2024