FM-Planner: Foundation Model Guided Path Planning for Autonomous Drone Navigation

Path planning is a critical component in autonomous drone operations, enabling safe and efficient navigation through complex environments. Recent advances in foundation models, particularly large language models (LLMs) and vision-language models (VLMs), have opened new opportunities for enhanced perception and intelligent decision-making in robotics. However, their practical applicability and effectiveness in global path planning remain relatively unexplored. This paper proposes foundation model-guided path planners (FM-Planner) and presents a comprehensive benchmarking study and practical validation for drone path planning. Specifically, we first systematically evaluate eight representative LLM and VLM approaches using standardized simulation scenarios. To enable effective real-time navigation, we then design an integrated LLM-Vision planner that combines semantic reasoning with visual perception. Furthermore, we deploy and validate the proposed path planner through real-world experiments under multiple configurations. Our findings provide valuable insights into the strengths, limitations, and feasibility of deploying foundation models in real-world drone applications and providing practical implementations in autonomous flight. Project site:this https URL.

@article{xiao2025_2505.20783,
  title={ FM-Planner: Foundation Model Guided Path Planning for Autonomous Drone Navigation },
  author={ Jiaping Xiao and Cheng Wen Tsao and Yuhang Zhang and Mir Feroskhan },
  journal={arXiv preprint arXiv:2505.20783},
  year={ 2025 }
}