Spot-On: A Mixed Reality Interface for Multi-Robot Cooperation

Recent progress in mixed reality (MR) and robotics is enabling increasingly sophisticated forms of human-robot collaboration. Building on these developments, we introduce a novel MR framework that allows multiple quadruped robots to operate in semantically diverse environments via a MR interface. Our system supports collaborative tasks involving drawers, swing doors, and higher-level infrastructure such as light switches. A comprehensive user study verifies both the design and usability of our app, with participants giving a "good" or "very good" rating in almost all cases. Overall, our approach provides an effective and intuitive framework for MR-based multi-robot collaboration in complex, real-world scenarios.

@article{engelbracht2025_2505.22539,
  title={ Spot-On: A Mixed Reality Interface for Multi-Robot Cooperation },
  author={ Tim Engelbracht and Petar Lukovic and Tjark Behrens and Kai Lascheit and René Zurbrügg and Marc Pollefeys and Hermann Blum and Zuria Bauer },
  journal={arXiv preprint arXiv:2505.22539},
  year={ 2025 }
}