612

Temporal Triplane Transformers as Occupancy World Models

Main:8 Pages
7 Figures
Bibliography:4 Pages
7 Tables
Abstract

World models aim to learn or construct representations of the environment that enable the prediction of future scenes, thereby supporting intelligent motion planning. However, existing models often struggle to produce fine-grained predictions and to operate in real time. In this work, we propose T3^3Former, a novel 4D occupancy world model for autonomous driving. T3^3Former begins by pre-training a compact {\em triplane} representation that efficiently encodes 3D occupancy. It then extracts multi-scale temporal motion features from historical triplanes and employs an autoregressive approach to iteratively predict future triplane changes. Finally, these triplane changes are combined with previous states to decode future occupancy and ego-motion trajectories. Experimental results show that T3^3Former achieves 1.44×\times speedup (26 FPS), improves mean IoU to 36.09, and reduces mean absolute planning error to 1.0 meters. Demos are available in the supplementary material.

View on arXiv
Comments on this paper