100

LitVISTA: A Benchmark for Narrative Orchestration in Literary Text

Mingzhe Lu
Yiwen Wang
Yanbing Liu
Qi You
Chong Liu
Ruize Qin
Haoyu Dong
Wenyu Zhang
Jiarui Zhang
Yue Hu
Yunpeng Li
Main:8 Pages
7 Figures
Bibliography:3 Pages
2 Tables
Appendix:18 Pages
Abstract

Computational narrative analysis aims to capture rhythm, tension, and emotional dynamics in literary texts. Existing large language models can generate long stories but overly focus on causal coherence, neglecting the complex story arcs and orchestration inherent in human narratives. This creates a structural misalignment between model- and human-generated narratives. We propose VISTA Space, a high-dimensional representational framework for narrative orchestration that unifies human and model narrative perspectives. We further introduce LitVISTA, a structurally annotated benchmark grounded in literary texts, enabling systematic evaluation of models' narrative orchestration capabilities. We conduct oracle evaluations on a diverse selection of frontier LLMs, including GPT, Claude, Grok, and Gemini. Results reveal systematic deficiencies: existing models fail to construct a unified global narrative view, struggling to jointly capture narrative function and structure. Furthermore, even advanced thinking modes yield only limited gains for such literary narrative understanding.

View on arXiv
Comments on this paper