59

Chart Question Answering from Real-World Analytical Narratives

Maeve Hutchinson
Radu Jianu
Aidan Slingsby
Jo Wood
Pranava Madhyastha
Main:4 Pages
Bibliography:2 Pages
2 Tables
Appendix:8 Pages
Abstract

We present a new dataset for chart question answering (CQA) constructed from visualization notebooks. The dataset features real-world, multi-view charts paired with natural language questions grounded in analytical narratives. Unlike prior benchmarks, our data reflects ecologically valid reasoning workflows. Benchmarking state-of-the-art multimodal large language models reveals a significant performance gap, with GPT-4.1 achieving an accuracy of 69.3%, underscoring the challenges posed by this more authentic CQA setting.

View on arXiv
Comments on this paper