SpartQA: : A Textual Question Answering Benchmark for Spatial Reasoning

SpartQA: : A Textual Question Answering Benchmark for Spatial Reasoning

12 April 2021

Roshanak Mirzaee

Hossein Rajaby Faghihi

Parisa Kordjmashidi

Papers citing "SpartQA: : A Textual Question Answering Benchmark for Spatial Reasoning"

18 / 18 papers shown

Title
Benchmarking Systematic Relational Reasoning with Large Language and Reasoning Models Irtaza Khalid Amir Masoud Nourollah Steven Schockaert LRM 40 0 0 30 Mar 2025
MastermindEval: A Simple But Scalable Reasoning Benchmark Jonas Golde Patrick Haller Fabio Barth Alan Akbik LRM ReLM ELM 51 2 0 07 Mar 2025
BIG-Bench Extra Hard Mehran Kazemi Bahare Fatemi Hritik Bansal John Palowitch Chrysovalantis Anastasiou ... Kate Olszewska Yi Tay Vinh Q. Tran Quoc V. Le Orhan Firat ELM LRM 119 5 0 26 Feb 2025
GRASP: A Grid-Based Benchmark for Evaluating Commonsense Spatial Reasoning Zhisheng Tang M. Kejriwal LRM 54 3 0 20 Jan 2025
Do Vision-Language Models Represent Space and How? Evaluating Spatial Frame of Reference Under Ambiguities Zheyuan Zhang Fengyuan Hu Jayjun Lee Freda Shi Parisa Kordjamshidi Joyce Chai Ziqiao Ma 53 11 0 22 Oct 2024
Neuro-symbolic Training for Reasoning over Spatial Language Tanawan Premsri Parisa Kordjamshidi NAI LRM 45 6 0 19 Jun 2024
Mind's Eye of LLMs: Visualization-of-Thought Elicits Spatial Reasoning in Large Language Models Wenshan Wu Shaoguang Mao Yadong Zhang Yan Xia Li Dong Lei Cui Furu Wei LRM 54 19 0 04 Apr 2024
Grounding Spatial Relations in Text-Only Language Models Gorka Azkune Ander Salaberria Eneko Agirre 36 0 0 20 Mar 2024
What's left can't be right -- The remaining positional incompetence of contrastive vision-language models Nils Hoehing Ellen Rushe Anthony Ventresque VLM 15 2 0 20 Nov 2023
Disentangling Extraction and Reasoning in Multi-hop Spatial Reasoning Roshanak Mirzaee Parisa Kordjamshidi LRM 21 7 0 25 Oct 2023
Statistical Depth for Ranking and Characterizing Transformer-Based Text Embeddings Parker Seegmiller S. Preum 31 3 0 23 Oct 2023
DepWiGNN: A Depth-wise Graph Neural Network for Multi-hop Spatial Reasoning in Text Shuaiyi Li Yang Deng Wai Lam 30 2 0 19 Oct 2023
Transfer Learning with Synthetic Corpora for Spatial Role Labeling and Reasoning Roshanak Mirzaee Parisa Kordjamshidi SyDa LRM 16 32 0 30 Oct 2022
ShortcutLens: A Visual Analytics Approach for Exploring Shortcuts in Natural Language Understanding Dataset Zhihua Jin Xingbo Wang Furui Cheng Chunhui Sun Qun Liu Huamin Qu 32 9 0 17 Aug 2022
PromptDA: Label-guided Data Augmentation for Prompt-based Few-shot Learners Canyu Chen Kai Shu VLM 26 8 0 18 May 2022
Visual Spatial Reasoning Fangyu Liu Guy Edward Toh Emerson Nigel Collier ReLM 28 157 0 30 Apr 2022
Tiered Reasoning for Intuitive Physics: Toward Verifiable Commonsense Language Understanding Shane Storks Qiaozi Gao Yichi Zhang J. Chai ReLM LRM 39 22 0 10 Sep 2021
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 297 6,956 0 20 Apr 2018