MLL-Lab/MindCube

---
language:
- en
license: mit
size_categories:
- 10K<n<100K
task_categories:
- question-answering
- image-text-to-text
pretty_name: MindCube
tags:
- spatial-reasoning
- visual-reasoning
- multimodal
- vision-language-model
- benchmark
---

# MindCube: Spatial Mental Modeling from Limited Views

MindCube is a novel benchmark designed to evaluate how well Vision Language Models (VLMs) can form robust spatial mental models from limited visual views. It comprises 21,154 questions across 3,268 images, assessing capabilities such as cognitive mapping (representing positions), perspective-taking (orientations), and mental simulation (dynamics for "what-if" movements). The dataset aims to expose critical gaps in existing VLMs' spatial understanding and facilitate research into improving their performance through structured spatial representations.

* **Paper:** [Spatial Mental Modeling from Limited Views](https://huggingface.co/papers/2506.21458)
* **Project Page:** [https://mll-lab-nu.github.io/mind-cube](https://mll-lab-nu.github.io/mind-cube)
* **GitHub Repository:** [https://github.com/mll-lab-nu/MindCube](https://github.com/mll-lab-nu/MindCube)

We release our MindCube dataset at this repo in the zip file `data.zip`. To use it, please follow the instructions in our [github repo](https://github.com/mll-lab-nu/MindCube).

## Sample Usage

To download the MindCube dataset:

```bash
bash scripts/bash_scripts/download_data.bash
```

Refer to the [GitHub repository](https://github.com/mll-lab-nu/MindCube) for further instructions on data generation, model inference, and evaluation.

## The File Structure of `data.zip`
```
data/
├── other_all_image/
│ ├── around/
│ │ └── <image_group_id>/
│ │ ├── image1.png
│ │ ├── image2.jpg
│ │ └── ...
│ ├── among/
│ │ └── <image_group_id>/
│ │ ├── image1.png
│ │ ├── image2.jpg
│ │ └── ...
│ ├── rotation/
│ │ └── <image_group_id>/
│ │ ├── image1.png
│ │ ├── image2.jpg
│ │ └── ...
│ └── translation/
│ └── <image_group_id>/
│ ├── image1.png
│ ├── image2.jpg
│ └── ...
└── raw/
├── MindCube.jsonl
├── MindCube_train.jsonl
└── MindCube_tinybench.jsonl

```