swap-uniba/SEED-Bench_IT

---
dataset_info:
features:
- name: image
dtype: image
- name: id
dtype: int64
- name: question
dtype: string
- name: choice_a
dtype: string
- name: choice_b
dtype: string
- name: choice_c
dtype: string
- name: choice_d
dtype: string
- name: answer
dtype: string
splits:
- name: test
num_bytes: 3701274123.3279996
num_examples: 2496
download_size: 3642639481
dataset_size: 3701274123.3279996
configs:
- config_name: default
data_files:
- split: test
path: data/test-*
language:
- it
---

# Dataset Card for SEED-Bench_IT

## Dataset description

This is a formatted version of [SEED-Bench](https://github.com/AILab-CVC/SEED-Bench) translated to the Italian language using [MADLAD400](https://huggingface.co/google/madlad400-3b-mt).

## Citation

If you use this dataset in your research you should cite both of the following:

```
@inproceedings{musacchioLLaVANDiNO,
title={LLaVA-NDiNO: Empowering LLMs with Multimodality for the Italian Language},
author={Musacchio, Elio and Siciliani, Lucia and Basile, Pierpaolo and Semeraro, Giovanni},
booktitle={Proceedings of the Eighth Workshop on Natural Language for Artificial Intelligence (NL4AI 2024) co-located with 23th International Conference of the Italian Association for Artificial Intelligence (AI*IA 2024)},
year={2024}
}

@article{li2023seed,
title={Seed-bench: Benchmarking multimodal llms with generative comprehension},
author={Li, Bohao and Wang, Rui and Wang, Guangzhi and Ge, Yuying and Ge, Yixiao and Shan, Ying},
journal={arXiv preprint arXiv:2307.16125},
year={2023}
}
```