CII-Bench

# CII-Bench

[**🌐 Homepage**](https://cii-bench.github.io/) | [**🤗 Dataset**](https://huggingface.co/datasets/m-a-p/CII-Bench) | [**GitHub**](https://github.com/MING-ZCH/CII-Bench) | [**🤗 Paper**](https://huggingface.co/papers/2410.13854) | [**📖 arXiv**](https://arxiv.org/abs/2410.13854)

<div style="text-align: center;">
<img src="composition.png" width="40%">
</div>

## Introduction
**CII-Bench** comprises 698 **Chinese images**, each accompanied by 1 to 3 multiple-choice questions, totaling 800 questions. CII-Bench encompasses images from six distinct domains: Life, Art, Society, Environment, Politics, and Chinese Traditional Culture. It also features a diverse array of image types, including Illustrations, Memes, Posters, Multi-panel Comics, Single-panel Comics, and Paintings. The detailed statistical information can be found in the image below.

<div style="text-align: center;">
<img src="CII-Bench-type.png" width="80%">
</div>

## Example

Here are some examples of CII-Bench:

<div style="text-align: center;">
<img src="CII-Bench-sample.png" width="80%">
</div>

## Disclaimers
The guidelines for the annotators emphasized strict compliance with copyright and licensing rules from the initial data source, specifically avoiding materials from websites that forbid copying and redistribution.
Should you encounter any data samples potentially breaching the copyright or licensing regulations of any site, we encourage you to [contact](#contact) us. Upon verification, such samples will be promptly removed.

## Contact
- Chenhao Zhang: [e-mail]
- Xi Feng: [e-mail]
- Ge Zhang: [e-mail]
- Shiwen Ni: [e-mail]
## Citation
**BibTeX:**
```bibtex
@misc{zhang2024mllmsunderstanddeepimplication,
title={Can MLLMs Understand the Deep Implication Behind Chinese Images?},
author={Chenhao Zhang and Xi Feng and Yuelin Bai and Xinrun Du and Jinchang Hou and Kaixin Deng and Guangzeng Han and Qinrui Li and Bingli Wang and Jiaheng Liu and Xingwei Qu and Yifei Zhang and Qixuan Zhao and Yiming Liang and Ziqiang Liu and Feiteng Fang and Min Yang and Wenhao Huang and Chenghua Lin and Ge Zhang and Shiwen Ni},
year={2024},
eprint={2410.13854},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2410.13854},
}
```

# CII-Bench

[**🌐 主页**](https://cii-bench.github.io/) | [**🤗 数据集**](https://huggingface.co/datasets/m-a-p/CII-Bench) | [**GitHub**](https://github.com/MING-ZCH/CII-Bench) | [**🤗 论文**](https://huggingface.co/papers/2410.13854) | [**📖 arXiv**](https://arxiv.org/abs/2410.13854)

<div style="text-align: center;">
<img src="composition.png" width="40%">
</div>

## 简介
**CII-Bench** 包含698张**中文图像**，每张图像配套1至3道多项选择题，总计800道题目。CII-Bench涵盖六大领域的图像：生活、艺术、社会、环境、政治以及中国传统文化。该数据集同时包含多样化的图像类型，涵盖插画、表情包、海报、多格漫画、单格漫画以及绘画作品。详细的统计信息可参见下图。

<div style="text-align: center;">
<img src="CII-Bench-type.png" width="80%">
</div>

## 示例
以下为CII-Bench的部分示例：

<div style="text-align: center;">
<img src="CII-Bench-sample.png" width="80%">
</div>

## 免责声明
标注人员的标注准则明确要求严格遵循原始数据源的版权与许可协议，尤其需规避来自禁止复制与二次分发的网站的素材。
若您发现任何疑似违反任一网站版权或许可规定的数据样本，欢迎[联系](#联系)我们。经核实后，此类样本将立即移除。

## 联系方式
- 张晨浩：[e-mail]
- 冯曦：[e-mail]
- 张戈：[e-mail]
- 倪世文：[e-mail]
## 引用
**BibTeX:**
bibtex
@misc{zhang2024mllmsunderstanddeepimplication,
title={Can MLLMs Understand the Deep Implication Behind Chinese Images?},
author={Chenhao Zhang and Xi Feng and Yuelin Bai and Xinrun Du and Jinchang Hou and Kaixin Deng and Guangzeng Han and Qinrui Li and Bingli Wang and Jiaheng Liu and Xingwei Qu and Yifei Zhang and Qixuan Zhao and Yiming Liang and Ziqiang Liu and Feiteng Fang and Min Yang and Wenhao Huang and Chenghua Lin and Ge Zhang and Shiwen Ni},
year={2024},
eprint={2410.13854},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2410.13854},
}