MMBench_EN

# Dataset Card for "MMBench_EN"
<p align="center" width="100%">
<img src="https://i.postimg.cc/g0QRgMVv/WX20240228-113337-2x.png" width="100%" height="80%">
</p>

# Large-scale Multi-modality Models Evaluation Suite

> Accelerating the development of large-scale multi-modality models (LMMs) with `lmms-eval`

🏠 [Homepage](https://lmms-lab.github.io/) | 📚 [Documentation](docs/README.md) | 🤗 [Huggingface Datasets](https://huggingface.co/lmms-lab)

# This Dataset

This is a formatted version of the English subset of [MMBench](https://arxiv.org/abs/2307.06281). It is used in our `lmms-eval` pipeline to allow for one-click evaluations of large multi-modality models.

```
@article{MMBench,
author = {Yuan Liu, Haodong Duan, Yuanhan Zhang, Bo Li, Songyang Zhang, Wangbo Zhao, Yike Yuan, Jiaqi Wang, Conghui He, Ziwei Liu, Kai Chen, Dahua Lin},
journal = {arXiv:2307.06281},
title = {MMBench: Is Your Multi-modal Model an All-around Player?},
year = {2023},
}
```

# "MMBench_EN"数据集卡片
<p align="center" width="100%">
<img src="https://i.postimg.cc/g0QRgMVv/WX20240228-113337-2x.png" width="100%" height="80%">
</p>

# 大规模多模态模型评测套件

> 依托`lmms-eval`加速大规模多模态模型（LMMs）的研发进程

🏠 [项目主页](https://lmms-lab.github.io/) | 📚 [文档说明](docs/README.md) | 🤗 [Huggingface数据集仓库](https://huggingface.co/lmms-lab)

# 本数据集

本数据集是[MMBench](https://arxiv.org/abs/2307.06281)英文子集的格式化版本，可集成于我们的`lmms-eval`评测流程中，实现大规模多模态模型的一键式评测。

@article{MMBench,
author = {Yuan Liu, Haodong Duan, Yuanhan Zhang, Bo Li, Songyang Zhang, Wangbo Zhao, Yike Yuan, Jiaqi Wang, Conghui He, Ziwei Liu, Kai Chen, Dahua Lin},
journal = {arXiv:2307.06281},
title = {MMBench: Is Your Multi-modal Model an All-around Player?},
year = {2023},
}

搜集汇总

背景与挑战

背景概述

MMBench_EN是一个大型多模态模型评估套件的英文子集格式化版本，用于通过lmms-eval管道加速多模态模型的开发，支持一键评估。该数据集基于2023年发布的MMBench研究，采用Apache License 2.0许可证。