IQ50
收藏魔搭社区2025-12-04 更新2024-10-12 收录
下载链接：
https://modelscope.cn/datasets/lmms-lab/IQ50
下载链接
链接失效反馈官方服务：
资源简介：
# Dataset Card for "IQ50"
<p align="center" width="100%">
<img src="https://i.postimg.cc/g0QRgMVv/WX20240228-113337-2x.png" width="100%" height="80%">
</p>
# Large-scale Multi-modality Models Evaluation Suite
> Accelerating the development of large-scale multi-modality models (LMMs) with `lmms-eval`
🏠 [Homepage](https://lmms-lab.github.io/) | 📚 [Documentation](docs/README.md) | 🤗 [Huggingface Datasets](https://huggingface.co/lmms-lab)
# This Dataset
This is a formatted version of [IQ50](https://github.com/microsoft/unilm/issues/1265). It is used in our `lmms-eval` pipeline to allow for one-click evaluations of large multi-modality models.
```
@article{huang2023language,
title={Language is not all you need: Aligning perception with language models},
author={Huang, Shaohan and Dong, Li and Wang, Wenhui and Hao, Yaru and Singhal, Saksham and Ma, Shuming and Lv, Tengchao and Cui, Lei and Mohammed, Owais Khan and Liu, Qiang and others},
journal={arXiv preprint arXiv:2302.14045},
volume={1},
number={2},
pages={3},
year={2023}
}
```
[More Information needed](https://github.com/huggingface/datasets/blob/main/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)
# IQ50 数据集卡片（Dataset Card）
<p align="center" width="100%">
<img src="https://i.postimg.cc/g0QRgMVv/WX20240228-113337-2x.png" width="100%" height="80%">
</p>
# 大规模多模态模型评测套件（Large-scale Multi-modality Models Evaluation Suite）
> 依托`lmms-eval`框架，加速大规模多模态模型（Large-scale Multi-modality Models, 简称LMMs）的研发。
🏠 [主页](https://lmms-lab.github.io/) | 📚 [文档](docs/README.md) | 🤗 [Huggingface 数据集仓库](https://huggingface.co/lmms-lab)
# 本数据集
本数据集为[IQ50](https://github.com/microsoft/unilm/issues/1265)的格式化版本，应用于我们的`lmms-eval`流水线中，可实现大规模多模态模型的一键评测。
@article{huang2023language,
title={语言并非万能：让感知与语言模型对齐},
author={黄绍汉、董力、王文辉、郝雅茹、Singhal, Saksham、马树明、吕腾超、崔磊、Mohammed, Owais Khan、刘强及其他作者},
journal={arXiv预印本 arXiv:2302.14045},
volume={1},
number={2},
pages={3},
year={2023}
}
[需补充更多信息](https://github.com/huggingface/datasets/blob/main/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)
提供机构：
maas
创建时间：
2024-10-06
