IQ50

# Dataset Card for "IQ50" <p align="center" width="100%"> <img src="https://i.postimg.cc/g0QRgMVv/WX20240228-113337-2x.png" width="100%" height="80%"> </p> # Large-scale Multi-modality Models Evaluation Suite > Accelerating the development of large-scale multi-modality models (LMMs) with `lmms-eval` 🏠 [Homepage](https://lmms-lab.github.io/) | 📚 [Documentation](docs/README.md) | 🤗 [Huggingface Datasets](https://huggingface.co/lmms-lab) # This Dataset This is a formatted version of [IQ50](https://github.com/microsoft/unilm/issues/1265). It is used in our `lmms-eval` pipeline to allow for one-click evaluations of large multi-modality models. ``` @article{huang2023language, title={Language is not all you need: Aligning perception with language models}, author={Huang, Shaohan and Dong, Li and Wang, Wenhui and Hao, Yaru and Singhal, Saksham and Ma, Shuming and Lv, Tengchao and Cui, Lei and Mohammed, Owais Khan and Liu, Qiang and others}, journal={arXiv preprint arXiv:2302.14045}, volume={1}, number={2}, pages={3}, year={2023} } ``` [More Information needed](https://github.com/huggingface/datasets/blob/main/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)# IQ50 数据集卡片（Dataset Card） <p align="center" width="100%"> <img src="https://i.postimg.cc/g0QRgMVv/WX20240228-113337-2x.png" width="100%" height="80%"> </p> # 大规模多模态模型评测套件（Large-scale Multi-modality Models Evaluation Suite） > 依托`lmms-eval`框架，加速大规模多模态模型（Large-scale Multi-modality Models, 简称LMMs）的研发。 🏠 [主页](https://lmms-lab.github.io/) | 📚 [文档](docs/README.md) | 🤗 [Huggingface 数据集仓库](https://huggingface.co/lmms-lab) # 本数据集 本数据集为[IQ50](https://github.com/microsoft/unilm/issues/1265)的格式化版本，应用于我们的`lmms-eval`流水线中，可实现大规模多模态模型的一键评测。 @article{huang2023language, title={语言并非万能：让感知与语言模型对齐}, author={黄绍汉、董力、王文辉、郝雅茹、Singhal, Saksham、马树明、吕腾超、崔磊、Mohammed, Owais Khan、刘强及其他作者}, journal={arXiv预印本 arXiv:2302.14045}, volume={1}, number={2}, pages={3}, year={2023} } [需补充更多信息](https://github.com/huggingface/datasets/blob/main/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

搜集汇总

背景与挑战

背景概述

IQ50是一个大规模多模态模型评估套件，旨在加速大型多模态模型（LMMs）的开发，通过lmms-eval管道支持一键式评估。该数据集采用Apache License 2.0许可证，由lmms-lab维护并定期更新。