NLVR2

# Dataset Card for "nlvr2"

<p align="center" width="100%">
<img src="https://i.postimg.cc/g0QRgMVv/WX20240228-113337-2x.png" width="100%" height="80%">
</p>

# Large-scale Multi-modality Models Evaluation Suite

> Accelerating the development of large-scale multi-modality models (LMMs) with `lmms-eval`

🏠 [Homepage](https://lmms-lab.github.io/) | 📚 [Documentation](docs/README.md) | 🤗 [Huggingface Datasets](https://huggingface.co/lmms-lab)

# This Dataset

This is a formatted version of [NLVR2](https://lil.nlp.cornell.edu/nlvr/). It is used in our `lmms-eval` pipeline to allow for one-click evaluations of large multi-modality models.

```
@inproceedings{suhr2017corpus,
title={A corpus of natural language for visual reasoning},
author={Suhr, Alane and Lewis, Mike and Yeh, James and Artzi, Yoav},
booktitle={Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)},
pages={217--223},
year={2017}
}
```

[More Information needed](https://github.com/huggingface/datasets/blob/main/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

# 数据集卡片："nlvr2"

<p align="center" width="100%">
<img src="https://i.postimg.cc/g0QRgMVv/WX20240228-113337-2x.png" width="100%" height="80%">
</p>

# 大规模多模态模型评测套件

> 借助`lmms-eval`加速大规模多模态模型（Large-scale Multi-modality Models, LMMs）的研发

🏠 [主页](https://lmms-lab.github.io/) | 📚 [文档](docs/README.md) | 🤗 [Huggingface 数据集](https://huggingface.co/lmms-lab)

# 本数据集
本数据集为[NLVR2](https://lil.nlp.cornell.edu/nlvr/)的格式化版本，被集成至我们的`lmms-eval`评测流程中，可实现大规模多模态模型的一键式评测。

@inproceedings{suhr2017corpus,
title={A corpus of natural language for visual reasoning},
author={Suhr, Alane and Lewis, Mike and Yeh, James and Artzi, Yoav},
booktitle={Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)},
pages={217--223},
year={2017}
}

[更多数据集卡片贡献指引](https://github.com/huggingface/datasets/blob/main/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

搜集汇总

背景与挑战

背景概述

NLVR2是一个用于评估大规模多模态模型的数据集，基于自然语言视觉推理语料库，支持`lmms-eval`管道的一键评估功能。