NoCaps

<p align="center" width="100%">
<img src="https://i.postimg.cc/g0QRgMVv/WX20240228-113337-2x.png" width="100%" height="80%">
</p>

# Large-scale Multi-modality Models Evaluation Suite

> Accelerating the development of large-scale multi-modality models (LMMs) with `lmms-eval`

🏠 [Homepage](https://lmms-lab.github.io/) | 📚 [Documentation](docs/README.md) | 🤗 [Huggingface Datasets](https://huggingface.co/lmms-lab)

# This Dataset

This is a formatted version of [NoCaps](https://nocaps.org/). It is used in our `lmms-eval` pipeline to allow for one-click evaluations of large multi-modality models.

```
@inproceedings{Agrawal_2019,
title={nocaps: novel object captioning at scale},
url={http://dx.doi.org/10.1109/ICCV.2019.00904},
DOI={10.1109/iccv.2019.00904},
booktitle={2019 IEEE/CVF International Conference on Computer Vision (ICCV)},
publisher={IEEE},
author={Agrawal, Harsh and Desai, Karan and Wang, Yufei and Chen, Xinlei and Jain, Rishabh and Johnson, Mark and Batra, Dhruv and Parikh, Devi and Lee, Stefan and Anderson, Peter},
year={2019},
month=oct }
```

# 大规模多模态模型评测套件
> 借助`lmms-eval`加速大规模多模态模型（Large-scale Multi-modality Models, LMMs）的研发
🏠 [主页](https://lmms-lab.github.io/) | 📚 [文档](docs/README.md) | 🤗 [Huggingface 数据集仓库](https://huggingface.co/lmms-lab)

# 本数据集
本数据集为[NoCaps](https://nocaps.org/)的格式化版本，已集成至`lmms-eval`评测流水线中，可实现大型多模态模型的一键式评测。

@inproceedings{Agrawal_2019,
title={nocaps：大规模新颖目标字幕生成},
url={http://dx.doi.org/10.1109/ICCV.2019.00904},
DOI={10.1109/iccv.2019.00904},
booktitle={2019 IEEE/CVF国际计算机视觉大会（ICCV）},
publisher={IEEE},
author={Agrawal, Harsh and Desai, Karan and Wang, Yufei and Chen, Xinlei and Jain, Rishabh and Johnson, Mark and Batra, Dhruv and Parikh, Devi and Lee, Stefan and Anderson, Peter},
year={2019},
month=oct
}