irds/msmarco-qna

`msmarco-qna`数据集由`ir-datasets`包提供，包含9,048,606个文档（即语料库）。该数据集主要用于文本检索任务。

原始信息汇总

数据集概述

数据集名称

msmarco-qna

数据集来源

由ir-datasets包提供。

数据集内容

• docs (文档，即语料库); 数量=9,048,606

数据集使用示例

python from datasets import load_dataset

docs = load_dataset(irds/msmarco-qna, docs) for record in docs: record # {doc_id: ..., text: ..., url: ..., msmarco_passage_id: ..., msmarco_document_id: ...}

引用信息

@inproceedings{Bajaj2016Msmarco, title={MS MARCO: A Human Generated MAchine Reading COmprehension Dataset}, author={Payal Bajaj, Daniel Campos, Nick Craswell, Li Deng, Jianfeng Gao, Xiaodong Liu, Rangan Majumder, Andrew McNamara, Bhaskar Mitra, Tri Nguyen, Mir Rosenberg, Xia Song, Alina Stoica, Saurabh Tiwary, Tong Wang}, booktitle={InCoCo@NIPS}, year={2016} }