irds/mmarco_v2_vi_train

`mmarco/v2/vi/train`数据集由`ir-datasets`包提供，主要用于文本检索任务。该数据集包含808,731个查询、532,761个相关性评估和39,780,811个文档对。文档部分需要从`irds/mmarco_v2_vi`数据集中获取。

The `mmarco/v2/vi/train` dataset, provided by the `ir-datasets` package, is primarily intended for text retrieval tasks. It contains 808,731 queries, 532,761 relevance judgments, and 39,780,811 document pairs. The document corpus of this dataset needs to be obtained from the `irds/mmarco_v2_vi` dataset.

原始信息汇总

数据集概述

数据集名称

mmarco/v2/vi/train

数据来源

• 源数据集: irds/mmarco_v2_vi

任务类别

• 文本检索

数据内容

• queries (查询语句): 数量=808,731
• qrels (相关性评估): 数量=532,761
• docpairs (文档对): 数量=39,780,811

数据使用示例

python from datasets import load_dataset

加载查询数据

queries = load_dataset(irds/mmarco_v2_vi_train, queries) for record in queries: record # {query_id: ..., text: ...}

加载相关性评估数据

qrels = load_dataset(irds/mmarco_v2_vi_train, qrels) for record in qrels: record # {query_id: ..., doc_id: ..., relevance: ..., iteration: ...}

加载文档对数据

docpairs = load_dataset(irds/mmarco_v2_vi_train, docpairs) for record in docpairs: record # {query_id: ..., doc_id_a: ..., doc_id_b: ...}

引用信息

@article{Bonifacio2021MMarco, title={{mMARCO}: A Multilingual Version of {MS MARCO} Passage Ranking Dataset}, author={Luiz Henrique Bonifacio and Israel Campiotti and Roberto Lotufo and Rodrigo Nogueira}, year={2021}, journal={arXiv:2108.13897} }