irds/mmarco_es_train

`mmarco/es/train`数据集由ir-datasets包提供，主要用于文本检索任务。该数据集包含808,731个查询、532,761个相关性评估和39,780,811个文档对。文档部分需要使用`irds/mmarco_es`数据集。数据集的使用方法包括加载查询、相关性评估和文档对，并提供了相应的Python代码示例。该数据集的引用信息也包含在README中。

The `mmarco/es/train` dataset, provided by the ir-datasets package, is primarily designed for text retrieval tasks. It contains 808,731 queries, 532,761 relevance judgments, and 39,780,811 document pairs. The document portion of this dataset requires the use of the `irds/mmarco_es` dataset. Usage procedures for the dataset include loading queries, relevance judgments, and document pairs, with corresponding Python code examples provided. Citation information for this dataset is also included in its README file.

原始信息汇总

数据集概述

数据集名称

mmarco/es/train

数据提供者

由ir-datasets包提供。

数据集内容

• queries (查询语句，即主题)：数量为808,731条。
• qrels (相关性评估)：数量为532,761条。
• docpairs：数量为39,780,811条。

数据集使用

• 对于docs数据，应使用irds/mmarco_es数据集。

示例代码

python from datasets import load_dataset

queries = load_dataset(irds/mmarco_es_train, queries) for record in queries: record # {query_id: ..., text: ...}

qrels = load_dataset(irds/mmarco_es_train, qrels) for record in qrels: record # {query_id: ..., doc_id: ..., relevance: ..., iteration: ...}

docpairs = load_dataset(irds/mmarco_es_train, docpairs) for record in docpairs: record # {query_id: ..., doc_id_a: ..., doc_id_b: ...}

引用信息

@article{Bonifacio2021MMarco, title={{mMARCO}: A Multilingual Version of {MS MARCO} Passage Ranking Dataset}, author={Luiz Henrique Bonifacio and Israel Campiotti and Roberto Lotufo and Rodrigo Nogueira}, year={2021}, journal={arXiv:2108.13897} }