irds/msmarco-passage_trec-dl-hard_fold3

该数据集名为`msmarco-passage/trec-dl-hard/fold3`，由ir-datasets包提供。数据集包含10个查询（queries）和444个相关性评估（qrels）。文档部分需要从`irds/msmarco-passage`数据集中获取。数据集的使用示例展示了如何通过`load_dataset`函数加载查询和相关性评估数据。

原始信息汇总

数据集概述

数据集名称

msmarco-passage/trec-dl-hard/fold3

数据来源

• 来源：ir-datasets
• 原始数据集：irds/msmarco-passage

数据内容

• queries（查询）：10个
• qrels（相关性评估）：444个
• docs：使用irds/msmarco-passage数据集

数据使用示例

python from datasets import load_dataset

queries = load_dataset(irds/msmarco-passage_trec-dl-hard_fold3, queries) for record in queries: record # {query_id: ..., text: ...}

qrels = load_dataset(irds/msmarco-passage_trec-dl-hard_fold3, qrels) for record in qrels: record # {query_id: ..., doc_id: ..., relevance: ...}

引用信息

@article{Mackie2021DlHard, title={How Deep is your Learning: the DL-HARD Annotated Deep Learning Dataset}, author={Iain Mackie and Jeffrey Dalton and Andrew Yates}, journal={ArXiv}, year={2021}, volume={abs/2105.07975} } @inproceedings{Bajaj2016Msmarco, title={MS MARCO: A Human Generated MAchine Reading COmprehension Dataset}, author={Payal Bajaj, Daniel Campos, Nick Craswell, Li Deng, Jianfeng Gao, Xiaodong Liu, Rangan Majumder, Andrew McNamara, Bhaskar Mitra, Tri Nguyen, Mir Rosenberg, Xia Song, Alina Stoica, Saurabh Tiwary, Tong Wang}, booktitle={InCoCo@NIPS}, year={2016} }