irds/msmarco-document_trec-dl-hard_fold1

`msmarco-document/trec-dl-hard/fold1`数据集是由`ir-datasets`包提供的一个文本检索任务数据集。该数据集包含10个查询（即主题）和1,557个相关性评估（qrels）。文档部分需要使用`irds/msmarco-document`数据集。

原始信息汇总

数据集概述

数据集名称

msmarco-document/trec-dl-hard/fold1

数据来源

• 源数据集：irds/msmarco-document

数据内容

• queries（查询主题）：数量=10
• qrels（相关性评估）：数量=1,557
• docs：使用irds/msmarco-document数据集

数据使用示例

python from datasets import load_dataset

queries = load_dataset(irds/msmarco-document_trec-dl-hard_fold1, queries) for record in queries: record # {query_id: ..., text: ...}

qrels = load_dataset(irds/msmarco-document_trec-dl-hard_fold1, qrels) for record in qrels: record # {query_id: ..., doc_id: ..., relevance: ...}

引用信息

@article{Mackie2021DlHard, title={How Deep is your Learning: the DL-HARD Annotated Deep Learning Dataset}, author={Iain Mackie and Jeffrey Dalton and Andrew Yates}, journal={ArXiv}, year={2021}, volume={abs/2105.07975} } @inproceedings{Bajaj2016Msmarco, title={MS MARCO: A Human Generated MAchine Reading COmprehension Dataset}, author={Payal Bajaj, Daniel Campos, Nick Craswell, Li Deng, Jianfeng Gao, Xiaodong Liu, Rangan Majumder, Andrew McNamara, Bhaskar Mitra, Tri Nguyen, Mir Rosenberg, Xia Song, Alina Stoica, Saurabh Tiwary, Tong Wang}, booktitle={InCoCo@NIPS}, year={2016} }