irds/mr-tydi_th_dev

`mr-tydi/th/dev`数据集由ir-datasets包提供，主要用于文本检索任务。该数据集包含807个查询（即主题）和817个相关性评估（qrels）。文档部分需要使用`irds/mr-tydi_th`数据集。该数据集的使用示例展示了如何通过Python代码加载查询和相关性评估数据。

The `mr-tydi/th/dev` dataset, provided by the ir-datasets package, is primarily used for text retrieval tasks. It contains 807 queries (i.e., topics) and 817 relevance judgments (qrels). The document collection requires the use of the `irds/mr-tydi_th` dataset. Usage examples of this dataset demonstrate how to load queries and relevance judgment data via Python code.

原始信息汇总

数据集概述

数据集名称

mr-tydi/th/dev

数据提供者

由 ir-datasets 包提供。

数据集内容

• queries (查询/主题): 数量=807
• qrels (相关性评估): 数量=817
• docs (文档): 使用 irds/mr-tydi_th 数据集

使用方法

python from datasets import load_dataset

queries = load_dataset(irds/mr-tydi_th_dev, queries) for record in queries: record # {query_id: ..., text: ...}

qrels = load_dataset(irds/mr-tydi_th_dev, qrels) for record in qrels: record # {query_id: ..., doc_id: ..., relevance: ..., iteration: ...}

引用信息

@article{Zhang2021MrTyDi, title={{Mr. TyDi}: A Multi-lingual Benchmark for Dense Retrieval}, author={Xinyu Zhang and Xueguang Ma and Peng Shi and Jimmy Lin}, year={2021}, journal={arXiv:2108.08787}, } @article{Clark2020TyDiQa, title={{TyDi QA}: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languages}, author={Jonathan H. Clark and Eunsol Choi and Michael Collins and Dan Garrette and Tom Kwiatkowski and Vitaly Nikolaev and Jennimaria Palomaki}, year={2020}, journal={Transactions of the Association for Computational Linguistics} }