irds/mr-tydi_th_test

`mr-tydi/th/test`数据集由`ir-datasets`包提供，主要用于文本检索任务。该数据集包含1,190个查询（queries）和1,368个相关评估（qrels）。文档部分需要使用`irds/mr-tydi_th`数据集。该数据集的使用方法通过`datasets`库加载，并提供了代码示例。

The `mr-tydi/th/test` dataset is provided by the `ir-datasets` package, mainly used for text retrieval tasks. This dataset contains 1,190 queries and 1,368 relevance qrels. The document part of this dataset requires the use of the `irds/mr-tydi_th` dataset. The dataset can be loaded through the `datasets` library, and corresponding code examples are provided.

原始信息汇总

Dataset Card for mr-tydi/th/test

Overview

• Dataset Name: mr-tydi/th/test
• Source: Provided by the ir-datasets package.
• Documentation: Link

Data Details

• Components:
  • queries: 1,190 topics
  • qrels: 1,368 relevance assessments
  • docs: Available via irds/mr-tydi_th

Usage Example

python from datasets import load_dataset

queries = load_dataset(irds/mr-tydi_th_test, queries) for record in queries: record # {query_id: ..., text: ...}

qrels = load_dataset(irds/mr-tydi_th_test, qrels) for record in qrels: record # {query_id: ..., doc_id: ..., relevance: ..., iteration: ...}

Citation

@article{Zhang2021MrTyDi, title={{Mr. TyDi}: A Multi-lingual Benchmark for Dense Retrieval}, author={Xinyu Zhang and Xueguang Ma and Peng Shi and Jimmy Lin}, year={2021}, journal={arXiv:2108.08787}, } @article{Clark2020TyDiQa, title={{TyDi QA}: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languages}, author={Jonathan H. Clark and Eunsol Choi and Michael Collins and Dan Garrette and Tom Kwiatkowski and Vitaly Nikolaev and Jennimaria Palomaki}, year={2020}, journal={Transactions of the Association for Computational Linguistics} }