irds/mr-tydi_ru_dev

`mr-tydi/ru/dev`数据集由`ir-datasets`包提供，包含1,375条查询（queries）和1,375条相关性评估（qrels）。文档部分需要从`irds/mr-tydi_ru`数据集中获取。该数据集主要用于文本检索任务。

原始信息汇总

数据集概述

数据集名称

mr-tydi/ru/dev

数据来源

• 源数据集: irds/mr-tydi_ru

数据内容

• queries: 查询（即主题），数量为1,375
• qrels: 相关性评估，数量为1,375
• docs: 文档数据，来源于irds/mr-tydi_ru

数据使用示例

python from datasets import load_dataset

queries = load_dataset(irds/mr-tydi_ru_dev, queries) for record in queries: record # {query_id: ..., text: ...}

qrels = load_dataset(irds/mr-tydi_ru_dev, qrels) for record in qrels: record # {query_id: ..., doc_id: ..., relevance: ..., iteration: ...}

引用信息

@article{Zhang2021MrTyDi, title={{Mr. TyDi}: A Multi-lingual Benchmark for Dense Retrieval}, author={Xinyu Zhang and Xueguang Ma and Peng Shi and Jimmy Lin}, year={2021}, journal={arXiv:2108.08787}, } @article{Clark2020TyDiQa, title={{TyDi QA}: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languages}, author={Jonathan H. Clark and Eunsol Choi and Michael Collins and Dan Garrette and Tom Kwiatkowski and Vitaly Nikolaev and Jennimaria Palomaki}, year={2020}, journal={Transactions of the Association for Computational Linguistics} }