irds/mr-tydi_fi

`mr-tydi/fi`数据集由`ir-datasets`包提供，主要用于文本检索任务。该数据集包含1,908,757个文档、9,572个查询和9,750个相关性评估。数据集被用于`mr-tydi_fi_dev`、`mr-tydi_fi_test`和`mr-tydi_fi_train`等子数据集。用户可以通过Python代码加载和使用这些数据。

The `mr-tydi/fi` dataset is provided by the `ir-datasets` package and is primarily used for text retrieval tasks. This dataset contains 1,908,757 documents, 9,572 queries, and 9,750 relevance judgments. It is split into three sub-datasets: `mr-tydi_fi_dev`, `mr-tydi_fi_test`, and `mr-tydi_fi_train`. Users can load and utilize these datasets via Python code.

原始信息汇总

数据集概述

数据集名称

mr-tydi/fi

数据来源

由 ir-datasets 提供。

数据内容

• docs (文档，即语料库); 数量=1,908,757
• queries (查询，即主题); 数量=9,572
• qrels (相关性评估); 数量=9,750

数据使用

该数据集被用于以下数据集：

• mr-tydi_fi_dev
• mr-tydi_fi_test
• mr-tydi_fi_train

数据加载示例

python from datasets import load_dataset

docs = load_dataset(irds/mr-tydi_fi, docs) for record in docs: record # {doc_id: ..., text: ...}

queries = load_dataset(irds/mr-tydi_fi, queries) for record in queries: record # {query_id: ..., text: ...}

qrels = load_dataset(irds/mr-tydi_fi, qrels) for record in qrels: record # {query_id: ..., doc_id: ..., relevance: ..., iteration: ...}

引用信息

@article{Zhang2021MrTyDi, title={{Mr. TyDi}: A Multi-lingual Benchmark for Dense Retrieval}, author={Xinyu Zhang and Xueguang Ma and Peng Shi and Jimmy Lin}, year={2021}, journal={arXiv:2108.08787}, } @article{Clark2020TyDiQa, title={{TyDi QA}: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languages}, author={Jonathan H. Clark and Eunsol Choi and Michael Collins and Dan Garrette and Tom Kwiatkowski and Vitaly Nikolaev and Jennimaria Palomaki}, year={2020}, journal={Transactions of the Association for Computational Linguistics} }