irds/mr-tydi_ko_dev

---
pretty_name: '`mr-tydi/ko/dev`'
viewer: false
source_datasets: ['irds/mr-tydi_ko']
task_categories:
- text-retrieval
---

# Dataset Card for `mr-tydi/ko/dev`

The `mr-tydi/ko/dev` dataset, provided by the [ir-datasets](https://ir-datasets.com/) package.
For more information about the dataset, see the [documentation](https://ir-datasets.com/mr-tydi#mr-tydi/ko/dev).

# Data

This dataset provides:
- `queries` (i.e., topics); count=303
- `qrels`: (relevance assessments); count=307

- For `docs`, use [`irds/mr-tydi_ko`](https://huggingface.co/datasets/irds/mr-tydi_ko)

## Usage

```python
from datasets import load_dataset

queries = load_dataset('irds/mr-tydi_ko_dev', 'queries')
for record in queries:
record # {'query_id': ..., 'text': ...}

qrels = load_dataset('irds/mr-tydi_ko_dev', 'qrels')
for record in qrels:
record # {'query_id': ..., 'doc_id': ..., 'relevance': ..., 'iteration': ...}

```

Note that calling `load_dataset` will download the dataset (or provide access instructions when it's not public) and make a copy of the
data in 🤗 Dataset format.

## Citation Information

```
@article{Zhang2021MrTyDi,
title={{Mr. TyDi}: A Multi-lingual Benchmark for Dense Retrieval},
author={Xinyu Zhang and Xueguang Ma and Peng Shi and Jimmy Lin},
year={2021},
journal={arXiv:2108.08787},
}
@article{Clark2020TyDiQa,
title={{TyDi QA}: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languages},
author={Jonathan H. Clark and Eunsol Choi and Michael Collins and Dan Garrette and Tom Kwiatkowski and Vitaly Nikolaev and Jennimaria Palomaki},
year={2020},
journal={Transactions of the Association for Computational Linguistics}
}
```

原始信息汇总

数据集概述

数据集名称

mr-tydi/ko/dev

数据提供者

由 ir-datasets 包提供。

数据内容

• queries（查询/主题）：数量为303
• qrels（相关性评估）：数量为307
• docs（文档）：使用 irds/mr-tydi_ko

使用示例

python from datasets import load_dataset

queries = load_dataset(irds/mr-tydi_ko_dev, queries) for record in queries: record # {query_id: ..., text: ...}

qrels = load_dataset(irds/mr-tydi_ko_dev, qrels) for record in qrels: record # {query_id: ..., doc_id: ..., relevance: ..., iteration: ...}

引用信息

@article{Zhang2021MrTyDi, title={{Mr. TyDi}: A Multi-lingual Benchmark for Dense Retrieval}, author={Xinyu Zhang and Xueguang Ma and Peng Shi and Jimmy Lin}, year={2021}, journal={arXiv:2108.08787}, } @article{Clark2020TyDiQa, title={{TyDi QA}: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languages}, author={Jonathan H. Clark and Eunsol Choi and Michael Collins and Dan Garrette and Tom Kwiatkowski and Vitaly Nikolaev and Jennimaria Palomaki}, year={2020}, journal={Transactions of the Association for Computational Linguistics} }