irds/mmarco_de_train
收藏Hugging Face2023-01-05 更新2024-03-04 收录
下载链接:
https://hf-mirror.com/datasets/irds/mmarco_de_train
下载链接
链接失效反馈官方服务:
资源简介:
---
pretty_name: '`mmarco/de/train`'
viewer: false
source_datasets: ['irds/mmarco_de']
task_categories:
- text-retrieval
---
# Dataset Card for `mmarco/de/train`
The `mmarco/de/train` dataset, provided by the [ir-datasets](https://ir-datasets.com/) package.
For more information about the dataset, see the [documentation](https://ir-datasets.com/mmarco#mmarco/de/train).
# Data
This dataset provides:
- `queries` (i.e., topics); count=808,731
- `qrels`: (relevance assessments); count=532,761
- `docpairs`; count=39,780,811
- For `docs`, use [`irds/mmarco_de`](https://huggingface.co/datasets/irds/mmarco_de)
## Usage
```python
from datasets import load_dataset
queries = load_dataset('irds/mmarco_de_train', 'queries')
for record in queries:
record # {'query_id': ..., 'text': ...}
qrels = load_dataset('irds/mmarco_de_train', 'qrels')
for record in qrels:
record # {'query_id': ..., 'doc_id': ..., 'relevance': ..., 'iteration': ...}
docpairs = load_dataset('irds/mmarco_de_train', 'docpairs')
for record in docpairs:
record # {'query_id': ..., 'doc_id_a': ..., 'doc_id_b': ...}
```
Note that calling `load_dataset` will download the dataset (or provide access instructions when it's not public) and make a copy of the
data in 🤗 Dataset format.
## Citation Information
```
@article{Bonifacio2021MMarco,
title={{mMARCO}: A Multilingual Version of {MS MARCO} Passage Ranking Dataset},
author={Luiz Henrique Bonifacio and Israel Campiotti and Roberto Lotufo and Rodrigo Nogueira},
year={2021},
journal={arXiv:2108.13897}
}
```
提供机构:
irds
原始信息汇总
数据集概述
数据集名称
mmarco/de/train
数据提供方
数据集内容
queries: 查询(即主题),数量为808,731qrels: 相关性评估,数量为532,761docpairs: 文档对,数量为39,780,811
数据集使用
- 对于
docs数据,使用irds/mmarco_de
数据集加载示例
python from datasets import load_dataset
queries = load_dataset(irds/mmarco_de_train, queries) for record in queries: record # {query_id: ..., text: ...}
qrels = load_dataset(irds/mmarco_de_train, qrels) for record in qrels: record # {query_id: ..., doc_id: ..., relevance: ..., iteration: ...}
docpairs = load_dataset(irds/mmarco_de_train, docpairs) for record in docpairs: record # {query_id: ..., doc_id_a: ..., doc_id_b: ...}
引用信息
@article{Bonifacio2021MMarco, title={{mMARCO}: A Multilingual Version of {MS MARCO} Passage Ranking Dataset}, author={Luiz Henrique Bonifacio and Israel Campiotti and Roberto Lotufo and Rodrigo Nogueira}, year={2021}, journal={arXiv:2108.13897} }



