irds/mmarco_v2_ar_train
收藏Hugging Face2023-01-05 更新2024-03-04 收录
下载链接:
https://hf-mirror.com/datasets/irds/mmarco_v2_ar_train
下载链接
链接失效反馈官方服务:
资源简介:
---
pretty_name: '`mmarco/v2/ar/train`'
viewer: false
source_datasets: ['irds/mmarco_v2_ar']
task_categories:
- text-retrieval
---
# Dataset Card for `mmarco/v2/ar/train`
The `mmarco/v2/ar/train` dataset, provided by the [ir-datasets](https://ir-datasets.com/) package.
For more information about the dataset, see the [documentation](https://ir-datasets.com/mmarco#mmarco/v2/ar/train).
# Data
This dataset provides:
- `queries` (i.e., topics); count=808,731
- `qrels`: (relevance assessments); count=532,761
- `docpairs`; count=39,780,811
- For `docs`, use [`irds/mmarco_v2_ar`](https://huggingface.co/datasets/irds/mmarco_v2_ar)
## Usage
```python
from datasets import load_dataset
queries = load_dataset('irds/mmarco_v2_ar_train', 'queries')
for record in queries:
record # {'query_id': ..., 'text': ...}
qrels = load_dataset('irds/mmarco_v2_ar_train', 'qrels')
for record in qrels:
record # {'query_id': ..., 'doc_id': ..., 'relevance': ..., 'iteration': ...}
docpairs = load_dataset('irds/mmarco_v2_ar_train', 'docpairs')
for record in docpairs:
record # {'query_id': ..., 'doc_id_a': ..., 'doc_id_b': ...}
```
Note that calling `load_dataset` will download the dataset (or provide access instructions when it's not public) and make a copy of the
data in 🤗 Dataset format.
## Citation Information
```
@article{Bonifacio2021MMarco,
title={{mMARCO}: A Multilingual Version of {MS MARCO} Passage Ranking Dataset},
author={Luiz Henrique Bonifacio and Israel Campiotti and Roberto Lotufo and Rodrigo Nogueira},
year={2021},
journal={arXiv:2108.13897}
}
```
提供机构:
irds
原始信息汇总
数据集概述
数据集名称
mmarco/v2/ar/train
数据来源
- 源数据集:
irds/mmarco_v2_ar
任务类别
- 文本检索
数据内容
queries(查询):808,731条qrels(相关性评估):532,761条docpairs(文档对):39,780,811条
数据使用示例
python from datasets import load_dataset
queries = load_dataset(irds/mmarco_v2_ar_train, queries) for record in queries: record # {query_id: ..., text: ...}
qrels = load_dataset(irds/mmarco_v2_ar_train, qrels) for record in qrels: record # {query_id: ..., doc_id: ..., relevance: ..., iteration: ...}
docpairs = load_dataset(irds/mmarco_v2_ar_train, docpairs) for record in docpairs: record # {query_id: ..., doc_id_a: ..., doc_id_b: ...}
引用信息
@article{Bonifacio2021MMarco, title={{mMARCO}: A Multilingual Version of {MS MARCO} Passage Ranking Dataset}, author={Luiz Henrique Bonifacio and Israel Campiotti and Roberto Lotufo and Rodrigo Nogueira}, year={2021}, journal={arXiv:2108.13897} }



