irds/mmarco_v2_zh_dev
收藏资源简介:
--- pretty_name: '`mmarco/v2/zh/dev`' viewer: false source_datasets: ['irds/mmarco_v2_zh'] task_categories: - text-retrieval --- # Dataset Card for `mmarco/v2/zh/dev` The `mmarco/v2/zh/dev` dataset, provided by the [ir-datasets](https://ir-datasets.com/) package. For more information about the dataset, see the [documentation](https://ir-datasets.com/mmarco#mmarco/v2/zh/dev). # Data This dataset provides: - `queries` (i.e., topics); count=101,093 - `qrels`: (relevance assessments); count=59,273 - For `docs`, use [`irds/mmarco_v2_zh`](https://huggingface.co/datasets/irds/mmarco_v2_zh) ## Usage ```python from datasets import load_dataset queries = load_dataset('irds/mmarco_v2_zh_dev', 'queries') for record in queries: record # {'query_id': ..., 'text': ...} qrels = load_dataset('irds/mmarco_v2_zh_dev', 'qrels') for record in qrels: record # {'query_id': ..., 'doc_id': ..., 'relevance': ..., 'iteration': ...} ``` Note that calling `load_dataset` will download the dataset (or provide access instructions when it's not public) and make a copy of the data in 🤗 Dataset format. ## Citation Information ``` @article{Bonifacio2021MMarco, title={{mMARCO}: A Multilingual Version of {MS MARCO} Passage Ranking Dataset}, author={Luiz Henrique Bonifacio and Israel Campiotti and Roberto Lotufo and Rodrigo Nogueira}, year={2021}, journal={arXiv:2108.13897} } ```
--- pretty_name: '`mmarco/v2/zh/dev`' 查看器:已禁用 源数据集:['irds/mmarco_v2_zh'] 任务类别: - 文本检索 --- # `mmarco/v2/zh/dev` 数据集卡片 本`mmarco/v2/zh/dev`数据集由[ir-datasets](https://ir-datasets.com/)工具包提供。如需了解该数据集的更多详情,请参阅[官方文档](https://ir-datasets.com/mmarco#mmarco/v2/zh/dev)。 ## 数据 本数据集包含以下内容: - `queries`(即查询主题):共计101093条 - `qrels`(相关性评估集):共计59273条 - 如需获取文档数据,请使用 [`irds/mmarco_v2_zh`](https://huggingface.co/datasets/irds/mmarco_v2_zh) 数据集。 ## 使用方法 python from datasets import load_dataset queries = load_dataset('irds/mmarco_v2_zh_dev', 'queries') for record in queries: record # {'query_id': ..., 'text': ...} qrels = load_dataset('irds/mmarco_v2_zh_dev', 'qrels') for record in qrels: record # {'query_id': ..., 'doc_id': ..., 'relevance': ..., 'iteration': ...} 请注意,调用`load_dataset`将自动下载该数据集(若数据集未公开,则会提供获取指引),并将数据转换为🤗 Dataset格式进行存储。 ## 引用信息 @article{Bonifacio2021MMarco, title={{mMARCO}: A Multilingual Version of {MS MARCO} Passage Ranking Dataset}, author={Luiz Henrique Bonifacio and Israel Campiotti and Roberto Lotufo and Rodrigo Nogueira}, year={2021}, journal={arXiv:2108.13897} }
数据集概述
数据集名称
mmarco/v2/zh/dev
数据来源
- 原始数据集:
irds/mmarco_v2_zh
任务类别
- 文本检索
数据内容
queries(查询): 数量=101,093qrels(相关性评估): 数量=59,273docs(文档): 使用irds/mmarco_v2_zh数据集
使用示例
python from datasets import load_dataset
queries = load_dataset(irds/mmarco_v2_zh_dev, queries) for record in queries: record # {query_id: ..., text: ...}
qrels = load_dataset(irds/mmarco_v2_zh_dev, qrels) for record in qrels: record # {query_id: ..., doc_id: ..., relevance: ..., iteration: ...}
引用信息
@article{Bonifacio2021MMarco, title={{mMARCO}: A Multilingual Version of {MS MARCO} Passage Ranking Dataset}, author={Luiz Henrique Bonifacio and Israel Campiotti and Roberto Lotufo and Rodrigo Nogueira}, year={2021}, journal={arXiv:2108.13897} }




