five

irds/mmarco_v2_it

收藏
Hugging Face2023-01-05 更新2024-03-04 收录
下载链接:
https://hf-mirror.com/datasets/irds/mmarco_v2_it
下载链接
链接失效反馈
官方服务:
资源简介:
--- pretty_name: '`mmarco/v2/it`' viewer: false source_datasets: [] task_categories: - text-retrieval --- # Dataset Card for `mmarco/v2/it` The `mmarco/v2/it` dataset, provided by the [ir-datasets](https://ir-datasets.com/) package. For more information about the dataset, see the [documentation](https://ir-datasets.com/mmarco#mmarco/v2/it). # Data This dataset provides: - `docs` (documents, i.e., the corpus); count=8,841,823 This dataset is used by: [`mmarco_v2_it_dev`](https://huggingface.co/datasets/irds/mmarco_v2_it_dev), [`mmarco_v2_it_train`](https://huggingface.co/datasets/irds/mmarco_v2_it_train) ## Usage ```python from datasets import load_dataset docs = load_dataset('irds/mmarco_v2_it', 'docs') for record in docs: record # {'doc_id': ..., 'text': ...} ``` Note that calling `load_dataset` will download the dataset (or provide access instructions when it's not public) and make a copy of the data in 🤗 Dataset format. ## Citation Information ``` @article{Bonifacio2021MMarco, title={{mMARCO}: A Multilingual Version of {MS MARCO} Passage Ranking Dataset}, author={Luiz Henrique Bonifacio and Israel Campiotti and Roberto Lotufo and Rodrigo Nogueira}, year={2021}, journal={arXiv:2108.13897} } ```
提供机构:
irds
原始信息汇总

数据集卡片 mmarco/v2/it

数据集概述

mmarco/v2/it 数据集由 ir-datasets 包提供。该数据集主要用于文本检索任务。

数据内容

  • 文档(即语料库):包含 8,841,823 个文档。

使用方法

以下是加载和使用该数据集的示例代码: python from datasets import load_dataset

docs = load_dataset(irds/mmarco_v2_it, docs) for record in docs: record # {doc_id: ..., text: ...}

引用信息

@article{Bonifacio2021MMarco, title={{mMARCO}: A Multilingual Version of {MS MARCO} Passage Ranking Dataset}, author={Luiz Henrique Bonifacio and Israel Campiotti and Roberto Lotufo and Rodrigo Nogueira}, year={2021}, journal={arXiv:2108.13897} }

5,000+
优质数据集
54 个
任务类型
进入经典数据集
二维码
社区交流群

面向社区/商业的数据集话题

二维码
科研交流群

面向高校/科研机构的开源数据集话题

数据驱动未来

携手共赢发展

商业合作