irds/wikir_it16k

`wikir/it16k`数据集由`ir-datasets`包提供，包含503,012条文档（即语料库）。该数据集主要用于文本检索任务。

原始信息汇总

数据集概述

数据集名称

wikir/it16k

数据来源

由ir-datasets包提供。

数据内容

• docs (文档，即语料库); 数量=503,012

使用方法

python from datasets import load_dataset

docs = load_dataset(irds/wikir_it16k, docs) for record in docs: record # {doc_id: ..., text: ...}

引用信息

@inproceedings{Frej2020Wikir, title={WIKIR: A Python toolkit for building a large-scale Wikipedia-based English Information Retrieval Dataset}, author={Jibril Frej and Didier Schwab and Jean-Pierre Chevallet}, booktitle={LREC}, year={2020} } @inproceedings{Frej2020MlWikir, title={MLWIKIR: A Python Toolkit for Building Large-scale Wikipedia-based Information Retrieval Datasets in Chinese, English, French, Italian, Japanese, Spanish and More}, author={Jibril Frej and Didier Schwab and Jean-Pierre Chevallet}, booktitle={CIRCLE}, year={2020} }