irds/wikiclir_de

`wikiclir/de`数据集由`ir-datasets`包提供，包含以下内容：`docs`（文档，即语料库），数量为2,091,278；`queries`（查询，即主题），数量为938,217；`qrels`（相关性评估），数量为5,550,454。该数据集可用于文本检索任务。

原始信息汇总

数据集概述

数据集名称

wikiclir/de

数据集来源

由ir-datasets包提供。

数据集内容

• 文档 (docs): 2,091,278条记录
• 查询 (queries): 938,217条记录
• 相关性评估 (qrels): 5,550,454条记录

数据集使用示例

python from datasets import load_dataset

加载文档数据

docs = load_dataset(irds/wikiclir_de, docs) for record in docs: record # {doc_id: ..., title: ..., text: ...}

加载查询数据

queries = load_dataset(irds/wikiclir_de, queries) for record in queries: record # {query_id: ..., text: ...}

加载相关性评估数据

qrels = load_dataset(irds/wikiclir_de, qrels) for record in qrels: record # {query_id: ..., doc_id: ..., relevance: ..., iteration: ...}

引用信息

@inproceedings{sasaki-etal-2018-cross, title = "Cross-Lingual Learning-to-Rank with Shared Representations", author = "Sasaki, Shota and Sun, Shuo and Schamoni, Shigehiko and Duh, Kevin and Inui, Kentaro", booktitle = "Proceedings of the 2018 Conference of the North {A}merican Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers)", month = jun, year = "2018", address = "New Orleans, Louisiana", publisher = "Association for Computational Linguistics", url = "https://aclanthology.org/N18-2073", doi = "10.18653/v1/N18-2073", pages = "458--463" }