irds/wikiclir_cs

`wikiclir/cs`数据集由`ir-datasets`包提供，主要用于文本检索任务。该数据集包含三个部分：文档（docs）、查询（queries）和相关性评估（qrels）。文档部分包含386,906条记录，查询部分包含233,553条记录，相关性评估部分包含954,370条记录。文档部分包含文档ID、标题和文本信息，查询部分包含查询ID和查询文本，相关性评估部分包含查询ID、文档ID、相关性和迭代信息。

原始信息汇总

数据集卡片 wikiclir/cs

数据集概述

wikiclir/cs 数据集由 ir-datasets 包提供。

数据内容

该数据集包含以下内容：

• docs（文档，即语料库）；数量=386,906
• queries（即主题）；数量=233,553
• qrels（相关性评估）；数量=954,370

使用方法

以下是加载和使用数据集的示例代码：

python from datasets import load_dataset

docs = load_dataset(irds/wikiclir_cs, docs) for record in docs: record # {doc_id: ..., title: ..., text: ...}

queries = load_dataset(irds/wikiclir_cs, queries) for record in queries: record # {query_id: ..., text: ...}

qrels = load_dataset(irds/wikiclir_cs, qrels) for record in qrels: record # {query_id: ..., doc_id: ..., relevance: ..., iteration: ...}

引用信息

@inproceedings{sasaki-etal-2018-cross, title = "Cross-Lingual Learning-to-Rank with Shared Representations", author = "Sasaki, Shota and Sun, Shuo and Schamoni, Shigehiko and Duh, Kevin and Inui, Kentaro", booktitle = "Proceedings of the 2018 Conference of the North {A}merican Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers)", month = jun, year = "2018", address = "New Orleans, Louisiana", publisher = "Association for Computational Linguistics", url = "https://aclanthology.org/N18-2073", doi = "10.18653/v1/N18-2073", pages = "458--463" }