irds/hc4_ru

`hc4/ru`数据集由`ir-datasets`包提供，主要用于文本检索任务。该数据集包含`docs`（文档，即语料库），总计4,721,064条记录。每条记录包含`doc_id`、`title`、`text`、`url`、`time`和`cc_file`等字段。

原始信息汇总

数据集概述

数据集名称

hc4/ru

数据来源

由 ir-datasets 包提供。

数据内容

• 文档类型：docs
• 文档数量：4,721,064

数据结构

每个文档记录包含以下字段：

• doc_id
• title
• text
• url
• time
• cc_file

使用方法

python from datasets import load_dataset

docs = load_dataset(irds/hc4_ru, docs) for record in docs: record # {doc_id: ..., title: ..., text: ..., url: ..., time: ..., cc_file: ...}

引用信息

@article{Lawrie2022HC4, author = {Dawn Lawrie and James Mayfield and Douglas W. Oard and Eugene Yang}, title = {HC4: A New Suite of Test Collections for Ad Hoc CLIR}, booktitle = {{Advances in Information Retrieval. 44th European Conference on IR Research (ECIR 2022)}, year = {2022}, month = apr, publisher = {Springer}, series = {Lecture Notes in Computer Science}, site = {Stavanger, Norway}, url = {https://arxiv.org/abs/2201.09992} }