five

irds/hc4_zh

收藏
Hugging Face2023-01-05 更新2024-03-04 收录
下载链接:
https://hf-mirror.com/datasets/irds/hc4_zh
下载链接
链接失效反馈
官方服务:
资源简介:
--- pretty_name: '`hc4/zh`' viewer: false source_datasets: [] task_categories: - text-retrieval --- # Dataset Card for `hc4/zh` The `hc4/zh` dataset, provided by the [ir-datasets](https://ir-datasets.com/) package. For more information about the dataset, see the [documentation](https://ir-datasets.com/hc4#hc4/zh). # Data This dataset provides: - `docs` (documents, i.e., the corpus); count=646,305 ## Usage ```python from datasets import load_dataset docs = load_dataset('irds/hc4_zh', 'docs') for record in docs: record # {'doc_id': ..., 'title': ..., 'text': ..., 'url': ..., 'time': ..., 'cc_file': ...} ``` Note that calling `load_dataset` will download the dataset (or provide access instructions when it's not public) and make a copy of the data in 🤗 Dataset format. ## Citation Information ``` @article{Lawrie2022HC4, author = {Dawn Lawrie and James Mayfield and Douglas W. Oard and Eugene Yang}, title = {HC4: A New Suite of Test Collections for Ad Hoc CLIR}, booktitle = {{Advances in Information Retrieval. 44th European Conference on IR Research (ECIR 2022)}, year = {2022}, month = apr, publisher = {Springer}, series = {Lecture Notes in Computer Science}, site = {Stavanger, Norway}, url = {https://arxiv.org/abs/2201.09992} } ```
提供机构:
irds
原始信息汇总

数据集概述

数据集名称

  • hc4/zh

数据集来源

数据集内容

  • 包含 docs (文档,即语料库),总计646,305条记录。

数据集结构

  • 每条记录包含以下字段:
    • doc_id
    • title
    • text
    • url
    • time
    • cc_file

数据集使用方法

  • 通过以下Python代码加载数据集: python from datasets import load_dataset docs = load_dataset(irds/hc4_zh, docs) for record in docs: record # {doc_id: ..., title: ..., text: ..., url: ..., time: ..., cc_file: ...}

引用信息

  • 引用格式:

    @article{Lawrie2022HC4, author = {Dawn Lawrie and James Mayfield and Douglas W. Oard and Eugene Yang}, title = {HC4: A New Suite of Test Collections for Ad Hoc CLIR}, booktitle = {{Advances in Information Retrieval. 44th European Conference on IR Research (ECIR 2022)}, year = {2022}, month = apr, publisher = {Springer}, series = {Lecture Notes in Computer Science}, site = {Stavanger, Norway}, url = {https://arxiv.org/abs/2201.09992} }

5,000+
优质数据集
54 个
任务类型
进入经典数据集
二维码
社区交流群

面向社区/商业的数据集话题

二维码
科研交流群

面向高校/科研机构的开源数据集话题

数据驱动未来

携手共赢发展

商业合作