five

irds/beir_nfcorpus

收藏
Hugging Face2023-01-05 更新2024-03-04 收录
下载链接:
https://hf-mirror.com/datasets/irds/beir_nfcorpus
下载链接
链接失效反馈
官方服务:
资源简介:
--- pretty_name: '`beir/nfcorpus`' viewer: false source_datasets: [] task_categories: - text-retrieval --- # Dataset Card for `beir/nfcorpus` The `beir/nfcorpus` dataset, provided by the [ir-datasets](https://ir-datasets.com/) package. For more information about the dataset, see the [documentation](https://ir-datasets.com/beir#beir/nfcorpus). # Data This dataset provides: - `docs` (documents, i.e., the corpus); count=3,633 - `queries` (i.e., topics); count=3,237 This dataset is used by: [`beir_nfcorpus_dev`](https://huggingface.co/datasets/irds/beir_nfcorpus_dev), [`beir_nfcorpus_test`](https://huggingface.co/datasets/irds/beir_nfcorpus_test), [`beir_nfcorpus_train`](https://huggingface.co/datasets/irds/beir_nfcorpus_train) ## Usage ```python from datasets import load_dataset docs = load_dataset('irds/beir_nfcorpus', 'docs') for record in docs: record # {'doc_id': ..., 'text': ..., 'title': ..., 'url': ...} queries = load_dataset('irds/beir_nfcorpus', 'queries') for record in queries: record # {'query_id': ..., 'text': ..., 'url': ...} ``` Note that calling `load_dataset` will download the dataset (or provide access instructions when it's not public) and make a copy of the data in 🤗 Dataset format. ## Citation Information ``` @inproceedings{Boteva2016Nfcorpus, title="A Full-Text Learning to Rank Dataset for Medical Information Retrieval", author = "Vera Boteva and Demian Gholipour and Artem Sokolov and Stefan Riezler", booktitle = "Proceedings of the European Conference on Information Retrieval ({ECIR})", location = "Padova, Italy", publisher = "Springer", year = 2016 } @article{Thakur2021Beir, title = "BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models", author = "Thakur, Nandan and Reimers, Nils and Rücklé, Andreas and Srivastava, Abhishek and Gurevych, Iryna", journal= "arXiv preprint arXiv:2104.08663", month = "4", year = "2021", url = "https://arxiv.org/abs/2104.08663", } ```

--- 数据集展示名:`beir/nfcorpus` 查看器:未启用 源数据集:无 任务类别: - 文本检索(text-retrieval) --- # `beir/nfcorpus` 数据集卡片 本`beir/nfcorpus` 数据集由[ir-datasets](https://ir-datasets.com/)工具包提供。如需了解该数据集的更多详情,请参阅[官方文档](https://ir-datasets.com/beir#beir/nfcorpus)。 # 数据集内容 该数据集包含以下两类数据: - `docs`(文档,即语料库):总计3633条 - `queries`(查询项,即检索主题):总计3237条 该数据集被以下子集使用:[`beir_nfcorpus_dev`](https://huggingface.co/datasets/irds/beir_nfcorpus_dev)、[`beir_nfcorpus_test`](https://huggingface.co/datasets/irds/beir_nfcorpus_test)以及[`beir_nfcorpus_train`](https://huggingface.co/datasets/irds/beir_nfcorpus_train)。 ## 使用方法 python from datasets import load_dataset docs = load_dataset('irds/beir_nfcorpus', 'docs') for record in docs: record # {'doc_id': ..., 'text': ..., 'title': ..., 'url': ...} queries = load_dataset('irds/beir_nfcorpus', 'queries') for record in queries: record # {'query_id': ..., 'text': ..., 'url': ...} 请注意,调用`load_dataset`函数将自动下载该数据集(若数据集未公开,则会提供访问指引),并将数据转换为🤗 数据集格式进行存储。 ## 引用信息 @inproceedings{Boteva2016Nfcorpus, title="A Full-Text Learning to Rank Dataset for Medical Information Retrieval", author = "Vera Boteva and Demian Gholipour and Artem Sokolov and Stefan Riezler", booktitle = "Proceedings of the European Conference on Information Retrieval ({ECIR})", location = "Padova, Italy", publisher = "Springer", year = 2016 } @article{Thakur2021Beir, title = "BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models", author = "Thakur, Nandan and Reimers, Nils and Rücklé, Andreas and Srivastava, Abhishek and Gurevych, Iryna", journal = "arXiv preprint arXiv:2104.08663", month = "4", year = "2021", url = "https://arxiv.org/abs/2104.08663", }
提供机构:
irds
原始信息汇总

数据集概述

数据集名称

beir/nfcorpus

数据来源

ir-datasets包提供。

数据内容

  • 文档(docs): 数量为3,633。
  • 查询(queries): 数量为3,237。

使用场景

该数据集被用于以下场景:

  • beir_nfcorpus_dev
  • beir_nfcorpus_test
  • beir_nfcorpus_train

数据集加载示例

python from datasets import load_dataset

docs = load_dataset(irds/beir_nfcorpus, docs) for record in docs: record # {doc_id: ..., text: ..., title: ..., url: ...}

queries = load_dataset(irds/beir_nfcorpus, queries) for record in queries: record # {query_id: ..., text: ..., url: ...}

引用信息

@inproceedings{Boteva2016Nfcorpus, title="A Full-Text Learning to Rank Dataset for Medical Information Retrieval", author = "Vera Boteva and Demian Gholipour and Artem Sokolov and Stefan Riezler", booktitle = "Proceedings of the European Conference on Information Retrieval ({ECIR})", location = "Padova, Italy", publisher = "Springer", year = 2016 } @article{Thakur2021Beir, title = "BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models", author = "Thakur, Nandan and Reimers, Nils and Rücklé, Andreas and Srivastava, Abhishek and Gurevych, Iryna", journal= "arXiv preprint arXiv:2104.08663", month = "4", year = "2021", url = "https://arxiv.org/abs/2104.08663", }

搜集汇总
数据集介绍
main_image_url
以上内容由遇见数据集搜集并总结生成
5,000+
优质数据集
54 个
任务类型
进入经典数据集
二维码
社区交流群

面向社区/商业的数据集话题

二维码
科研交流群

面向高校/科研机构的开源数据集话题

数据驱动未来

携手共赢发展

商业合作