irds/beir_hotpotqa_test

`beir/hotpotqa/test`数据集由ir-datasets包提供，主要用于文本检索任务。数据集中包含7,405条查询（queries）和14,810条相关性评估（qrels）。文档（docs）部分需要使用`irds/beir_hotpotqa`数据集。该数据集可用于多样化的、可解释的多跳问答任务。

The `beir/hotpotqa/test` dataset, provided by the `ir-datasets` package, is primarily designed for text retrieval tasks. It comprises 7,405 queries and 14,810 relevance assessments (qrels). The document (docs) subset requires the `irds/beir_hotpotqa` dataset. This dataset can be applied to diverse and interpretable multi-hop question answering tasks.

原始信息汇总

数据集概述

数据集名称

beir/hotpotqa/test

数据提供者

由ir-datasets包提供。

数据内容

• queries（查询）: 数量为7,405
• qrels（相关性评估）: 数量为14,810

数据使用

• 使用irds/beir_hotpotqa数据集中的文档数据。
• 通过load_dataset函数加载数据集，具体格式如下：
  • queries: {query_id: ..., text: ...}
  • qrels: {query_id: ..., doc_id: ..., relevance: ..., iteration: ...}

引用信息

@inproceedings{Yang2018Hotpotqa, title = "{H}otpot{QA}: A Dataset for Diverse, Explainable Multi-hop Question Answering", author = "Yang, Zhilin and Qi, Peng and Zhang, Saizheng and Bengio, Yoshua and Cohen, William and Salakhutdinov, Ruslan and Manning, Christopher D.", booktitle = "Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing", month = oct # "-" # nov, year = "2018", address = "Brussels, Belgium", publisher = "Association for Computational Linguistics", url = "https://www.aclweb.org/anthology/D18-1259", doi = "10.18653/v1/D18-1259", pages = "2369--2380" } @article{Thakur2021Beir, title = "BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models", author = "Thakur, Nandan and Reimers, Nils and Rücklé, Andreas and Srivastava, Abhishek and Gurevych, Iryna", journal= "arXiv preprint arXiv:2104.08663", month = "4", year = "2021", url = "https://arxiv.org/abs/2104.08663", }