irds/beir_fever_train

`beir/fever/train`数据集由`ir-datasets`包提供，主要用于文本检索任务。该数据集包含109,810条`queries`（即主题）和140,085条`qrels`（相关性评估）。文档部分需要使用`irds/beir_fever`数据集。数据集的使用示例代码展示了如何通过`datasets`库加载查询和相关性评估数据。

原始信息汇总

数据集概述

数据集名称

beir/fever/train

数据来源

• 原始数据集：irds/beir_fever

数据内容

• queries: 查询（即主题），数量为109,810
• qrels: 相关性评估，数量为140,085
• docs: 使用irds/beir_fever数据集

数据使用示例

python from datasets import load_dataset

queries = load_dataset(irds/beir_fever_train, queries) for record in queries: record # {query_id: ..., text: ...}

qrels = load_dataset(irds/beir_fever_train, qrels) for record in qrels: record # {query_id: ..., doc_id: ..., relevance: ..., iteration: ...}

引用信息

@inproceedings{Thorne2018Fever, title = "{FEVER}: a Large-scale Dataset for Fact Extraction and {VER}ification", author = "Thorne, James and Vlachos, Andreas and Christodoulopoulos, Christos and Mittal, Arpit", booktitle = "Proceedings of the 2018 Conference of the North {A}merican Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers)", month = jun, year = "2018", address = "New Orleans, Louisiana", publisher = "Association for Computational Linguistics", url = "https://www.aclweb.org/anthology/N18-1074", doi = "10.18653/v1/N18-1074", pages = "809--819" } @article{Thakur2021Beir, title = "BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models", author = "Thakur, Nandan and Reimers, Nils and Rücklé, Andreas and Srivastava, Abhishek and Gurevych, Iryna", journal= "arXiv preprint arXiv:2104.08663", month = "4", year = "2021", url = "https://arxiv.org/abs/2104.08663", }