irds/beir_fever_dev

`beir/fever/dev`数据集由ir-datasets包提供，主要用于文本检索任务。数据集中包含6,666个查询（即主题）和8,079个相关性评估（qrels）。文档部分需要从`irds/beir_fever`数据集中获取。

原始信息汇总

数据集概述

数据集名称

beir/fever/dev

数据来源

• 源数据集：irds/beir_fever

数据内容

• queries（查询，即主题）：数量为6,666
• qrels（相关性评估）：数量为8,079
• docs：使用数据集irds/beir_fever

使用方法

python from datasets import load_dataset

queries = load_dataset(irds/beir_fever_dev, queries) for record in queries: record # {query_id: ..., text: ...}

qrels = load_dataset(irds/beir_fever_dev, qrels) for record in qrels: record # {query_id: ..., doc_id: ..., relevance: ..., iteration: ...}

引用信息

@inproceedings{Thorne2018Fever, title = "{FEVER}: a Large-scale Dataset for Fact Extraction and {VER}ification", author = "Thorne, James and Vlachos, Andreas and Christodoulopoulos, Christos and Mittal, Arpit", booktitle = "Proceedings of the 2018 Conference of the North {A}merican Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers)", month = jun, year = "2018", address = "New Orleans, Louisiana", publisher = "Association for Computational Linguistics", url = "https://www.aclweb.org/anthology/N18-1074", doi = "10.18653/v1/N18-1074", pages = "809--819" } @article{Thakur2021Beir, title = "BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models", author = "Thakur, Nandan and Reimers, Nils and Rücklé, Andreas and Srivastava, Abhishek and Gurevych, Iryna", journal= "arXiv preprint arXiv:2104.08663", month = "4", year = "2021", url = "https://arxiv.org/abs/2104.08663", }