irds/beir_climate-fever

`beir/climate-fever`数据集由`ir-datasets`包提供，主要用于信息检索任务。该数据集包含三部分数据：文档（corpus）、查询（topics）和相关性评估（relevance assessments）。文档部分包含5,416,593条记录，查询部分包含1,535条记录，相关性评估部分包含4,681条记录。数据集可用于验证真实世界的气候声明，并支持零样本信息检索模型的评估。

The `beir/climate-fever` dataset, provided by the `ir-datasets` package, is primarily designed for information retrieval tasks. This dataset comprises three components: the corpus (documents), topics (queries), and relevance assessments. The corpus contains 5,416,593 records, the topics include 1,535 entries, and the relevance assessments consist of 4,681 records. This dataset can be used to validate real-world climate claims and support the evaluation of zero-shot information retrieval models.

原始信息汇总

数据集概述

数据集名称

beir/climate-fever

数据集来源

由ir-datasets包提供。

数据集内容

• 文档（docs）: 总计5,416,593个文档。
• 查询（queries）: 总计1,535个查询。
• 相关性评估（qrels）: 总计4,681个相关性评估。

数据集使用示例

python from datasets import load_dataset

docs = load_dataset(irds/beir_climate-fever, docs) for record in docs: record # {doc_id: ..., text: ..., title: ...}

queries = load_dataset(irds/beir_climate-fever, queries) for record in queries: record # {query_id: ..., text: ...}

qrels = load_dataset(irds/beir_climate-fever, qrels) for record in qrels: record # {query_id: ..., doc_id: ..., relevance: ..., iteration: ...}

引用信息

@article{Diggelmann2020CLIMATEFEVERAD, title={CLIMATE-FEVER: A Dataset for Verification of Real-World Climate Claims}, author={T. Diggelmann and Jordan L. Boyd-Graber and Jannis Bulian and Massimiliano Ciaramita and Markus Leippold}, journal={ArXiv}, year={2020}, volume={abs/2012.00614} } @article{Thakur2021Beir, title = "BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models", author = "Thakur, Nandan and Reimers, Nils and Rücklé, Andreas and Srivastava, Abhishek and Gurevych, Iryna", journal= "arXiv preprint arXiv:2104.08663", month = "4", year = "2021", url = "https://arxiv.org/abs/2104.08663", }