pyterrier/climate-fever.retromae.flex

--- # pretty_name: "" # Example: "MS MARCO Terrier Index" tags: - pyterrier - pyterrier-artifact - pyterrier-artifact.dense_index - pyterrier-artifact.dense_index.flex task_categories: - text-retrieval viewer: false --- # climate-fever.retromae.flex ## Description RetroMAE index for Climate-Fever ## Usage ```python # Load the artifact import pyterrier_alpha as pta artifact = pta.Artifact.from_hf('pyterrier/climate-fever.retromae.flex') artifact.np_retriever() ``` ## Benchmarks `climate-fever` | name | nDCG@10 | R@1000 | |:----------|----------:|---------:| | np (flat) | 0.1967 | 0.6945 | ## Reproduction ```python import pyterrier as pt from tqdm import tqdm import ir_datasets from pyterrier_dr import FlexIndex, RetroMAE pipeline = RetroMAE.msmarco_distill() >> FlexIndex("climate-fever.retromae.flex") dataset = ir_datasets.load('beir/climate-fever') docs = ({'docno': d.doc_id, 'text': d.default_text()} for d in tqdm(dataset.docs)) pipeline.index(docs) ``` ## Metadata ``` { "type": "dense_index", "format": "flex", "vec_size": 768, "doc_count": 5416593 } ```