five

pyterrier/fever.retromae.flex

收藏
Hugging Face2024-10-13 更新2025-04-26 收录
下载链接:
https://hf-mirror.com/datasets/pyterrier/fever.retromae.flex
下载链接
链接失效反馈
官方服务:
资源简介:
--- # pretty_name: "" # Example: "MS MARCO Terrier Index" tags: - pyterrier - pyterrier-artifact - pyterrier-artifact.dense_index - pyterrier-artifact.dense_index.flex task_categories: - text-retrieval viewer: false --- # fever.retromae.flex ## Description RetroMAE index for Fever ## Usage ```python # Load the artifact import pyterrier_alpha as pta artifact = pta.Artifact.from_hf('pyterrier/fever.retromae.flex') artifact.np_retriever() ``` ## Benchmarks `fever/dev` | name | nDCG@10 | R@1000 | |:----------|----------:|---------:| | np (flat) | 0.719 | 0.9578 | `fever/test` | name | nDCG@10 | R@1000 | |:----------|----------:|---------:| | np (flat) | 0.688 | 0.9615 | ## Reproduction ```python import pyterrier as pt from tqdm import tqdm import ir_datasets from pyterrier_dr import FlexIndex, RetroMAE pipeline = RetroMAE.msmarco_distill() >> FlexIndex("fever.retromae.flex") dataset = ir_datasets.load('beir/fever') docs = ({'docno': d.doc_id, 'text': d.default_text()} for d in tqdm(dataset.docs)) pipeline.index(docs) ``` ## Metadata ``` { "type": "dense_index", "format": "flex", "vec_size": 768, "doc_count": 5416568 } ```
提供机构:
pyterrier
5,000+
优质数据集
54 个
任务类型
进入经典数据集
二维码
社区交流群

面向社区/商业的数据集话题

二维码
科研交流群

面向高校/科研机构的开源数据集话题

数据驱动未来

携手共赢发展

商业合作