five

lightonai/NanoBEIR-pt

收藏
Hugging Face2025-12-10 更新2025-12-20 收录
下载链接:
https://hf-mirror.com/datasets/lightonai/NanoBEIR-pt
下载链接
链接失效反馈
官方服务:
资源简介:
--- dataset_info: - config_name: corpus features: - name: _id dtype: string - name: text dtype: string splits: - name: NanoClimateFEVER num_bytes: 6000608 num_examples: 3408 - name: NanoDBPedia num_bytes: 2437556 num_examples: 6045 - name: NanoFEVER num_bytes: 6518656 num_examples: 4996 - name: NanoFiQA2018 num_bytes: 4679793 num_examples: 4598 - name: NanoHotpotQA num_bytes: 2048685 num_examples: 5090 - name: NanoMSMARCO num_bytes: 1869617 num_examples: 5043 - name: NanoNFCorpus num_bytes: 5071806 num_examples: 2953 - name: NanoNQ num_bytes: 2929253 num_examples: 5035 - name: NanoQuoraRetrieval num_bytes: 394871 num_examples: 5046 - name: NanoSCIDOCS num_bytes: 2449916 num_examples: 2210 - name: NanoArguAna num_bytes: 4151660 num_examples: 3635 - name: NanoSciFact num_bytes: 4757499 num_examples: 2919 - name: NanoTouche2020 num_bytes: 13672460 num_examples: 5745 download_size: 33007867 dataset_size: 56982380 - config_name: qrels features: - name: query-id dtype: string - name: corpus-id dtype: string splits: - name: NanoClimateFEVER num_bytes: 4361 num_examples: 148 - name: NanoDBPedia num_bytes: 60640 num_examples: 1158 - name: NanoFEVER num_bytes: 1630 num_examples: 57 - name: NanoFiQA2018 num_bytes: 2200 num_examples: 123 - name: NanoHotpotQA num_bytes: 3885 num_examples: 100 - name: NanoMSMARCO num_bytes: 1065 num_examples: 50 - name: NanoNFCorpus num_bytes: 64851 num_examples: 2518 - name: NanoNQ num_bytes: 1340 num_examples: 57 - name: NanoQuoraRetrieval num_bytes: 1359 num_examples: 70 - name: NanoSCIDOCS num_bytes: 21472 num_examples: 244 - name: NanoArguAna num_bytes: 3496 num_examples: 50 - name: NanoSciFact num_bytes: 1054 num_examples: 56 - name: NanoTouche2020 num_bytes: 45452 num_examples: 932 download_size: 91853 dataset_size: 212805 - config_name: queries features: - name: _id dtype: string - name: text dtype: string splits: - name: NanoClimateFEVER num_bytes: 8190 num_examples: 50 - name: NanoDBPedia num_bytes: 2953 num_examples: 50 - name: NanoFEVER num_bytes: 3189 num_examples: 50 - name: NanoFiQA2018 num_bytes: 4306 num_examples: 50 - name: NanoHotpotQA num_bytes: 6243 num_examples: 50 - name: NanoMSMARCO num_bytes: 2815 num_examples: 50 - name: NanoNFCorpus num_bytes: 2282 num_examples: 50 - name: NanoNQ num_bytes: 3435 num_examples: 50 - name: NanoQuoraRetrieval num_bytes: 3491 num_examples: 50 - name: NanoSCIDOCS num_bytes: 6727 num_examples: 50 - name: NanoArguAna num_bytes: 61690 num_examples: 50 - name: NanoSciFact num_bytes: 6045 num_examples: 50 - name: NanoTouche2020 num_bytes: 2960 num_examples: 49 download_size: 100732 dataset_size: 114326 configs: - config_name: corpus data_files: - split: NanoClimateFEVER path: corpus/NanoClimateFEVER-* - split: NanoDBPedia path: corpus/NanoDBPedia-* - split: NanoFEVER path: corpus/NanoFEVER-* - split: NanoFiQA2018 path: corpus/NanoFiQA2018-* - split: NanoHotpotQA path: corpus/NanoHotpotQA-* - split: NanoMSMARCO path: corpus/NanoMSMARCO-* - split: NanoNFCorpus path: corpus/NanoNFCorpus-* - split: NanoNQ path: corpus/NanoNQ-* - split: NanoQuoraRetrieval path: corpus/NanoQuoraRetrieval-* - split: NanoSCIDOCS path: corpus/NanoSCIDOCS-* - split: NanoArguAna path: corpus/NanoArguAna-* - split: NanoSciFact path: corpus/NanoSciFact-* - split: NanoTouche2020 path: corpus/NanoTouche2020-* - config_name: qrels data_files: - split: NanoClimateFEVER path: qrels/NanoClimateFEVER-* - split: NanoDBPedia path: qrels/NanoDBPedia-* - split: NanoFEVER path: qrels/NanoFEVER-* - split: NanoFiQA2018 path: qrels/NanoFiQA2018-* - split: NanoHotpotQA path: qrels/NanoHotpotQA-* - split: NanoMSMARCO path: qrels/NanoMSMARCO-* - split: NanoNFCorpus path: qrels/NanoNFCorpus-* - split: NanoNQ path: qrels/NanoNQ-* - split: NanoQuoraRetrieval path: qrels/NanoQuoraRetrieval-* - split: NanoSCIDOCS path: qrels/NanoSCIDOCS-* - split: NanoArguAna path: qrels/NanoArguAna-* - split: NanoSciFact path: qrels/NanoSciFact-* - split: NanoTouche2020 path: qrels/NanoTouche2020-* - config_name: queries data_files: - split: NanoClimateFEVER path: queries/NanoClimateFEVER-* - split: NanoDBPedia path: queries/NanoDBPedia-* - split: NanoFEVER path: queries/NanoFEVER-* - split: NanoFiQA2018 path: queries/NanoFiQA2018-* - split: NanoHotpotQA path: queries/NanoHotpotQA-* - split: NanoMSMARCO path: queries/NanoMSMARCO-* - split: NanoNFCorpus path: queries/NanoNFCorpus-* - split: NanoNQ path: queries/NanoNQ-* - split: NanoQuoraRetrieval path: queries/NanoQuoraRetrieval-* - split: NanoSCIDOCS path: queries/NanoSCIDOCS-* - split: NanoArguAna path: queries/NanoArguAna-* - split: NanoSciFact path: queries/NanoSciFact-* - split: NanoTouche2020 path: queries/NanoTouche2020-* default: true ---

### 数据集信息 本数据集包含三个核心配置项: 1. **配置名称:corpus(语料库配置)** 本配置的特征字段包括: - `_id`:数据类型为字符串(string) - `text`:数据类型为字符串(string) 该配置下的数据集划分及详情如下: - NanoClimateFEVER:占用字节数6000608,样本量3408 - NanoDBPedia:占用字节数2437556,样本量6045 - NanoFEVER:占用字节数6518656,样本量4996 - NanoFiQA2018:占用字节数4679793,样本量4598 - NanoHotpotQA:占用字节数2048685,样本量5090 - NanoMSMARCO:占用字节数1869617,样本量5043 - NanoNFCorpus:占用字节数5071806,样本量2953 - NanoNQ:占用字节数2929253,样本量5035 - NanoQuoraRetrieval:占用字节数394871,样本量5046 - NanoSCIDOCS:占用字节数2449916,样本量2210 - NanoArguAna:占用字节数4151660,样本量3635 - NanoSciFact:占用字节数4757499,样本量2919 - NanoTouche2020:占用字节数13672460,样本量5745 本配置总下载大小为33007867字节,总数据集占用大小为56982380字节。 2. **配置名称:qrels(查询相关性标注配置)** 本配置的特征字段包括: - `query-id`:数据类型为字符串(string) - `corpus-id`:数据类型为字符串(string) 该配置下的数据集划分及详情如下: - NanoClimateFEVER:占用字节数4361,样本量148 - NanoDBPedia:占用字节数60640,样本量1158 - NanoFEVER:占用字节数1630,样本量57 - NanoFiQA2018:占用字节数2200,样本量123 - NanoHotpotQA:占用字节数3885,样本量100 - NanoMSMARCO:占用字节数1065,样本量50 - NanoNFCorpus:占用字节数64851,样本量2518 - NanoNQ:占用字节数1340,样本量57 - NanoQuoraRetrieval:占用字节数1359,样本量70 - NanoSCIDOCS:占用字节数21472,样本量244 - NanoArguAna:占用字节数3496,样本量50 - NanoSciFact:占用字节数1054,样本量56 - NanoTouche2020:占用字节数45452,样本量932 本配置总下载大小为91853字节,总数据集占用大小为212805字节。 3. **配置名称:queries(查询语句配置)** 本配置的特征字段包括: - `_id`:数据类型为字符串(string) - `text`:数据类型为字符串(string) 该配置下的数据集划分及详情如下: - NanoClimateFEVER:占用字节数8190,样本量50 - NanoDBPedia:占用字节数2953,样本量50 - NanoFEVER:占用字节数3189,样本量50 - NanoFiQA2018:占用字节数4306,样本量50 - NanoHotpotQA:占用字节数6243,样本量50 - NanoMSMARCO:占用字节数2815,样本量50 - NanoNFCorpus:占用字节数2282,样本量50 - NanoNQ:占用字节数3435,样本量50 - NanoQuoraRetrieval:占用字节数3491,样本量50 - NanoSCIDOCS:占用字节数6727,样本量50 - NanoArguAna:占用字节数61690,样本量50 - NanoSciFact:占用字节数6045,样本量50 - NanoTouche2020:占用字节数2960,样本量49 本配置总下载大小为100732字节,总数据集占用大小为114326字节。 ### 数据集配置项 本数据集的配置项详情如下: 1. **配置名称:corpus** 数据文件对应路径为: - 划分NanoClimateFEVER:`corpus/NanoClimateFEVER-*` - 划分NanoDBPedia:`corpus/NanoDBPedia-*` - 划分NanoFEVER:`corpus/NanoFEVER-*` - 划分NanoFiQA2018:`corpus/NanoFiQA2018-*` - 划分NanoHotpotQA:`corpus/NanoHotpotQA-*` - 划分NanoMSMARCO:`corpus/NanoMSMARCO-*` - 划分NanoNFCorpus:`corpus/NanoNFCorpus-*` - 划分NanoNQ:`corpus/NanoNQ-*` - 划分NanoQuoraRetrieval:`corpus/NanoQuoraRetrieval-*` - 划分NanoSCIDOCS:`corpus/NanoSCIDOCS-*` - 划分NanoArguAna:`corpus/NanoArguAna-*` - 划分NanoSciFact:`corpus/NanoSciFact-*` - 划分NanoTouche2020:`corpus/NanoTouche2020-*` 2. **配置名称:qrels** 数据文件对应路径为: - 划分NanoClimateFEVER:`qrels/NanoClimateFEVER-*` - 划分NanoDBPedia:`qrels/NanoDBPedia-*` - 划分NanoFEVER:`qrels/NanoFEVER-*` - 划分NanoFiQA2018:`qrels/NanoFiQA2018-*` - 划分NanoHotpotQA:`qrels/NanoHotpotQA-*` - 划分NanoMSMARCO:`qrels/NanoMSMARCO-*` - 划分NanoNFCorpus:`qrels/NanoNFCorpus-*` - 划分NanoNQ:`qrels/NanoNQ-*` - 划分NanoQuoraRetrieval:`qrels/NanoQuoraRetrieval-*` - 划分NanoSCIDOCS:`qrels/NanoSCIDOCS-*` - 划分NanoArguAna:`qrels/NanoArguAna-*` - 划分NanoSciFact:`qrels/NanoSciFact-*` - 划分NanoTouche2020:`qrels/NanoTouche2020-*` 3. **配置名称:queries** 数据文件对应路径为: - 划分NanoClimateFEVER:`queries/NanoClimateFEVER-*` - 划分NanoDBPedia:`queries/NanoDBPedia-*` - 划分NanoFEVER:`queries/NanoFEVER-*` - 划分NanoFiQA2018:`queries/NanoFiQA2018-*` - 划分NanoHotpotQA:`queries/NanoHotpotQA-*` - 划分NanoMSMARCO:`queries/NanoMSMARCO-*` - 划分NanoNFCorpus:`queries/NanoNFCorpus-*` - 划分NanoNQ:`queries/NanoNQ-*` - 划分NanoQuoraRetrieval:`queries/NanoQuoraRetrieval-*` - 划分NanoSCIDOCS:`queries/NanoSCIDOCS-*` - 划分NanoArguAna:`queries/NanoArguAna-*` - 划分NanoSciFact:`queries/NanoSciFact-*` - 划分NanoTouche2020:`queries/NanoTouche2020-*` 本数据集默认启用配置为`corpus`。
提供机构:
lightonai
二维码
社区交流群
二维码
科研交流群
商业服务