lightonai/NanoBEIR-pt
收藏Hugging Face2025-12-10 更新2025-12-20 收录
下载链接:
https://hf-mirror.com/datasets/lightonai/NanoBEIR-pt
下载链接
链接失效反馈官方服务:
资源简介:
---
dataset_info:
- config_name: corpus
features:
- name: _id
dtype: string
- name: text
dtype: string
splits:
- name: NanoClimateFEVER
num_bytes: 6000608
num_examples: 3408
- name: NanoDBPedia
num_bytes: 2437556
num_examples: 6045
- name: NanoFEVER
num_bytes: 6518656
num_examples: 4996
- name: NanoFiQA2018
num_bytes: 4679793
num_examples: 4598
- name: NanoHotpotQA
num_bytes: 2048685
num_examples: 5090
- name: NanoMSMARCO
num_bytes: 1869617
num_examples: 5043
- name: NanoNFCorpus
num_bytes: 5071806
num_examples: 2953
- name: NanoNQ
num_bytes: 2929253
num_examples: 5035
- name: NanoQuoraRetrieval
num_bytes: 394871
num_examples: 5046
- name: NanoSCIDOCS
num_bytes: 2449916
num_examples: 2210
- name: NanoArguAna
num_bytes: 4151660
num_examples: 3635
- name: NanoSciFact
num_bytes: 4757499
num_examples: 2919
- name: NanoTouche2020
num_bytes: 13672460
num_examples: 5745
download_size: 33007867
dataset_size: 56982380
- config_name: qrels
features:
- name: query-id
dtype: string
- name: corpus-id
dtype: string
splits:
- name: NanoClimateFEVER
num_bytes: 4361
num_examples: 148
- name: NanoDBPedia
num_bytes: 60640
num_examples: 1158
- name: NanoFEVER
num_bytes: 1630
num_examples: 57
- name: NanoFiQA2018
num_bytes: 2200
num_examples: 123
- name: NanoHotpotQA
num_bytes: 3885
num_examples: 100
- name: NanoMSMARCO
num_bytes: 1065
num_examples: 50
- name: NanoNFCorpus
num_bytes: 64851
num_examples: 2518
- name: NanoNQ
num_bytes: 1340
num_examples: 57
- name: NanoQuoraRetrieval
num_bytes: 1359
num_examples: 70
- name: NanoSCIDOCS
num_bytes: 21472
num_examples: 244
- name: NanoArguAna
num_bytes: 3496
num_examples: 50
- name: NanoSciFact
num_bytes: 1054
num_examples: 56
- name: NanoTouche2020
num_bytes: 45452
num_examples: 932
download_size: 91853
dataset_size: 212805
- config_name: queries
features:
- name: _id
dtype: string
- name: text
dtype: string
splits:
- name: NanoClimateFEVER
num_bytes: 8190
num_examples: 50
- name: NanoDBPedia
num_bytes: 2953
num_examples: 50
- name: NanoFEVER
num_bytes: 3189
num_examples: 50
- name: NanoFiQA2018
num_bytes: 4306
num_examples: 50
- name: NanoHotpotQA
num_bytes: 6243
num_examples: 50
- name: NanoMSMARCO
num_bytes: 2815
num_examples: 50
- name: NanoNFCorpus
num_bytes: 2282
num_examples: 50
- name: NanoNQ
num_bytes: 3435
num_examples: 50
- name: NanoQuoraRetrieval
num_bytes: 3491
num_examples: 50
- name: NanoSCIDOCS
num_bytes: 6727
num_examples: 50
- name: NanoArguAna
num_bytes: 61690
num_examples: 50
- name: NanoSciFact
num_bytes: 6045
num_examples: 50
- name: NanoTouche2020
num_bytes: 2960
num_examples: 49
download_size: 100732
dataset_size: 114326
configs:
- config_name: corpus
data_files:
- split: NanoClimateFEVER
path: corpus/NanoClimateFEVER-*
- split: NanoDBPedia
path: corpus/NanoDBPedia-*
- split: NanoFEVER
path: corpus/NanoFEVER-*
- split: NanoFiQA2018
path: corpus/NanoFiQA2018-*
- split: NanoHotpotQA
path: corpus/NanoHotpotQA-*
- split: NanoMSMARCO
path: corpus/NanoMSMARCO-*
- split: NanoNFCorpus
path: corpus/NanoNFCorpus-*
- split: NanoNQ
path: corpus/NanoNQ-*
- split: NanoQuoraRetrieval
path: corpus/NanoQuoraRetrieval-*
- split: NanoSCIDOCS
path: corpus/NanoSCIDOCS-*
- split: NanoArguAna
path: corpus/NanoArguAna-*
- split: NanoSciFact
path: corpus/NanoSciFact-*
- split: NanoTouche2020
path: corpus/NanoTouche2020-*
- config_name: qrels
data_files:
- split: NanoClimateFEVER
path: qrels/NanoClimateFEVER-*
- split: NanoDBPedia
path: qrels/NanoDBPedia-*
- split: NanoFEVER
path: qrels/NanoFEVER-*
- split: NanoFiQA2018
path: qrels/NanoFiQA2018-*
- split: NanoHotpotQA
path: qrels/NanoHotpotQA-*
- split: NanoMSMARCO
path: qrels/NanoMSMARCO-*
- split: NanoNFCorpus
path: qrels/NanoNFCorpus-*
- split: NanoNQ
path: qrels/NanoNQ-*
- split: NanoQuoraRetrieval
path: qrels/NanoQuoraRetrieval-*
- split: NanoSCIDOCS
path: qrels/NanoSCIDOCS-*
- split: NanoArguAna
path: qrels/NanoArguAna-*
- split: NanoSciFact
path: qrels/NanoSciFact-*
- split: NanoTouche2020
path: qrels/NanoTouche2020-*
- config_name: queries
data_files:
- split: NanoClimateFEVER
path: queries/NanoClimateFEVER-*
- split: NanoDBPedia
path: queries/NanoDBPedia-*
- split: NanoFEVER
path: queries/NanoFEVER-*
- split: NanoFiQA2018
path: queries/NanoFiQA2018-*
- split: NanoHotpotQA
path: queries/NanoHotpotQA-*
- split: NanoMSMARCO
path: queries/NanoMSMARCO-*
- split: NanoNFCorpus
path: queries/NanoNFCorpus-*
- split: NanoNQ
path: queries/NanoNQ-*
- split: NanoQuoraRetrieval
path: queries/NanoQuoraRetrieval-*
- split: NanoSCIDOCS
path: queries/NanoSCIDOCS-*
- split: NanoArguAna
path: queries/NanoArguAna-*
- split: NanoSciFact
path: queries/NanoSciFact-*
- split: NanoTouche2020
path: queries/NanoTouche2020-*
default: true
---
### 数据集信息
本数据集包含三个核心配置项:
1. **配置名称:corpus(语料库配置)**
本配置的特征字段包括:
- `_id`:数据类型为字符串(string)
- `text`:数据类型为字符串(string)
该配置下的数据集划分及详情如下:
- NanoClimateFEVER:占用字节数6000608,样本量3408
- NanoDBPedia:占用字节数2437556,样本量6045
- NanoFEVER:占用字节数6518656,样本量4996
- NanoFiQA2018:占用字节数4679793,样本量4598
- NanoHotpotQA:占用字节数2048685,样本量5090
- NanoMSMARCO:占用字节数1869617,样本量5043
- NanoNFCorpus:占用字节数5071806,样本量2953
- NanoNQ:占用字节数2929253,样本量5035
- NanoQuoraRetrieval:占用字节数394871,样本量5046
- NanoSCIDOCS:占用字节数2449916,样本量2210
- NanoArguAna:占用字节数4151660,样本量3635
- NanoSciFact:占用字节数4757499,样本量2919
- NanoTouche2020:占用字节数13672460,样本量5745
本配置总下载大小为33007867字节,总数据集占用大小为56982380字节。
2. **配置名称:qrels(查询相关性标注配置)**
本配置的特征字段包括:
- `query-id`:数据类型为字符串(string)
- `corpus-id`:数据类型为字符串(string)
该配置下的数据集划分及详情如下:
- NanoClimateFEVER:占用字节数4361,样本量148
- NanoDBPedia:占用字节数60640,样本量1158
- NanoFEVER:占用字节数1630,样本量57
- NanoFiQA2018:占用字节数2200,样本量123
- NanoHotpotQA:占用字节数3885,样本量100
- NanoMSMARCO:占用字节数1065,样本量50
- NanoNFCorpus:占用字节数64851,样本量2518
- NanoNQ:占用字节数1340,样本量57
- NanoQuoraRetrieval:占用字节数1359,样本量70
- NanoSCIDOCS:占用字节数21472,样本量244
- NanoArguAna:占用字节数3496,样本量50
- NanoSciFact:占用字节数1054,样本量56
- NanoTouche2020:占用字节数45452,样本量932
本配置总下载大小为91853字节,总数据集占用大小为212805字节。
3. **配置名称:queries(查询语句配置)**
本配置的特征字段包括:
- `_id`:数据类型为字符串(string)
- `text`:数据类型为字符串(string)
该配置下的数据集划分及详情如下:
- NanoClimateFEVER:占用字节数8190,样本量50
- NanoDBPedia:占用字节数2953,样本量50
- NanoFEVER:占用字节数3189,样本量50
- NanoFiQA2018:占用字节数4306,样本量50
- NanoHotpotQA:占用字节数6243,样本量50
- NanoMSMARCO:占用字节数2815,样本量50
- NanoNFCorpus:占用字节数2282,样本量50
- NanoNQ:占用字节数3435,样本量50
- NanoQuoraRetrieval:占用字节数3491,样本量50
- NanoSCIDOCS:占用字节数6727,样本量50
- NanoArguAna:占用字节数61690,样本量50
- NanoSciFact:占用字节数6045,样本量50
- NanoTouche2020:占用字节数2960,样本量49
本配置总下载大小为100732字节,总数据集占用大小为114326字节。
### 数据集配置项
本数据集的配置项详情如下:
1. **配置名称:corpus**
数据文件对应路径为:
- 划分NanoClimateFEVER:`corpus/NanoClimateFEVER-*`
- 划分NanoDBPedia:`corpus/NanoDBPedia-*`
- 划分NanoFEVER:`corpus/NanoFEVER-*`
- 划分NanoFiQA2018:`corpus/NanoFiQA2018-*`
- 划分NanoHotpotQA:`corpus/NanoHotpotQA-*`
- 划分NanoMSMARCO:`corpus/NanoMSMARCO-*`
- 划分NanoNFCorpus:`corpus/NanoNFCorpus-*`
- 划分NanoNQ:`corpus/NanoNQ-*`
- 划分NanoQuoraRetrieval:`corpus/NanoQuoraRetrieval-*`
- 划分NanoSCIDOCS:`corpus/NanoSCIDOCS-*`
- 划分NanoArguAna:`corpus/NanoArguAna-*`
- 划分NanoSciFact:`corpus/NanoSciFact-*`
- 划分NanoTouche2020:`corpus/NanoTouche2020-*`
2. **配置名称:qrels**
数据文件对应路径为:
- 划分NanoClimateFEVER:`qrels/NanoClimateFEVER-*`
- 划分NanoDBPedia:`qrels/NanoDBPedia-*`
- 划分NanoFEVER:`qrels/NanoFEVER-*`
- 划分NanoFiQA2018:`qrels/NanoFiQA2018-*`
- 划分NanoHotpotQA:`qrels/NanoHotpotQA-*`
- 划分NanoMSMARCO:`qrels/NanoMSMARCO-*`
- 划分NanoNFCorpus:`qrels/NanoNFCorpus-*`
- 划分NanoNQ:`qrels/NanoNQ-*`
- 划分NanoQuoraRetrieval:`qrels/NanoQuoraRetrieval-*`
- 划分NanoSCIDOCS:`qrels/NanoSCIDOCS-*`
- 划分NanoArguAna:`qrels/NanoArguAna-*`
- 划分NanoSciFact:`qrels/NanoSciFact-*`
- 划分NanoTouche2020:`qrels/NanoTouche2020-*`
3. **配置名称:queries**
数据文件对应路径为:
- 划分NanoClimateFEVER:`queries/NanoClimateFEVER-*`
- 划分NanoDBPedia:`queries/NanoDBPedia-*`
- 划分NanoFEVER:`queries/NanoFEVER-*`
- 划分NanoFiQA2018:`queries/NanoFiQA2018-*`
- 划分NanoHotpotQA:`queries/NanoHotpotQA-*`
- 划分NanoMSMARCO:`queries/NanoMSMARCO-*`
- 划分NanoNFCorpus:`queries/NanoNFCorpus-*`
- 划分NanoNQ:`queries/NanoNQ-*`
- 划分NanoQuoraRetrieval:`queries/NanoQuoraRetrieval-*`
- 划分NanoSCIDOCS:`queries/NanoSCIDOCS-*`
- 划分NanoArguAna:`queries/NanoArguAna-*`
- 划分NanoSciFact:`queries/NanoSciFact-*`
- 划分NanoTouche2020:`queries/NanoTouche2020-*`
本数据集默认启用配置为`corpus`。
提供机构:
lightonai


