taeminlee/Ko-mrtydi
收藏Hugging Face2024-01-19 更新2024-03-04 收录
下载链接:
https://hf-mirror.com/datasets/taeminlee/Ko-mrtydi
下载链接
链接失效反馈官方服务:
资源简介:
---
language:
- ko
multilinguality:
- monolingual
size_categories:
- 1K<n<10K
source_datasets:
- mrtydi
task_categories:
- text-retrieval
task_ids:
- document-retrieval
config_names:
- default
- queries
- corpus
tags:
- text-retrieval
dataset_info:
- config_name: default
features:
- name: query-id
dtype: string
- name: corpus-id
dtype: string
- name: score
dtype: float64
splits:
- name: train
num_bytes: 34828
num_examples: 1317
- name: dev
num_bytes: 8121
num_examples: 307
- name: test
num_bytes: 13482
num_examples: 492
- config_name: corpus
features:
- name: _id
dtype: string
- name: title
dtype: string
- name: text
dtype: string
splits:
- name: corpus
num_bytes: 609925549
num_examples: 1496126
- config_name: queries
features:
- name: _id
dtype: string
- name: text
dtype: string
splits:
- name: queries
num_bytes: 135944
num_examples: 2019
configs:
- config_name: default
data_files:
- split: train
path: qrels/train.jsonl
- split: dev
path: qrels/dev.jsonl
- split: test
path: qrels/test.jsonl
- config_name: corpus
data_files:
- split: corpus
path: corpus.jsonl
- config_name: queries
data_files:
- split: queries
path: queries.jsonl
---
# Ko-mrtydi
This dataset represents a conversion of the Korean (Ko) section from the [Mr.TyDI dataset](https://github.com/castorini/mr.tydi) into the [BeIR](https://github.com/beir-cellar/beir) format, making it compatible for use with [mteb](https://github.com/embeddings-benchmark/mteb).
提供机构:
taeminlee
原始信息汇总
数据集概述
基本信息
- 语言: 韩语 (ko)
- 多语言性: 单语种 (monolingual)
- 数据集大小: 1K<n<10K
- 源数据集: mrtydi
- 任务类别: 文本检索 (text-retrieval)
- 任务ID: 文档检索 (document-retrieval)
- 配置名称: default, queries, corpus
- 标签: 文本检索 (text-retrieval)
数据集配置详情
配置名称: default
- 特征:
query-id: 字符串 (string)corpus-id: 字符串 (string)score: 浮点数 (float64)
- 分割:
train: 34828 字节, 1317 个样本dev: 8121 字节, 307 个样本test: 13482 字节, 492 个样本
配置名称: corpus
- 特征:
_id: 字符串 (string)title: 字符串 (string)text: 字符串 (string)
- 分割:
corpus: 609925549 字节, 1496126 个样本
配置名称: queries
- 特征:
_id: 字符串 (string)text: 字符串 (string)
- 分割:
queries: 135944 字节, 2019 个样本
数据文件配置
配置名称: default
- 数据文件:
train: qrels/train.jsonldev: qrels/dev.jsonltest: qrels/test.jsonl
配置名称: corpus
- 数据文件:
corpus: corpus.jsonl
配置名称: queries
- 数据文件:
queries: queries.jsonl



