kakaobrain/kor_nlu

---
annotations_creators:
- found
language_creators:
- expert-generated
- found
- machine-generated
language:
- ko
license:
- cc-by-sa-4.0
multilinguality:
- monolingual
size_categories:
- 100K<n<1M
source_datasets:
- extended|snli
task_categories:
- text-classification
task_ids:
- natural-language-inference
- semantic-similarity-scoring
- text-scoring
pretty_name: KorNlu
dataset_info:
- config_name: nli
features:
- name: premise
dtype: string
- name: hypothesis
dtype: string
- name: label
dtype:
class_label:
names:
'0': entailment
'1': neutral
'2': contradiction
splits:
- name: train
num_bytes: 80135707
num_examples: 550146
- name: validation
num_bytes: 318170
num_examples: 1570
- name: test
num_bytes: 1047250
num_examples: 4954
download_size: 80030037
dataset_size: 81501127
- config_name: sts
features:
- name: genre
dtype:
class_label:
names:
'0': main-news
'1': main-captions
'2': main-forum
'3': main-forums
- name: filename
dtype:
class_label:
names:
'0': images
'1': MSRpar
'2': MSRvid
'3': headlines
'4': deft-forum
'5': deft-news
'6': track5.en-en
'7': answers-forums
'8': answer-answer
- name: year
dtype:
class_label:
names:
'0': '2017'
'1': '2016'
'2': '2013'
'3': 2012train
'4': '2014'
'5': '2015'
'6': 2012test
- name: id
dtype: int32
- name: score
dtype: float32
- name: sentence1
dtype: string
- name: sentence2
dtype: string
splits:
- name: train
num_bytes: 1056664
num_examples: 5703
- name: validation
num_bytes: 305009
num_examples: 1471
- name: test
num_bytes: 249671
num_examples: 1379
download_size: 1603824
dataset_size: 1611344
---

# Dataset Card for [Dataset Name]

## Table of Contents
- [Dataset Description](#dataset-description)
- [Dataset Summary](#dataset-summary)
- [Supported Tasks and Leaderboards](#supported-tasks-and-leaderboards)
- [Languages](#languages)
- [Dataset Structure](#dataset-structure)
- [Data Instances](#data-instances)
- [Data Fields](#data-fields)
- [Data Splits](#data-splits)
- [Dataset Creation](#dataset-creation)
- [Curation Rationale](#curation-rationale)
- [Source Data](#source-data)
- [Annotations](#annotations)
- [Personal and Sensitive Information](#personal-and-sensitive-information)
- [Considerations for Using the Data](#considerations-for-using-the-data)
- [Social Impact of Dataset](#social-impact-of-dataset)
- [Discussion of Biases](#discussion-of-biases)
- [Other Known Limitations](#other-known-limitations)
- [Additional Information](#additional-information)
- [Dataset Curators](#dataset-curators)
- [Licensing Information](#licensing-information)
- [Citation Information](#citation-information)
- [Contributions](#contributions)

## Dataset Description

- **Homepage:** [Github](https://github.com/kakaobrain/KorNLUDatasets)
- **Repository:** [Github](https://github.com/kakaobrain/KorNLUDatasets)
- **Paper:** [Arxiv](https://arxiv.org/abs/2004.03289)
- **Leaderboard:**
- **Point of Contact:**

### Dataset Summary

[More Information Needed]

### Supported Tasks and Leaderboards

[More Information Needed]

### Languages

[More Information Needed]

## Dataset Structure

### Data Instances

[More Information Needed]

### Data Fields

[More Information Needed]

### Data Splits

[More Information Needed]

## Dataset Creation

### Curation Rationale

[More Information Needed]

### Source Data

#### Initial Data Collection and Normalization

[More Information Needed]

#### Who are the source language producers?

[More Information Needed]

### Annotations

#### Annotation process

[More Information Needed]

#### Who are the annotators?

[More Information Needed]

### Personal and Sensitive Information

[More Information Needed]

## Considerations for Using the Data

### Social Impact of Dataset

[More Information Needed]

### Discussion of Biases

[More Information Needed]

### Other Known Limitations

[More Information Needed]

## Additional Information

### Dataset Curators

[More Information Needed]

### Licensing Information

[More Information Needed]

### Citation Information

[More Information Needed]
### Contributions

Thanks to [@sumanthd17](https://github.com/sumanthd17) for adding this dataset.

原始信息汇总

数据集概述

基本信息

• 数据集名称: KorNlu
• 语言: 韩语
• 许可: CC-BY-SA-4.0
• 多语言性: 单语种
• 数据集大小: 100K<n<1M
• 源数据集: 扩展自SNLI

任务类别

• 文本分类
• 自然语言推理
• 语义相似度评分
• 文本评分

数据集结构

配置: nli

• 特征:
  • premise: 字符串
  • hypothesis: 字符串
  • label: 类别标签
    • 0: 蕴含
    • 1: 中性
    • 2: 矛盾
• 数据分割:
  • train: 80135707 字节, 550146 样本
  • validation: 318170 字节, 1570 样本
  • test: 1047250 字节, 4954 样本
• 下载大小: 80030037 字节
• 数据集大小: 81501127 字节

配置: sts

• 特征:
  • genre: 类别标签
    • 0: 主要新闻
    • 1: 主要标题
    • 2: 主要论坛
    • 3: 主要论坛
  • filename: 类别标签
    • 0: 图片
    • 1: MSRpar
    • 2: MSRvid
    • 3: 标题
    • 4: deft-forum
    • 5: deft-news
    • 6: track5.en-en
    • 7: answers-forums
    • 8: answer-answer
  • year: 类别标签
    • 0: 2017
    • 1: 2016
    • 2: 2013
    • 3: 2012train
    • 4: 2014
    • 5: 2015
    • 6: 2012test
  • id: 整数
  • score: 浮点数
  • sentence1: 字符串
  • sentence2: 字符串
• 数据分割:
  • train: 1056664 字节, 5703 样本
  • validation: 305009 字节, 1471 样本
  • test: 249671 字节, 1379 样本
• 下载大小: 1603824 字节
• 数据集大小: 1611344 字节