KETI-AIR/kor_commonsense_qa

---
configs:
- config_name: default
data_files:
- split: train
path: data/train-*
- split: validation
path: data/validation-*
- split: test
path: data/test-*
dataset_info:
features:
- name: data_index_by_user
dtype: int32
- name: id
dtype: string
- name: question
dtype: string
- name: question_concept
dtype: string
- name: choices
struct:
- name: text
sequence: string
- name: label
sequence: string
- name: answerKey
dtype: string
splits:
- name: train
num_bytes: 2642161
num_examples: 9741
- name: validation
num_bytes: 327694
num_examples: 1221
- name: test
num_bytes: 309213
num_examples: 1140
download_size: 1782280
dataset_size: 3279068
license: mit
---
# Dataset Card for "kor_commonsense_qa"

[More Information needed](https://github.com/huggingface/datasets/blob/main/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

# Source Data Citation Information
```
@inproceedings{talmor-etal-2019-commonsenseqa,
title = "{C}ommonsense{QA}: A Question Answering Challenge Targeting Commonsense Knowledge",
author = "Talmor, Alon and
Herzig, Jonathan and
Lourie, Nicholas and
Berant, Jonathan",
booktitle = "Proceedings of the 2019 Conference of the North {A}merican Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)",
month = jun,
year = "2019",
address = "Minneapolis, Minnesota",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/N19-1421",
doi = "10.18653/v1/N19-1421",
pages = "4149--4158",
archivePrefix = "arXiv",
eprint = "1811.00937",
primaryClass = "cs",
}
```

原始信息汇总

数据集概述

数据集名称

• kor_commonsense_qa

数据集配置

• 默认配置（default）
  • 训练集（train）：路径为 data/train-*
  • 验证集（validation）：路径为 data/validation-*
  • 测试集（test）：路径为 data/test-*

数据集特征

• data_index_by_user：类型为 int32
• id：类型为 string
• question：类型为 string
• question_concept：类型为 string
• choices：结构包含
  • text：序列类型为 string
  • label：序列类型为 string
• answerKey：类型为 string

数据集分割

• 训练集（train）
  • 字节数：2642161
  • 样本数：9741
• 验证集（validation）
  • 字节数：327694
  • 样本数：1221
• 测试集（test）
  • 字节数：309213
  • 样本数：1140

数据集大小

• 下载大小：1782280 字节
• 数据集大小：3279068 字节

许可证

• MIT 许可证

数据来源引用

@inproceedings{talmor-etal-2019-commonsenseqa, title = "{C}ommonsense{QA}: A Question Answering Challenge Targeting Commonsense Knowledge", author = "Talmor, Alon and Herzig, Jonathan and Lourie, Nicholas and Berant, Jonathan", booktitle = "Proceedings of the 2019 Conference of the North {A}merican Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)", month = jun, year = "2019", address = "Minneapolis, Minnesota", publisher = "Association for Computational Linguistics", url = "https://aclanthology.org/N19-1421", doi = "10.18653/v1/N19-1421", pages = "4149--4158", archivePrefix = "arXiv", eprint = "1811.00937", primaryClass = "cs", }