hfl/cmrc2018
收藏资源简介:
该数据集是一个用于中文机器阅读理解的任务,旨在增加该领域的语言多样性。数据集包含近20,000个从维基百科段落中提取的真实问题,并由人类专家进行标注。此外,还包含一个挑战集,其中的问题需要综合理解和多句子推理。数据集分为训练集、验证集和测试集,每个数据实例包含id、context、question和answers字段。
This dataset is designed for the Chinese machine reading comprehension task, aiming to enhance linguistic diversity in this field. It contains nearly 20,000 authentic questions extracted from Wikipedia paragraphs, which are annotated by human experts. Additionally, it includes a challenge set where the questions require comprehensive comprehension and multi-sentence reasoning. The dataset is split into training, validation and test sets, and each data instance contains the fields of id, context, question and answers.
数据集概述
基本信息
- 名称: Chinese Machine Reading Comprehension 2018 (cmrc2018)
- 语言: 中文 (zh)
- 许可证: cc-by-sa-4.0
- 多语言性: 单语种
- 大小: 10K<n<100K
- 源数据: 原创数据
- 任务类别: 问答 (question-answering)
- 任务ID: extractive-qa
- 论文代码ID: cmrc-2018
数据集结构
- 特征:
id: 字符串类型context: 字符串类型question: 字符串类型answers: 字典类型,包含:text: 字符串类型answer_start: 整数类型 (int32)
- 数据分割:
train: 10142 个样本validation: 3219 个样本test: 1002 个样本
数据集创建
- 注释创建者: 众包
- 语言创建者: 众包
数据集大小
- 下载大小: 11.50 MB
- 数据集大小: 22.31 MB
引用信息
@inproceedings{cui-emnlp2019-cmrc2018, title = "A Span-Extraction Dataset for {C}hinese Machine Reading Comprehension", author = "Cui, Yiming and Liu, Ting and Che, Wanxiang and Xiao, Li and Chen, Zhipeng and Ma, Wentao and Wang, Shijin and Hu, Guoping", booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)", month = nov, year = "2019", address = "Hong Kong, China", publisher = "Association for Computational Linguistics", url = "https://www.aclweb.org/anthology/D19-1600", doi = "10.18653/v1/D19-1600", pages = "5886--5891", }




