tomaarsen/conll2003

CoNLL-2003数据集是一个用于命名实体识别（NER）任务的数据集，专注于识别四种类型的命名实体：人名、地名、组织名以及其他不属于前三类的实体。数据集包含训练集、验证集和测试集，分别包含14041、3250和3453个样本。每个样本包含id、document_id、sentence_id、tokens、pos_tags、chunk_tags和ner_tags等字段。数据集使用了IOB2标记方案，而不是原始的IOB1方案。

The CoNLL-2003 dataset is a standard dataset for named entity recognition (NER) tasks, focusing on identifying four types of named entities: persons, locations, organizations, and miscellaneous entities that do not fall into the first three categories. It comprises training, validation, and test sets with 14,041, 3,250, and 3,453 samples respectively. Each sample contains fields including id, document_id, sentence_id, tokens, pos_tags, chunk_tags, and ner_tags. The dataset adopts the IOB2 tagging scheme instead of the original IOB1 scheme.

原始信息汇总

数据集概述

名称: CoNLL-2003

语言: 英语 (en)

许可证: 其他

多语言性: 单语

大小: 10K<n<100K

源数据集: 扩展自其他-reuters-corpus

任务类别: 词元分类

任务ID:

• 命名实体识别
• 词性标注

论文代码ID: conll-2003

配置名称: conll2003

数据集结构

数据实例

数据集包含以下字段:

• id: 字符串类型
• tokens: 字符串序列
• pos_tags: 分类标签序列，包含以下标签:
  • ", ``, #, $, (, ), ,, ., :, , CC, CD, DT, EX, FW, IN, JJ, JJR, JJS, LS, MD, NN, NNP, NNPS, NNS, NN|SYM, PDT, POS, PRP, PRP$, RB, RBR, RBS, RP, SYM, TO, UH, VB, VBD, VBG, VBN, VBP, VBZ, WDT, WP, WP$, WRB`
• chunk_tags: 分类标签序列，包含以下标签:
  • O, B-ADJP, I-ADJP, B-ADVP, I-ADVP, B-CONJP, I-CONJP, B-INTJ, I-INTJ, B-LST, I-LST, B-NP, I-NP, B-PP, I-PP, B-PRT, I-PRT, B-SBAR, I-SBAR, B-UCP, I-UCP, B-VP, I-VP
• ner_tags: 分类标签序列，包含以下标签:
  • O, B-PER, I-PER, B-ORG, I-ORG, B-LOC, I-LOC, B-MISC, I-MISC

数据分割

名称	训练	验证	测试
conll2003	14041	3250	3453

数据集创建

许可证信息

数据集的版权信息来源于CoNLL2003 shared task和Reuters Corpus page。使用数据集需遵守相关版权协议。

引用信息

@inproceedings{tjong-kim-sang-de-meulder-2003-introduction, title = "Introduction to the {C}o{NLL}-2003 Shared Task: Language-Independent Named Entity Recognition", author = "Tjong Kim Sang, Erik F. and De Meulder, Fien", booktitle = "Proceedings of the Seventh Conference on Natural Language Learning at {HLT}-{NAACL} 2003", year = "2003", url = "https://www.aclweb.org/anthology/W03-0419", pages = "142--147", }