procit001/conll2003susantest

该数据集包含文本数据，每个样本具有唯一的id、文本序列（tokens）、词性标注序列（pos_tags）、短语标注序列（chunk_tags）和命名实体识别标签（ner_tags）。数据集分为训练集、验证集和测试集，分别包含14041、3250和3453个样本。数据集的下载大小为1822978字节，总大小为10252622字节。

This dataset contains text data, with each sample having a unique id, a sequence of tokens, a sequence of part-of-speech tags (pos_tags), a sequence of chunk tags (chunk_tags), and named entity recognition tags (ner_tags). The dataset is divided into training, validation, and test sets, containing 14041, 3250, and 3453 samples respectively. The download size of the dataset is 1822978 bytes, and the total size is 10252622 bytes.

原始信息汇总

数据集概述

数据集特征

• id: 字符串类型
• tokens: 字符串序列
• pos_tags: 词性标签序列
  • 标签名称:
    • 0: "
    • 1:
    • 2: #
    • 3: $
    • 4: (
    • 5: )
    • 6: ,
    • 7: .
    • 8: :
    • 9: ``
    • 10: CC
    • 11: CD
    • 12: DT
    • 13: EX
    • 14: FW
    • 15: IN
    • 16: JJ
    • 17: JJR
    • 18: JJS
    • 19: LS
    • 20: MD
    • 21: NN
    • 22: NNP
    • 23: NNPS
    • 24: NNS
    • 25: NN|SYM
    • 26: PDT
    • 27: POS
    • 28: PRP
    • 29: PRP$
    • 30: RB
    • 31: RBR
    • 32: RBS
    • 33: RP
    • 34: SYM
    • 35: TO
    • 36: UH
    • 37: VB
    • 38: VBD
    • 39: VBG
    • 40: VBN
    • 41: VBP
    • 42: VBZ
    • 43: WDT
    • 44: WP
    • 45: WP$
    • 46: WRB
• chunk_tags: 短语标签序列
  • 标签名称:
    • 0: O
    • 1: B-ADJP
    • 2: I-ADJP
    • 3: B-ADVP
    • 4: I-ADVP
    • 5: B-CONJP
    • 6: I-CONJP
    • 7: B-INTJ
    • 8: I-INTJ
    • 9: B-LST
    • 10: I-LST
    • 11: B-NP
    • 12: I-NP
    • 13: B-PP
    • 14: I-PP
    • 15: B-PRT
    • 16: I-PRT
    • 17: B-SBAR
    • 18: I-SBAR
    • 19: B-UCP
    • 20: I-UCP
    • 21: B-VP
    • 22: I-VP
• ner_tags: 命名实体标签序列
  • 标签名称:
    • 0: O
    • 1: B-PER
    • 2: I-PER
    • 3: B-ORG
    • 4: I-ORG
    • 5: B-LOC
    • 6: I-LOC
    • 7: B-MISC
    • 8: I-MISC

数据集划分

• train:
  • 字节数: 6931345
  • 样本数: 14041
• validation:
  • 字节数: 1739223
  • 样本数: 3250
• test:
  • 字节数: 1582054
  • 样本数: 3453

数据集大小

• 下载大小: 1822978 字节
• 数据集总大小: 10252622 字节

配置

• config_name: default
  • 数据文件路径:
    • train: data/train-*
    • validation: data/validation-*
    • test: data/test-*