procit001/dataset_NER

该数据集包含文本数据的多个标注信息，包括词性标注（pos_tags）、短语标注（chunk_tags）和命名实体识别标注（ner_tags）。数据集分为训练集、验证集和测试集，分别包含454850、56856和56857个样本。数据集的下载大小为15351340字节，总大小为49583937.99999999字节。

This dataset contains multiple annotation information for text data, including part-of-speech tags (pos_tags), chunk tags (chunk_tags), and named entity recognition tags (ner_tags). The dataset is divided into training, validation, and test sets, containing 454850, 56856, and 56857 samples respectively. The download size of the dataset is 15351340 bytes, and the total size is 49583937.99999999 bytes.

原始信息汇总

数据集概述

数据集特征

• id: 字符串类型
• tokens: 字符串序列
• pos_tags: 词性标签序列
  • 标签名称:
    • 0: "
    • 1:
    • 2: #
    • 3: $
    • 4: (
    • 5: )
    • 6: ,
    • 7: .
    • 8: :
    • 9: ``
    • 10: CC
    • 11: CD
    • 12: DT
    • 13: EX
    • 14: FW
    • 15: IN
    • 16: JJ
    • 17: JJR
    • 18: JJS
    • 19: LS
    • 20: MD
    • 21: NN
    • 22: NNP
    • 23: NNPS
    • 24: NNS
    • 25: NN|SYM
    • 26: PDT
    • 27: POS
    • 28: PRP
    • 29: PRP$
    • 30: RB
    • 31: RBR
    • 32: RBS
    • 33: RP
    • 34: SYM
    • 35: TO
    • 36: UH
    • 37: VB
    • 38: VBD
    • 39: VBG
    • 40: VBN
    • 41: VBP
    • 42: VBZ
    • 43: WDT
    • 44: WP
    • 45: WP$
    • 46: WRB
• chunk_tags: 短语结构标签序列
  • 标签名称:
    • 0: O
    • 1: B-ADJP
    • 2: I-ADJP
    • 3: B-ADVP
    • 4: I-ADVP
    • 5: B-CONJP
    • 6: I-CONJP
    • 7: B-INTJ
    • 8: I-INTJ
    • 9: B-LST
    • 10: I-LST
    • 11: B-NP
    • 12: I-NP
    • 13: B-PP
    • 14: I-PP
    • 15: B-PRT
    • 16: I-PRT
    • 17: B-SBAR
    • 18: I-SBAR
    • 19: B-UCP
    • 20: I-UCP
    • 21: B-VP
    • 22: I-VP
• ner_tags: 命名实体标签序列
  • 标签名称:
    • 0: O
    • 1: B-PER
    • 2: I-PER
    • 3: B-ORG
    • 4: I-ORG
    • 5: B-LOC
    • 6: I-LOC
    • 7: B-MISC
    • 8: I-MISC

数据集划分

• train:
  • 样本数量: 454850
  • 字节数: 39667115.516310416
• validation:
  • 样本数量: 56856
  • 字节数: 4958367.637232813
• test:
  • 样本数量: 56857
  • 字节数: 4958454.846456769

数据集大小

• 下载大小: 15351340 字节
• 数据集总大小: 49583937.99999999 字节

配置

• config_name: default
  • 数据文件路径:
    • train: data/train-*
    • validation: data/validation-*
    • test: data/test-*