procit001/new_loaded_dataset

该数据集包含四个主要特征：id、tokens、pos_tags和chunk_tags、ner_tags。其中，pos_tags、chunk_tags和ner_tags是序列类型，并且每个标签都有对应的类别名称。数据集分为训练集、验证集和测试集，每个部分都有相应的字节大小和示例数量。此外，还提供了数据集的下载大小和总大小。

This dataset is primarily used for natural language processing tasks, specifically part-of-speech tagging, chunking, and named entity recognition. It includes four main features: id (string type), tokens (string sequence), pos_tags (part-of-speech tag sequence), chunk_tags (chunk tag sequence), and ner_tags (named entity recognition tag sequence). Each feature has detailed tag names and corresponding codes. The dataset is divided into training, validation, and test sets, each containing different numbers of samples and bytes. The dataset configuration files specify the paths of the various data files.

原始信息汇总

数据集概述

数据集特征

• id: 字符串类型
• tokens: 字符串序列
• pos_tags: 词性标签序列
  • 标签名称及其对应编码：
    • 0: "
    • 1:
    • 2: #
    • 3: $
    • 4: (
    • 5: )
    • 6: ,
    • 7: .
    • 8: :
    • 9: ``
    • 10: CC
    • 11: CD
    • 12: DT
    • 13: EX
    • 14: FW
    • 15: IN
    • 16: JJ
    • 17: JJR
    • 18: JJS
    • 19: LS
    • 20: MD
    • 21: NN
    • 22: NNP
    • 23: NNPS
    • 24: NNS
    • 25: NN|SYM
    • 26: PDT
    • 27: POS
    • 28: PRP
    • 29: PRP$
    • 30: RB
    • 31: RBR
    • 32: RBS
    • 33: RP
    • 34: SYM
    • 35: TO
    • 36: UH
    • 37: VB
    • 38: VBD
    • 39: VBG
    • 40: VBN
    • 41: VBP
    • 42: VBZ
    • 43: WDT
    • 44: WP
    • 45: WP$
    • 46: WRB
• chunk_tags: 短语标签序列
  • 标签名称及其对应编码：
    • 0: O
    • 1: B-ADJP
    • 2: I-ADJP
    • 3: B-ADVP
    • 4: I-ADVP
    • 5: B-CONJP
    • 6: I-CONJP
    • 7: B-INTJ
    • 8: I-INTJ
    • 9: B-LST
    • 10: I-LST
    • 11: B-NP
    • 12: I-NP
    • 13: B-PP
    • 14: I-PP
    • 15: B-PRT
    • 16: I-PRT
    • 17: B-SBAR
    • 18: I-SBAR
    • 19: B-UCP
    • 20: I-UCP
    • 21: B-VP
    • 22: I-VP
• ner_tags: 命名实体标签序列
  • 标签名称及其对应编码：
    • 0: O
    • 1: B-PER
    • 2: I-PER
    • 3: B-ORG
    • 4: I-ORG
    • 5: B-LOC
    • 6: I-LOC
    • 7: B-MISC
    • 8: I-MISC

数据集分割

• train: 包含124708个样本，大小为9741149字节
• validation: 包含15589个样本，大小为1215061字节
• test: 包含15589个样本，大小为1217405字节

数据集大小

• 下载大小: 3597222字节
• 数据集总大小: 12173615字节

配置

• config_name: default
  • 数据文件路径：
    • train: data/train-*
    • validation: data/validation-*
    • test: data/test-*