Thaweewat/oasst1_th

--- dataset_info: - config_name: default features: - name: message_id dtype: string - name: parent_id dtype: string - name: user_id dtype: string - name: created_date dtype: string - name: text dtype: string - name: text_th dtype: string - name: role dtype: string - name: lang dtype: string - name: review_count dtype: int32 - name: review_result dtype: bool - name: deleted dtype: bool - name: rank dtype: float64 - name: synthetic dtype: bool - name: model_name dtype: 'null' - name: detoxify struct: - name: identity_attack dtype: float64 - name: insult dtype: float64 - name: obscene dtype: float64 - name: severe_toxicity dtype: float64 - name: sexual_explicit dtype: float64 - name: threat dtype: float64 - name: toxicity dtype: float64 - name: message_tree_id dtype: string - name: tree_state dtype: string - name: emojis struct: - name: count sequence: int32 - name: name sequence: string - name: labels struct: - name: count sequence: int32 - name: name sequence: string - name: value sequence: float64 splits: - name: train num_bytes: 10381992 num_examples: 4401 download_size: 0 dataset_size: 10381992 - config_name: train features: - name: message_id dtype: string - name: parent_id dtype: string - name: user_id dtype: string - name: created_date dtype: string - name: text dtype: string - name: text_th dtype: string - name: role dtype: string - name: lang dtype: string - name: review_count dtype: int32 - name: review_result dtype: bool - name: deleted dtype: bool - name: rank dtype: float64 - name: synthetic dtype: bool - name: model_name dtype: 'null' - name: detoxify struct: - name: identity_attack dtype: float64 - name: insult dtype: float64 - name: obscene dtype: float64 - name: severe_toxicity dtype: float64 - name: sexual_explicit dtype: float64 - name: threat dtype: float64 - name: toxicity dtype: float64 - name: message_tree_id dtype: string - name: tree_state dtype: string - name: emojis struct: - name: count sequence: int32 - name: name sequence: string - name: labels struct: - name: count sequence: int32 - name: name sequence: string - name: value sequence: float64 - name: __index_level_0__ dtype: int64 splits: - name: train num_bytes: 200135278 num_examples: 84437 download_size: 75167235 dataset_size: 200135278 - config_name: val features: - name: message_id dtype: string - name: parent_id dtype: string - name: user_id dtype: string - name: created_date dtype: string - name: text dtype: string - name: text_th dtype: string - name: role dtype: string - name: lang dtype: string - name: review_count dtype: int32 - name: review_result dtype: bool - name: deleted dtype: bool - name: rank dtype: float64 - name: synthetic dtype: bool - name: model_name dtype: 'null' - name: detoxify struct: - name: identity_attack dtype: float64 - name: insult dtype: float64 - name: obscene dtype: float64 - name: severe_toxicity dtype: float64 - name: sexual_explicit dtype: float64 - name: threat dtype: float64 - name: toxicity dtype: float64 - name: message_tree_id dtype: string - name: tree_state dtype: string - name: emojis struct: - name: count sequence: int32 - name: name sequence: string - name: labels struct: - name: count sequence: int32 - name: name sequence: string - name: value sequence: float64 splits: - name: train num_bytes: 10381992 num_examples: 4401 download_size: 3907352 dataset_size: 10381992 configs: - config_name: train data_files: - split: train path: train/train-* - config_name: val data_files: - split: train path: val/train-* language: - th --- # Dataset Card for "oasst1_th" [More Information needed](https://github.com/huggingface/datasets/blob/main/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

原始信息汇总

数据集概述

数据集配置

• default

  • 特征:
    • message_id: 字符串
    • parent_id: 字符串
    • user_id: 字符串
    • created_date: 字符串
    • text: 字符串
    • text_th: 字符串
    • role: 字符串
    • lang: 字符串
    • review_count: 32位整数
    • review_result: 布尔值
    • deleted: 布尔值
    • rank: 64位浮点数
    • synthetic: 布尔值
    • model_name: null
    • detoxify: 结构体
      • identity_attack: 64位浮点数
      • insult: 64位浮点数
      • obscene: 64位浮点数
      • severe_toxicity: 64位浮点数
      • sexual_explicit: 64位浮点数
      • threat: 64位浮点数
      • toxicity: 64位浮点数
    • message_tree_id: 字符串
    • tree_state: 字符串
    • emojis: 结构体
      • count: 序列化的32位整数
      • name: 序列化的字符串
    • labels: 结构体
      • count: 序列化的32位整数
      • name: 序列化的字符串
      • value: 序列化的64位浮点数
  • 分割:
    • train
      • 字节数: 10381992
      • 样本数: 4401
  • 下载大小: 0
  • 数据集大小: 10381992

• train

  • 特征:
    • message_id: 字符串
    • parent_id: 字符串
    • user_id: 字符串
    • created_date: 字符串
    • text: 字符串
    • text_th: 字符串
    • role: 字符串
    • lang: 字符串
    • review_count: 32位整数
    • review_result: 布尔值
    • deleted: 布尔值
    • rank: 64位浮点数
    • synthetic: 布尔值
    • model_name: null
    • detoxify: 结构体
      • identity_attack: 64位浮点数
      • insult: 64位浮点数
      • obscene: 64位浮点数
      • severe_toxicity: 64位浮点数
      • sexual_explicit: 64位浮点数
      • threat: 64位浮点数
      • toxicity: 64位浮点数
    • message_tree_id: 字符串
    • tree_state: 字符串
    • emojis: 结构体
      • count: 序列化的32位整数
      • name: 序列化的字符串
    • labels: 结构体
      • count: 序列化的32位整数
      • name: 序列化的字符串
      • value: 序列化的64位浮点数
    • __index_level_0__: 64位整数
  • 分割:
    • train
      • 字节数: 200135278
      • 样本数: 84437
  • 下载大小: 75167235
  • 数据集大小: 200135278

• val

  • 特征:
    • message_id: 字符串
    • parent_id: 字符串
    • user_id: 字符串
    • created_date: 字符串
    • text: 字符串
    • text_th: 字符串
    • role: 字符串
    • lang: 字符串
    • review_count: 32位整数
    • review_result: 布尔值
    • deleted: 布尔值
    • rank: 64位浮点数
    • synthetic: 布尔值
    • model_name: null
    • detoxify: 结构体
      • identity_attack: 64位浮点数
      • insult: 64位浮点数
      • obscene: 64位浮点数
      • severe_toxicity: 64位浮点数
      • sexual_explicit: 64位浮点数
      • threat: 64位浮点数
      • toxicity: 64位浮点数
    • message_tree_id: 字符串
    • tree_state: 字符串
    • emojis: 结构体
      • count: 序列化的32位整数
      • name: 序列化的字符串
    • labels: 结构体
      • count: 序列化的32位整数
      • name: 序列化的字符串
      • value: 序列化的64位浮点数
  • 分割:
    • train
      • 字节数: 10381992
      • 样本数: 4401
  • 下载大小: 3907352
  • 数据集大小: 10381992

数据文件配置

• train
  • 数据文件:
    • split: train
    • path: train/train-*
• val
  • 数据文件:
    • split: train
    • path: val/train-*

语言

• 泰语 (th)