M-A-D/Mixed-Arabic-Dataset-Main-Test

---
dataset_info:
features:
- name: GenId
dtype: int64
- name: SubId
dtype: int64
- name: DatasetName
dtype: string
- name: DatasetLink
dtype: string
- name: Text
dtype: string
- name: MetaData
struct:
- name: AboutAuthor
dtype: 'null'
- name: AboutBook
dtype: 'null'
- name: Author
dtype: 'null'
- name: AuthorName
dtype: 'null'
- name: BookLink
dtype: 'null'
- name: BookName
dtype: 'null'
- name: ChapterLink
dtype: 'null'
- name: ChapterName
dtype: 'null'
- name: Tags
dtype: 'null'
- name: __index_level_0__
dtype: float64
- name: created_date
dtype: string
- name: deleted
dtype: bool
- name: detoxify
dtype: 'null'
- name: emojis
struct:
- name: count
sequence: int32
- name: name
sequence: string
- name: id
dtype: string
- name: labels
struct:
- name: count
sequence: int32
- name: name
sequence: string
- name: value
sequence: float64
- name: lang
dtype: string
- name: message_id
dtype: string
- name: message_tree_id
dtype: string
- name: model_name
dtype: 'null'
- name: parent_id
dtype: string
- name: query_id
dtype: 'null'
- name: rank
dtype: float64
- name: review_count
dtype: float64
- name: review_result
dtype: bool
- name: role
dtype: string
- name: synthetic
dtype: bool
- name: title
dtype: 'null'
- name: tree_state
dtype: string
- name: url
dtype: 'null'
- name: user_id
dtype: string
- name: ConcatenatedText
dtype: int64
splits:
- name: train
num_bytes: 96491917
num_examples: 71935
download_size: 37192033
dataset_size: 96491917
configs:
- config_name: default
data_files:
- split: train
path: data/train-*
---
# Dataset Card for "Mixed-Arabic-Dataset-Main-Test"

[More Information needed](https://github.com/huggingface/datasets/blob/main/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

原始信息汇总

数据集概述

特征信息

• GenId: 数据类型为 int64
• SubId: 数据类型为 int64
• DatasetName: 数据类型为 string
• DatasetLink: 数据类型为 string
• Text: 数据类型为 string
• MetaData: 结构化数据，包含以下字段：
  • AboutAuthor: 数据类型为 null
  • AboutBook: 数据类型为 null
  • Author: 数据类型为 null
  • AuthorName: 数据类型为 null
  • BookLink: 数据类型为 null
  • BookName: 数据类型为 null
  • ChapterLink: 数据类型为 null
  • ChapterName: 数据类型为 null
  • Tags: 数据类型为 null
  • index_level_0: 数据类型为 float64
  • created_date: 数据类型为 string
  • deleted: 数据类型为 bool
  • detoxify: 数据类型为 null
  • emojis: 结构化数据，包含以下字段：
    • count: 数据类型为 int32
    • name: 数据类型为 string
  • id: 数据类型为 string
  • labels: 结构化数据，包含以下字段：
    • count: 数据类型为 int32
    • name: 数据类型为 string
    • value: 数据类型为 float64
  • lang: 数据类型为 string
  • message_id: 数据类型为 string
  • message_tree_id: 数据类型为 string
  • model_name: 数据类型为 null
  • parent_id: 数据类型为 string
  • query_id: 数据类型为 null
  • rank: 数据类型为 float64
  • review_count: 数据类型为 float64
  • review_result: 数据类型为 bool
  • role: 数据类型为 string
  • synthetic: 数据类型为 bool
  • title: 数据类型为 null
  • tree_state: 数据类型为 string
  • url: 数据类型为 null
  • user_id: 数据类型为 string
• ConcatenatedText: 数据类型为 int64

数据分割

• train: 包含 71935 个样本，占用 96491917 字节

数据集大小

• 下载大小: 37192033 字节
• 数据集大小: 96491917 字节

配置信息

• config_name: default
  • data_files:
    • split: train
    • path: data/train-*