ola13/c4-clusters

--- dataset_info: features: - name: text dtype: string - name: timestamp dtype: string - name: url dtype: string - name: meta struct: - name: perplexity_score dtype: float64 - name: text_length dtype: int64 - name: domain dtype: 'null' - name: perplexity dtype: float64 - name: dup_ratio dtype: float64 - name: pairs sequence: sequence: int64 - name: repetitions sequence: binary - name: cluster sequence: int64 splits: - name: train num_bytes: 1061375955254 num_examples: 364868892 download_size: 137201241092 dataset_size: 1061375955254 --- # Dataset Card for "c4-clusters" [More Information needed](https://github.com/huggingface/datasets/blob/main/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

原始信息汇总

数据集概述

数据集名称

c4-clusters

数据集特征

• text: 字符串类型
• timestamp: 字符串类型
• url: 字符串类型
• meta: 结构体类型，包含以下字段：
  • perplexity_score: 浮点数类型
• text_length: 整数类型
• domain: 空值类型
• perplexity: 浮点数类型
• dup_ratio: 浮点数类型
• pairs: 序列类型，序列元素为整数类型
• repetitions: 序列类型，序列元素为二进制类型
• cluster: 序列类型，序列元素为整数类型

数据集分割

• train: 训练集
  • num_bytes: 1061375955254字节
  • num_examples: 364868892个样本

数据集大小

• download_size: 137201241092字节
• dataset_size: 1061375955254字节