sade-adrien/redpajama_v2_32k

---
dataset_info:
features:
- name: raw_content
dtype: string
- name: doc_id
dtype: string
- name: meta
dtype: string
- name: quality_signals
dtype: string
splits:
- name: train
num_bytes: 3919516915.1525173
num_examples: 364920
download_size: 18972252318
dataset_size: 3919516915.1525173
---
# Dataset Card for "redpajama_v2_32k"

[More Information needed](https://github.com/huggingface/datasets/blob/main/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

The dataset redpajama_v2_32k includes four features: raw_content (text content), doc_id (document ID), meta (metadata), and quality_signals (quality signals), all of which are of string type. The dataset is divided into a training set, which is 3919516915.1525173 bytes in size and contains 364920 samples. The total download size of the dataset is 18972252318 bytes, and the actual size of the dataset is 3919516915.1525173 bytes.

原始信息汇总

数据集卡片 "redpajama_v2_32k"

数据集信息

特征

• raw_content: 数据类型为字符串。
• doc_id: 数据类型为字符串。
• meta: 数据类型为字符串。
• quality_signals: 数据类型为字符串。

分割

• train:
  • 字节数: 3919516915.1525173
  • 样本数: 364920

大小

• 下载大小: 18972252318
• 数据集大小: 3919516915.1525173