tvu-vlinhd11/pretrain-dataset-raw-10M

--- license: apache-2.0 task_categories: - text-generation language: - en - vi tags: - pretrain - text-corpus - multilingual size_categories: - 1M<n<10M --- # Pretrain Dataset (Text) This dataset contains preprocessed text documents ready for LLM pretraining. ## Dataset Details | Property | Value | |----------|-------| | **Documents** | 10,000,000 | | **Processed** | 10000000 | | **Shards** | 21 | | **Created** | 2025-12-09 | ## Dataset Structure Each sample contains: - `text`: The document text - `source`: Source dataset identifier - `id`: Unique document ID ## Usage ```python from datasets import load_dataset dataset = load_dataset("tvu-vlinhd11/pretrain-dataset-raw-10M") train_data = dataset["train"] sample = train_data[0] text = sample["text"] ``` ## License Apache 2.0