emozilla/dolma-v1_7-3B

---
license: odc-by
task_categories:
- text-generation
language:
- en
tags:
- language-modeling
- casual-lm
- llm
pretty_name: Dolma
size_categories:
- 1B<n<10B
---

This dataset is a 0.1% sample of [Dolma v1.7](https://huggingface.co/datasets/allenai/dolma), equating to around ~3B tokens and uploaded directly as a Hugging Face dataset.

As a pure sample, it maintains the [ODC-BY](https://opendatacommons.org/licenses/by/1-0/) license.

This is a 0.1% sample of the Dolma v1.7 dataset, containing approximately 3 billion tokens, primarily used for text generation tasks. The sample retains the ODC-BY license and is tagged as language modeling, casual language model, and large language model.

原始信息汇总

数据集概述

基本信息

• 名称: Dolma
• 许可证: ODC-BY
• 任务类别: 文本生成
• 语言: 英语
• 标签: 语言建模, 休闲语言模型, 大型语言模型
• 大小类别: 1B<n<10B

详细描述

• 来源: 该数据集是Dolma v1.7的0.1%样本。
• 规模: 约30亿个token。
• 上传平台: 直接上传至Hugging Face。
• 许可证: 保持ODC-BY许可证。