kp7742/YALM-pretrain2-16M
收藏Hugging Face2025-03-21 更新2025-04-12 收录
下载链接：
https://hf-mirror.com/datasets/kp7742/YALM-pretrain2-16M
下载链接
链接失效反馈官方服务：
资源简介：
YALM预训练数据-2是一个包含英语、印地语和混合英语印地语（Hinglish）的数据集，用于语言建模任务和YALM（Yet Another Language Model）的开发。总样本数量约为1600万。数据集由多个来源组成，包括HuggingFaceFW/fineweb-edu、prince-canuma/fineweb-CC-MAIN-2024-10-1B-en和zicsx/mC4-Hindi-Cleaned等子数据集。
The YALM Pretraining Data - 2 is a mix of English, Hindi, and Hinglish from various sources for language modeling tasks and the development of YALM (Yet Another Language Model). It contains approximately 16 million samples. The dataset is composed of several sources, including sub-datasets like HuggingFaceFW/fineweb-edu, prince-canuma/fineweb-CC-MAIN-2024-10-1B-en, and zicsx/mC4-Hindi-Cleaned.
提供机构：
kp7742
