Avelina/smollm-corpus-cleaned
收藏官方服务:
资源简介:
SmolLM-Corpus洗牌分片版本,包含三个子集:cosmopedia-v2、fineweb-edu-dedup和python-edu,经过交织、洗牌处理,分为23698个jsonl.zst格式的文件,每个文件包含大约10000个文本数据。
Shuffled and sharded version of SmolLM-Corpus, containing three subsets: cosmopedia-v2, fineweb-edu-dedup, and python-edu, interwoven and shuffled into 23698 jsonl.zst files, each containing about 10,000 text entries.
提供机构:
Avelina


