sagels/longmino_256k_filtered

longmino_filtered数据集是Dolma 3 Longmino Pool数据经过简单过滤后的分片版本，按子集（如2e15、2e16、8k_32k、synth_cwe、synth_rex）分子文件夹存放。数据以gzip压缩的JSONL文件格式存储，无需转换为Parquet即可配合Hugging Face datasets库使用。每条样本包含text（正文）、id（文档标识）、source、added、created和metadata（嵌套元数据）等字段。该数据集主要用于个人研究或训练，非官方发行物，遵循上游的Open Data Commons Attribution License v1.0（ODC-By）许可。The longmino_filtered dataset is a filtered and sharded version of the Dolma 3 Longmino Pool data, organized into subfolders by subset (e.g., 2e15, 2e16, 8k_32k, synth_cwe, synth_rex). The data is stored in gzip-compressed JSONL files and can be used directly with the Hugging Face datasets library without conversion to Parquet. Each sample includes fields such as text (content), id (document identifier), source, added, created, and metadata (nested metadata). This dataset is primarily intended for personal research or training, is not an official release, and follows the upstream Open Data Commons Attribution License v1.0 (ODC-By).