liechticonsulting/filtered_apertus_pretrained
收藏Hugging Face2025-10-02 更新2025-10-25 收录
下载链接：
https://hf-mirror.com/datasets/liechticonsulting/filtered_apertus_pretrained
下载链接
链接失效反馈官方服务：
资源简介：
该数据集的描述在README文件中并未直接提供，但是脚本中引用了一个名为swiss-ai/apertus-pretrain-swiss的数据集。过滤标准是基于id列和text列中不存在特定的子字符串。数据集以流的方式处理，以节省内存，并写入名为filtered_apertus_pretrain_swiss.jsonl的文件中。
The README file does not provide an explicit description of the dataset, but it references a dataset named swiss-ai/apertus-pretrain-swiss. The filtering criteria are based on the absence of certain substrings in the id column and the text column. The dataset is processed in a streaming manner to save memory and is written to a file named filtered_apertus_pretrain_swiss.jsonl.
提供机构：
liechticonsulting
