LoneWolfgang/FineWeb

这是FineWeb的日本语部分，已经预处理以便于选择教育内容。主要文件为preprocessed/jpn_Jpan.parquet，包含字段：域名(domain)、页面数量(count)、顶级域名(tld)。中间文件包含两个字目录：stripped和grouped，分别包含不同的字段信息。This is the Japanese segment of FineWeb, preprocessed to streamline the task of selecting educational content. The main file is preprocessed/jpn_Jpan.parquet, which includes the fields: domain, count, and tld. The intermediate files are located in two subdirectories: stripped and grouped, each containing different field information.