agentlans/fineweb-english-regions

FineWeb English Regions是一个英语语言数据集，按地区划分，包含多个国家或地区的配置，如澳大利亚、加拿大、英国、印度等。每个配置对应一个数据文件（格式为jsonl.zst），数据分割为训练集。数据集提供了每个地区的行数统计，例如英国有514,673行，新西兰有40,448行。数据集可能用于自然语言处理任务，如文本分析、区域语言建模等，但具体内容（如文本来源、主题等）未在README中详细说明。

FineWeb English Regions is an English-language dataset organized by regions, including configurations for multiple countries or regions such as Australia, Canada, United Kingdom, India, and others. Each configuration corresponds to a data file (in jsonl.zst format) with a train split. The dataset provides row counts for each region, for example, United Kingdom has 514,673 rows, New Zealand has 40,448 rows. It may be used for natural language processing tasks like text analysis or regional language modeling, but specific details (e.g., data source, content topics) are not elaborated in the README.