luca-g97/dolma-v1_7-50B-second-phase

这个数据集基于原始的AllenAI Dolma数据集，包含了用于OLMo第二阶段训练的源数据的估计分割。它包含了多种来源，如Flan、Open Web Math、Stack Exchange、Star Coder、Dolma Reddit、Refined Web、Algebraic Stack、Semantic Scholar、Project Gutenberg和Wikipedia Wikibooks。数据集的大小和示例数量也有提供，同时还给出了源的估计分割及其百分比。元数据允许用户动态选择要下载的部分。

This dataset is based on the original AllenAI Dolma dataset and contains the estimated split of sources used for the second phase of training OLMo. It includes various sources such as Flan, Open Web Math, Stack Exchange, Star Coder, Dolma Reddit, Refined Web, Algebraic Stack, Semantic Scholar, Project Gutenberg, and Wikipedia Wikibooks. The dataset size and number of examples are also provided, along with the estimated split of sources and their percentages. The metadata allows users to dynamically select which parts to download.