gair-prox/open-web-math-pro

Open-Web-Math-Pro数据集是从open-web-math数据集通过ProX精炼框架精炼而来的，包含约50亿个高质量数学相关标记，适用于预训练。该数据集基于ODC-By 1.0许可证，用户还需遵守CommonCrawl的使用条款。Open-Web-Math-Pro is refined from the open-web-math dataset using the ProX refining framework. It contains about 5 billion high-quality math-related tokens, ready for pre-training. The dataset is based on the ODC-By 1.0 license, and users should also abide by the CommonCrawl Terms of Use.