gair-prox/open-web-math-pro
收藏Hugging Face2024-09-26 更新2024-12-14 收录
下载链接:
https://hf-mirror.com/datasets/gair-prox/open-web-math-pro
下载链接
链接失效反馈官方服务:
资源简介:
Open-Web-Math-Pro数据集是从open-web-math数据集通过ProX精炼框架精炼而来的,包含约50亿个高质量数学相关标记,适用于预训练。该数据集基于ODC-By 1.0许可证,用户还需遵守CommonCrawl的使用条款。
Open-Web-Math-Pro is refined from the open-web-math dataset using the ProX refining framework. It contains about 5 billion high-quality math-related tokens, ready for pre-training. The dataset is based on the ODC-By 1.0 license, and users should also abide by the CommonCrawl Terms of Use.
提供机构:
gair-prox



