Tiiny/PowerMath

--- license: apache-2.0 --- This repository contains approximately 10 billion tokens of pretrain data generated using Qwen2.5-14B-Instruct. The dataset utilizes a [MGA-style](https://arxiv.org/abs/2502.04235) methodology to create diverse and comprehensive training data from the [MegaMath](https://huggingface.co/datasets/LLM360/MegaMath) dataset. The dataset is available under the Apache 2.0 license. # Bias, Risks, and Limitations - This dataset is mainly in English. - The dataset inherits the biases, errors, and omissions known to exist in data used for seed sources and models used for data generation. - The dataset is synthetically generated and hence may contain inaccuracies that do not accurately reflect real-world phenomena. - The synthetic nature of this dataset may limit its ability to generalize to real-world cases.