HRM-Text-data-io-cleaned-20260515

Pre-built HRM-Text pretraining dataset from raw data using the [data_io](https://github.com/sapientinc/data_io) cleaning scripts. ## Citation If you find this project or our paper useful, please consider citing our paper: ``` @misc{wang2026hrmtextefficientpretrainingscaling, title={HRM-Text: Efficient Pretraining Beyond Scaling}, author={Guan Wang and Changling Liu and Chenyu Wang and Cai Zhou and Yuhao Sun and Yifei Wu and Shuai Zhen and Luca Scimeca and Yasin Abbasi Yadkori}, year={2026}, eprint={2605.20613}, archivePrefix={arXiv}, primaryClass={cs.CL}, url={https://arxiv.org/abs/2605.20613}, } ```