DAPO-Math-17k-Processed

# Dataset Card for DAPO-Math-17k-Processed

This is a processed version of [BytedTsinghua-SIA/DAPO-Math-17k](https://huggingface.co/datasets/BytedTsinghua-SIA/DAPO-Math-17k) where we have:

* Deduplicated the prompts
* Reformatted the prompts and ground truth answers to be compatible with TRL's GRPO trainer

We have also derived pure English and Chinese subsets.

The full dataset processing logic can be found in create_dataset.py.

If you find this dataset useful in your work, please cite the original source with:

```
@misc{yu2025dapoopensourcellmreinforcement,
title={DAPO: An Open-Source LLM Reinforcement Learning System at Scale},
author={Qiying Yu and Zheng Zhang and Ruofei Zhu and Yufeng Yuan and Xiaochen Zuo and Yu Yue and Tiantian Fan and Gaohong Liu and Lingjun Liu and Xin Liu and Haibin Lin and Zhiqi Lin and Bole Ma and Guangming Sheng and Yuxuan Tong and Chi Zhang and Mofan Zhang and Wang Zhang and Hang Zhu and Jinhua Zhu and Jiaze Chen and Jiangjie Chen and Chengyi Wang and Hongli Yu and Weinan Dai and Yuxuan Song and Xiangpeng Wei and Hao Zhou and Jingjing Liu and Wei-Ying Ma and Ya-Qin Zhang and Lin Yan and Mu Qiao and Yonghui Wu and Mingxuan Wang},
year={2025},
eprint={2503.14476},
archivePrefix={arXiv},
primaryClass={cs.LG},
url={https://arxiv.org/abs/2503.14476},
}
```

# DAPO-Math-17k-处理版 数据集卡片
本数据集为[BytedTsinghua-SIA/DAPO-Math-17k](https://huggingface.co/datasets/BytedTsinghua-SIA/DAPO-Math-17k)的处理版本，我们对其进行了如下操作：
* 对提示词（prompts）进行去重处理
* 重新格式化提示词与标准答案（ground truth answers），使其兼容TRL库的GRPO训练器

此外，我们还构建了纯英文与纯中文两个独立子集。

完整的数据集处理逻辑可在create_dataset.py文件中查阅。

若本数据集对您的研究工作有所助益，请引用如下原始文献：

@misc{yu2025dapoopensourcellmreinforcement,
title={DAPO：面向大规模部署的开源大语言模型强化学习系统},
author={Qiying Yu and Zheng Zhang and Ruofei Zhu and Yufeng Yuan and Xiaochen Zuo and Yu Yue and Tiantian Fan and Gaohong Liu and Lingjun Liu and Xin Liu and Haibin Lin and Zhiqi Lin and Bole Ma and Guangming Sheng and Yuxuan Tong and Chi Zhang and Mofan Zhang and Wang Zhang and Hang Zhu and Jinhua Zhu and Jiaze Chen and Jiangjie Chen and Chengyi Wang and Hongli Yu and Weinan Dai and Yuxuan Song and Xiangpeng Wei and Hao Zhou and Jingjing Liu and Wei-Ying Ma and Ya-Qin Zhang and Lin Yan and Mu Qiao and Yonghui Wu and Mingxuan Wang},
year={2025},
eprint={2503.14476},
archivePrefix={arXiv},
primaryClass={cs.LG},
url={https://arxiv.org/abs/2503.14476},
}

搜集汇总

背景与挑战

背景概述

该数据集是DAPO-Math-17k的处理版本，进行了提示去重和格式调整以兼容GRPO训练器，并包含纯英文和中文子集。