skandermoalla/qrpo-paper-mistral-sft-magpieair-armorm-temp1-ref50-offpolicy2best-armorm

--- license: mit tags: - reinforcement-learning - alignment - qrpo --- # qrpo-paper-mistral-sft-magpieair-armorm-temp1-ref50-offpolicy2best-armorm Dataset with reference completions and rewards for a specific model and reward model, ready for training with the **QRPO reference codebase** (https://github.com/CLAIRE-Labo/quantile-reward-policy-optimization). Part of the dataset collection for the paper **Quantile Reward Policy Optimization: Alignment with Pointwise Regression and Exact Partition Functions** (https://arxiv.org/pdf/2507.08068).--- 许可证：MIT许可证 标签： - 强化学习 - 对齐 - QRPO（Quantile Reward Policy Optimization） --- # qrpo-paper-mistral-sft-magpieair-armorm-temp1-ref50-offpolicy2best-armorm 本数据集包含特定模型与奖励模型的参考补全内容及奖励值，可直接用于**QRPO参考代码库**（https://github.com/CLAIRE-Labo/quantile-reward-policy-optimization）的训练工作。 本数据集为论文《分位数奖励策略优化：基于逐点回归与精确配分函数的对齐》（Quantile Reward Policy Optimization: Alignment with Pointwise Regression and Exact Partition Functions，https://arxiv.org/pdf/2507.08068）的数据集集合的组成部分。