skandermoalla/qrpo-paper-llama-nosft-ultrafeedback-armorm-temp1-ref50-offpolicy2random-armorm
收藏Hugging Face2025-12-08 更新2025-12-20 收录
下载链接：
https://hf-mirror.com/datasets/skandermoalla/qrpo-paper-llama-nosft-ultrafeedback-armorm-temp1-ref50-offpolicy2random-armorm
下载链接
链接失效反馈官方服务：
资源简介：
---
license: mit
tags:
- reinforcement-learning
- alignment
- qrpo
---
# qrpo-paper-llama-nosft-ultrafeedback-armorm-temp1-ref50-offpolicy2random-armorm
Dataset with reference completions and rewards for a specific model and reward model, ready for training with the **QRPO reference codebase** (https://github.com/CLAIRE-Labo/quantile-reward-policy-optimization).
Part of the dataset collection for the paper **Quantile Reward Policy Optimization: Alignment with Pointwise Regression and Exact Partition Functions** (https://arxiv.org/pdf/2507.08068).
提供机构：
skandermoalla
