PPE-Human-Preference-V1

# Overview

This contains the human preference evaluation set for Preference Proxy Evaluations.

This dataset is meant for benchmarking and evaluation, not for training.

[Paper](https://arxiv.org/abs/2410.14872)

[Code](https://github.com/lmarena/PPE)

# License

User prompts are licensed under CC-BY-4.0, and model outputs are governed by the terms of use set by the respective model providers.

# Citation

```
@misc{frick2024evaluaterewardmodelsrlhf,
title={How to Evaluate Reward Models for RLHF},
author={Evan Frick and Tianle Li and Connor Chen and Wei-Lin Chiang and Anastasios N. Angelopoulos and Jiantao Jiao and Banghua Zhu and Joseph E. Gonzalez and Ion Stoica},
year={2024},
eprint={2410.14872},
archivePrefix={arXiv},
primaryClass={cs.LG},
url={https://arxiv.org/abs/2410.14872},
}
```

# 数据集概览
本数据集为面向偏好代理评估（Preference Proxy Evaluations）的人工偏好评测集。
本数据集仅用于基准测试与模型评估，不可用于模型训练。
[论文](https://arxiv.org/abs/2410.14872)
[代码](https://github.com/lmarena/PPE)

# 授权协议
用户提示词（User prompts）采用CC-BY-4.0协议授权，模型生成输出需遵循对应模型提供商的使用条款。

# 引用信息

@misc{frick2024evaluaterewardmodelsrlhf,
title={面向基于人类反馈的强化学习（Reinforcement Learning from Human Feedback, RLHF）的奖励模型评估},
author={Evan Frick and Tianle Li and Connor Chen and Wei-Lin Chiang and Anastasios N. Angelopoulos and Jiantao Jiao and Banghua Zhu and Joseph E. Gonzalez and Ion Stoica},
year={2024},
eprint={2410.14872},
archivePrefix={arXiv},
primaryClass={cs.LG},
url={https://arxiv.org/abs/2410.14872},
}

搜集汇总

背景与挑战

背景概述

PPE-Human-Preference-V1是一个专门用于基准测试和评估的人类偏好数据集，不适用于训练目的。数据集包含用户提示和模型输出，分别遵循不同的许可协议，并与评估RLHF奖励模型的研究论文相关联。