Felladrin/ChatML-Neural-DPO
收藏Hugging Face2024-02-25 更新2024-03-04 收录
下载链接：
https://hf-mirror.com/datasets/Felladrin/ChatML-Neural-DPO
下载链接
链接失效反馈官方服务：
资源简介：
---
license: apache-2.0
language:
- en
size_categories:
- 1K<n<10K
---
[NeuralNovel/Neural-DPO](https://huggingface.co/datasets/NeuralNovel/Neural-DPO) in ChatML format, ready to use in [HuggingFace TRL's DPO Trainer](https://huggingface.co/docs/trl/main/en/dpo_trainer).
Python code used for conversion:
```python
from datasets import load_dataset
dataset = load_dataset("NeuralNovel/Neural-DPO", split="train")
def format(columns):
prompt = f"<|im_start|>user\n{columns['question']}<|im_end|>\n<|im_start|>assistant\n"
if (columns['system']):
prompt = f"<|im_start|>system\n{columns['system']}<|im_end|>\n{prompt}"
return {
"prompt": prompt,
"chosen": f"{columns['chosen']}<|im_end|>",
"rejected": f"{columns['rejected']}<|im_end|>",
}
dataset.map(format).select_columns(['prompt', 'chosen', 'rejected']).to_parquet("train.parquet")
```
提供机构：
Felladrin
原始信息汇总
数据集概述
基本信息
- 许可证: Apache-2.0
- 语言: 英语
- 数据量: 1K<n<10K
数据集用途
- 该数据集以ChatML格式提供，适用于HuggingFace TRLs DPO Trainer。
数据转换代码
以下Python代码用于将数据集转换为所需格式：
python from datasets import load_dataset
dataset = load_dataset("NeuralNovel/Neural-DPO", split="train")
def format(columns): prompt = f"<|im_start|>user {columns[question]}<|im_end|> <|im_start|>assistant "
if (columns[system]):
prompt = f"<|im_start|>system
{columns[system]}<|im_end|> {prompt}"
return {
"prompt": prompt,
"chosen": f"{columns[chosen]}<|im_end|>",
"rejected": f"{columns[rejected]}<|im_end|>",
}
dataset.map(format).select_columns([prompt, chosen, rejected]).to_parquet("train.parquet")
