ReBatch/ultrafeedback_binarized_nl

---
dataset_info:
features:
- name: prompt
dtype: string
- name: prompt_id
dtype: string
- name: messages
list:
- name: content
dtype: string
- name: original
dtype: string
- name: role
dtype: string
- name: rejected
list:
- name: content
dtype: string
- name: original
dtype: string
- name: role
dtype: string
- name: chosen
list:
- name: content
dtype: string
- name: original
dtype: string
- name: role
dtype: string
splits:
- name: test
num_bytes: 11991516
num_examples: 991
- name: train
num_bytes: 726715578
num_examples: 60746
download_size: 368124762
dataset_size: 738707094
configs:
- config_name: default
data_files:
- split: test
path: data/test-*
- split: train
path: data/train-*
---

# Dataset Card for ultrafeedback_nl

## Dataset Description

This dataset is a tranlsation of [HuggingFaceH4/ultrafeedback_binarized](https://huggingface.co/datasets/HuggingFaceH4/ultrafeedback_binarized) using a MarianMT model.
It contains both Chosen and rejected versions of multi-turn chat conversations between a user and an assistant.

## Dataset Structure

The dataset has two splits; Only the prefs splits of the original dataset were translated. This is because the datasets was created for DPO finetuning. Some Translations failed and those sampleswere left out.

| train | test |
|:-------:|:-------:|
| 60746 | 991 |

## Usage

```python
from datasets import load_dataset

ds = load_dataset("ReBatch/ultrafeedback_binarized_nl")

```

## Translation

The ultrafeedback_binarized dataset was translated using [vvn/en-to-dutch-marianmt](https://huggingface.co/vvn/en-to-dutch-marianmt).
A fine-Tuned MarianMT translation model for translating text from English to Dutch.

原始信息汇总

数据集概述

数据集名称

ultrafeedback_nl

数据集描述

该数据集是通过MarianMT模型对HuggingFaceH4/ultrafeedback_binarized进行翻译得到的，包含用户与助手之间的多轮聊天对话的Chosen和rejected版本。

数据集结构

• 特征：

  • prompt: 字符串类型
  • prompt_id: 字符串类型
  • messages: 列表类型，包含
    • content: 字符串类型
    • original: 字符串类型
    • role: 字符串类型
  • rejected: 列表类型，包含
    • content: 字符串类型
    • original: 字符串类型
    • role: 字符串类型
  • chosen: 列表类型，包含
    • content: 字符串类型
    • original: 字符串类型
    • role: 字符串类型

• 分割：

  • train: 60746个样本，726715578字节
  • test: 991个样本，11991516字节

数据集大小

• 下载大小: 368124762字节
• 数据集大小: 738707094字节

配置

• 默认配置包含
  • 测试集路径: data/test-*
  • 训练集路径: data/train-*

翻译

数据集使用vvn/en-to-dutch-marianmt进行翻译，这是一个专门用于从英语翻译到荷兰语的MarianMT模型。