ReBatch/ultrafeedback_binarized_nl

--- dataset_info: features: - name: prompt dtype: string - name: prompt_id dtype: string - name: messages list: - name: content dtype: string - name: original dtype: string - name: role dtype: string - name: rejected list: - name: content dtype: string - name: original dtype: string - name: role dtype: string - name: chosen list: - name: content dtype: string - name: original dtype: string - name: role dtype: string splits: - name: test num_bytes: 11991516 num_examples: 991 - name: train num_bytes: 726715578 num_examples: 60746 download_size: 368124762 dataset_size: 738707094 configs: - config_name: default data_files: - split: test path: data/test-* - split: train path: data/train-* --- # Dataset Card for ultrafeedback_nl ## Dataset Description This dataset is a tranlsation of [HuggingFaceH4/ultrafeedback_binarized](https://huggingface.co/datasets/HuggingFaceH4/ultrafeedback_binarized) using a MarianMT model. It contains both Chosen and rejected versions of multi-turn chat conversations between a user and an assistant. ## Dataset Structure The dataset has two splits; Only the prefs splits of the original dataset were translated. This is because the datasets was created for DPO finetuning. Some Translations failed and those sampleswere left out. | train | test | |:-------:|:-------:| | 60746 | 991 | ## Usage ```python from datasets import load_dataset ds = load_dataset("ReBatch/ultrafeedback_binarized_nl") ``` ## Translation The ultrafeedback_binarized dataset was translated using [vvn/en-to-dutch-marianmt](https://huggingface.co/vvn/en-to-dutch-marianmt). A fine-Tuned MarianMT translation model for translating text from English to Dutch.

原始信息汇总

数据集概述

数据集名称

ultrafeedback_nl

数据集描述

该数据集是通过MarianMT模型对HuggingFaceH4/ultrafeedback_binarized进行翻译得到的，包含用户与助手之间的多轮聊天对话的Chosen和rejected版本。

数据集结构

• 特征：

  • prompt: 字符串类型
  • prompt_id: 字符串类型
  • messages: 列表类型，包含
    • content: 字符串类型
    • original: 字符串类型
    • role: 字符串类型
  • rejected: 列表类型，包含
    • content: 字符串类型
    • original: 字符串类型
    • role: 字符串类型
  • chosen: 列表类型，包含
    • content: 字符串类型
    • original: 字符串类型
    • role: 字符串类型

• 分割：

  • train: 60746个样本，726715578字节
  • test: 991个样本，11991516字节

数据集大小

• 下载大小: 368124762字节
• 数据集大小: 738707094字节

配置

• 默认配置包含
  • 测试集路径: data/test-*
  • 训练集路径: data/train-*

翻译

数据集使用vvn/en-to-dutch-marianmt进行翻译，这是一个专门用于从英语翻译到荷兰语的MarianMT模型。