August4293/Preference-Dataset

---
dataset_info:
features:
- name: prompt
dtype: string
- name: rejected
dtype: string
- name: chosen
dtype: string
splits:
- name: train
num_bytes: 8024886
num_examples: 4449
download_size: 4200748
dataset_size: 8024886
configs:
- config_name: default
data_files:
- split: train
path: data/train-*
task_categories:
- text-generation
- question-answering
language:
- en
pretty_name: Mistral 7b Preference Dataset
size_categories:
- 1K<n<10K
---

# Mistral Self-Alignment Preference Dataset

**Warning: This dataset contains harmful and offensive data! Proceed with caution.**

The Mistral Self-Alignment Preference Dataset was generated by Mistral 7b using the Anthropics Red Teaming Prompts dataset available at [Hugging Face - Anthropics Red Teaming Prompts Dataset](https://huggingface.co/datasets/Anthropic/hh-rlhf). The data generation process utilized the Preference Data Generation Notebook, which can be found [here](https://github.com/August-murr/Lab/blob/main/Mistral%20Self%20Alignment/Notebooks/preference-dataset-generation.ipynb).

The purpose of this dataset is to facilitate self-alignment, as explained in detail on the corresponding [GitHub page](https://github.com/August-murr/Lab/tree/main/Mistral%20Self%20Alignment).

## Dataset Details:
- **Source:** [Anthropics Red Teaming Prompts Dataset](https://huggingface.co/datasets/Anthropic/hh-rlhf)
- **Generated by:** [Mistral 7b](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1)
- **Purpose:** Self-Alignment
- **Usage:** Alignment and Evaluation

原始信息汇总

数据集概述

基本信息

• 名称: Mistral 7b Preference Dataset
• 语言: 英语 (en)
• 大小: 1K<n<10K

数据集特征

• prompt: 数据类型为字符串
• rejected: 数据类型为字符串
• chosen: 数据类型为字符串

数据集分割

• 训练集 (train): 包含4449个样本，总大小为8024886字节

下载信息

• 下载大小: 4200748字节
• 数据集总大小: 8024886字节

配置

• 默认配置 (default): 训练数据文件路径为data/train-*

任务类别

• 文本生成
• 问答