when2rl/distilabel-capybara-dpo-7k-binarized_reformatted

---
language:
- en
dataset_info:
features:
- name: prompt
dtype: string
- name: prompt_id
dtype: string
- name: chosen
list:
- name: content
dtype: string
- name: role
dtype: string
- name: rejected
list:
- name: content
dtype: string
- name: role
dtype: string
- name: messages
list:
- name: content
dtype: string
- name: role
dtype: string
- name: score_chosen
dtype: float64
- name: score_rejected
dtype: float64
- name: other_info
struct:
- name: chosen-model
dtype: string
- name: generation_prompt
sequence: string
- name: new_generations
sequence: string
- name: original_response
dtype: string
- name: rejected-model
dtype: string
- name: source
dtype: string
splits:
- name: train
num_bytes: 273625666.701309
num_examples: 7562
download_size: 117571506
dataset_size: 273625666.701309
configs:
- config_name: default
data_files:
- split: train
path: data/train-*
---

# Dataset Card for distilabel-capybara-dpo-7k-binarized_reformatted

<!-- Provide a quick summary of the dataset. -->

This dataset comes from argilla/distilabel-capybara-dpo-7k-binarized with:
1. changed all rating to rating * 2, because the original ratings are in [1,5], whereas all other DPO pairs typically have ratings [1, 10]. This is to make future data preprocessing easier.
2. reformatted the dataset to be in the same format as HuggingFaceH4/ultrafeedback_binarized, with additional annotations (e.g., source) stored under the `other_info` column.
3. *(new)* removed all rows where the `chosen` is the same as `rejected`. This removed 1 row from the training set.

## Dataset Details

### Dataset Description

<!-- Provide a longer summary of what this dataset is. -->

- **Curated by:** [More Information Needed]
- **Funded by [optional]:** [More Information Needed]
- **Shared by [optional]:** [More Information Needed]
- **Language(s) (NLP):** [More Information Needed]
- **License:** [More Information Needed]

### Dataset Sources [optional]

<!-- Provide the basic links for the dataset. -->

- **Repository:** [More Information Needed]
- **Paper [optional]:** [More Information Needed]
- **Demo [optional]:** [More Information Needed]

## Uses

<!-- Address questions around how the dataset is intended to be used. -->

### Direct Use

<!-- This section describes suitable use cases for the dataset. -->

[More Information Needed]

### Out-of-Scope Use

<!-- This section addresses misuse, malicious use, and uses that the dataset will not work well for. -->

[More Information Needed]

## Dataset Structure

<!-- This section provides a description of the dataset fields, and additional information about the dataset structure such as criteria used to create the splits, relationships between data points, etc. -->

[More Information Needed]

## Dataset Creation

### Curation Rationale

<!-- Motivation for the creation of this dataset. -->

[More Information Needed]

### Source Data

<!-- This section describes the source data (e.g. news text and headlines, social media posts, translated sentences, ...). -->

#### Data Collection and Processing

<!-- This section describes the data collection and processing process such as data selection criteria, filtering and normalization methods, tools and libraries used, etc. -->

[More Information Needed]

#### Who are the source data producers?

<!-- This section describes the people or systems who originally created the data. It should also include self-reported demographic or identity information for the source data creators if this information is available. -->

[More Information Needed]

### Annotations [optional]

<!-- If the dataset contains annotations which are not part of the initial data collection, use this section to describe them. -->

#### Annotation process

<!-- This section describes the annotation process such as annotation tools used in the process, the amount of data annotated, annotation guidelines provided to the annotators, interannotator statistics, annotation validation, etc. -->

[More Information Needed]

#### Who are the annotators?

<!-- This section describes the people or systems who created the annotations. -->

[More Information Needed]

#### Personal and Sensitive Information

<!-- State whether the dataset contains data that might be considered personal, sensitive, or private (e.g., data that reveals addresses, uniquely identifiable names or aliases, racial or ethnic origins, sexual orientations, religious beliefs, political opinions, financial or health data, etc.). If efforts were made to anonymize the data, describe the anonymization process. -->

[More Information Needed]

## Bias, Risks, and Limitations

<!-- This section is meant to convey both technical and sociotechnical limitations. -->

[More Information Needed]

### Recommendations

<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->

Users should be made aware of the risks, biases and limitations of the dataset. More information needed for further recommendations.

## Citation [optional]

<!-- If there is a paper or blog post introducing the dataset, the APA and Bibtex information for that should go in this section. -->

**BibTeX:**

[More Information Needed]

**APA:**

[More Information Needed]

## Glossary [optional]

<!-- If relevant, include terms and calculations in this section that can help readers understand the dataset or dataset card. -->

[More Information Needed]

## More Information [optional]

[More Information Needed]

## Dataset Card Authors [optional]

[More Information Needed]

## Dataset Card Contact

[More Information Needed]

原始信息汇总

数据集卡片 for distilabel-capybara-dpo-7k-binarized_reformatted

数据集详情

数据集描述

• 语言: 英语
• 数据集大小: 273625666.701309 字节
• 下载大小: 117571506 字节
• 配置: default
• 数据文件:
  • 分割: train
  • 路径: data/train-*
  • 样本数量: 7562

数据集特征

• prompt: 字符串
• prompt_id: 字符串
• chosen:
  • content: 字符串
  • role: 字符串
• rejected:
  • content: 字符串
  • role: 字符串
• messages:
  • content: 字符串
  • role: 字符串
• score_chosen: 浮点数 (float64)
• score_rejected: 浮点数 (float64)
• other_info:
  • chosen-model: 字符串
  • generation_prompt: 字符串序列
  • new_generations: 字符串序列
  • original_response: 字符串
  • rejected-model: 字符串
  • source: 字符串

数据集修改

1. 所有评分乘以2，因为原始评分范围是[1,5]，而其他DPO对通常有评分范围[1, 10]。这是为了简化未来的数据预处理。
2. 重新格式化数据集，使其与HuggingFaceH4/ultrafeedback_binarized格式相同，并在other_info列中存储额外的注释（例如，来源）。
3. 移除所有chosen与rejected相同的行。这从训练集中移除了1行。