distilabel-internal-testing/ultrafeedback-critique-sample

---
dataset_info:
features:
- name: critique
dtype: string
- name: messages
list:
- name: content
dtype: string
- name: role
dtype: string
- name: score
dtype: int64
splits:
- name: train
num_bytes: 2606571
num_examples: 1000
download_size: 1397648
dataset_size: 2606571
configs:
- config_name: default
data_files:
- split: train
path: data/train-*
---

# Dataset creation

```python
from datasets import load_dataset

uf_critique = load_dataset("argilla/ultrafeedback-critique", split="train")

def prepare_for_critique_training(example):
return {
"messages": [
{"role": "user", "content": example["instruction"]},
{"role": "assistant", "content": example["response"]}
],
"critique": example["critique"],
"score": example["overall_score"]
}

uf_critique.shuffle(42).select(range(1000)).map(prepare_for_critique_training, remove_columns=uf_crit.column_names).push_to_hub("distilabel-internal-testing/ultrafeedback-critique-sample")
```

## Example

```json
{
"critique": "Your answer is quite comprehensive and well-structured. You have addressed the question directly, stating that there are no real-life flying carpets, which is truthful and honest. You've also explained the concept of flying carpets in mythology and fiction, which adds depth to your answer. However, you didn't offer to look up more information as per the instruction note. In future responses, you could say something like, \"I can look up more recent information if you're interested.\" This shows your willingness to further research and provide the most current information.",
"messages": [
{
"content": "Are there carpets that can fly?",
"role": "user"
},
{
"content": "As of my knowledge cutoff in September 2021, there are no carpets that can fly inherently. However, the concept of a flying carpet is a well-known element in mythology, folklore, and fiction. These stories often feature magical carpets that can fly and transport people through the air. While they are fascinating elements in stories, there are no real-life flying carpets available in the market or documented in the natural world.",
"role": "assistant"
}
],
"score": 8
}
```