STAR-1

# 🌟 STAR-1: Safer Alignment of Reasoning LLMs with 1K Data

<p align="center">
📃 <a href="https://arxiv.org/abs/2504.01903" target="_blank">Paper</a> ｜🤗 <a href="https://huggingface.co/datasets/UCSC-VLAA/STAR-1" target="_blank">STAR-1 Data</a> | 🤗 <a href="https://huggingface.co/collections/UCSC-VLAA/star-1-67edda2a042e8ba3e955e522" target="_blank">STAR-1 Model</a> | 📚 <a href="https://ucsc-vlaa.github.io/STAR-1/" target="_blank">Project Page</a>
</p>

## Introduction
[**STAR-1**](https://huggingface.co/datasets/UCSC-VLAA/STAR-1) is a high-quality safety dataset designed to enhance safety alignment in large reasoning models (LRMs) like DeepSeek-R1.

- Built on the principles of diversity, deliberative reasoning, and rigorous filtering, STAR-1 integrates and refines data from multiple sources to provide policy-grounded reasoning samples.
- The dataset contains **1,000** carefully selected examples, each aligned with best safety practices through GPT-4o-based evaluation.
- Fine-tuning with STAR-1 leads to significant safety improvements across multiple benchmarks, with minimal impact on reasoning capabilities.
We open-sourced our 1K [STAR-1](https://huggingface.co/datasets/UCSC-VLAA/STAR-1) here.

## Artifacts
### Data

| Dataset | Num. of Sample | URL |
|------------|----------------|----------------------------------------------------------------------|
| STAR-1 | 1K | 🤗 [UCSC-VLAA/STAR-1](https://huggingface.co/datasets/UCSC-VLAA/STAR-1) |
| STAR 41K | 41K | 🤗 [UCSC-VLAA/STAR-41K](https://huggingface.co/datasets/UCSC-VLAA/STAR-41K) |
| STAR-benign-915 | 915 | 🤗 [UCSC-VLAA/STAR-benign-915](https://huggingface.co/datasets/UCSC-VLAA/STAR-benign-915) |

### Model
| Model | Type | URL |
|--------------------------------|-------------------------------------------|----------------------------------------------------------------------------------------|
| `STAR1`-R1-Distill-1.5B | R1-Distill-Qwen-1.5B trained on STAR-1 | 🤗 [UCSC-VLAA/STAR1-R1-Distill-1.5B](https://huggingface.co/UCSC-VLAA/STAR1-R1-Distill-1.5B) |
| `STAR1`-R1-Distill-7B | R1-Distill-Qwen-7B trained on STAR-1 | 🤗 [UCSC-VLAA/STAR1-R1-Distill-7B](https://huggingface.co/UCSC-VLAA/STAR1-R1-Distill-7B) |
| `STAR1`-R1-Distill-8B | R1-Distill-Llama-8B trained on STAR-1 | 🤗 [UCSC-VLAA/STAR1-R1-Distill-8B](https://huggingface.co/UCSC-VLAA/STAR1-R1-Distill-8B) |
| `STAR1`-R1-Distill-14B | R1-Distill-Qwen-14B trained on STAR-1 | 🤗 [UCSC-VLAA/STAR1-R1-Distill-14B](https://huggingface.co/UCSC-VLAA/STAR1-R1-Distill-14B) |
| `STAR1`-R1-Distill-32B | R1-Distill-Qwen-32B trained on STAR-1 | 🤗 [UCSC-VLAA/STAR1-R1-Distill-32B](https://huggingface.co/UCSC-VLAA/STAR1-R1-Distill-32B) |

## Acknowledgement
This work is partially supported by a gift from Open Philanthropy. We thank the NAIRR Pilot Program and the Microsoft Accelerate Foundation Models Research Program for supporting our computing needs.

## Citation
```
@article{wang2025star1saferalignmentreasoning,
title={STAR-1: Safer Alignment of Reasoning LLMs with 1K Data},
author={Zijun Wang and Haoqin Tu and Yuhan Wang and Juncheng Wu and Jieru Mei and Brian R. Bartoldson and Bhavya Kailkhura and Cihang Xie},
year={2025},
journal = {arXiv preprint arXiv:2504.01903}
}
```

# 🌟 STAR-1：基于1K数据实现推理型大语言模型（Large Reasoning Models, LRMs）的安全对齐

<p align="center">
📃 <a href="https://arxiv.org/abs/2504.01903" target="_blank">论文</a> ｜🤗 <a href="https://huggingface.co/datasets/UCSC-VLAA/STAR-1" target="_blank">STAR-1 数据集</a> | 🤗 <a href="https://huggingface.co/collections/UCSC-VLAA/star-1-67edda2a042e8ba3e955e522" target="_blank">STAR-1 模型</a> | 📚 <a href="https://ucsc-vlaa.github.io/STAR-1/" target="_blank">项目主页</a>
</p>

## 简介

**STAR-1**（<a href="https://huggingface.co/datasets/UCSC-VLAA/STAR-1" target="_blank">链接</a>）是一款高质量安全数据集，旨在提升DeepSeek-R1等推理型大语言模型的安全对齐性能。

- 本数据集遵循多样性、审慎推理与严格筛选的核心原则，整合并优化多源数据，产出符合政策规范的推理样本。
- 该数据集包含1000条精心筛选的样本，所有样本均通过基于GPT-4o的安全评估，符合行业最佳安全实践标准。
- 基于STAR-1开展微调，可在多项基准测试中实现安全性能的显著提升，同时对模型推理能力的影响微乎其微。

我们现已将这款1K规模的STAR-1数据集开源至上述链接。

## 成果

### 数据集

| 数据集名称 | 样本数量 | 下载链接 |
|------------|----------|----------|
| STAR-1 | 1K | 🤗 [UCSC-VLAA/STAR-1](https://huggingface.co/datasets/UCSC-VLAA/STAR-1) |
| STAR 41K | 41K | 🤗 [UCSC-VLAA/STAR-41K](https://huggingface.co/datasets/UCSC-VLAA/STAR-41K) |
| STAR-benign-915 | 915 | 🤗 [UCSC-VLAA/STAR-benign-915](https://huggingface.co/datasets/UCSC-VLAA/STAR-benign-915) |

### 模型

| 模型名称 | 模型类型 | 下载链接 |
|----------|----------|----------|
| `STAR1`-R1-Distill-1.5B | 在STAR-1上训练的R1-Distill-Qwen-1.5B | 🤗 [UCSC-VLAA/STAR1-R1-Distill-1.5B](https://huggingface.co/UCSC-VLAA/STAR1-R1-Distill-1.5B) |
| `STAR1`-R1-Distill-7B | 在STAR-1上训练的R1-Distill-Qwen-7B | 🤗 [UCSC-VLAA/STAR1-R1-Distill-7B](https://huggingface.co/UCSC-VLAA/STAR1-R1-Distill-7B) |
| `STAR1`-R1-Distill-8B | 在STAR-1上训练的R1-Distill-Llama-8B | 🤗 [UCSC-VLAA/STAR1-R1-Distill-8B](https://huggingface.co/UCSC-VLAA/STAR1-R1-Distill-8B) |
| `STAR1`-R1-Distill-14B | 在STAR-1上训练的R1-Distill-Qwen-14B | 🤗 [UCSC-VLAA/STAR1-R1-Distill-14B](https://huggingface.co/UCSC-VLAA/STAR1-R1-Distill-14B) |
| `STAR1`-R1-Distill-32B | 在STAR-1上训练的R1-Distill-Qwen-32B | 🤗 [UCSC-VLAA/STAR1-R1-Distill-32B](https://huggingface.co/UCSC-VLAA/STAR1-R1-Distill-32B) |

## 致谢

本研究部分由Open Philanthropy提供赠款支持，同时感谢NAIRR试点项目与微软加速基础模型研究计划（Microsoft Accelerate Foundation Models Research Program）为我们提供计算资源支持。

## 引用

@article{wang2025star1saferalignmentreasoning,
title={STAR-1: Safer Alignment of Reasoning LLMs with 1K Data},
author={Zijun Wang and Haoqin Tu and Yuhan Wang and Juncheng Wu and Jieru Mei and Brian R. Bartoldson and Bhavya Kailkhura and Cihang Xie},
year={2025},
journal = {arXiv preprint arXiv:2504.01903}
}

搜集汇总

背景与挑战

背景概述

STAR-1是一个包含1,000个示例的高质量安全数据集，旨在提升大型推理模型的安全对齐，通过GPT-4o评估确保与最佳安全实践一致，同时保持推理能力。