richardyoung/tempest-replication

---
license: mit
task_categories:
- text-classification
language:
- en
tags:
- adversarial-attacks
- llm-safety
- jailbreaks
- red-teaming
size_categories:
- 1K<n<10K
---

# TEMPEST Replication Dataset

Multi-turn adversarial attack results on 10 frontier LLMs.

## Dataset Description

This dataset contains results from replicating the TEMPEST multi-turn jailbreak framework across 10 frontier language models, each evaluated on 100 harmful behaviors from JailbreakBench.

## Key Findings

- **ASR range: 42-100%** - All models vulnerable
- **No scale-safety correlation** (r=-0.12)
- **Thinking mode helps**: Kimi K2 Thinking (42%) vs standard (97%)

## Files

- `data/*.json` - One file per model with 100 behavior evaluations

## Citation

```bibtex
@article{young2025tempest,
title={Replication and Comparative Analysis of Multi-Turn Adversarial Attacks on Frontier Large Language Models},
author={Young, Richard},
year={2025},
institution={University of Nevada Las Vegas}
}
```

## Links

- Paper & Code: [github.com/ricyoung/tempest-replication](https://github.com/ricyoung/tempest-replication)