ALE-Bench

# ALE-Bench

## Dataset Description

**ALE-Bench** is a benchmark for evaluating AI systems on score-based algorithmic programming contests.

This dataset is **officially provided by [AtCoder Inc.](https://atcoder.jp/company?lang=en)**.
Please be sure to check the "License" section below.

Please read [our blog post](https://sakana.ai/ale-bench/) and [our paper](https://arxiv.org/abs/2506.09050) for more details.

**Related resources:**

- [Preprint paper (arXiv)](https://arxiv.org/abs/2506.09050)
- [Sakana AI Blog (English)](https://sakana.ai/ale-bench/)
- [Sakana AI Blog (Japanese)](https://sakana.ai/ale-bench-jp/)
- [GitHub repository](https://github.com/SakanaAI/ALE-Bench)
- [Leaderboard](https://sakanaai.github.io/ALE-Bench-Leaderboard/)

## Usage

[Our Python library](https://github.com/SakanaAI/ALE-Bench) automatically downloads the data from this repository.

```python
import ale_bench

ale_bench_session = ale_bench.start("ahc001")
```

## License

[Creative Commons Attribution-NoDerivatives 4.0 International](https://creativecommons.org/licenses/by-nd/4.0/)

## Citation

```bibtex
@article{imajuku2025ale-bench,
title = {ALE-Bench: A Benchmark for Long-Horizon Objective-Driven Algorithm Engineering},
author = {Imajuku, Yuki and Horie, Kohki and Iwata, Yoichi and Aoki, Kensho and Takahashi, Naohiro and Akiba, Takuya},
journal = {arXiv preprint arXiv:2506.09050},
year = {2025}
}
```

# ALE-Bench

## 数据集说明

**ALE-Bench** 是一款用于在基于得分的算法编程竞赛场景中评估人工智能系统的基准测试集。

本数据集由**AtCoder株式会社（AtCoder Inc.）**官方提供，请务必查阅下文的「许可协议」章节。
如需了解更多细节，请参阅我们的[博客文章](https://sakana.ai/ale-bench/)与[研究论文](https://arxiv.org/abs/2506.09050)。

**相关资源：**
- [预印本论文（arXiv）](https://arxiv.org/abs/2506.09050)
- [Sakana AI 英文博客](https://sakana.ai/ale-bench/)
- [Sakana AI 日文博客](https://sakana.ai/ale-bench-jp/)
- [GitHub 代码仓库](https://github.com/SakanaAI/ALE-Bench)
- [排行榜页面](https://sakanaai.github.io/ALE-Bench-Leaderboard/)

## 使用方法

我们提供的[Python工具库](https://github.com/SakanaAI/ALE-Bench)可自动从本代码仓库下载数据集。
python
import ale_bench

ale_bench_session = ale_bench.start("ahc001")

## 许可协议

[知识共享署名-禁止演绎4.0国际许可协议（CC BY-ND 4.0）](https://creativecommons.org/licenses/by-nd/4.0/)

## 引用格式

bibtex
@article{imajuku2025ale-bench,
title = {ALE-Bench: A Benchmark for Long-Horizon Objective-Driven Algorithm Engineering},
author = {Imajuku, Yuki and Horie, Kohki and Iwata, Yoichi and Aoki, Kensho and Takahashi, Naohiro and Akiba, Takuya},
journal = {arXiv preprint arXiv:2506.09050},
year = {2025}
}