trojblue/sakugabooru2025
收藏Hugging Face2024-12-30 更新2025-02-15 收录
下载链接:
https://hf-mirror.com/datasets/trojblue/sakugabooru2025
下载链接
链接失效反馈官方服务:
资源简介:
---
license: mit
task_categories:
- text-to-image
- text-to-video
language:
- en
- ja
tags:
- animation
- image
- video
- webdataset
pretty_name: Sakugabooru 2025
size_categories:
- 100K<n<1M
---

# Sakugabooru2025: Curated Animation Clips from Enthusiasts
[Sakugabooru.com](https://www.sakugabooru.com/post) is a booru-style imageboard dedicated to collecting and sharing noteworthy animation clips, emphasizing Japanese anime but open to creators worldwide. Over the years, it has amassed more than 240,000 animation clips, alongside informative [blog posts](https://blog.sakugabooru.com/) for anime fans everywhere.
With the growing interest in generative video models and AI animations, the scarcity of proper animation-related video datasets has become a challenge. This dataset was created to provide resources for animation enthusiasts and industry researchers, to help advancing the frontier of animation-video research.
Potential uses include:
- text-to-video training
- multimodal animation research
- video quality/aesthetics analysis
## Dataset Details
This dataset includes over 155,238 video clips and 8,680 images of unique or noteworthy animation:
```yaml
image files: 8680, video files: 155238, json files: 240242
total unique files: 404160
last post id: 273264
```
Note that Sakugabooru’s archives have been reduced by DMCA strikes over the years. Popular titles like [Mob Psycho 100](https://www.reddit.com/r/AnimeSakuga/comments/10du14k/alternatives_to_sakugabooru_for_mob_psycho_100/) may not appear because they were removed from the site.
- **Curated by:** [trojblue](https://huggingface.co/trojblue)
- **Language(s) (NLP):** English, Japanese
- **License:** MIT
## Dataset Structure
Files are split into tar archives by post ID **modulo 1,000**:
- Example: post ID **42** goes to `0000.tar`, post ID **5306** goes to `0005.tar`.
- Each tar is about 1GB, suitable for large-batch data processing.
The dataset follows [WebDataset](https://github.com/webdataset/webdataset) conventions, with each tar containing media files (~1GB) plus metadata:
```bash
./media/0.tar
# ./train/0.tar/{sakuga_5306.webm}
# ./train/0.tar/{sakuga_5306.json}
```
The index file `./sakugabooru-index.json` is generated using `widsindex` (see [WebDataset FAQ](https://github.com/webdataset/webdataset/blob/main/FAQ.md)):
```bash
widsindex *.tar > mydataset-index.json
```
## Dataset Creation
This dataset is sourced directly from Sakugabooru by querying IDs from 0 up to the latest, by Dec.28, 2024:
```bash
https://www.sakugabooru.com/post/show/{id}
```
### Data Collection and Processing
Since Sakugabooru lacks a direct JSON API, metadata were gathered by visiting each page and extracting relevant parts. The scraper code is available here: [arot-devs/sakuga-scraper](https://github.com/arot-devs/sakuga-scraper/tree/main).
Each post’s JSON metadata follows a format like:
```json
{
"post_id": 100112,
"post_url": "https://www.sakugabooru.com/post/show/100112",
"image_url": null,
"tags": {},
...
"status_notice": [
"This post was deleted.\n\n Reason: ..."
]
}
```
No additional processing was performed beyond metadata collection.
## Bias, Risks, and Limitations
Owing to DMCA takedowns, duplicates, or other factors, only about 60% (163,918 of 273,264) post IDs have attached media. The selection also tends to favor older Japanese animations.
### Recommendations
For more interesting reads about animation, visit: [Sakuga Blog – The Art of Japanese Animation](https://blog.sakugabooru.com/)
You can support Sakugabooru through: [Sakugabooru | Patreon](https://www.patreon.com/Sakugabooru)
Sakugabooru2025 is a dataset that collects and shares noteworthy animation clips, with a focus on Japanese anime but open to creators worldwide. It includes over 155,238 video clips and 8,680 unique or remarkable animation images. The dataset aims to provide resources for animation enthusiasts and industry researchers to advance the frontier of animation-video research. Potential uses include text-to-video training, multimodal animation research, and video quality/aesthetics analysis.
提供机构:
trojblue搜集汇总
数据集介绍

背景与挑战
背景概述
Sakugabooru2025是一个专注于动画剪辑的数据集,包含超过155,000个视频剪辑和8,600张图像,总计约404,000个文件,大小为1.27 TB,数据来源于Sakugabooru.com网站,覆盖截至2024年12月的帖子。该数据集适用于文本到视频训练和多模态动画研究等任务,使用MIT许可证,支持英语和日语,但受DMCA删除影响,仅约60%的帖子有媒体附件,且偏向较旧的日本动画内容。
以上内容由遇见数据集搜集并总结生成



