safebooru-webp-4Mpixel

# Safebooru 4M Re-encoded Dataset

This is the re-encoded dataset of [deepghs/safebooru_full](https://huggingface.co/datasets/deepghs/safebooru_full). And all the resized images are maintained here.

There are 5756655 images in total. The maximum ID of these images is 5974383. Last updated at `2025-08-06 08:31:53 JST`.

# How to Painlessly Use This

Use [cheesechaser](https://github.com/deepghs/cheesechaser) to quickly get images from this repository.

Before using this code, you have to **grant the access from this gated repository**. And then **set your personal HuggingFace token into `HF_TOKEN` environment variable** to give the code authorization for this repository.

```python
from cheesechaser.datapool import SafebooruWebpDataPool

pool = SafebooruWebpDataPool()
pool.batch_download_to_directory(
# download images #7000000-7000100, any ranges or id lists are okay
resource_ids=range(7000000, 7000100),

# save to directory /data/safebooru_webp
dst_dir='/data/safebooru_webp',
)
```

# Safebooru 4M重编码数据集

本数据集为[deepghs/safebooru_full](https://huggingface.co/datasets/deepghs/safebooru_full)的重编码版本，所有经过尺寸调整的图像均存储于此。

数据集总计包含5,756,655张图像，其最大图像ID为5974383，最后更新时间为`2025-08-06 08:31:53 日本标准时间（JST）`。

# 轻松使用指南

可通过[cheesechaser](https://github.com/deepghs/cheesechaser)快速从本仓库获取图像资源。

在运行此代码前，您需**先申请本受限仓库的访问权限**，并**将个人Hugging Face Token (Token)配置到`HF_TOKEN`环境变量中**，以授予代码访问本仓库的权限。

python
from cheesechaser.datapool import SafebooruWebpDataPool

pool = SafebooruWebpDataPool()
pool.batch_download_to_directory(
# 下载ID范围7000000至7000100的图像，支持任意ID范围或ID列表
resource_ids=range(7000000, 7000100),

# 保存至目录 /data/safebooru_webp
dst_dir='/data/safebooru_webp',
)

搜集汇总

背景与挑战

背景概述

该数据集为Safebooru图像库的重新编码版本，包含约575万张图像，最大ID为5974383，更新于2025年8月6日。用户需授权访问并设置HuggingFace令牌，通过专用工具进行图像下载。