rule34-webp-4Mpixel

# Rule34 4M Re-encoded Dataset

This is the re-encoded dataset of [deepghs/rule34_full](https://huggingface.co/datasets/deepghs/rule34_full). And all the resized images are maintained here.

There are 9972271 images in total. The maximum ID of these images is 11563431. Last updated at `2024-11-18 00:08:58 UTC`.

# How to Painlessly Use This

Use [cheesechaser](https://github.com/deepghs/cheesechaser) to quickly get images from this repository.

Before using this code, you have to **grant the access from this gated repository**. And then **set your personal HuggingFace token into `HF_TOKEN` environment variable** to give the code authorization for this repository.

```python
from cheesechaser.datapool import Rule34WebpDataPool

pool = Rule34WebpDataPool()
pool.batch_download_to_directory(
# download images #7000000-7000100, any ranges or id lists are okay
resource_ids=range(7000000, 7000100),

# save to directory /data/rule34_webp
dst_dir='/data/rule34_webp',
)
```

# Rule34 4M 重编码数据集
本数据集为 [deepghs/rule34_full](https://huggingface.co/datasets/deepghs/rule34_full) 的重编码版本，所有经过尺寸调整的图像均存储于此。
本数据集总计包含9972271张图像，图像最大ID为11563431，最后更新时间为`2024-11-18 00:08:58 UTC`。

# 轻松使用指南
可通过 [cheesechaser](https://github.com/deepghs/cheesechaser) 快速从本仓库获取图像资源。
在运行此代码前，您需要**先申请本受控仓库的访问权限**，并将个人Hugging Face令牌（Token）配置至`HF_TOKEN`环境变量中，以授予代码访问本仓库的权限。
python
from cheesechaser.datapool import Rule34WebpDataPool

pool = Rule34WebpDataPool()
pool.batch_download_to_directory(
# 下载编号7000000至7000100的图像，支持任意范围或ID列表
resource_ids=range(7000000, 7000100),

# 保存至目录 /data/rule34_webp
dst_dir='/data/rule34_webp',
)