CyberHarem/idw_girlsfrontline

---
license: mit
task_categories:
- text-to-image
tags:
- art
- not-for-all-audiences
size_categories:
- n<1K
---

# Dataset of idw/IDW/IDW (Girls' Frontline)

This is the dataset of idw/IDW/IDW (Girls' Frontline), containing 125 images and their tags.

The core tags of this character are `animal_ears, blonde_hair, cat_ears, blue_eyes, long_hair, twintails, hair_ornament, bangs, hair_between_eyes, tail, fang, hairclip, cat_tail, breasts, animal_ear_fluff`, which are pruned in this dataset.

Images are crawled from many sites (e.g. danbooru, pixiv, zerochan ...), the auto-crawling system is powered by [DeepGHS Team](https://github.com/deepghs)([huggingface organization](https://huggingface.co/deepghs)).

## List of Packages

| Name | Images | Size | Download | Type | Description |
|:-----------------|---------:|:-----------|:--------------------------------------------------------------------------------------------------------------------|:-----------|:---------------------------------------------------------------------|
| raw | 125 | 142.10 MiB | [Download](https://huggingface.co/datasets/CyberHarem/idw_girlsfrontline/resolve/main/dataset-raw.zip) | Waifuc-Raw | Raw data with meta information (min edge aligned to 1400 if larger). |
| 800 | 125 | 82.35 MiB | [Download](https://huggingface.co/datasets/CyberHarem/idw_girlsfrontline/resolve/main/dataset-800.zip) | IMG+TXT | dataset with the shorter side not exceeding 800 pixels. |
| stage3-p480-800 | 295 | 177.97 MiB | [Download](https://huggingface.co/datasets/CyberHarem/idw_girlsfrontline/resolve/main/dataset-stage3-p480-800.zip) | IMG+TXT | 3-stage cropped dataset with the area not less than 480x480 pixels. |
| 1200 | 125 | 126.03 MiB | [Download](https://huggingface.co/datasets/CyberHarem/idw_girlsfrontline/resolve/main/dataset-1200.zip) | IMG+TXT | dataset with the shorter side not exceeding 1200 pixels. |
| stage3-p480-1200 | 295 | 249.90 MiB | [Download](https://huggingface.co/datasets/CyberHarem/idw_girlsfrontline/resolve/main/dataset-stage3-p480-1200.zip) | IMG+TXT | 3-stage cropped dataset with the area not less than 480x480 pixels. |

### Load Raw Dataset with Waifuc

We provide raw dataset (including tagged images) for [waifuc](https://deepghs.github.io/waifuc/main/tutorials/installation/index.html) loading. If you need this, just run the following code

```python
import os
import zipfile

from huggingface_hub import hf_hub_download
from waifuc.source import LocalSource

# download raw archive file
zip_file = hf_hub_download(
repo_id='CyberHarem/idw_girlsfrontline',
repo_type='dataset',
filename='dataset-raw.zip',
)

# extract files to your directory
dataset_dir = 'dataset_dir'
os.makedirs(dataset_dir, exist_ok=True)
with zipfile.ZipFile(zip_file, 'r') as zf:
zf.extractall(dataset_dir)

# load the dataset with waifuc
source = LocalSource(dataset_dir)
for item in source:
print(item.image, item.meta['filename'], item.meta['tags'])
```

## List of Clusters

List of tag clustering result, maybe some outfits can be mined here.

### Raw Text Version

| # | Samples | Img-1 | Img-2 | Img-3 | Img-4 | Img-5 | Tags |
|----:|----------:|:--------------------------------|:--------------------------------|:--------------------------------|:--------------------------------|:--------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| 0 | 8 |  |  |  |  |  | 1girl, solo, fingerless_gloves, shorts, boots, headset, looking_at_viewer, necktie, open_mouth, suspenders, holding_gun, knee_pads, smile, full_body, panties, submachine_gun, :3, sleeves_rolled_up, white_shirt |
| 1 | 7 |  |  |  |  |  | 1girl, fingerless_gloves, headset, open_mouth, suspender_shorts, collared_shirt, white_shirt, black_shorts, holding_gun, sleeves_rolled_up, :d, blue_panties, character_name, cowboy_shot, short_shorts, submachine_gun, 2girls, looking_at_viewer, solo_focus, striped_necktie, v-shaped_eyebrows |
| 2 | 11 |  |  |  |  |  | 1girl, elbow_gloves, solo, black_dress, black_gloves, official_alternate_costume, open_mouth, smile, bare_shoulders, choker, small_breasts, collarbone, looking_at_viewer, strapless_dress, sunglasses, simple_background, thigh_strap, :3, gun, tail_ribbon, white_background |

### Table Version

| # | Samples | Img-1 | Img-2 | Img-3 | Img-4 | Img-5 | 1girl | solo | fingerless_gloves | shorts | boots | headset | looking_at_viewer | necktie | open_mouth | suspenders | holding_gun | knee_pads | smile | full_body | panties | submachine_gun | :3 | sleeves_rolled_up | white_shirt | suspender_shorts | collared_shirt | black_shorts | :d | blue_panties | character_name | cowboy_shot | short_shorts | 2girls | solo_focus | striped_necktie | v-shaped_eyebrows | elbow_gloves | black_dress | black_gloves | official_alternate_costume | bare_shoulders | choker | small_breasts | collarbone | strapless_dress | sunglasses | simple_background | thigh_strap | gun | tail_ribbon | white_background |
|----:|----------:|:--------------------------------|:--------------------------------|:--------------------------------|:--------------------------------|:--------------------------------|:--------|:-------|:--------------------|:---------|:--------|:----------|:--------------------|:----------|:-------------|:-------------|:--------------|:------------|:--------|:------------|:----------|:-----------------|:-----|:--------------------|:--------------|:-------------------|:-----------------|:---------------|:-----|:---------------|:-----------------|:--------------|:---------------|:---------|:-------------|:------------------|:--------------------|:---------------|:--------------|:---------------|:-----------------------------|:-----------------|:---------|:----------------|:-------------|:------------------|:-------------|:--------------------|:--------------|:------|:--------------|:-------------------|
| 0 | 8 |  |  |  |  |  | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | | | | | | | | | | | | | | | | | | | | | | | | | | | |
| 1 | 7 |  |  |  |  |  | X | | X | | | X | X | | X | | X | | | | | X | | X | X | X | X | X | X | X | X | X | X | X | X | X | X | | | | | | | | | | | | | | | |
| 2 | 11 |  |  |  |  |  | X | X | | | | | X | | X | | | | X | | | | X | | | | | | | | | | | | | | | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X |

原始信息汇总

数据集概述：idw/IDW/IDW (Girls Frontline)

数据集基本信息

• 许可证：MIT
• 任务类别：text-to-image
• 标签：art, not-for-all-audiences
• 大小类别：n<1K

数据集内容

• 描述：包含125张图像及其标签，主要标签包括animal_ears, blonde_hair, cat_ears, blue_eyes, long_hair, twintails, hair_ornament, bangs, hair_between_eyes, tail, fang, hairclip, cat_tail, breasts, animal_ear_fluff。
• 图像来源：从多个网站爬取，如danbooru, pixiv, zerochan等，由DeepGHS Team提供自动爬虫系统。

数据集包列表

名称	图像数量	大小	类型	描述
raw	125	142.10 MiB	Waifuc-Raw	包含元信息的原始数据，最小边对齐至1400像素（如果更大）。
800	125	82.35 MiB	IMG+TXT	短边不超过800像素的数据集。
stage3-p480-800	295	177.97 MiB	IMG+TXT	三阶段裁剪数据集，区域不小于480x480像素。
1200	125	126.03 MiB	IMG+TXT	短边不超过1200像素的数据集。
stage3-p480-1200	295	249.90 MiB	IMG+TXT	三阶段裁剪数据集，区域不小于480x480像素。

数据集加载示例

• 加载工具：waifuc

• 加载代码示例： python import os import zipfile

  from huggingface_hub import hf_hub_download from waifuc.source import LocalSource

  下载原始档案文件

  zip_file = hf_hub_download( repo_id=CyberHarem/idw_girlsfrontline, repo_type=dataset, filename=dataset-raw.zip, )

  提取文件到你的目录

  dataset_dir = dataset_dir os.makedirs(dataset_dir, exist_ok=True) with zipfile.ZipFile(zip_file, r) as zf: zf.extractall(dataset_dir)

  使用waifuc加载数据集

  source = LocalSource(dataset_dir) for item in source: print(item.image, item.meta[filename], item.meta[tags])

标签聚类结果

• 示例：展示了不同图像的标签聚类结果，有助于进一步的数据挖掘。

原始文本版本

#	样本数	图像1	图像2	图像3	图像4	图像5	标签
0	8						1girl, solo, fingerless_gloves, shorts, boots, headset, looking_at_viewer, necktie, open_mouth, suspenders, holding_gun, knee_pads, smile, full_body, panties, submachine_gun, :3, sleeves_rolled_up, white_shirt
1	7						1girl, fingerless_gloves, headset, open_mouth, suspender_shorts, collared_shirt, white_shirt, black_shorts, holding_gun, sleeves_rolled_up, :d, blue_panties, character_name, cowboy_shot, short_shorts, submachine_gun, 2girls, looking_at_viewer, solo_focus, striped_necktie, v-shaped_eyebrows
2	11						1girl, elbow_gloves, solo, black_dress, black_gloves, official_alternate_costume, open_mouth, smile, bare_shoulders, choker, small_breasts, collarbone, looking_at_viewer, strapless_dress, sunglasses, simple_background, thigh_strap, :3, gun, tail_ribbon, white_background

表格版本

| # | 样本数 | 图像1 | 图像2 | 图像3 | 图像4 | 图像5 | 1girl | solo | fingerless_gloves | shorts | boots | headset | looking_at_viewer | necktie | open_mouth | suspenders | holding_gun | knee_pads | smile | full_body | panties | submachine_gun | :3 | sleeves_rolled_up | white_shirt | suspender_shorts | collared_shirt | black_shorts | :d | blue_panties | character_name | cowboy_shot | short_shorts | 2girls | solo_focus | striped_necktie | v-shaped_eyebrows | elbow_gloves | black_dress | black_gloves | official_alternate_costume | bare_shoulders | choker | small_breasts | collarbone | strapless_dress | sunglasses | simple_background | thigh_strap | gun | tail_ribbon | white_background |