CyberHarem/murasaki_shikibu_fgo

---
license: mit
task_categories:
- text-to-image
tags:
- art
- not-for-all-audiences
size_categories:
- n<1K
---

# Dataset of murasaki_shikibu/紫式部/紫式部 (Fate/Grand Order)

This is the dataset of murasaki_shikibu/紫式部/紫式部 (Fate/Grand Order), containing 500 images and their tags.

The core tags of this character are `long_hair, purple_eyes, breasts, large_breasts, hair_ornament, very_long_hair, hair_bun, cone_hair_bun, double_bun, two_side_up, brown_hair, hair_between_eyes`, which are pruned in this dataset.

Images are crawled from many sites (e.g. danbooru, pixiv, zerochan ...), the auto-crawling system is powered by [DeepGHS Team](https://github.com/deepghs)([huggingface organization](https://huggingface.co/deepghs)).

## List of Packages

| Name | Images | Size | Download | Type | Description |
|:-----------------|---------:|:-----------|:----------------------------------------------------------------------------------------------------------------------|:-----------|:---------------------------------------------------------------------|
| raw | 500 | 917.63 MiB | [Download](https://huggingface.co/datasets/CyberHarem/murasaki_shikibu_fgo/resolve/main/dataset-raw.zip) | Waifuc-Raw | Raw data with meta information (min edge aligned to 1400 if larger). |
| 1200 | 500 | 791.44 MiB | [Download](https://huggingface.co/datasets/CyberHarem/murasaki_shikibu_fgo/resolve/main/dataset-1200.zip) | IMG+TXT | dataset with the shorter side not exceeding 1200 pixels. |
| stage3-p480-1200 | 1282 | 1.50 GiB | [Download](https://huggingface.co/datasets/CyberHarem/murasaki_shikibu_fgo/resolve/main/dataset-stage3-p480-1200.zip) | IMG+TXT | 3-stage cropped dataset with the area not less than 480x480 pixels. |

### Load Raw Dataset with Waifuc

We provide raw dataset (including tagged images) for [waifuc](https://deepghs.github.io/waifuc/main/tutorials/installation/index.html) loading. If you need this, just run the following code

```python
import os
import zipfile

from huggingface_hub import hf_hub_download
from waifuc.source import LocalSource

# download raw archive file
zip_file = hf_hub_download(
repo_id='CyberHarem/murasaki_shikibu_fgo',
repo_type='dataset',
filename='dataset-raw.zip',
)

# extract files to your directory
dataset_dir = 'dataset_dir'
os.makedirs(dataset_dir, exist_ok=True)
with zipfile.ZipFile(zip_file, 'r') as zf:
zf.extractall(dataset_dir)

# load the dataset with waifuc
source = LocalSource(dataset_dir)
for item in source:
print(item.image, item.meta['filename'], item.meta['tags'])
```

## List of Clusters

List of tag clustering result, maybe some outfits can be mined here.

### Raw Text Version

| # | Samples | Img-1 | Img-2 | Img-3 | Img-4 | Img-5 | Tags |
|----:|----------:|:----------------------------------|:----------------------------------|:----------------------------------|:----------------------------------|:----------------------------------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| 0 | 30 |  |  |  |  |  | 1girl, looking_at_viewer, purple_hair, solo, bare_shoulders, blush, gold_trim, hair_flower, hair_up, black_one-piece_swimsuit, highleg_swimsuit, armlet, half_gloves, black_gloves, thighs, covered_navel, fingerless_gloves, black_hair, single_thighhigh, shawl, smile |
| 1 | 6 |  |  |  |  |  | 1girl, long_sleeves, looking_at_viewer, ribbed_sweater, solo, turtleneck_sweater, purple_hair, black_sweater, parted_lips, simple_background, blush, jeans, white_background |
| 2 | 25 |  |  |  |  |  | 1girl, solo, black_hair, layered_clothes, layered_kimono, looking_at_viewer, wide_sleeves, long_sleeves, folding_fan, holding_fan, upper_body, wisteria |
| 3 | 7 |  |  |  |  |  | 1girl, black_dress, juliet_sleeves, smile, solo, closed_mouth, frills, looking_at_viewer, purple_gemstone, sleeves_past_wrists, puff_and_slash_sleeves, blush, wide_sleeves |
| 4 | 25 |  |  |  |  |  | 1girl, black_dress, frills, looking_at_viewer, sleeves_past_wrists, solo, juliet_sleeves, gem, holding_umbrella, parted_lips, frilled_umbrella, upper_body, wide_sleeves |
| 5 | 10 |  |  |  |  |  | 1girl, black_dress, frills, holding_umbrella, juliet_sleeves, looking_at_viewer, simple_background, solo, white_background, gem, sleeves_past_wrists, black_hair |
| 6 | 13 |  |  |  |  |  | 1girl, black_dress, frills, handbag, holding_umbrella, juliet_sleeves, sleeves_past_wrists, solo, looking_at_viewer, purple_gemstone, wisteria, frilled_umbrella, wide_sleeves |
| 7 | 7 |  |  |  |  |  | 1girl, black_dress, calligraphy_brush, frills, juliet_sleeves, looking_at_viewer, sleeves_past_wrists, solo, parted_lips, smile, gem, holding_paintbrush |
| 8 | 13 |  |  |  |  |  | 1girl, looking_at_viewer, solo, cleavage, blush, thighs, bare_shoulders, purple_hair, blue_bikini, navel, glasses, striped_thighhighs, collarbone, open_mouth, wet |
| 9 | 5 |  |  |  |  |  | 1girl, looking_at_viewer, solo, black_serafuku, long_sleeves, smile, glasses, holding, shirt, upper_body, bandages, black-framed_eyewear, black_sailor_collar, collarbone, hair_ribbon, pleated_skirt, ponytail, purple_hair, purple_neckerchief, simple_background |
| 10 | 8 |  |  |  |  |  | 1girl, bare_shoulders, cleavage, looking_at_viewer, solo, thighs, blush, lingerie, navel, collarbone, lace-trimmed_bra, lace-trimmed_panties, purple_bra, purple_panties, underwear_only, black_panties, parted_lips, stomach, black_thighhighs, garter_belt, holding, kimono, long_sleeves, off_shoulder, open_clothes, purple_hair |

### Table Version

| # | Samples | Img-1 | Img-2 | Img-3 | Img-4 | Img-5 | 1girl | looking_at_viewer | purple_hair | solo | bare_shoulders | blush | gold_trim | hair_flower | hair_up | black_one-piece_swimsuit | highleg_swimsuit | armlet | half_gloves | black_gloves | thighs | covered_navel | fingerless_gloves | black_hair | single_thighhigh | shawl | smile | long_sleeves | ribbed_sweater | turtleneck_sweater | black_sweater | parted_lips | simple_background | jeans | white_background | layered_clothes | layered_kimono | wide_sleeves | folding_fan | holding_fan | upper_body | wisteria | black_dress | juliet_sleeves | closed_mouth | frills | purple_gemstone | sleeves_past_wrists | puff_and_slash_sleeves | gem | holding_umbrella | frilled_umbrella | handbag | calligraphy_brush | holding_paintbrush | cleavage | blue_bikini | navel | glasses | striped_thighhighs | collarbone | open_mouth | wet | black_serafuku | holding | shirt | bandages | black-framed_eyewear | black_sailor_collar | hair_ribbon | pleated_skirt | ponytail | purple_neckerchief | lingerie | lace-trimmed_bra | lace-trimmed_panties | purple_bra | purple_panties | underwear_only | black_panties | stomach | black_thighhighs | garter_belt | kimono | off_shoulder | open_clothes |
|----:|----------:|:----------------------------------|:----------------------------------|:----------------------------------|:----------------------------------|:----------------------------------|:--------|:--------------------|:--------------|:-------|:-----------------|:--------|:------------|:--------------|:----------|:---------------------------|:-------------------|:---------|:--------------|:---------------|:---------|:----------------|:--------------------|:-------------|:-------------------|:--------|:--------|:---------------|:-----------------|:---------------------|:----------------|:--------------|:--------------------|:--------|:-------------------|:------------------|:-----------------|:---------------|:--------------|:--------------|:-------------|:-----------|:--------------|:-----------------|:---------------|:---------|:------------------|:----------------------|:-------------------------|:------|:-------------------|:-------------------|:----------|:--------------------|:---------------------|:-----------|:--------------|:--------|:----------|:---------------------|:-------------|:-------------|:------|:-----------------|:----------|:--------|:-----------|:-----------------------|:----------------------|:--------------|:----------------|:-----------|:---------------------|:-----------|:-------------------|:-----------------------|:-------------|:-----------------|:-----------------|:----------------|:----------|:-------------------|:--------------|:---------|:---------------|:---------------|
| 0 | 30 |  |  |  |  |  | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | |
| 1 | 6 |  |  |  |  |  | X | X | X | X | | X | | | | | | | | | | | | | | | | X | X | X | X | X | X | X | X | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | |
| 2 | 25 |  |  |  |  |  | X | X | | X | | | | | | | | | | | | | | X | | | | X | | | | | | | | X | X | X | X | X | X | X | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | |
| 3 | 7 |  |  |  |  |  | X | X | | X | | X | | | | | | | | | | | | | | | X | | | | | | | | | | | X | | | | | X | X | X | X | X | X | X | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | |
| 4 | 25 |  |  |  |  |  | X | X | | X | | | | | | | | | | | | | | | | | | | | | | X | | | | | | X | | | X | | X | X | | X | | X | | X | X | X | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | |
| 5 | 10 |  |  |  |  |  | X | X | | X | | | | | | | | | | | | | | X | | | | | | | | | X | | X | | | | | | | | X | X | | X | | X | | X | X | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | |
| 6 | 13 |  |  |  |  |  | X | X | | X | | | | | | | | | | | | | | | | | | | | | | | | | | | | X | | | | X | X | X | | X | X | X | | | X | X | X | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | |
| 7 | 7 |  |  |  |  |  | X | X | | X | | | | | | | | | | | | | | | | | X | | | | | X | | | | | | | | | | | X | X | | X | | X | | X | | | | X | X | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | |
| 8 | 13 |  |  |  |  |  | X | X | X | X | X | X | | | | | | | | | X | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | X | X | X | X | X | X | X | X | | | | | | | | | | | | | | | | | | | | | | | |
| 9 | 5 |  |  |  |  |  | X | X | X | X | | | | | | | | | | | | | | | | | X | X | | | | | X | | | | | | | | X | | | | | | | | | | | | | | | | | | X | | X | | | X | X | X | X | X | X | X | X | X | X | | | | | | | | | | | | | |
| 10 | 8 |  |  |  |  |  | X | X | X | X | X | X | | | | | | | | | X | | | | | | | X | | | | X | | | | | | | | | | | | | | | | | | | | | | | | X | | X | | | X | | | | X | | | | | | | | | X | X | X | X | X | X | X | X | X | X | X | X | X |

原始信息汇总

数据集概述

数据集名称

• 名称: murasaki_shikibu/紫式部/紫式部 (Fate/Grand Order)

数据集内容

• 类型: 包含500张图像及其标签。
• 核心标签: long_hair, purple_eyes, breasts, large_breasts, hair_ornament, very_long_hair, hair_bun, cone_hair_bun, double_bun, two_side_up, brown_hair, hair_between_eyes

数据集来源

• 来源: 图像从多个网站爬取，如danbooru, pixiv, zerochan等。
• 爬取系统: 由DeepGHS Team开发。

数据集版本

原始数据

• 名称: raw
• 图像数量: 500
• 大小: 917.63 MiB
• 格式: Waifuc-Raw
• 描述: 包含元信息的原始数据，最小边对齐至1400像素。

1200像素版本

• 名称: 1200
• 图像数量: 500
• 大小: 791.44 MiB
• 格式: IMG+TXT
• 描述: 短边不超过1200像素的图像集。

阶段3-p480-1200

• 名称: stage3-p480-1200
• 图像数量: 1282
• 大小: 1.50 GiB
• 格式: IMG+TXT
• 描述: 三阶段裁剪数据集，区域不小于480x480像素。

数据集使用

• 加载工具: 使用waifuc加载原始数据集。

• 加载代码示例: python import os import zipfile from huggingface_hub import hf_hub_download from waifuc.source import LocalSource

  zip_file = hf_hub_download( repo_id=CyberHarem/murasaki_shikibu_fgo, repo_type=dataset, filename=dataset-raw.zip, )

  dataset_dir = dataset_dir os.makedirs(dataset_dir, exist_ok=True) with zipfile.ZipFile(zip_file, r) as zf: zf.extractall(dataset_dir)

  source = LocalSource(dataset_dir) for item in source: print(item.image, item.meta[filename], item.meta[tags])

数据集标签集群

• 集群列表: 包含多个集群，每个集群有不同的图像样本和标签。
• 示例集群:
  • 集群0: 30个样本，包含标签如1girl, looking_at_viewer, purple_hair等。
  • 集群1: 6个样本，包含标签如1girl, long_sleeves, looking_at_viewer等。
  • 集群2: 25个样本，包含标签如1girl, layered_clothes, layered_kimono等。
  • 集群3: 7个样本，包含标签如1girl, black_dress, juliet_sleeves等。
  • 集群4: 25个样本，包含标签如1girl, black_dress, frills等。
  • 集群5: 10个样本，包含标签如1girl, black_dress, frills等。
  • 集群6: 13个样本，包含标签如1girl, black_dress, frills等。
  • 集群7: 7个样本，包含标签如1girl, black_dress, calligraphy_brush等。
  • 集群8: 13个样本，包含标签如1girl, looking_at_viewer, solo等。
  • 集群9: 5个样本，包含标签如1girl, looking_at_viewer, solo等。
  • 集群10: 8个样本，包含标签如1girl, bare_shoulders, cleavage等。