five

CyberHarem/lind_neuralcloud

收藏
Hugging Face2024-02-17 更新2024-03-04 收录
下载链接:
https://hf-mirror.com/datasets/CyberHarem/lind_neuralcloud
下载链接
链接失效反馈
官方服务:
资源简介:
--- license: mit task_categories: - text-to-image tags: - art - not-for-all-audiences size_categories: - n<1K --- # Dataset of lind/リンド/琳德 (Neural Cloud) This is the dataset of lind/リンド/琳德 (Neural Cloud), containing 280 images and their tags. The core tags of this character are `blue_eyes, bangs, ahoge, long_hair, breasts, hair_ornament, star_hair_ornament, hat, bags_under_eyes, black_headwear, medium_breasts, grey_hair`, which are pruned in this dataset. Images are crawled from many sites (e.g. danbooru, pixiv, zerochan ...), the auto-crawling system is powered by [DeepGHS Team](https://github.com/deepghs)([huggingface organization](https://huggingface.co/deepghs)). ## List of Packages | Name | Images | Size | Download | Type | Description | |:-----------------|---------:|:-----------|:------------------------------------------------------------------------------------------------------------------|:-----------|:---------------------------------------------------------------------| | raw | 280 | 395.13 MiB | [Download](https://huggingface.co/datasets/CyberHarem/lind_neuralcloud/resolve/main/dataset-raw.zip) | Waifuc-Raw | Raw data with meta information (min edge aligned to 1400 if larger). | | 800 | 280 | 200.22 MiB | [Download](https://huggingface.co/datasets/CyberHarem/lind_neuralcloud/resolve/main/dataset-800.zip) | IMG+TXT | dataset with the shorter side not exceeding 800 pixels. | | stage3-p480-800 | 695 | 449.30 MiB | [Download](https://huggingface.co/datasets/CyberHarem/lind_neuralcloud/resolve/main/dataset-stage3-p480-800.zip) | IMG+TXT | 3-stage cropped dataset with the area not less than 480x480 pixels. | | 1200 | 280 | 336.17 MiB | [Download](https://huggingface.co/datasets/CyberHarem/lind_neuralcloud/resolve/main/dataset-1200.zip) | IMG+TXT | dataset with the shorter side not exceeding 1200 pixels. | | stage3-p480-1200 | 695 | 673.53 MiB | [Download](https://huggingface.co/datasets/CyberHarem/lind_neuralcloud/resolve/main/dataset-stage3-p480-1200.zip) | IMG+TXT | 3-stage cropped dataset with the area not less than 480x480 pixels. | ### Load Raw Dataset with Waifuc We provide raw dataset (including tagged images) for [waifuc](https://deepghs.github.io/waifuc/main/tutorials/installation/index.html) loading. If you need this, just run the following code ```python import os import zipfile from huggingface_hub import hf_hub_download from waifuc.source import LocalSource # download raw archive file zip_file = hf_hub_download( repo_id='CyberHarem/lind_neuralcloud', repo_type='dataset', filename='dataset-raw.zip', ) # extract files to your directory dataset_dir = 'dataset_dir' os.makedirs(dataset_dir, exist_ok=True) with zipfile.ZipFile(zip_file, 'r') as zf: zf.extractall(dataset_dir) # load the dataset with waifuc source = LocalSource(dataset_dir) for item in source: print(item.image, item.meta['filename'], item.meta['tags']) ``` ## List of Clusters List of tag clustering result, maybe some outfits can be mined here. ### Raw Text Version | # | Samples | Img-1 | Img-2 | Img-3 | Img-4 | Img-5 | Tags | |----:|----------:|:--------------------------------|:--------------------------------|:--------------------------------|:--------------------------------|:--------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| | 0 | 8 | ![](samples/0/clu0-sample0.png) | ![](samples/0/clu0-sample1.png) | ![](samples/0/clu0-sample2.png) | ![](samples/0/clu0-sample3.png) | ![](samples/0/clu0-sample4.png) | 1girl, holding_lollipop, simple_background, solo, star_(symbol), black_gloves, looking_at_viewer, white_background, beret, white_jacket, upper_body, blush, closed_mouth, character_name, collarbone, hood, open_jacket | | 1 | 5 | ![](samples/1/clu1-sample0.png) | ![](samples/1/clu1-sample1.png) | ![](samples/1/clu1-sample2.png) | ![](samples/1/clu1-sample3.png) | ![](samples/1/clu1-sample4.png) | 1girl, black_gloves, black_shorts, black_thighhighs, cleavage, looking_at_viewer, open_clothes, simple_background, solo, star_(symbol), white_background, white_jacket, beret, hood, holding_lollipop, belt, black_sweater, short_shorts, standing | | 2 | 7 | ![](samples/2/clu2-sample0.png) | ![](samples/2/clu2-sample1.png) | ![](samples/2/clu2-sample2.png) | ![](samples/2/clu2-sample3.png) | ![](samples/2/clu2-sample4.png) | 1girl, black_shorts, black_thighhighs, holding_gun, looking_at_viewer, shotgun, solo, star_(symbol), black_shirt, long_sleeves, open_jacket, short_shorts, white_jacket, beret, choker, full_body, simple_background, white_background, black_gloves, blush, collarbone, holding_lollipop, standing, bare_shoulders, knee_pads, off_shoulder | | 3 | 8 | ![](samples/3/clu3-sample0.png) | ![](samples/3/clu3-sample1.png) | ![](samples/3/clu3-sample2.png) | ![](samples/3/clu3-sample3.png) | ![](samples/3/clu3-sample4.png) | 1girl, cleavage, hairclip, solo, star_earrings, white_shirt, collarbone, cone_hair_bun, double_bun, looking_at_viewer, purple_choker, black_bra, blush, holding_lollipop, mouth_hold, nail_polish, sitting, black_bikini, clothes_writing, off-shoulder_shirt, simple_background, white_background, x_hair_ornament | | 4 | 7 | ![](samples/4/clu4-sample0.png) | ![](samples/4/clu4-sample1.png) | ![](samples/4/clu4-sample2.png) | ![](samples/4/clu4-sample3.png) | ![](samples/4/clu4-sample4.png) | 1girl, goggles_on_head, cleavage, navel, side-tie_bikini_bottom, white_bikini, criss-cross_halter, lollipop, looking_at_viewer, solo, blue_sky, blush, cowboy_shot, holding_food, open_mouth, outdoors, ass_visible_through_thighs, bead_bracelet, day, gun, stomach, thigh_gap | ### Table Version | # | Samples | Img-1 | Img-2 | Img-3 | Img-4 | Img-5 | 1girl | holding_lollipop | simple_background | solo | star_(symbol) | black_gloves | looking_at_viewer | white_background | beret | white_jacket | upper_body | blush | closed_mouth | character_name | collarbone | hood | open_jacket | black_shorts | black_thighhighs | cleavage | open_clothes | belt | black_sweater | short_shorts | standing | holding_gun | shotgun | black_shirt | long_sleeves | choker | full_body | bare_shoulders | knee_pads | off_shoulder | hairclip | star_earrings | white_shirt | cone_hair_bun | double_bun | purple_choker | black_bra | mouth_hold | nail_polish | sitting | black_bikini | clothes_writing | off-shoulder_shirt | x_hair_ornament | goggles_on_head | navel | side-tie_bikini_bottom | white_bikini | criss-cross_halter | lollipop | blue_sky | cowboy_shot | holding_food | open_mouth | outdoors | ass_visible_through_thighs | bead_bracelet | day | gun | stomach | thigh_gap | |----:|----------:|:--------------------------------|:--------------------------------|:--------------------------------|:--------------------------------|:--------------------------------|:--------|:-------------------|:--------------------|:-------|:----------------|:---------------|:--------------------|:-------------------|:--------|:---------------|:-------------|:--------|:---------------|:-----------------|:-------------|:-------|:--------------|:---------------|:-------------------|:-----------|:---------------|:-------|:----------------|:---------------|:-----------|:--------------|:----------|:--------------|:---------------|:---------|:------------|:-----------------|:------------|:---------------|:-----------|:----------------|:--------------|:----------------|:-------------|:----------------|:------------|:-------------|:--------------|:----------|:---------------|:------------------|:---------------------|:------------------|:------------------|:--------|:-------------------------|:---------------|:---------------------|:-----------|:-----------|:--------------|:---------------|:-------------|:-----------|:-----------------------------|:----------------|:------|:------|:----------|:------------| | 0 | 8 | ![](samples/0/clu0-sample0.png) | ![](samples/0/clu0-sample1.png) | ![](samples/0/clu0-sample2.png) | ![](samples/0/clu0-sample3.png) | ![](samples/0/clu0-sample4.png) | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | 1 | 5 | ![](samples/1/clu1-sample0.png) | ![](samples/1/clu1-sample1.png) | ![](samples/1/clu1-sample2.png) | ![](samples/1/clu1-sample3.png) | ![](samples/1/clu1-sample4.png) | X | X | X | X | X | X | X | X | X | X | | | | | | X | | X | X | X | X | X | X | X | X | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | 2 | 7 | ![](samples/2/clu2-sample0.png) | ![](samples/2/clu2-sample1.png) | ![](samples/2/clu2-sample2.png) | ![](samples/2/clu2-sample3.png) | ![](samples/2/clu2-sample4.png) | X | X | X | X | X | X | X | X | X | X | | X | | | X | | X | X | X | | | | | X | X | X | X | X | X | X | X | X | X | X | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | 3 | 8 | ![](samples/3/clu3-sample0.png) | ![](samples/3/clu3-sample1.png) | ![](samples/3/clu3-sample2.png) | ![](samples/3/clu3-sample3.png) | ![](samples/3/clu3-sample4.png) | X | X | X | X | | | X | X | | | | X | | | X | | | | | X | | | | | | | | | | | | | | | X | X | X | X | X | X | X | X | X | X | X | X | X | X | | | | | | | | | | | | | | | | | | | 4 | 7 | ![](samples/4/clu4-sample0.png) | ![](samples/4/clu4-sample1.png) | ![](samples/4/clu4-sample2.png) | ![](samples/4/clu4-sample3.png) | ![](samples/4/clu4-sample4.png) | X | | | X | | | X | | | | | X | | | | | | | | X | | | | | | | | | | | | | | | | | | | | | | | | | | | | | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X | X |
提供机构:
CyberHarem
原始信息汇总

数据集概述

基本信息

  • 名称: lind/リンド/琳德 (Neural Cloud)
  • 许可证: MIT
  • 任务类别: text-to-image
  • 标签: art, not-for-all-audiences
  • 大小类别: n<1K

数据集内容

  • 包含内容: 280张图像及其标签
  • 核心标签: blue_eyes, bangs, ahoge, long_hair, breasts, hair_ornament, star_hair_ornament, hat, bags_under_eyes, black_headwear, medium_breasts, grey_hair

数据集包

名称 图像数量 大小 类型 描述
raw 280 395.13 MiB Waifuc-Raw 原始数据,包含元信息(如果图像较大,则最小边对齐到1400像素)
800 280 200.22 MiB IMG+TXT 短边不超过800像素的图像数据集
stage3-p480-800 695 449.30 MiB IMG+TXT 三阶段裁剪数据集,区域不小于480x480像素
1200 280 336.17 MiB IMG+TXT 短边不超过1200像素的图像数据集
stage3-p480-1200 695 673.53 MiB IMG+TXT 三阶段裁剪数据集,区域不小于480x480像素

数据集加载

  • 加载工具: waifuc

  • 加载代码示例: python import os import zipfile

    from huggingface_hub import hf_hub_download from waifuc.source import LocalSource

    下载原始存档文件

    zip_file = hf_hub_download( repo_id=CyberHarem/lind_neuralcloud, repo_type=dataset, filename=dataset-raw.zip, )

    提取文件到你的目录

    dataset_dir = dataset_dir os.makedirs(dataset_dir, exist_ok=True) with zipfile.ZipFile(zip_file, r) as zf: zf.extractall(dataset_dir)

    使用waifuc加载数据集

    source = LocalSource(dataset_dir) for item in source: print(item.image, item.meta[filename], item.meta[tags])

数据集集群

# 样本数 标签
0 8 1girl, holding_lollipop, simple_background, solo, star_(symbol), black_gloves, ...
1 5 1girl, black_gloves, black_shorts, black_thighhighs, cleavage, looking_at_viewer, ...
2 7 1girl, black_shorts, black_thighhighs, holding_gun, looking_at_viewer, shotgun, ...
3 8 1girl, cleavage, hairclip, solo, star_earrings, white_shirt, collarbone, ...
4 7 1girl, goggles_on_head, cleavage, navel, side-tie_bikini_bottom, white_bikini, ...
搜集汇总
数据集介绍
main_image_url
构建方式
该数据集聚焦于《神经网络云》中的角色琳德(lind/リンド/琳德),整合了来自Danbooru、Pixiv、Zerochan等多个平台的图像资源,共计280幅图片及其对应的标签信息。数据采集由DeepGHS团队开发的自动化爬取系统完成,确保了来源的广泛性与多样性。在构建过程中,对核心标签如蓝眼、刘海、呆毛、长发等进行了精细化筛选与修剪,以提升数据质量。数据集提供了多种处理版本,包括原始数据包(保留元信息)、缩放到800或1200像素的标准化版本,以及经过三阶段裁剪、面积不低于480x480像素的高质量裁剪版本,以满足不同训练需求。
特点
该数据集的一大特色在于其丰富的版本设计与标签聚类分析。除原始图像外,提供了多个预处理包,便于用户直接用于文本到图像生成模型的训练。特别地,数据集包含了标签聚类结果,将图像按视觉与语义相似性分为多个簇,每个簇附有代表图像及其标签集合,这有助于挖掘角色的不同装扮与场景模式。例如,簇0聚焦于手持棒棒糖、简单背景的造型,而簇4则展示了户外场景中的比基尼形象。这种结构化组织方式为风格迁移、角色定制等下游任务提供了便利。
使用方法
使用者可通过Hugging Face Hub直接下载数据集压缩包,支持多种格式如原始数据、缩放图像及裁剪图像。对于希望利用元信息的用户,推荐使用waifuc库加载原始数据集:首先通过huggingface_hub下载dataset-raw.zip,解压后利用LocalSource接口读取图像及其标签,便于进行二次开发。此外,数据集提供的标签聚类表可作为先验知识,辅助用户快速定位特定风格或装扮的子集,从而高效地筛选训练数据或进行模型微调。
背景与挑战
背景概述
在文本到图像生成领域,高质量、标注精细的角色数据集是驱动模型精准刻画特定人物形象的关键资源。CyberHarem/lind_neuralcloud 数据集由 DeepGHS 团队于近期构建并发布,聚焦于游戏《云图计划》中的角色“琳德”(lind/リンド)。该团队通过自动化爬取系统从 Danbooru、Pixiv、Zerochan 等多个知名艺术社区收集了 280 张图像,并为每张图像配备了详尽的标签体系,核心特征如“蓝眼”、“灰色长发”、“星形发饰”等被精心筛选与保留。这一数据集不仅为研究者提供了丰富的角色视觉素材,更通过多分辨率版本(如 800px、1200px)及阶段性裁剪处理,满足了不同训练场景的需求,对推动二次元角色定制化生成模型的研发具有显著参考价值。
当前挑战
该数据集所面临的挑战首先体现在领域问题的复杂性上:文本到图像生成任务要求模型能根据细粒度标签(如“持枪”、“棒棒糖”、“白色夹克”)精准合成角色在不同姿态与装扮下的图像,而 280 张的样本量对捕捉琳德多样的外观变化(如 5 个服饰聚类)构成了显著局限。其次,构建过程中遭遇多重技术难题:自动化爬取自多个来源的图像需处理版权与质量差异,原始数据必须经过严格的边缘对齐与裁剪(如 480×480 像素最小区域)以消除噪声;标签的冗余与缺失需通过修剪核心标签来平衡描述精度与学习效率;此外,不同分辨率版本(raw、800、1200)的存储与分发策略也需兼顾训练效率与空间开销,这些环节均对数据集的可用性提出了严峻考验。
常用场景
经典使用场景
在文本到图像生成领域,CyberHarem/lind_neuralcloud 数据集为角色一致性生成任务提供了精良的训练素材。该数据集收纳了280张来自Danbooru、Pixiv等平台的琳德(Neural Cloud)角色图像,并附带了精细的标签注释,涵盖发型、服饰、配饰等核心属性。研究者可借助此数据集微调扩散模型,使其在生成特定虚拟角色时保持外观特征的高度一致性,从而推动可控图像生成技术在动漫角色创作中的发展。
解决学术问题
该数据集有效回应了多模态生成领域中角色身份保真度的关键挑战。通过提供结构化标签与多分辨率版本(如800px与1200px的裁剪变体),它解决了训练数据中图像尺度不一、标签噪声高等常见问题。其聚类分析结果更可辅助挖掘角色不同装束的潜在关联,为细粒度视觉概念解耦研究提供实证基础,进而推动生成模型在复杂语义控制下的鲁棒性提升。
衍生相关工作
围绕此数据集,已衍生出基于标签聚类分析的角色风格迁移研究,以及针对动漫角色多视角生成的条件控制模型。例如,DeepGHS团队开发的自动化爬取与标注系统为同类数据集的构建树立了范式,而3阶段裁剪策略(stage3-p480-800)则被后续工作借鉴以优化训练数据质量。这些成果共同夯实了特定领域生成任务的数据基础设施,推动了二次元角色生成技术的标准化进程。
以上内容由遇见数据集搜集并总结生成
二维码
社区交流群
二维码
科研交流群
商业服务