Hakureirm/bird-species-10k

# Bird-10K SigLIP Training Dataset Taxonomy-aware image-text dataset for fine-tuning SigLIP on 10,753 bird species. ## Dataset Structure ``` taxonomy.json # eBird v2025 taxonomy (species/genus/family/order hierarchy) hard_negatives.json # Same-genus & same-family negative sampling index siglip_train.jsonl # 692,236 training image-text pairs siglip_val.jsonl # 32,125 validation pairs images_224_*.tar.gz # 224x224 bird images organized by species (from bird-species-10k) DATA_NOTES.md # Data provenance and quality notes ``` ## Record Format (jsonl) ```json { "image": "path/to/image.jpg", "taxonomy_version": "ebird_v2025", "species": "Abbott's Babbler", "scientific_name": "Malacocincla abbotti", "cn_name": "阿氏雅鹛", "genus": "Malacocincla", "family": "雀眉科", "order": "雀形目", "description": "Plain, sandy-brown babbler with...", "desc_source": "ebird_original", "texts": { "species": ["A photo of a Abbott's Babbler.", ...], "species_taxonomy": ["Abbott's Babbler (Malacocincla abbotti), a bird of the family 雀眉科.", ...], "genus": ["A bird of the genus Malacocincla.", ...], "family": ["A bird in the family 雀眉科.", ...], "bilingual": ["Abbott's Babbler / 阿氏雅鹛（Malacocincla abbotti）", ...], "chinese": ["阿氏雅鹛（Malacocincla abbotti），属于雀形目雀眉科。", ...] }, "hard_negatives": { "same_genus": ["Black-browed Babbler", "Horsfield's Babbler"], "same_family_count": 63 } } ``` ## Statistics - **Species**: 10,753 (with images) / 10,805 (total taxonomy) - **Images**: 724,342 - **Taxonomy**: 42 orders / 286 families / 2,345 genera - **Text templates**: 6 levels (species / species_taxonomy / genus / family / bilingual / chinese) - **Descriptions**: 99.8% from eBird (0% LLM-generated) ## Training Recipe Joint training with: - **SigLIP sigmoid contrastive loss** (image-text alignment) - **Species classification head** (λ=1.0) - **Genus classification head** (λ=0.3) - **Family classification head** (λ=0.1) - **Taxonomy-aware hard negative sampling** (same-genus priority) ## Taxonomy Based on eBird/Clements v2025. All order/family names standardized to simplified Chinese with proper suffixes (目/科). ## License Research and educational use.# Bird-10K SigLIP 训练数据集 针对10753种鸟类微调SigLIP(SigLIP)的分类感知图文数据集。 ## 数据集结构 taxonomy.json # eBird v2025 分类体系文件（包含物种/属/科/目层级结构） hard_negatives.json # 同属及同科负样本采样索引文件 siglip_train.jsonl # 692,236 条训练图文对 siglip_val.jsonl # 32,125 条验证集图文对 images_224_*.tar.gz # 按物种组织的224×224分辨率鸟类图像（源自bird-species-10k数据集） DATA_NOTES.md # 数据集来源与质量说明文档 ## 单条记录格式（jsonl） json { "image": "图像文件路径", "taxonomy_version": "eBird_v2025", "species": "阿博特雅鹛（Abbott's Babbler）", "scientific_name": "Malacocincla abbotti", "cn_name": "阿氏雅鹛", "genus": "Malacocincla", "family": "雀眉科", "order": "雀形目", "description": "体羽质朴，呈沙褐色的鹛类...", "desc_source": "ebird_original", "texts": { "species": ["一张阿博特雅鹛的照片。", ...], "species_taxonomy": ["阿博特雅鹛（Malacocincla abbotti），隶属于雀眉科的鸟类。", ...], "genus": ["一种属于Malacocincla属的鸟类。", ...], "family": ["一种雀眉科的鸟类。", ...], "bilingual": ["Abbott's Babbler / 阿氏雅鹛（Malacocincla abbotti）", ...], "chinese": ["阿氏雅鹛（Malacocincla abbotti），属于雀形目雀眉科。", ...] }, "hard_negatives": { "same_genus": ["黑眉雅鹛", "霍斯菲尔德雅鹛"], "same_family_count": 63 } } ## 数据集统计 - **物种数量**：带图像标注的10,753种 / 分类体系内总计10,805种 - **图像总量**：724,342张 - **分类层级**：42个目 / 286个科 / 2,345个属 - **文本模板类别**：共6类（物种级、物种分类学级、属级、科级、双语级、中文级） - **物种描述来源**：99.8%源自eBird平台（无大语言模型生成内容） ## 训练方案 采用联合训练策略，结合以下模块： - **SigLIP Sigmoid对比损失**（用于图文对齐任务） - **物种分类头**（权重λ=1.0） - **属分类头**（权重λ=0.3） - **科分类头**（权重λ=0.1） - **分类感知难例采样**（优先采用同属负样本） ## 分类体系说明 本数据集基于eBird/Clements v2025分类体系构建，所有目、科名称均已标准化为简体中文并添加对应后缀（目/科）。 ## 授权协议 仅可用于科研与教育用途。