Complete-FABLE.5-traces-2M

<p align="center"> <img src="https://huggingface.co/datasets/Crownelius/Complete-FABLE.5-traces-2M/resolve/c6990bf1e5f394fdf5760a09ef9d2a0363697dfc/assets/fablelibrary.png" alt="Fable Library by Crownelius" width="100%"> </p> <div align="center"> # Complete FABLE.5 Traces 2M <strong>Provenance-cleaned FABLE.5 / Claude corpus — trimmed to content-verified traces only.</strong> [`Dataset Viewer`](https://huggingface.co/datasets/Crownelius/Complete-FABLE.5-traces-2M/viewer/default/train) | [`Parquet`](data/train.parquet) </div> This dataset is a post-closure compilation of FABLE.5 / Claude trace datasets found on Hugging Face after the closure of Fable and Mythos. It is deduplicated at the normalized-row level and keeps row-level provenance through `first_source_dataset`, `first_source_config`, `first_source_split`, and `first_source_row_index`. **A provenance pass has since removed material that was matched only by dataset name/keyword and was not genuine FABLE.5 / Claude data — see [What Changed](#what-changed).** <div style="background:#041315;border:1px solid #13c8d3;border-radius:10px;padding:18px;margin:18px 0;color:#dffcff;"> <div style="font-size:13px;text-transform:uppercase;letter-spacing:.18em;color:#91fff1;">Verified Corpus Snapshot</div> <div style="display:flex;flex-wrap:wrap;gap:12px;margin-top:14px;"> <div style="min-width:160px;flex:1;border:1px solid #1f7f83;border-radius:8px;padding:12px;background:#071b1d;"><strong style="font-size:24px;color:#efffff;">50,651</strong><br><span>verified rows</span></div> <div style="min-width:160px;flex:1;border:1px solid #1f7f83;border-radius:8px;padding:12px;background:#071b1d;"><strong style="font-size:24px;color:#efffff;">2,006,487</strong><br><span>original combined size</span></div> <div style="min-width:160px;flex:1;border:1px solid #1f7f83;border-radius:8px;padding:12px;background:#071b1d;"><strong style="font-size:24px;color:#efffff;">~98%</strong><br><span>of original removed</span></div> </div> </div> <div style="background:#1a1204;border:1px solid #d39a13;border-radius:10px;padding:18px;margin:18px 0;color:#fff5df;"> <div style="font-size:13px;text-transform:uppercase;letter-spacing:.18em;color:#ffd479;">&#9888; Correction — provenance cleanup</div> <p style="margin:10px 0 0;">An earlier version advertised <strong>~2,006,487 "FABLE.5 traces."</strong> On inspection, ~98% was <strong>not</strong> FABLE.5 / Claude data — it had been matched by dataset <em>name/keyword</em> ("fable", "mythos", "claude") rather than verified by row content. That contamination has been removed and the corpus rebuilt from <strong>content-verified rows only</strong>.</p> </div> ## What Changed A provenance and quality pass rebuilt the corpus so that **every row is content-verified** as genuine FABLE.5 / Claude model-interaction data (Anthropic `toolu_…` tool-use IDs, Claude Code harness markers, `/model → Fable 5`, or `model: claude-fable-5` tags) — judged on **row content, not dataset name**. Each source verdict was adversarially re-checked. **Original combined size: 2,006,487 rows → 50,651 verified rows.** That is **40,421** verified rows kept from the original (~2%) plus **10,230** content-verified rows added from 8 sources. ### Removed — matched by keyword/name, not genuine FABLE.5 / Claude | Rows | Source | What it actually was | | ---: | --- | --- | | 1,100,000 | `attentionAllYouNeed/Vibe-Coding-Claude-Fable-5` | Procedurally-generated template filler (a few stems × a "Scenario N" counter); no trace structure. "Claude"/"Fable" only in the name. | | 775,175 of 776,496 | `Poumrm/Mythos-5-and-Fabel-5-Class-Model-Outputs` | Generic synthetic SFT ("Class Model Outputs"). Only ~0.16% were real traces — those **1,321** were salvaged; the rest removed. | | 40,215 | `BerkayBB/MythosAi` | Turkish news-summarization corpus. Matched on "mythos". | | 25,000 | `ansulev/claude_mythos_distilled_25k` | Self-declared synthetic imitation — its own card states *"Not real Claude/Mythos outputs."* | | 7,635 | `desiree/mythos-coder-data` | Procedurally slot-filled synthetic coding exercises. | | 7,090 | `umm-maybe/wikisource-cthulhu-mythos` | Public-domain Lovecraft / Cthulhu-mythos fiction. Matched on "mythos". | | 951 | `Glint-Research/mythosmini` | Synthetic tool-use traces of unknown provenance (upstream now private). | | 551 | `ox-ox/mythos-character-distillation` | Majority Gemini/manual-generated + short-story fiction. | | 347 | `ronniealfaro/mythos` | Spanish mythology/philosophy essays. Matched on "mythos". | | 192 | `HelioAI/Fable-5-Distill-Reasoning-462x` | CoT distilled from an unspecified "Mythos V2" teacher — not verifiably Anthropic. | A **row-level validity filter** was also applied to the kept sources: only **QA**, **chain-of-thought**, and **agent/tool-use** rows with a real question **and** a substantive response are retained. Dropped: control/envelope events (`queue-operation`, `mode`, `permission-mode`, session pointers, UI/paste metadata), model-fallback markers, empty/`null` content, placeholder stubs (e.g. `***…***`), author-flagged `decoy` rows, questions with no answer, and unstructured/whole-document dumps. ### Added — content-verified and deduplicated by `sha256(row_json)` (8 sources, 10,230 rows) | Rows | Source | Notes | | ---: | --- | --- | | 5,060 | `lordx64/fable-tool-use-sft` | FABLE.5 tool-use pairs (`<tool_use … id="toolu_…">` XML format). | | 4,460 | `Glint-Research/Fable-5-traces` | Canonical FABLE.5 trace hub (`messages`/`tools`/`trace`). | | 347 | `armand0e/Fable-5-Chat` | FABLE.5 chat Q&A pairs. | | 174 | `licongxu/fable5-flamingo-research-trace` | Claude Code research-session trace events. | | 107 | `cfahlgren1/Fable-5-traces` | Curated Claude Code sessions. | | 63 | `suayptalha/fable-5-claude-code` | Claude Code coding sessions. | | 18 | `AlinCiocan/fable-5-claude-code-traces` | Claude Code sessions. | | 1 | `victor/claude-fable-worldcup-2026-session` | Single long Claude Code session. | Verified-but-excluded this round: `choucsan/mimo-claude-code-traces-1k` (MiniMax **MiMo** model, mislabeled `claude-fable-5`), `lordx64/fable-sft-combined-v2` (derivative re-combine of already-included data), `Sexyeinstein/Agent` (redundant raw dumps of already-included sessions), `hotdogs/uka-fable-reasoning` (gated — content not verifiable). ### Files | File | Rows | Purpose | | --- | ---: | --- | | `data/train.parquet` | 2,006,487 → **50,651** | Canonical, viewer-friendly Parquet split. | The previous `raw/fable5_mythos_dedup.jsonl.gz` mirror was **removed** — it held the pre-cleanup contaminated export. <div style="background:#041315;border:1px solid #13c8d3;border-radius:10px;padding:16px;margin:18px 0;color:#dffcff;"> <div style="font-size:13px;text-transform:uppercase;letter-spacing:.18em;color:#91fff1;">Provenance &amp; honesty</div> <p style="margin:10px 0 0;">Retained rows are content-verified and attributed to FABLE.5 / Claude by their upstream sources. This provenance is <strong>source-asserted and content-verified — not cryptographically certified by Anthropic</strong>, and this dataset does not claim Anthropic endorsement. There is no method to prove text was emitted by a specific model; the cleanup removes keyword/name-matched contamination and keeps genuine QA / CoT / agent-trace data.</p> </div> ## Schema | Column | Type | Description | | --- | --- | --- | | `row_hash` | string | SHA256 of the normalized original row JSON. | | `first_source_dataset` | string | First dataset where this canonical row was observed. | | `first_source_config` | string | First observed config or loader surface. | | `first_source_split` | string | First observed split, file, or local extraction label. | | `first_source_row_index` | int64 | Row index within the first observed source surface. | | `seen_count` | int64 | Number of times this canonical row was seen during the pass. | | `row_json` | string | Preserved original row as canonical JSON. Parse this for source-specific fields. | ## Source Citations Every row can be traced back to the dataset where that canonical row was first observed, via the `first_source_*` fields. <details> <summary><strong>Retained sources: 16 Hugging Face datasets (50,651 rows)</strong></summary> | Rows | Source Dataset | Link | | ---: | --- | --- | | 16,979 | `1EYE4ALL/Fable-5-traces` | [dataset](https://huggingface.co/datasets/1EYE4ALL/Fable-5-traces) | | 11,947 | `armand0e/claude-fable-5-claude-code` | [dataset](https://huggingface.co/datasets/armand0e/claude-fable-5-claude-code) | | 5,060 | `lordx64/fable-tool-use-sft` | [dataset](https://huggingface.co/datasets/lordx64/fable-tool-use-sft) | | 4,460 | `Glint-Research/Fable-5-traces` | [dataset](https://huggingface.co/datasets/Glint-Research/Fable-5-traces) | | 4,399 | `Swarm-AI-Research/fable5-traces-sft` | [dataset](https://huggingface.co/datasets/Swarm-AI-Research/fable5-traces-sft) | | 4,022 | `lordx64/agentic-distill-fable-5-sft` | [dataset](https://huggingface.co/datasets/lordx64/agentic-distill-fable-5-sft) | | 1,321 | `Poumrm/Mythos-5-and-Fabel-5-Class-Model-Outputs` (salvaged) | [dataset](https://huggingface.co/datasets/Poumrm/Mythos-5-and-Fabel-5-Class-Model-Outputs) | | 815 | `victor/fable-5-boeing-747-trace` | [dataset](https://huggingface.co/datasets/victor/fable-5-boeing-747-trace) | | 591 | `PawanKrd/claude-fable-5-code` | [dataset](https://huggingface.co/datasets/PawanKrd/claude-fable-5-code) | | 347 | `TheFusionCube/Fable-5-CoT-Traces` | [dataset](https://huggingface.co/datasets/TheFusionCube/Fable-5-CoT-Traces) | | 347 | `armand0e/Fable-5-Chat` | [dataset](https://huggingface.co/datasets/armand0e/Fable-5-Chat) | | 174 | `licongxu/fable5-flamingo-research-trace` | [dataset](https://huggingface.co/datasets/licongxu/fable5-flamingo-research-trace) | | 107 | `cfahlgren1/Fable-5-traces` | [dataset](https://huggingface.co/datasets/cfahlgren1/Fable-5-traces) | | 63 | `suayptalha/fable-5-claude-code` | [dataset](https://huggingface.co/datasets/suayptalha/fable-5-claude-code) | | 18 | `AlinCiocan/fable-5-claude-code-traces` | [dataset](https://huggingface.co/datasets/AlinCiocan/fable-5-claude-code-traces) | | 1 | `victor/claude-fable-worldcup-2026-session` | [dataset](https://huggingface.co/datasets/victor/claude-fable-worldcup-2026-session) | </details> <details> <summary><strong>Removed sources: 10 datasets (keyword/name matches, not genuine FABLE.5 / Claude)</strong></summary> | Rows removed | Source Dataset | Link | | ---: | --- | --- | | 1,100,000 | `attentionAllYouNeed/Vibe-Coding-Claude-Fable-5` | [dataset](https://huggingface.co/datasets/attentionAllYouNeed/Vibe-Coding-Claude-Fable-5) | | 775,175 | `Poumrm/Mythos-5-and-Fabel-5-Class-Model-Outputs` (non-trace bulk) | [dataset](https://huggingface.co/datasets/Poumrm/Mythos-5-and-Fabel-5-Class-Model-Outputs) | | 40,215 | `BerkayBB/MythosAi` | [dataset](https://huggingface.co/datasets/BerkayBB/MythosAi) | | 25,000 | `ansulev/claude_mythos_distilled_25k` | [dataset](https://huggingface.co/datasets/ansulev/claude_mythos_distilled_25k) | | 7,635 | `desiree/mythos-coder-data` | [dataset](https://huggingface.co/datasets/desiree/mythos-coder-data) | | 7,090 | `umm-maybe/wikisource-cthulhu-mythos` | [dataset](https://huggingface.co/datasets/umm-maybe/wikisource-cthulhu-mythos) | | 951 | `Glint-Research/mythosmini` | [dataset](https://huggingface.co/datasets/Glint-Research/mythosmini) | | 551 | `ox-ox/mythos-character-distillation` | [dataset](https://huggingface.co/datasets/ox-ox/mythos-character-distillation) | | 347 | `ronniealfaro/mythos` | [dataset](https://huggingface.co/datasets/ronniealfaro/mythos) | | 192 | `HelioAI/Fable-5-Distill-Reasoning-462x` | [dataset](https://huggingface.co/datasets/HelioAI/Fable-5-Distill-Reasoning-462x) | </details> ## Loading ```python from datasets import load_dataset ds = load_dataset("Crownelius/Complete-FABLE.5-traces-2M", split="train") ```