soundstarrain/hu-lightnovels-clean

--- language: - hu pretty_name: hu-lightnovels-clean license: other license_name: custom-restricted-fan-translation tags: - hungarian - light-novel - fan-translation - curated - restricted size_categories: - 10K<n<100K configs: - config_name: default data_files: - split: train path: lines-*.parquet --- hu-lightnovels-clean is a cleaned Hungarian light novel dataset built from Baka-Tsuki Hungarian project pages and recoverable linked Hungarian fan-translation sources. The dataset contains 3 series, 47 chapters, and 16,523 line-level records organized from a series / volume / chapter corpus, with 1,089,440 characters, 158,775 words, and 446,830 tokens measured with the Qwen/Qwen3-8B tokenizer. The default Hugging Face dataset view uses one row per text line. The original hierarchical text layout under `novels/` is preserved alongside the standard `lines-*.parquet` export. The source texts were manually reviewed and additionally strict-cleaned to remove obvious wrong-language pages, placeholder pages, glossary pages, Wikipedia/archive/project pages, translator-note pages, duplicated entries, and other non-story material, while keeping in-book forewords, afterwords, author notes, and commentary when they belonged to the original volume. Copyright and translation rights remain with the original rightsholders, publishers, and/or translators. This dataset should be treated as a restricted research dataset and should not be assumed to be freely redistributable or commercially reusable.