soundstarrain/it-lightnovels-clean

--- language: - it pretty_name: it-lightnovels-clean license: other license_name: custom-restricted-fan-translation tags: - italian - light-novel - fan-translation - curated - restricted size_categories: - 100K<n<1M configs: - config_name: default data_files: - split: train path: lines-*.parquet --- it-lightnovels-clean is a cleaned Italian light novel dataset built from Baka-Tsuki Italian project pages and recoverable linked Italian fan-translation sources. The dataset contains 20 series, 460 chapters, and 279,514 line-level records organized from a series / volume / chapter corpus, with 16,920,015 characters, 2,693,666 words, and 5,052,408 tokens measured with the Qwen/Qwen3-8B tokenizer. The default Hugging Face dataset view uses one row per text line. The original hierarchical text layout under `novels/` is preserved alongside the standard `lines-*.parquet` export. The source texts were manually reviewed and additionally strict-cleaned to remove obvious wrong-language pages, placeholder pages, glossary pages, Wikipedia/archive/project pages, translator-note pages, duplicated entries, and other non-story material, while keeping in-book forewords, afterwords, author notes, and commentary when they belonged to the original volume. Copyright and translation rights remain with the original rightsholders, publishers, and/or translators. This dataset should be treated as a restricted research dataset and should not be assumed to be freely redistributable or commercially reusable.