five

soundstarrain/en-lightnovels-clean

收藏
Hugging Face2026-03-21 更新2026-03-29 收录
下载链接:
https://hf-mirror.com/datasets/soundstarrain/en-lightnovels-clean
下载链接
链接失效反馈
官方服务:
资源简介:
--- language: - en pretty_name: en-lightnovels-clean license: other license_name: custom-restricted-fan-translation tags: - english - light-novel - fan-translation - curated - restricted size_categories: - 1M<n<10M configs: - config_name: default data_files: - split: train path: lines-*.parquet --- en-lightnovels-clean is a cleaned English light novel dataset built from Baka-Tsuki English project pages and recoverable linked English fan-translation sources. The dataset contains 146 series, 17773 chapters, and 7,604,221 line-level records organized from a series / volume / chapter corpus, with 391,097,448 characters, 68,001,661 words, and 89,528,649 tokens measured with the Qwen/Qwen3-8B tokenizer. The default Hugging Face dataset view uses one row per text line. The original hierarchical text layout under `novels/` is preserved alongside the standard `train-*.parquet` export. The source texts were manually reviewed and additionally strict-cleaned to remove obvious wrong-language pages, placeholder pages, glossary pages, Wikipedia/archive/project pages, translator-note pages, duplicated entries, and other non-story material, while keeping in-book forewords, afterwords, author notes, and commentary when they belonged to the original volume. Copyright and translation rights remain with the original rightsholders, publishers, and/or translators. This dataset should be treated as a restricted research dataset and should not be assumed to be freely redistributable or commercially reusable.
提供机构:
soundstarrain
5,000+
优质数据集
54 个
任务类型
进入经典数据集
二维码
社区交流群

面向社区/商业的数据集话题

二维码
科研交流群

面向高校/科研机构的开源数据集话题

数据驱动未来

携手共赢发展

商业合作