Test Data

This dataset provides chinese erotic texts. We crawl and clean the data from several famous erotic story websites. We provide the raw files of the pages and the cleaned files. We also provide all the tools used to build the dataset. 这个数据集提供中文情色文本。我们从几个著名的色情故事网站抓取并清理数据。我们提供网页的原始文件和清理后的文件。我们还提供了用于建立该数据集的所有工具。 Specifically, the dataset includes the following sites (size of cleaned files in parentheses): 具体来说,数据集包括以下站点(括号内为清理后的文件的大小): 冰戀網(95.0 MB) 風月文學網(681 MB) 污污虾(2.87 GB) CA情色小說(42.8 MB) TS人生(179 MB) How we cleaned the data: We design the XPath expression to extract the title and body text from the page. For websites in traditional chinese, we convert the extracted content to simplified chinese. 我们是如何清理数据的: 我们设计了XPath表达式来提取页面中的标题和正文。对于繁体中文网站,我们将提取的内容转换为简体中文。 The cleaned text can be used to train your language model. We expect to see a ChatGPT that generates erotic content. You can also do some other interesting things with the raw files. 清洗过的文本可以用来训练你的语言模型。我们期望看到一个能生成色情内容的ChatGPT。你还可以用原始文件做一些其他有趣的事情。