IKMLab-team/hk_content_corpus

HK内容语料库是一个包含香港粤语和繁体中文文本的数据集，总大小为9.44GB。该数据集由8个来源特定的清洁子语料库组成，这些子语料库从公共网站和平台爬取而来，包括新闻网站、在线论坛、百科全书和餐厅评论。该数据集最初是为了研究双言现象对香港语言建模影响而创建的。每个文件存储纯UTF-8文本，每条记录占一行，空行作为分隔符。该数据集也可在Zenodo上获取。

The HK Content Corpus is a dataset containing text in Hong Kong Cantonese and Traditional Chinese, with a total size of 9.44GB. The dataset consists of eight source-specific clean sub-corpora, crawled from public websites and platforms, including news sites, online forums, encyclopedias, and restaurant reviews. The corpus was initially created for studying the effect of diglossia on Hong Kong language modeling. Each file stores plain UTF-8 text, where each record occupies one line, and blank lines serve as separators. The dataset is also available on Zenodo.