IKMLab-team/hk_content_corpus_mysql

HK Web Text Corpus (MySQL Dump, raw version) 是一个大规模原始文本语料库，主要收集自香港的公共网络资源，包括新闻网站、在线论坛、百科全书和餐厅评论等，特别关注香港粤语和繁体中文的使用。该数据集以MySQL转储文件的形式提供，用于生成香港内容语料库，并用于研究双语现象对香港语言建模的影响。该数据库旨在用于存档和可重现性目的，可能包含噪声、重复、HTML标记等。

The HK Web Text Corpus (MySQL Dump, raw version) is a large-scale raw text corpus collected primarily from various Hong Kong public web sources, including news sites, online forums, encyclopedias, and restaurant reviews, with a focus on Hong Kong Cantonese and Traditional Chinese usage. The dataset is provided in the form of a MySQL dump file and was used to generate the Hong Kong Content Corpus for studying the effect of diglossia on Hong Kong language modeling. The database is intended for archival and reproducibility purposes and may contain noise, duplication, HTML markup, etc.