THUCNews Chinese News Text Classification Dataset

THUCTC (THU Chinese Text Classification) is a Chinese text classification toolkit developed by the Natural Language Processing Laboratory of Tsinghua University. It can efficiently automate the training, evaluation, and classification of user-defined text classification corpora. Text classification typically involves three steps: feature selection, feature dimensionality reduction, and model training. Selecting appropriate text features and performing dimensionality reduction are challenging problems in Chinese text classification. Based on years of research experience in Chinese text classification, our team has chosen bigram (two-character strings) as the feature unit in THUCTC, with Chi-square as the dimensionality reduction method, tf-idf as the weight calculation method, and LibSVM or LibLinear as the classification model. THUCTC demonstrates good versatility for open-domain long texts, is independent of the performance of any Chinese word segmentation tool, and offers the advantages of high accuracy and fast testing speed.