kanhatakeyama/japanese-corpus-categorized
收藏Hugging Face2024-09-28 更新2024-12-14 收录
下载链接：
https://hf-mirror.com/datasets/kanhatakeyama/japanese-corpus-categorized
下载链接
链接失效反馈官方服务：
资源简介：
该数据集是基于mc4-ja等网络语料库进行清洗后，通过无监督学习模型将文本聚类成约1万条记录的日语语料库。该数据集可用于信息解析目的，符合著作权法的规定。需要注意的是，并非所有文件都已转换为parquet格式，文件列表可在指定文件夹内查看。
This is a Japanese corpus that has been cleaned and clustered using an unsupervised learning model to cluster texts into approximately 10,000 items. The corpus can be used for information analysis purposes permitted by copyright law. Note that not all files are converted to parquet format, and the file list can be found in the specified folder.
提供机构：
kanhatakeyama
