turkish-nlp-suite/temiz-Wiki
收藏Hugging Face2026-02-16 更新2026-02-07 收录
下载链接:
https://hf-mirror.com/datasets/turkish-nlp-suite/temiz-Wiki
下载链接
链接失效反馈官方服务:
资源简介:
这是一个经过清理的土耳其语维基百科数据集,源数据来自wikimedia/wikipedia数据集。清理过程包括删除低于预定阈值的短文本(按单词和字符数计算),然后进行了NFKC标准化处理,清除非ASCII字符,并标准化了空白字符。
A cleaned version of Turkish Wikipedia dataset. The soource is wikimedia/wikipedia dataset. The text is cleaned throughoutly, first of all we eliminated text that are shorter than a predetermined threshold of words and characters. Then we normalized with NFKC, cleaned some non-ASCII chars and normalized whitespaces.
提供机构:
turkish-nlp-suite



