huntoken - tokenizer and sentence splitter
收藏B2FIND2026-04-25 收录
下载链接：
https://b2find.eudat.eu/dataset/a607e112-e3b7-5ce0-a63b-2d4ca5b661f1
下载链接
链接失效反馈官方服务：
资源简介：
HunToken is a rule based tokenizer and sentence boundary detector for Hungarian (and English) texts.
