huntoken - tokenizer and sentence splitter

Name: huntoken - tokenizer and sentence splitter
Creator: 暂无描述
License: 暂无描述

B2FIND2026-04-25 收录

下载链接：

https://b2find.eudat.eu/dataset/a607e112-e3b7-5ce0-a63b-2d4ca5b661f1

下载链接

链接失效反馈

官方服务：

资源简介：

HunToken is a rule based tokenizer and sentence boundary detector for Hungarian (and English) texts.