shahulyn/dhivehi-kenlm-corpus
收藏Hugging Face2026-02-10 更新2026-03-29 收录
下载链接：
https://hf-mirror.com/datasets/shahulyn/dhivehi-kenlm-corpus
下载链接
链接失效反馈官方服务：
资源简介：
---
language: dv
license: apache-2.0
tags:
- dhivehi
- kenlm
- language-model
- speech-recognition
---
# Dhivehi KenLM Language Model
This repository contains a 5-gram KenLM language model built from the HuggingFace dataset:
alakxender/dhivehi-news-corpus
The corpus was cleaned and normalized to Thaana Unicode and used to improve Dhivehi ASR decoding (Wav2Vec2/XLS-R CTC).
## Files
- dhivehi.bin — KenLM binary language model (use this for decoding)
- dhivehi_corpus_raw.txt.gz — cleaned Dhivehi news text corpus
## Purpose
This LM is designed to be used with CTC-based ASR systems (Wav2Vec2 / XLS-R) via pyctcdecode to:
- correct spelling
- insert spaces
- prefer real Dhivehi words
- dramatically improve dictation accuracy
提供机构：
shahulyn
