National Institute of the Korean Language Corpus 国家韩语语料库研究所

对于自然语言处理和语言学家来说，单词在语言中出现的频率是重要的信息。在自然语言处理中，非常频繁的单词往往比不太频繁的单词具有更少的信息，并且在预处理过程中经常被删除。该数据集包含有关韩语的频率信息，有8000万人使用。对于每个项目，都提供了频率（它在语料库中出现的次数）及其相对于其他引理的相对等级。

For researchers in natural language processing (NLP) and linguists, the frequency of word occurrence in a language constitutes critical information. In the field of NLP, extremely frequent words generally carry less informational value than infrequent counterparts, and are often removed during text preprocessing. This dataset provides frequency information for the Korean language, which is spoken by 80 million people. For each entry, both the frequency (the number of times it appears in the corpus) and its relative rank compared to other lemmas are provided.

搜集汇总

背景与挑战

背景概述

该数据集由国立韩国语学院提供，包含韩语的频率信息，用于自然语言处理研究，涵盖单词在语料库中的出现次数和相对排名。数据集包含六个子文件，涉及字母、音节、外来词和非标准词等不同方面的频率数据，遵循非商业性开放许可。