遇见数据集

Lists of Uzbek Stopwords

收藏
Zenodo2022-04-25 更新2026-05-25 收录
数据链接:
官方服务:

资源简介:

The dataset presents 3 lists of stopwords in the Uzbek language. The lists were constructed using three automatic methods applied to the same corpus. The corpus was constructed by obtaining a source of 25 school textbooks, it was named "School corpus". The total number of words in the "School corpus" is 731156. And them 47165 words are unique words. The corpus can be re-constructed using the list of urls of all files comprised in the corpus. The list is part of the dataset (list_of_urls_of_school_corpus.txt). Description of the methods and the lists: A set of grammar rules and the TDIDF algorithm was used to automatically collect a list of single-word stopwords. 2357 stopwords were collected. The name of the file: stopwords_unigrams.txt. A bigram method was used to extract a list of 4548 bigrams (pairs) of stopwords. The name of the file: stopwords_bigrams.txt. A set of two-word collocations as stopwords was also extracted. The list has 24490 pairs of stopwords. The name of the file: stopwords_bigrams_with_collocations.txt.

提供机构:
Zenodo
创建时间:
2022-04-25
二维码
社区交流群
二维码
科研交流群
商业服务