five

cjvt/sloleks

收藏
Hugging Face2024-02-11 更新2024-03-04 收录
下载链接:
https://hf-mirror.com/datasets/cjvt/sloleks
下载链接
链接失效反馈
官方服务:
资源简介:
--- license: cc-by-sa-4.0 --- # Dataset Card for Sloleks 3 **Important**: this is a mostly complete script for processing Sloleks 3. Certain data properties may not be exposed through the script. Please see the [CLARIN repository](https://www.clarin.si/repository/xmlui/handle/11356/1745) for full details on what the dataset contains, and open an issue or a pull request if you require some other information from the raw data. ### Dataset Summary Sloleks is a reference morphological lexicon of Slovene that was developed to be used in various NLP applications and language manuals. It contains Slovene lemmas, their inflected or derivative word forms and the corresponding grammatical description. In addition to the approx. 100,000 entries already available in [Sloleks 2.0](http://hdl.handle.net/11356/1230), Sloleks 3.0 contains an additional cca. 265,000 newly generated entries from the most frequent lemmas in [Gigafida 2.0](http://hdl.handle.net/11356/1320) not yet included in previous versions of Sloleks. For verbs, adjectives, adverbs, and common nouns, the lemmas were checked manually by three annotators and included in Sloleks only if confirmed as legitimate by at least one annotator. No manual checking was performed on proper nouns. Lemmatization rules, part-of-speech categorization and the set of feature-value pairs follow the [MULTEXT-East morphosyntactic specifications for Slovenian](https://nl.ijs.si/ME/V6/msd/html/msd-sl.html). ### Supported Tasks and Leaderboards Other (the data is a knowledge base - lexicon). ### Languages Slovenian. ## Dataset Structure ### Data Instances Entry for the verb `absorbirati` (English: *to absorb*): ``` { 'headword_lemma': 'absorbirati', 'pos': 'verb', 'lex_unit': {'id': 'LE_a293f9ab871299f116dff2cc1421367a', 'form': 'absorbirati', 'key': 'G_absorbirati', 'type': 'single'}, 'word_forms': [ {'forms': ['absorbirati'], 'msd': 'Ggvn'}, {'forms': ['absorbirat'], 'msd': 'Ggvm'}, {'forms': ['absorbiral'], 'msd': 'Ggvd-em'}, {'forms': ['absorbirala'], 'msd': 'Ggvd-dm'}, {'forms': ['absorbirali'], 'msd': 'Ggvd-mm'}, {'forms': ['absorbirala'], 'msd': 'Ggvd-ez'}, {'forms': ['absorbirali'], 'msd': 'Ggvd-dz'}, {'forms': ['absorbirale'], 'msd': 'Ggvd-mz'}, {'forms': ['absorbiralo'], 'msd': 'Ggvd-es'}, {'forms': ['absorbirali'], 'msd': 'Ggvd-ds'}, {'forms': ['absorbirala'], 'msd': 'Ggvd-ms'}, {'forms': ['absorbiram'], 'msd': 'Ggvspe'}, {'forms': ['absorbiraš'], 'msd': 'Ggvsde'}, {'forms': ['absorbira'], 'msd': 'Ggvste'}, {'forms': ['absorbirava'], 'msd': 'Ggvspd'}, {'forms': ['absorbirata'], 'msd': 'Ggvsdd'}, {'forms': ['absorbirata'], 'msd': 'Ggvstd'}, {'forms': ['absorbiramo'], 'msd': 'Ggvspm'}, {'forms': ['absorbirate'], 'msd': 'Ggvsdm'}, {'forms': ['absorbirajo'], 'msd': 'Ggvstm'}, {'forms': ['absorbirajva'], 'msd': 'Ggvvpd'}, {'forms': ['absorbirajmo'], 'msd': 'Ggvvpm'}, {'forms': ['absorbiraj'], 'msd': 'Ggvvde'}, {'forms': ['absorbirajta'], 'msd': 'Ggvvdd'}, {'forms': ['absorbirajte'], 'msd': 'Ggvvdm'} ], 'is_manually_checked': True } ``` ### Data Fields - `headword_lemma`: lemma of the headword; - `pos`: coarse-grained part-of-speech tag (one of `{"noun", "verb", "adjective", "adverb", "pronoun", "numeral", "preposition", "conjunction", "particle", "interjection", "abbreviation", "residual"}`); - `lex_unit`: properties of the lexical unit corresponding to the headword (`id`, `form`, `key` and `type`); - `word_forms`: forms of the headword, each with its own list of possible forms and the morphosyntactic description of the form; - `is_manually_checked`: whether the headword was manually validated or not. ## Additional Information ### Dataset Curators Jaka Čibej; et al. (please see http://hdl.handle.net/11356/1745 for the full list). ### Licensing Information CC BY-SA 4.0. ### Citation Information ``` @misc{sloleks3, title = {Morphological lexicon Sloleks 3.0}, author = {{\v C}ibej, Jaka and Gantar, Kaja and Dobrovoljc, Kaja and Krek, Simon and Holozan, Peter and Erjavec, Toma{\v z} and Romih, Miro and Arhar Holdt, {\v S}pela and Krsnik, Luka and Robnik-{\v S}ikonja, Marko}, url = {http://hdl.handle.net/11356/1745}, note = {Slovenian language resource repository {CLARIN}.{SI}}, copyright = {Creative Commons - Attribution-{ShareAlike} 4.0 International ({CC} {BY}-{SA} 4.0)}, year = {2022} } ``` ### Contributions Thanks to [@matejklemen](https://github.com/matejklemen) for adding this dataset.
提供机构:
cjvt
原始信息汇总

数据集概述

数据集名称

Sloleks 3

数据集描述

Sloleks是一个用于各种NLP应用和语言手册的斯洛文尼亚语参考形态学词典。它包含斯洛文尼亚语的词根、它们的屈折或派生词形以及相应的语法描述。Sloleks 3.0在Sloleks 2.0的基础上新增了约265,000个来自Gigafida 2.0的最常用词根的条目。

数据集内容

  • 包含约100,000个已有的条目和约265,000个新条目。
  • 对于动词、形容词、副词和常用名词,词根由三名注释者手动检查,只有至少一名注释者确认合法的词根才会被包含。
  • 词形变化规则、词性分类和特征-值对遵循MULTEXT-East的斯洛文尼亚语形态句法规范。

数据集结构

  • 数据实例:以动词absorbirati为例,展示了一个词条的结构。
  • 数据字段
    • headword_lemma:词条的词根。
    • pos:词性标签。
    • lex_unit:词条的词汇单元属性。
    • word_forms:词条的词形及其形态句法描述。
    • is_manually_checked:词条是否经过手动验证。

支持的任务

数据作为知识库 - 词典使用。

语言

斯洛文尼亚语。

许可证

CC BY-SA 4.0。

数据集创建者

Jaka Čibej等人。

引用信息

@misc{sloleks3, title = {Morphological lexicon Sloleks 3.0}, author = {{v C}ibej, Jaka and Gantar, Kaja and Dobrovoljc, Kaja and Krek, Simon and Holozan, Peter and Erjavec, Toma{v z} and Romih, Miro and Arhar Holdt, {v S}pela and Krsnik, Luka and Robnik-{v S}ikonja, Marko}, url = {http://hdl.handle.net/11356/1745}, note = {Slovenian language resource repository {CLARIN}.{SI}}, copyright = {Creative Commons - Attribution-{ShareAlike} 4.0 International ({CC} {BY}-{SA} 4.0)}, year = {2022} }

5,000+
优质数据集
54 个
任务类型
进入经典数据集
二维码
社区交流群

面向社区/商业的数据集话题

二维码
科研交流群

面向高校/科研机构的开源数据集话题

数据驱动未来

携手共赢发展

商业合作