遇见数据集

Målfrid 2022 – Freely Available Documents from Norwegian State Institutions

收藏
data.europa2022-01-31 更新2025-06-01 收录
官方服务:

资源简介:

This corpus consists of documents from 571 domains of Norwegian state institutions and comprises approximately 4,5 billion tokens in total. In addition to Norwegian Bokmål and Nynorsk texts, the corpus contains texts in Northern Sami, Lule Sami, Southern Sami and English. The data were collected as part of the so-called Målfrid project, where the National Library of Norway on behalf of the Ministry of Culture and in collaboration with the The Language Council of Norway collects and aggregates data for mapping the usage of Norwegian Bokmål and Norwegian Nynorsk on the domains of Norwegian state institutions. The corpus is the result of a focused crawl conducted between December 2021 and January 2022, recursively downloading text documents (HTML, DOC(X)/ODT and PDF) from a set of domains (down to and including level 12), while obeying robots.txt and politeness restrictions. For technical information, please consult the documentation files.

创建时间:
2021-12-01
二维码
社区交流群
二维码
科研交流群
商业服务