遇见数据集

Dutch Historical Word2Vec models

收藏
Zenodo2021-06-03 更新2026-05-25 收录
数据链接:
官方服务:

资源简介:

<strong>Introduction</strong> The repository contains Word2Vec models trained on Dutch historical newspaper data converting the period from 1840 to 1890. Models were created as part of a Research-in-Residence at the Dutch National Library. During my residency, I created language models trained on specific subsections of the newspaper corpus, to explore bias over time and by place or political leaning. To read more about this project, please read the introductory blog post. <strong>Code</strong> The code used for training the models is available on Github. Please look at the README for more instruction. <strong>Warning: </strong>the raw text data used was provided by Mirjam Cuper of the KB and is available only on request. Some code for loading and exploring the models is also available on Github. For more information on <strong>interactive lexicon creation using these models</strong>, go to this README. For more information on exploring <strong>bias on these model</strong>, go to this README. <strong>Models</strong> Models are available in zip files, one for each decade. We trained models using a window size of twenty years and a step size of five. The structure of the file names is as follows: <strong>{year_start}-{year_end}-{attribute}.w2v.model .</strong> For example <strong>1840-1860-Protestant.w2v.model</strong> is trained on all article published in protestant newspapers between 1840 and 1860. The <strong>attribute</strong> value is chosen from either the <strong>Politiek</strong> (political leaning) or <strong>Provincie</strong> (province) column in this metadata file.

提供机构:
Zenodo
创建时间:
2021-06-02
二维码
社区交流群
二维码
科研交流群
商业服务