遇见数据集

Time shifting word2vec models from Times

收藏
Zenodo2020-09-20 更新2026-05-25 收录
数据链接:
官方服务:

资源简介:

Time-shifting word2vec models based on Times news paper. These models were generated using the "Generate time shifting models" scripts found here. In summary, these scripts generate a collection of sentences for every 2 years period, and trains a word2vec model on this period using gensim. The original text from the Times news paper articles is processed as follows: Articles are divided into sentences using punctuation. Punctuation symbols are removed. Text is converted to lower case. Word are validated to ensure they are valid English non-stop words (using nltk). The two year time period was selected following the Measure convergence for a range described here. This data publication was made possible thanks to collaboration with the Utrecht Digital Humanities Lab. Unfortunately original Times data set is not publicly available.

提供机构:
Zenodo
创建时间:
2018-11-22
二维码
社区交流群
二维码
科研交流群
商业服务