TaPvex: A Tagged and Phrased word2vec Model

TaPvex: A Tagged and Phrased word2vec Model Benjamin J. Radford September 29, 2017 Summary TaPvex is a trained word2vec model of part-of-speech-tagged and named-entity-tagged words and phrases. The model was trained on a large corpus of English language news text from the early 2010s. Words have been tagged using Stanford CoreNLP to include named entities (NER) and Penn Treebank parts-of-speech (POS). Tagged words have been concatenated into n-gram phrases. The model contains 1.17 million unique words and phrases. Word vectors are of size 150. Use All three files (TaPvex, TaPvex.syn0.npy, TaPvex.syn1.npy) must be located in the same directory. The file can be opened with the gensim Python module using: from gensim.models import Word2Vec model = Word2Vec.load("/path/to/model/TaPvex") Examples Tokens are of the form: [WORD]:[NER]:[POS] Phrases are of the form: [WORD]:[NER]:[POS]_[WORD]:[NER]:[POS] Example tokens include: BUSH:O:NN BUSHES:O:NNS BUSH:PERSON:NNP GEORGE:PERSON:NNP_BUSH:PERSON:NNP GEORGE:PERSON:NNP_W:PERSON:NNP_BUSH:PERSON:NNP NEW:O:JJ NEW:LOCATION:NNP_YORK:LOCATION:NNP NEW:ORGANIZATION:NNP_YORK:ORGANIZATION:NNP_TIMES:ORGANIZATION:NNP