Game Walkthrough Corpus (GWTC)

Motivation

The Game Walkthrough Corpus (GWTC) contains 12,295 unique
walkthrough documents that cover a total of 6,117 games.  For each game walkthrough,
it provides frequencies of unigrams and bigrams, treating it as a bag of words. In
addition, it provides word frequencies on the sentence level. Furthermore, the GWTC
contains a number of game-related metadata, including title, publisher, developer, year,
genre, etc. All the language statistics and metadata are stored in separate plain text files
and can be referenced by means of uniform resource names (URN). These URNs also
can be used to derive any combination of statistics and metadata. Researchers, for
instance, can investigate the most frequent unigrams for games in the “Adventure”
genre. This way, the GWTC can be reused in various ways, for different kinds of
research questions on the topic of gaming language, which may be summarized as
“distant playing”.

Copyright Information

Game walkthroughs are protected by individual copyright notices that are often very strict. That is why this data set does not include the documents but instead various data formats that are useful for text mining and distant reading methods while not allowing to recreate the documents. It is highly unlikely that even a single sentence can be reconstructed from the published data.
Since the documents are not -- not even in part -- published but only text mining statistics about them, no violation of copyright is done by this project.
Links to the original documents are available in the sourceUrls file in the data folder.

File Information

data folder: document data

bagofwords: Word frequencies per document

bigrams: Bigram frequencies per document

corpusstats: Min, avg and max token count, type count, type/token ratio, documents per game plus corressponding standard deviation

game_walkthrough_mapping: Documents per game

game_walkthrough_mapping: Number of documents per game

sentencecollocations: Word frequencies per sentence per document

sourceUrls: Links to original text

textlength: Number of characters per document

tfidf_deu: Word significance per document (German)

ifidf_eng: Word significance per document (English)

tokencount: Number of unique words per document

typecount: Number of words per document

metadata: game metadata

file names that do not start with "_": metadata [filename] per game

_all: All metadata in one file

_mapping_release_date*: Metadata combined with release data for time series

doc folder: documentation

createdata: Python script to create content of data folder

extractMetainformation: Python script to create content of metadata folder

metadata_rawg: Game metadata collected from RAWG

metadata_steam: Game metadata collected from Steam

metadata_symbol: Quality control. Relation of text in source HTML and extracted text

titlesandurns: Game titles mapped to project identifiers

Walkthrough Sources

https://portforward.com/games/walkthroughs/

https://www.neoseeker.com

https://www.spieletipps.de

https://jayisgames.com/

http://gamesetter.com/

Corpus Statistics

Number of unique games: 6,013

Number of documents: 12,295

Genre associations: 3,806

Gameplay tags: 10,246

Release dates: 2,443

Developers: 3,152

Publishers: 2,782

Steam IDs: 1,086

Platform associations: 5,293 (PC, Gameboy, iOS, Linux,...)

Game language associations: 4,631

Languages: English, German and a little bit of French

External Resources

Project Website: https://www.informatik.uni-leipzig.de/~jtiepmar/forschung/gwtc/

Bitbucket: https://bitbucket.org/jtiepmar/the-game-walkthrough-corpus/src/master/

There are two version of the GWTC available for download: ver. 0.99 contains all the above corpus files, plus the Git files. Note that after downloading ver. 0.99, the Git folders may be hidden per default, depending on you operating system. Ver. 1.0 is a cleaned up version that comes without the Git files.