SparkWiki: Wikipedia graph dataset and pagecounts pre-processing tools

SparkWiki toolkit can be used in various scenarios where you are interested in researching Wikipedia graph and pageview statistics. Graph and pageviews can be used and studied separately. The code used to process Wikipedia SQL dumps, along with deployment instructions, are located on GitHub. To test an example of a pre-processed graph, you can download a dump of the English Wikipedia graph (see attached wikipedia_nrc.dump), which you can directly import into a Neo4J instance. The dump is intended for neo4j version 3.x and can be imported using the following command (make sure you do not have an existing wikipedia.db database as the command below will overwrite its content): sudo -u neo4j neo4j-admin load --force --from=wikipedia_nrc.dump --database=wikipedia.db If you try to import it into Neo4J version 4.x, you need to set the property dbms.allow_upgrade=true in /etc/neo4j/neo4j.conf before importing. When you start the neo4j server it will upgrade the database s.t. it is compatible with version 4.x.