Wikipedia data for "From Wikipedia to AI"

These zip files contain JSONs of the revisions and text data used in the publication "From Wikipedia to AI: Measuring 25 years of synthesis of human genetics research in the public-facing information ecosystem". As Wikipedia text, they are available under the Creative Commons Attribution-ShareAlike 4.0 License (CC BY-SA 4.0). Each line of the revision history is its own JSON object. Example of revision history JSON: {"revid": 1079717274, "parentid": 964688689, "minor": false, "user": "Ffffrr", "userid": 41865877, "timestamp": "2022-03-28T07:35:20Z", "size": 763, "slots": {"main": {"size": 763}}, "comment": "Importing Wikidata [[Wikipedia:Short description|short description]]: \"Inhibitory SMAD proteins\" ([[Wikipedia:Shortdesc helper|Shortdesc helper]])", "tags": []} Revision contents are stored as a single JSON object where each key is the revision ID and the value is the revision's markup, e.g. "1079717274": "{{Short description|Inhibitory SMAD proteins}}\n'''I-SMAD or Inhibitor SMAD''' is a subclass..." There are over 3 million revisions contained within this data. However, not all revisions were used in the manuscript analysis. There are also three CSVs containing the lengths of different sections over time. These are included here as they are too large for github.