Compact representation of the OpenAIRE citation graph

We're making available a distilled version of the OpenAIRE citation graph. We share the complete graph as two files totalling ~11GB. We also provide a larger file including additonal publication fields (see table below). For complete description see the preprint of the data paper at Arxiv. The files are (size when loaded in RAM): publications.tsv.xz (16GB) - The nodes in the citation graph citations.tsv.xz (16GB*) - The edges in the citation graph publication_large.tsv.xz (309GB) - The nodes, but with several fields for additional features. pipeline.tar.xz - The pyspark pipeline used to produce the other files. Contains a singularity container for reproducability and portability. The code is also found at Codeberg. All files are compressed (.xz) files. * Citations.tsv can be loaded using int32, thus reducing it's memory footprint. The preprint of the data paper is available at Arxiv. The fields in the publication_large.csv: Field Explanation Memory usage (GB) nodeId Unique internal identifier for the node (publication) 2 openaireId Identifier assigned by the OpenAIRE platform 18 doi Digital Object Identifier of the publication 13 title Title of the publication 28 authors List of authors associated with the publication 20 description Abstract or short description of the publication 192 date Date when the publication was published 11 container Journal, conference, or repository where it was published 13 citations Number of times the publication has been cited 2 language Language in which the publication is written 10