TEI survey 2021

This dataset comprises the processing scripts, processed files, and summary statistics from a survey of two million publicly available TEI files on GitHub. The survey was carried out between December 2020 – May 2021 with the motivation of examining real-world usage of the Text Encoding Initiative guidelines.

Outputs include counts of TEI and non-TEI tag usage, TEI modules, and other namespaces, languages declared, and lists of filenames/repositories.

The processed files are plain text and consist of the tag names used within the corresponding TEI XML file, separated by spaces. E.g. file 1000001.txt contains:

?xml TEI teiHeader fileDesc titleStmt title publicationStmt idno idno availability p p ref p ref p ref notesStmt note sourceDesc biblFull titleStmt title author extent publicationStmt date pubPlace profileDesc creation date textClass keywords term text body div div head head p p p p p pb p p pb

Files with the XML attributes as well are available on request, due to size limitations.