Towards a general open dataset and model for late medieval Castilian text recognition (HTR/OCR). Datasets and scripts

This repository contains the dataset of the article "Towards a general open dataset and models for late medieval Castilian writing (HTR/OCR)" submitted to the Journal of Data Mining and Digital Humanities (JDMDH). I refer to the paper (https://doi.org/10.5281/zenodo.7387376) for the description of the corpus and the models.
The dataset is in version V2: it contains the allographetic AND graphematic transcriptions (files `*.normalized.xml`) and models.
Caveat: the allographetic transcriptions and models only are described in the data paper mentionned above. The graphematic transcriptions are produced using a Chocomuffin conversion table (see `corpus/conversion_table.csv`) to reduce each allograph to its corresponding grapheme. The abbreviations are not expanded.
Please cite the following paper if you use this dataset or the models:
@article{gille_levenson_2023_towards, author = {Gille Levenson, Matthias}, date = {2023}, journaltitle = {Journal of Data Mining and Digital Humanities}, doi = {10.46298/jdmdh.10416}, editor = {Pinche, Ariane and Stokes, Peter}, issuetitle = {Special Issue: Historical documents and automatic text recognition}, title = {Towards a general open dataset and models for late medieval Castilian text recognition(HTR/OCR)},
GILLE LEVENSON , Matthias, « Towards a general open dataset and models for late medieval Castiliantext recognition (HTR/OCR) », Journal of Data Mining and Digital Humanities (2023) : SpecialIssue : Historical documents and automatic text recognition, eds. Ariane PINCHE and PeterSTOKES, DOI : 10.46298/jdmdh.10416.
The image of the manuscript M (Esc_M) has not yet been uploaded, pending permission from the library that keeps the manuscript.
All images are kept in a directory named after the place where the manuscript is kept, and the sigla of the witness for the in-domain dataset.

The global licence for the dataset (except for images) is CC-BY-NC-SA.
All manuscripts reproductions are published with the authorization of the libraries.
©Biblioteca General Histórica de Salamanca
Universidad de Salamanca (España), Biblioteca General Histórica, Ms. 2709 (L)
Universidad de Salamanca (España), Biblioteca General Histórica, Ms. 2097 (J)
Universidad de Salamanca (España), Biblioteca General Histórica, Ms. 2673
Universidad de Salamanca (España), Biblioteca General Histórica, Ms. 2011
Universidad de Salamanca (España), Biblioteca General Histórica, Ms. 2654
Universidad de Salamanca (España), Biblioteca General Histórica, Ms. 2086
©Museo Lázaro Galdiano. Madrid
Inv. 15304, Fundación Lázaro Galdiano (A)
©Universidad de Valladolid
Ms. 251, Biblioteca Santa Cruz (S)
©Real Biblioteca del Escorial
Ms. K.I.5, Biblioteca del Real Monasterio del Escorial (Q)
Ms. h.I.8, Biblioteca del Real Monasterio del Escorial (M): to be published
Ms. Z-I-12
Ms.Z-III-9
Ms. X-III-4
Ms. h-III-9
Ms. b-IV-15
Ms. b-II-11
Ms. a-II-17
Ms. T-III-5
©Rosenbach Foundation
Ms. 482/2 (U)
© Gallica.bnf.fr
Espagnol 12
Espagnol 36
Espagnol 218
© Bodleian Library
Ms. Span. d. 1
Ms. Span. d. 2/1
© Biblioteca Real, Madrid
Ms. II/215 (G)
© Biblioteca Nacional de España
Mss/4183
Inc/901 (Z)
© Biblioteca Universitaria, Sevilla
Ms. 332/131 (R)

Edit: add result files