DGS-Fabeln-1

# DGS-Fabeln-1 ## General Info This is a corpus between written German and German Sign Language (DGS). It consists of 7 fairy tales recorded from 7 points of view, plus 1 for the backchanneling (framing the listener). The 7 fairy tales are: 1. Der Hase und der Igel 2. Frau Holle 3. Der Wolf und die 7 Geißlein 4. Schneewittchen 5. Hänsel und Gretel 6. Dornröschen 7. Die Bremer Stadtmusikanten See the XLS file in this repository (`DGS-Fabeln-1-Content-yymmdd.xlsx`) for details about code number, short name, and some stats. E.g., the first fairy tale numer/code is `1-DHUDI`. ## References This corpus is associated to the paper presented at the 2024 LREC conference. Cite as: Nunnari, F., Avramidis, E., España-Bonet, C., González, M., Hennes, A., & Gebhard, P. (2024). DGS-Fabeln-1: A Multi-Angle Parallel Corpus of Fairy Tales between German Sign Language and German Text. In N. Calzolari, M.-Y. Kan, V. Hoste, A. Lenci, S. Sakti, & N. Xue (Eds.), Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024) (pp. 4847–4857). ELRA and ICCL. https://aclanthology.org/2024.lrec-main.434 Bibtex: ``` @inproceedings{nunnari-etal-2024-dgs-fabeln, title = "{DGS}-Fabeln-1: A Multi-Angle Parallel Corpus of Fairy Tales between {G}erman {S}ign {L}anguage and {G}erman Text", author = "Nunnari, Fabrizio and Avramidis, Eleftherios and Espa{\~n}a-Bonet, Cristina and Gonz{\'a}lez, Marco and Hennes, Anna and Gebhard, Patrick", editor = "Calzolari, Nicoletta and Kan, Min-Yen and Hoste, Veronique and Lenci, Alessandro and Sakti, Sakriani and Xue, Nianwen", booktitle = "Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)", month = may, year = "2024", address = "Torino, Italy", publisher = "ELRA and ICCL", url = "https://aclanthology.org/2024.lrec-main.434", pages = "4847--4857", abstract = "We present the acquisition process and the data of DGS-Fabeln-1, a parallel corpus of German text and videos containing German fairy tales interpreted into the German Sign Language (DGS) by a native DGS signer. The corpus contains 573 segments of videos with a total duration of 1 hour and 32 minutes, corresponding with 1428 written sentences. It is the first corpus of semi-naturally expressed DGS that has been filmed from 7 angles, and one of the few sign language (SL) corpora globally which have been filmed from more than 3 angles and where the listener has been simultaneously filmed. The corpus aims at aiding research at SL linguistics, SL machine translation and affective computing, and is freely available for research purposes at the following address: https://doi.org/10.5281/zenodo.10822097.", } ``` ## Structure Each fairy tale is composed by: sentence list (CSV file), videos (a zipped folder), annotations (a zipped folder): ### Sentence List A single comma-separated-values (CSV) file with very simple 2-column structure. Example filename: `1-DHUDI-Sentences.csv` ``` id,text_original S1,Der Hase und der Igel. Es war einmal: So fangen Märchen an. Ein Märchen ist eine sehr alte Geschichte. Dieses Märchen heißt: Der Hase und der Igel. Das Märchen geht so: ...,... ``` ### Videos A zipped folder with name scheme `1-DHUDI.zip` containing, for each segment (S1, S2, ...): * All videos (Front, Left/Right on 30/60/90 degrees). These videos contain black frames when the device couldn't capture the frame * For each video also the exact timestamp, in nanoseconds, when the frame was shot. This is the result of the automatic alignment system. * A `NiceCollage.mp4` showing all videos at once * A `Backchannel.mp4` video, and its `Backchannel.csv` timestamps, framing the listener. * An `FrontOriginal.mp4` video as recorded on the device. Thus NOT showing the injected black frames. More comfortable for annotation. Example of the unzipped folder: ``` 1-DHUDI/ 00-Sentences.txt DHUDI-S1/ NiceCollage.mp4 Left30.mp4 Left30.csv Front.mp4 Front.csv Front-Original.mp4 Backchannel.mp4 Backchannel.csv ... ``` ### Annotations Annotations are exported from the ELAN software. For each tale, the annotations are zipped in a file with a name like `1-DHUDI-ELAN.zip`. Content follows this structure: ``` 1-DHUDI-ELAN/ _Glossen-Liste.txt DHUDI-S1.eaf DHUDI-S1.pfsx DHUDI-S2.eaf DHUDI-S2.pfsx ... ```