SMILE Swiss German Sign Language Dataset

Description

The SMILE Swiss German Sign Language Dataset consists of videos, joint coordinates and annotations of 100 isolated signs of a Swiss German Sign Language (Deutschschweizerische Gebärdensprache, DSGS) vocabulary production test. All items were produced multiple times by 16 adult L1 signers and 22 adult L2 learners of DSGS. Associated linguistic transcriptions and annotations are available for second path data of 10 adult L1 signers and 18 adult L2 learners of DSGS.

The dataset has been created in the context of developing an assessment system for lexical signs of DSGS in the SNSF project SMILE.

More precisely, for each participant, the following files are available:

Kinect color video (.mp4); 1920x1080 Pixels @ 30 FPS;

Kinect Pose Information (.csv); 25 Joints; 3D Joint Coordinates and Angles;

OpenPose output (.json); 2D Joint Coordinates and Confidences;

iLex annotation files (.xml); linguistic annotations.

Reference

If you use this database, please cite the following publication:

Sarah Ebling, Necati Cihan Camgöz, Penny Boyes Braem, Katja Tissi, Sandra Sidler-Miserez, Stephanie Stoll, Simon Hadfield, Tobias Haug, Richard Bowden, Sandrine Tornay, Marzieh Razavi, and Mathew Magimai-Doss. SMILE Swiss German Sign Language Dataset. In Proceedings of the 11th Language Resources and Evaluation Conference (LREC 2018), pages 4221–4229, 2018.