Snapture - A Novel Neural Architecture for Combined Static and Dynamic Hand Gesture Recognition:TERAIS Data

This repository lists the datasets used for developing the experiments of the paper titled: Snapture - A Novel Neural Architecture for Combined Static and Dynamic Hand Gesture Recognition (Open access) by Hassan Ali, Doreen Jirak and Stefan Wermter. The study was conducted in the Knowledge Technology (WTM) group at the University of Hamburg. GRIT Robot Commands Dataset This dataset is was recorded at the Knowledge Technology (WTM) group at the University of Hamburg and can be requested here. The dataset is public and was not collected as part of this study. Montalbano Co-Speech Dataset This dataset was recorded as part of the ChaLearn Looking at People Challenge and can be downloaded from here. The dataset is public and was not collected as part of this study. The attached montalbano_segments.csv file can be used to create gesture segmentations of the test subset of this dataset. Acknow ledgements This work was partially supported by the DFG under project CML (TRR 169) and BMWK under project KI-SIGS and EU under project TERAIS. Citation To cite our paper, you can copy the following into your .bib file @Article{Ali2023, author={Ali, Hassan and Jirak, Doreen and Wermter, Stefan}, title={Snapture---a Novel Neural Architecture for Combined Static and Dynamic Hand Gesture Recognition}, journal={Cognitive Computation}, year={2023}, month={Jul}, day={17}, issn={1866-9964}, doi={10.1007/s12559-023-10174-z}, url={https://doi.org/10.1007/s12559-023-10174-z} }本仓库收录了题为《Snapture——一种面向静态与动态手势识别融合的新型神经架构》的开放获取论文的实验所用数据集，作者为哈桑·阿里（Hassan Ali）、多琳·吉拉克（Doreen Jirak）与斯特凡·韦尔特（Stefan Wermter），该研究由汉堡大学知识技术（Knowledge Technology, WTM）课题组完成。 ### GRIT机器人指令数据集 本数据集由汉堡大学知识技术（WTM）课题组录制，可通过此处申请获取。该数据集为公开数据集，并非本研究的自研采集数据集。 ### Montalbano同语音手势数据集 本数据集为ChaLearn全球人机交互挑战赛（ChaLearn Looking at People Challenge）的配套数据集，可通过此处下载。该数据集为公开数据集，并非本研究的自研采集数据集。可通过附件中的`montalbano_segments.csv`文件对该数据集的测试子集进行手势分割标注。 #### 致谢 本研究部分受德国研究基金会（Deutsche Forschungsgemeinschaft, DFG）项目CML（TRR 169）、德国联邦经济与气候保护部（Bundesministerium für Wirtschaft und Klimaschutz, BMWK）以及欧盟（EU）项目TERAIS资助。 #### 引用 如需引用本论文，可将以下内容复制至您的.bib文献文件中： bibtex @Article{Ali2023, author={Ali, Hassan and Jirak, Doreen and Wermter, Stefan}, title={Snapture---a Novel Neural Architecture for Combined Static and Dynamic Hand Gesture Recognition}, journal={Cognitive Computation}, year={2023}, month={Jul}, day={17}, issn={1866-9964}, doi={10.1007/s12559-023-10174-z}, url={https://doi.org/10.1007/s12559-023-10174-z} }