Rethinking linguistic feedback: A modality-agnostic and holistic approach to multimodal addressee signals in spoken and signed dyadic interaction: Video examples

This dataset contains five short video clips illustrating examples of linguistic feedback in dyadic interaction, accompanying the article Rethinking linguistic feedback: A modality-agnostic and holistic approach to multimodal addressee signals in spoken and signed dyadic interaction (published in Glossa). The clips showcase naturally occurring feedback behaviors across two signed and one spoken language. Examples include feedback in German Sign Language (DGS), taken from the Public DGS Corpus (Hanke et al. 2020; examples 1 and 7); feedback in Russian Sign Language (RSL), drawn from the RSL Online Corpus (Burkova 2015; example 6) and from the Corpus of RSL Conversations (Bauer & Poryadin 2023; example 8); and feedback in spoken Russian, taken from the Russian Multimodal Conversation Corpus (Bauer 2023; examples 5). These clips illustrate the multimodal composition of feedback events discussed in the article and serve as accessible reference material for researchers working on interaction, multimodality, and feedback across modalities.In addition to the video clips, the dataset includes three supplementary files: (i) a CSV file containing the structured dataset underlying the analyses presented in the article, (ii) a CSV file documenting IAA, and (iii) an R script used for data processing and analysis. These materials facilitate transparency, reproducibility, and reuse of the data.Bauer, Anastasia. 2023. Russian multimodal conversational data. https://doi.org/10.18716/DCH/A.00000016.Bauer, Anastasia & Poryadin, Roman. 2023. Russian Sign Language conversations. https://doi.org/10.18716/DCH/A.00000028.Burkova, Svetlana. 2015. Russian Sign Language Corpus. http://rsl.nstu.ru/.Hanke, Thomas & Schulder, Marc & Konrad, Reiner & Jahn, Elena. 2020. Extendingthe Public DGS Corpus in size and septh. In Efthimiou, Eleni & Fotinea, Stavroula-Evita & Hanke, Thomas & Hochgesang, Julie A. & Kristoffersen, Jette & Mesch,Johanna (eds.), Proceedings of the LREC2020 9th Workshop on the Representation andProcessing of Sign Languages: Sign Language Resources in the Service of the LanguageCommunity, Technological Challenges and Application Perspectives. 75–82. Marseille,France: European Language Resources Association (ELRA).本数据集包含五段短视频片段，用以展示二方互动（dyadic interaction）中的语言反馈示例，配套发表于《Glossa》期刊的论文《重新思考语言反馈：面向口语与手语二方互动中多模态受话者信号的模态无关整体方法》。这些片段展示了覆盖两种手语与一种口语的自然反馈行为。示例包括取自德国手语（German Sign Language, DGS）公共语料库（Public DGS Corpus，Hanke et al. 2020；示例1与7）的德国手语反馈；取自俄罗斯手语（Russian Sign Language, RSL）在线语料库（Burkova 2015；示例6）与俄罗斯手语对话语料库（Bauer & Poryadin 2023；示例8）的俄罗斯手语反馈；以及取自俄罗斯多模态对话语料库（Bauer 2023；示例5）的口语俄语反馈。这些片段直观展示了论文中讨论的反馈事件的多模态构成，可为从事互动、多模态及跨模态反馈研究的学者提供易于获取的参考资料。 除视频片段外，本数据集还包含三份补充文件：(i) 一份结构化数据集CSV文件，对应论文中分析所用的基础数据；(ii) 一份标注者间一致性（Inter-Annotator Agreement, IAA）记录CSV文件；(iii) 一份用于数据处理与分析的R脚本。这些材料有助于提升研究的透明度、可复现性与数据复用性。 参考文献： 1. Bauer, Anastasia. 2023. 俄罗斯多模态对话语料库. https://doi.org/10.18716/DCH/A.00000016. 2. Bauer, Anastasia & Poryadin, Roman. 2023. 俄罗斯手语对话语料库. https://doi.org/10.18716/DCH/A.00000028. 3. Burkova, Svetlana. 2015. 俄罗斯手语语料库. http://rsl.nstu.ru/. 4. Hanke, Thomas, Schulder, Marc, Konrad, Reiner & Jahn, Elena. 2020. 扩充德国手语公共语料库（Public DGS Corpus）的规模与范围. 收录于Efthimiou, Eleni, Fotinea, Stavroula-Evita, Hanke, Thomas, Hochgesang, Julie A., Kristoffersen, Jette & Mesch, Johanna 主编的《第9届LREC2020手语表征与处理研讨会论文集：服务语言社区的手语资源、技术挑战与应用前景》，第75-82页。法国马赛：欧洲语言资源协会（ELRA）。