Changes in multimodal communication synchrony (Murillo et al., 2018)

Purpose: The aim of this study is to analyze the changes in temporal synchrony between gesture and speech of multimodal communicative behaviors in the transition from babbling to two-word productions.Method: Ten Spanish-speaking children were observed at 9, 12, 15, and 18 months of age in a semistructured play situation. We longitudinally analyzed the synchrony between gestures and vocal productions and between their prominent parts. We also explored the relationship between gestural–vocal synchrony and independent measures of language development.Results: Results showed that multimodal communicative behaviors tend to be shorter with age, with an increasing overlap of its constituting elements. The same pattern is found when considering the synchrony between the prominent parts. The proportion of overlap between gestural and vocal elements at 15 months of age as well as the proportion of the stroke overlapped with vocalization appear to be related to lexical development 3 months later.Conclusions: These results suggest that children produce gestures and vocalizations as coordinated elements of a single communication system before the transition to the two-word stage. This coordination is related to subsequent lexical development in this period.Examples of Types of Gestures Coded in the StudySupplemental Material S1. Examples of pointing gestures.Supplemental Material S2. Example of reaching gesture.Supplemental Material S3. Example of showing gesture.Supplemental Material S4. Example of give gesture.Supplemental Material S5. Example of conventional gesture.Supplemental Material S6. Example of symbolic gesture.Supplemental Material S7. Example of “other” gesture.Supplemental Material S8. Sequence of the preparation phase of the gesture. The arm starts to move until its full extension.Supplemental Material S9. Sequence of the stroke phase of the gesture. The expression of the gesture is fully accomplished, indicating where the attention of the observer is intended to go.Examples of the Phases of Gestures Coded in the StudySupplemental Material S10. Sequence of the retraction phase of the gesture. The arm moves from the stroke position until the initial rest position.Murillo, E., Ortega, C., Otones, A., Rujas, I., & Casla, M. (2018). Changes in the synchrony of multimodal communication in early language development. Journal of Speech, Language, and Hearing Research, 61, 2235–2245. https://doi.org/10.1044/2018_JSLHR-L-17-0402

研究目的：本研究的宗旨在于探讨婴儿从咿呀学语阶段过渡至双词表达阶段过程中，多模态交流行为中手势与言语在时间同步性上的变化。研究方法：对十名西班牙语儿童在9个月、12个月、15个月及18个月大时在半结构化游戏情境下的行为进行了观察。我们对手势与语音产出的同步性及其显著部分的同步性进行了纵向分析，并探讨了手势-语音同步性与独立语言发展指标之间的关系。研究结果：结果显示，随着年龄的增长，多模态交流行为呈现缩短趋势，其构成要素之间的重叠度逐渐增加。当考虑显著部分的同步性时，同样观察到这一模式。15个月大时手势与语音要素的重叠比例，以及与语音化重叠的笔画比例，似乎与3个月后的词汇发展相关。研究结论：这些结果提示，在进入双词表达阶段之前，儿童将手势与语音作为单一交流系统的协调要素进行产出。这种协调与该时期随后的词汇发展密切相关。研究中所编码手势类型示例：补充材料S1. 指点手势的示例。补充材料S2. 伸手手势的示例。补充材料S3. 展示手势的示例。补充材料S4. 给予手势的示例。补充材料S5. 传统手势的示例。补充材料S6. 符号手势的示例。补充材料S7. “其他”手势的示例。补充材料S8. 手势准备阶段的序列。手臂开始移动直至完全伸展。补充材料S9. 手势笔画阶段的序列。手势表达完全完成，指示观察者的注意力所应集中之处。研究中所编码手势阶段示例：补充材料S10. 手势缩回阶段的序列。手臂从笔画位置移动至初始休息位置。Murillo, E., Ortega, C., Otones, A., Rujas, I., & Casla, M. (2018). 早期语言发展中多模态交流同步性的变化。言语、语言和听觉研究杂志，61，2235–2245. https://doi.org/10.1044/2018_JSLHR-L-17-0402