Circle Modulation

This online study investigates the effect of different visually presented speech features (speech envelope, formants, word onsets) during a two-talker audio on word recognition. The speech features were presented as a circle whose size was modulated over time based on the dynamics of three speech features. The circle was either modulated according to the speech features of the target speaker, the distractor speaker or an unrelated control sentence. After each sentence, the participants` word recognition was tested by writing down what they heard. We show that word recognition is not enhanced for any of the visual features relative to the visual control condition.

这项在线研究旨在探究双说话人音频场景中，不同视觉呈现的语音特征（语音包络（speech envelope）、共振峰（formants）、单词起始点（word onsets））对单词识别的影响。这些语音特征以圆形形式呈现，其大小会根据三种语音特征的动态变化随时间调制。圆形的调制方式分为三种：依据目标说话人、干扰说话人的语音特征，或无关的控制语句。每听完一个句子后，参与者需写下所听到的内容，以此测试其单词识别能力。研究结果表明，相较于视觉控制条件，任何视觉特征均未提升单词识别效果。