Audiovisual Time-Flow Experiment Data

In this experiment we introduce the Audiovisual Time-Flow Illusion, a novel illusion whereby regularly-paced visual speech samples are perceived as "pausing" or "skipping" when they are presented with congruent auditory counterparts that contain brief inserted or removed portions (pausing and skipping, respectively). When stimulus manipulation is reversed so that the visual components contain brief inserted or removed portions while the auditory components are regularly-paced, the illusion is not perceived. Our data suggest that visual perception continually realigns its pace with that of the auditory modality, suggesting that the auditory modality sets the pace, or tempo, of the visual modality.

本实验中我们提出了视听时序流错觉（Audiovisual Time-Flow Illusion），这是一种全新的视听错觉：当与包含短暂插入或删减片段的匹配听觉刺激（分别对应‘停顿’与‘跳帧’）同步呈现时，节奏规整的视觉语音样本会被感知为‘停顿’或‘跳帧’。若将刺激操控逻辑反转，即视觉成分包含短暂插入或删减片段，而听觉成分保持节奏规整，则不会感知到该错觉。我们的实验数据表明，视觉感知会持续将自身节奏与听觉通道的节奏进行重对齐，这暗示听觉通道决定了视觉通道的节奏速率。