INPROSH, A Multimodal-context Interruptibility Dataset for Proactive Services on Smart Speakers

Abstract As smart speakers become increasingly integrated into everyday home life, there is growing interest in leveraging thesespeakers to proactively deliver personalized proactive services. To enhance user experience and engagement of proactiveservices, a key challenge is identifying opportune moments, user contexts when users are mostly interruptible to engage inproactive services. Researchers have identified such moments by exploring interruptibility across various user contexts (inwhich contexts users are more interruptible), and several datasets have been released with interruptibility labels. However,no publicly available dataset has focused specifically on interruptibility within home environments. To fill this gap, we presentINPROSH, a dataset collected from 26 participants over a three-week in-the-wild field study. Participants used proactive servicesvia smart speakers in their home. INPROSH comprises 2,830 cases, each annotated with interruptibility labels and enriched withcontextual information, including temporal, spatial, and user-behavioral contexts, as well as surrounding image and soundrecordings near the smart speakers. We believe INPROSH will support deeper understanding and more accurate detection ofinterruptibility in home environments.摘要 随着智能音箱日益融入日常家庭生活，利用此类音箱主动提供个性化主动服务的需求愈发旺盛。为提升主动服务的用户体验与参与度，核心挑战在于识别合适的时机——即用户最具可中断性（interruptibility）的用户情境，以开展主动服务交互。研究人员已通过探索不同用户情境下的可中断性来识别此类时机，且已有多个带有可中断性标签的数据集发布。然而，目前尚无专门针对家庭环境下可中断性的公开可用数据集。为填补这一研究空白，我们提出INPROSH数据集：该数据集基于为期三周的真实野外实地研究，从26名参与者处收集所得。参与者在家中通过智能音箱使用主动服务。INPROSH包含2830条样本，每条样本均标注有可中断性标签，并辅以丰富的上下文信息，涵盖时间、空间与用户行为上下文，以及智能音箱周边的图像与音频录音。我们相信，INPROSH将助力学界更深入地理解家庭环境下的可中断性，并实现更精准的可中断性检测。