The Pulse Breath Water System: Exploring Breathing as an Embodied Interaction for Enhancing the Affective Potential of VR

We study Pulse Breath Water, an immersive virtual environment (VE) with affect estimation in sound. We employ embodied interaction between a user and the system through the user's breathing frequencies mapped to the system's behaviour. In this study we investigate how two different mappings (metaphoric, and "reverse") of embodied interaction design might enhance the affective properties of the presented system. We build on previous work in embodied cognition, embodied interaction, and affect estimation in sound by examining the impact of affective audiovisuals and two kinds of interaction mapping on the user's engagement, affective states, and overall experience. The insights gained through questionnaires and semi-structured interviews are discussed in the context of participants' lived experience and the limitations of the system to be addressed in future work. Content type is respiratory sensor data synched with audio and format of files is .mubu (see MAX Sound Box Library by IRCAM). Software used was MAX 7 by Cycling74. Confidentiality declaration: The data is anonymous. This dataset was originally deposited in the Simon Fraser University institutional repository.

本研究聚焦脉搏呼吸水（Pulse Breath Water）——一款集成声音情感估计功能的沉浸式虚拟环境（virtual environment, VE）。研究采用具身交互（embodied interaction）模式，将用户的呼吸频率映射至系统行为，实现用户与系统间的具身互动。本研究旨在探究具身交互设计的两类映射方式——隐喻式与"反向"式，对所提系统情感特性的提升效果。本研究依托具身认知（embodied cognition）、具身交互及声音情感估计领域的既往研究，通过考察情感视听内容与两类交互映射对用户参与度、情感状态及整体体验的影响开展相关探索。本研究将通过问卷与半结构化访谈所获得的研究结论，结合参与者的实际体验与该系统有待未来工作中解决的局限性展开讨论。数据集内容类型为与音频同步的呼吸传感器数据，文件格式为.mubu（详见IRCAM旗下的MAX Sound Box库）。本次研究使用的软件为Cycling74公司开发的MAX 7。保密声明：本数据集已完成匿名化处理，最初上传至西蒙弗雷泽大学（Simon Fraser University）机构知识库。