Supplementary Material for "AcouMotion - An Interactive Sonification System for Acoustic Motion Control"

This paper introduces AcouMotion as a new hard-/software system for combining human body motion, tangible interfaces and sonification to a closed-loop human computer interface that allows non-visual motor control by using sonification (non-speech auditory displays) as major feedback channel. AcouMotion's main components are (i) a sensor device for measuring motion parameters (ii) a computer simulation to represent the dynamical evolution of a model world, and (iii) a sonification engine which generates an auditory representation of objects and any interactions in the model world. The intended applications of AcouMotion range from new kinds of sport games that can be played without visual displays and therefore may be particularly interesting for people with visual impairment to further applications in data mining, physiotherapy and cognitive research. The first application of AcouMotion presented in this paper is Blindminton, a sport game similar to Badminton which is particularly adapted to the abilities of people with visual impairment. We describe our current system and its state of development, and we present first sound examples for interactive sonification using an early prototype. Finally, we discuss some interesting research directions based on the fact that AcouMotion binds auditory stimuli and body motion, and thus can represent a counterpart to the Eye-tracker device that exploits the binding of visual stimuli and eye-movement in cognitive research.
<br>

Here we will provide sound examples and interaction video to demonstrate our current prototype of AcouMotion which is currently being developed to enable the sport game Blindminton for people with visual impairment.
This is a video of our current One-player version of Blindminton, which might be called Blindhit. Sound Synthesis is implemented in SuperCollider.

Video showing some Blindhit Interactions:
<center><video controls="controls"
poster="https://pub.uni-bielefeld.de/download/2920665/2920667" width="80%"
height="80%">
<source src="https://pub.uni-bielefeld.de/download/2920665/2920669"
type="video/mp4" /> </center>

本文介绍了AcouMotion作为一种新型软硬件系统，该系统将人体运动、实体界面和声音化（非语音听觉显示）相结合，形成了一种闭环的人机界面，通过使用声音化作为主要的反馈通道，实现了非视觉的运动控制。AcouMotion的主要组件包括：（i）一种测量运动参数的传感器设备；（ii）一种计算机模拟，用于表示模型世界的动态演化；（iii）一个声音化引擎，用于生成模型世界中对象及其交互的听觉表示。AcouMotion的预期应用范围广泛，从无需视觉显示即可进行的新颖运动游戏，对于视力障碍人士可能特别有趣，到数据挖掘、物理治疗和认知研究等领域的进一步应用。本文中首次介绍的AcouMotion的应用是盲人羽毛球，一种类似于羽毛球的运动游戏，特别适合视力障碍人士的能力。我们描述了我们的当前系统和其发展阶段，并展示了使用早期原型的首次交互声音示例。最后，我们基于AcouMotion将听觉刺激与身体运动结合的事实，讨论了一些有趣的研究方向，因为AcouMotion可以作为一种对应物，与在认知研究中利用视觉刺激与眼动结合的Eye-tracker设备相媲美。在此，我们将提供声音示例和交互视频来展示我们目前正在开发的AcouMotion原型，旨在为视力障碍人士开发盲人羽毛球游戏。这是一段展示当前单人版本盲人羽毛球的视频，可能被称为盲击。声音合成在SuperCollider中实现。

展示一些盲击交互的视频：

<video controls="controls" poster="https://pub.uni-bielefeld.de/download/2920665/2920667" width="80%" height="80%">
<source src="https://pub.uni-bielefeld.de/download/2920665/2920669" type="video/mp4" />
</video>