Supplementary Material for "Multi-Touch Interactions for Model-Based Sonification"

This paper presents novel interaction modes for Model-Based Soni- fication (MBS) via a multi-touch interface. We first lay out details about the constructed multi-touch surface. This is followed by a description of the Data Sonogram Sonification Model and how it is implemented using the system. Modifications from the original sonification model such as the limited space scans are described and discussed with sonification examples. Videos showing exam- ples of interaction are provided for various data sets. Beyond Data Sonograms, the presented system provides a basis for the imple- mentation of known and novel sonification models. We discuss the available interaction modes with multi-touch surfaces and how these interactions can be profitably used to control spatial and non- spatial sonification models.

本文提出了一种依托多点触控界面的新型交互模式，用于基于模型的声化（Model-Based Sonification, MBS）研究。首先，本文详述所构建的多点触控交互表面的细节信息。随后，本文对数据声图声化模型（Data Sonogram Sonification Model）及其在本系统中的实现方式进行说明。本文还针对原始声化模型的改进方案（如有限空间扫描）展开阐述，并结合声化示例进行讨论。本文提供了针对多种数据集的交互示例演示视频。除数据声图应用场景外，本系统还可为现有经典声化模型与新型声化模型的实现提供通用支撑框架。最后，本文探讨了多点触控交互表面所支持的各类可用交互模式，以及如何通过这些交互方式高效调控空间型与非空间型声化模型。