Supplementary Material for "Relevance-based Interactive Optimization of Sonification"

This paper presents a novel approach for the interactive optimization of sonification parameters. In a closed loop, the system automatically generates modified versions of an initial (or previously selected) sonification via gradient ascend or evolutionary algorithms. The human listener directs the optimization process by providing relevance feedback about the perceptual quality of these propositions. In summary, the scheme allows users to bring in their perceptual capabilities without burdening them with computational tasks. It also allows for continuous update of exploration goals in the course of an exploration task. Finally, Interactive Optimization is a promising novel paradigm for solving the mapping problems and for a user-centred design of auditory display. The paper gives a full account on the technique, and demonstrates the optimization at hand of synthetic and real-world data sets. ### Sonification examples Fisher Data set (two overlapping clusters): The sonification examples are the parents of a series of optimization steps, starting with a random sonification and optimizing towards an audible separation of chlusters. SFk is the parent of iteration k. + [SF1 (mp3, 28k)](https://pub.uni-bielefeld.de/download/2702997/2702998) + [SF3 (mp3, 28k)](https://pub.uni-bielefeld.de/download/2702997/2702999) + [SF5 (mp3, 28k)](https://pub.uni-bielefeld.de/download/2702997/2703000) + [SF6 (mp3, 28k)](https://pub.uni-bielefeld.de/download/2702997/2703001) + [SF7 (mp3, 28k)](https://pub.uni-bielefeld.de/download/2702997/2703002) + [SF9 (mp3, 28k)](https://pub.uni-bielefeld.de/download/2702997/2703003) + [SF10 (mp3, 28k)](https://pub.uni-bielefeld.de/download/2702997/2703004) good audible clustering structure + [SF11 (mp3, 28k)](https://pub.uni-bielefeld.de/download/2702997/2703005) + [SF12 (mp3, 28k)](https://pub.uni-bielefeld.de/download/2702997/2703006) + [SF13 (mp3, 28k)](https://pub.uni-bielefeld.de/download/2702997/2703008) + [SF14 (mp3, 28k)](https://pub.uni-bielefeld.de/download/2702997/2703007) + [SF15 (mp3, 28k)](https://pub.uni-bielefeld.de/download/2702997/2703009) + [SF17 (mp3, 28k)](https://pub.uni-bielefeld.de/download/2702997/2703010) + [SF18 (mp3, 28k)](https://pub.uni-bielefeld.de/download/2702997/2703011) + [SF19 (mp3, 28k)](https://pub.uni-bielefeld.de/download/2702997/2703012) + [SF20 (mp3, 28k)](https://pub.uni-bielefeld.de/download/2702997/2703013) + [SF21 (mp3, 28k)](https://pub.uni-bielefeld.de/download/2702997/2703014) + [SF22 (mp3, 28k)](https://pub.uni-bielefeld.de/download/2702997/2703016) + [SF23 (mp3, 28k)](https://pub.uni-bielefeld.de/download/2702997/2703015) + [SF24 (mp3, 28k)](https://pub.uni-bielefeld.de/download/2702997/2703018) + [SF25 (mp3, 28k)](https://pub.uni-bielefeld.de/download/2702997/2703017) + [SF33 (mp3, 28k)](https://pub.uni-bielefeld.de/download/2702997/2703019) + [SF34 (mp3, 28k)](https://pub.uni-bielefeld.de/download/2702997/2703020) + [SF37 (mp3, 28k)](https://pub.uni-bielefeld.de/download/2702997/2703021) Iris data set (4d data with 3 clusters, 150 items): The sonification examples are again the parents for the successive iterations during evolutionary optimization SIk denotes (S)ound Example for (I)ris data set iteration k. + [SI1 (mp3, 40k)](https://pub.uni-bielefeld.de/download/2702997/2703024) + [SI2 (mp3, 40k)](https://pub.uni-bielefeld.de/download/2702997/2703022) + [SI3 (mp3, 40k)](https://pub.uni-bielefeld.de/download/2702997/2703023) + [SI4 (mp3, 40k)](https://pub.uni-bielefeld.de/download/2702997/2703025) + [SI5 (mp3, 40k)](https://pub.uni-bielefeld.de/download/2702997/2703026) + [SI6 (mp3, 40k)](https://pub.uni-bielefeld.de/download/2702997/2703027) + [SI7 (mp3, 40k)](https://pub.uni-bielefeld.de/download/2702997/2703028) + [SI8 (mp3, 40k)](https://pub.uni-bielefeld.de/download/2702997/2703031) + [SI9 (mp3, 40k)](https://pub.uni-bielefeld.de/download/2702997/2703029) + [SI10 (mp3, 40k)](https://pub.uni-bielefeld.de/download/2702997/2703030) The following examples are optimization results for increased attention to amplitude and panning. + [SI Amplitude (mp3, 40k)](https://pub.uni-bielefeld.de/download/2702997/2703032) + [SI Panning (mp3, 40k)](https://pub.uni-bielefeld.de/download/2702997/2703033) ### SuperCollider Extensions Find here SuperCollider classes by Thomas Hermann, which are useful for programming sonifications. #### OctaveSC OctaveSC is a class to interface with the free powerful math package [octave](http://www.octave.org/). Description The class allows to call octave functions and execute octave instructions from sc3 transfer data between octave and sc3 use the SuperCollider rtf document editor as octave shell (tested on OSX): via CTRL-RETURN the current line or selection can be executed in octave. This allows to interleave octave code and explaning text in the same way as it can be done with sc code. #### Download OctaveSC is provided as zip archive (download [(OctaveSC.zip (16kB)](https://pub.uni-bielefeld.de/download/2702997/2933602/OctaveSC.zip) ]) with the OctaveSC class directory containing the class file OctaveSC.sc and a help file OctaveSC.help.rtf. See the README.txt for installation instructions and how to get started. #### Contributing to OctaveSC The standard data types (scalars, vectors, matrices) of numbers work reliable, and I find OctaveSC very useful. However, its functionality is far from complete in this version. In particular, I'd like to address for future versions the integration of high-level commands to exchange strings exchange of string matrices checks for proper dimensions when exchanging matrices and vectors automatic matrix-2-vector conversion for Nx1 matrices (which currently appear in sc as arrays of arrays with 1 element each) working with structures. Suggestions for improving OctaveSC are very welcome, please e-mail your code fragment for inclusion into the official distribution provided on this website.