Supplementary Material: Effectiveness of Performance Visualizations for Declarative Model Transformations

We performed a case study to evaluate whether our performance visualizations developed for the declarative transformation language Henshin are suitable for performing a root cause analysis. Our study consisted of four parts. 1) Participants completed a questionnaire that collected data on their demographics and knowledge of model transformations. 2) The participants watched a video explaining the basics of models, Henshin, and our performance visualizations. 3) The study participants solved four different tasks one after the other. Guided by a questionnaire, they carried out a root cause analysis. 4) Finally, in a short interview session, we asked the participants about their assessment of the comprehensibility and usefulness of the visualizations.

In total, 18 participants took part in our study. Our results show that most participants could correctly read and interpret the information provided by the visualizations. The majority of our participants could propose a performance optimization based on the visualizations that optimized the execution of a transformation.

This data set contains our study material, which is necessary to repeat the study, our raw and processed data.