A Statistical Model Checker for Nondeterminism and Rare Events (Artifact)

The Modest Toolset for quantitative modelling and verification includes the 'modes' statistical model checker. We present 'modes' in our TACAS 2018 tool paper titled "A Statistical Model Checker for Nondeterminism and Rare Events", with a particular focus on its capabilities in automated rare event simulation and in approximating optimal schedulers on nondeterministic models. In the paper, we present an experimental evaluation of the capabilities (in terms of the kinds of supported models and analyses), performance, and scalability (across multi-core and distributed setups). This artifact contains (1) the version of 'modes' and (2) the model files used for our experiments, (3) the raw experimental results, (4) summarising tabular views of those results (from which we derived the tables of results included in the paper), and (5) a Linux shell script to replicate a subset of the experiments. Since our complete experiments take several hours to complete and require powerful hardware and computer clusters, we have selected a subset for the replication script. It runs to completion within less than one hour on typical workstation hardware of today while still substantiating the main conclusions drawn in the paper.