iCFTL-Diagnostics dataset

This dataset accompanies the paper "Diagnosing Violations of Time-based Properties Captured in iCFTL", by Cristina Stratan, Joshua Heneage Dawes, and Domenico Bianculli, to appear in the proceedings of FormaliSE 2024. <br>Together with the dataset, we provide the source code (iCFTL-Diagnostics-tool.zip) of the tool developed as part of the contribution of this paper. iCFTL-Diagnostics tool is also available at https://github.com/SNTSVV/icftl-diagnostics. The instructions on usage can be found in the README both in the zip file and GitHub).The dataset.zip has three folders:<b>rq1</b> for research question RQ1<b>rq2</b> for research question RQ2<b>rq3</b> for research question RQ3In folder rq1 we have rq1.csv file that contains the data used to answer RQ1 and it has the following columns:<i>project - </i>for the project full name<i>e</i><i>xpected PNR, </i>for the line number expected to be returned by the diagnostics approach<i>detected PNR, </i>for the line number of the PNR detected by our diagnostics approach<i>correct PNR, </i>Boolean values to show if expected PNR coincides with detected PNRIn folder rq2 we have time-men-diagn.csv and time-men-diagn2.csv files that contain the data used to build <b>Table 2</b>: Average (over 5 runs) time and memory consumed by the diagnostics approach. Both time-men-diagn.csv and time-men-diagn2.csv have the columns:<i>project</i> - for the project full name<i>time-mean </i>- for the mean time calculated over the 5 runs of the project<i>time_std</i> - for the standard deviation of the time taken<i>memory-mean</i> - for the mean memory calculated over the 5 runs of the project<i>memory_std</i> - for the standard deviation of the memory consumed<i>ID</i> - for the project ID<i>binding-count </i>- for the number of binding the project has<i>avg-trace-length</i> - for the average trace lengthFinally, in rq3 we have the rq3.csv file that contain data used to build <b>Table 3</b>: Mean of time and memory consumed by different instrumentation schemes. rq3.csv has the columns:<i>project </i>- for the project name<i>mean-n-t -</i> for mean time calculated over 5 runs of the non-instrumented program<i>std-n-t </i>- standard deviation of the time taken over 5 runs of the non-instrumented program<i>mean-v-t - </i>for mean time calculated over 5 runs of the vanilla instrumented program<i>std-v-t - </i>standard deviation of the time taken over 5 runs of the vanilla instrumented program<i>mean-d-t - </i>for mean time calculated over 5 runs of diagnostics instrumented program<i>std-d-t - </i>standard deviation of the time taken over 5 runs of the diagnostics instrumented program<i>ID-t -</i> for the project ID<i>mean-n-m - </i>for mean memory calculated over 5 runs of non-instrumented program<i>std-n-m - </i>standard deviation of the memory consumed over 5 runs of the non-instrumented program<i>mean-v-m - </i>for mean memory calculated over 5 runs of vanilla instrumented program<i>std-v-m - </i>standard deviation of the memory consumed over 5 runs of the vanilla instrumented program<i>mean-d-m - </i>for mean memory calculated over 5 runs of diagnostics instrumented program<i>std-d-m - </i>standard deviation of the memory consumed over 5 runs of the diagnostics instrumented program<i>ID-m - </i>for the project ID<i>t-d-v - </i>for approximate percentage of time taken by the diagnostics instrumented program over vanilla instrumented program (in percentage)<i>m-d-v - </i>for approximate percentage of memory consumed by the diagnostics instrumented program over vanilla instrumented program (in percentage)<i>t-d-n-raw - </i>for<i> </i>the<i> </i>time the diagnostics instrumented program took over non-instrumented program (in percentage)<i>t-d-v-raw - </i>for<i> </i>the<i> </i>time the diagnostics instrumented program took over vanilla instrumented program (in percentage)<i>m-d-n-raw - </i>for memory the diagnostics instrumented program took over non-instrumented program (in percentage)<i>m-d-v-raw - </i>for memory the diagnostics instrumented program took over vanilla instrumented program (in percentage)<br>