Benchmarking Change Detection Exactness and Overhead of Instrumentation and Sampling - Dataset

This contains the code and the experimental results for the paper "Benchmarking Change Detection Exactness and Overhead of Instrumentation and Sampling". Especially, it contains 3 things Code code.tar: The code of sjsw, peass, precision-experiments, and precision-experiments-rca that are needed to execute the experiments (although the GitHub repos are preferable, if they are available) To run the experiments, build all projects as described in their READMEs and run for percentage in 1 2 3 4 5; do ./run_instrumentation_regular.sh $percentage UNTIL_SOURCE_CHANGE; done for percentage in 1 2 3 4 5; do ./run_sampling.sh $percentage 1; done for percentage in 1 2 3 4 5; do ./run_sampling.sh $percentage 10; done for percentage in 1 2 3 4 5; do ./run_sampling.sh $percentage 20; done ./run_measure.sh 1 The experiments can be distributed, as long as the resulting _peass folders are copied to the same analysis folder For analysis, use the scripts in precision-experiments-rca/scripts/analysis_instrumentationSampling Measurement Data instrumentation-usc.tar: Measurement results of instrumented executions of the demo project, where only the methods that are calling the method with changes source code are instrumented sampling-interval1.tar.zstd: Measurement results of the executions using sampling with 1 ms interval sampling-interval10.tar.zstd: Measurement results of the executions using sampling with 10 ms interval sampling-interval20.tar.zstd: Measurement results of the executions using sampling with 100 ms interval Analysis results results.tar: Heatmaps and analysis results based on the data overhead.pdf depicting the overhead of run without instrumentation, with instrumentation and with sampling