Evaluation Data and Scripts for SPLC 2025 Paper "Investigating the Effects of T-Wise Interaction Sampling for Vulnerability Discovery in Highly-Configurable Software Systems"

The replication package containing the evaluation data and associated scripts for the SPLC 2025 paper Investigating the Effects of T-Wise Interaction Sampling for Vulnerability Discovery in Highly-Configurable Software Systems. The evaluation data is located in the data directory, whereas the scripts can be found in the src subdirectory. Requirements The evaluation scripts were written for Python 3.10. A tutorial on how it can be installed on an Ubuntu system can be found online. Note: The sudo add-apt-repository ppa: dead snakes/PPA command referred to in the tutorial should actually be:sudo add-apt-repository ppa:deadsnakes/ppa If needed, a guide on how a virtual machine running Ubuntu can be set up can be found here. Execution of the Evaluation Scripts Download the zipped replication package (see Files section below). Ensure that there is sufficient disk space available. The replication package has a size of nearly 24GB. Unzip the replication package (e.g., via right-click on the file --> Extract Here in a file explorer or the command unzip <filename>.zip -d <destination_folder>). Install the required Python packages from the requirements.txt file located in the project's top-level directory via pip: python3.10 -m pip install -r /path/to/requirements.txt. If you are shown an /usr/bin/python3.10: No module named pip error, pip first needs to be installed manually, like described below: Execute: sudo apt update Execute: sudo apt install python3.10-distutils curl Execute: curl -sS https://bootstrap.pypa.io/get-pip.py | sudo python3.10 For creating the processed data visualized in the paper via tikz and pgfplots, follow the step-by-step guide in the Evaluation Workflow section of the README.md file located in the project's top-level directory.