Dataset and Results for "A Comprehensive Empirical Analysis of Patch Presence Testing"

Data artifact and replication package for the ISSTA 2026 paper "A Comprehensive Empirical Analysis of Patch Presence Testing: Capabilities, Limitations, and Paths Forward." This repository snapshot contains the study's dataset metadata (562 test-set CVE entries and 559 reference entries across 10 open-source projects: binutils, curl, ffmpeg, freetype, imagemagick, libxml2, openjpeg,openssl, sqlite, tcpdump), the collected CVE patch diffs, reference/test-set mappings and target functions, the detection results of five patch presence testing tools (BinXray, PatchDiscovery, PS3, React, Robin), the per-research-question analysis data backing the paper's figures and tables, and the dataset-construction pipeline scripts (including an offline smoke test and a reduced, runnable demo). An offline smoke test (python3 scripts/smoke_test.py, also provided as a container image) validates the snapshot. The separately archived compiled binary corpus (~43 GB) is available at DOI 10.5281/zenodo.18382612. Submitted for the ISSTA 2026 Available and Reusable badges. Author-created data are released under CC BY 4.0 and scripts under the MIT License; third-party source, patches, and binaries remain under their upstream licenses.