Unveiling Heisenbugs with Diversified Execution -- Beanstalk Evaluation Artifact

The assets in this release, in addition to data processing tools, include:

data-raw.zip: Raw data from data-collection cluster

data.zip: Processed data from raw data

summary.zip: Summarized data (from data.zip)

simulations.zip: Simulation runs for compute budget/max instrumentation simulations

figures.zip: List of figures generated for the paper

beanstalk-benchmarks.zip: Source code of benchmarks used

The relevant data processing code is located on Github (commit 45f4f92) with a Zenodo-backed archive (DOI included in the README)Follow instructions in README.md of the data processing repo to reproduce results. Note: You may have to install JAX with pip for data processing