Fuzzing: On Benchmarking Outcome as a Function of Benchmark Properties

Fuzzing: On Benchmarking Outcome as a Function of Benchmark Properties<br><br>This artifact is structured as follows:<br><code>fuzzbench-per-trial-seeds</code> -- A modified version of Fuzzbench which allows seeds files to be provided for each trial. Also contains some pre- and post-processing scripts for gathering data<code>final-data-analysis</code> -- An R Jupyter notebook and Python scripts used to generate the figures in the paper, along with the cleaned and aggregated data in CSV files<code>delay</code> -- Python scripts used to generate the figures for e0 (injecting delays) in the paper<code>raw-data</code> -- The raw files output by Fuzzbench for our experimentsThe notebook and scripts should be runnable on the CSV files in that directory without modification. For the Python scripts, dependencies are listed in the <code>requirements.txt</code> file. For the R code, all dependencies are installed in the top cell of the notebook. Note that installing these may take some time. To run the notebook, you will need R with the IRkernel installed (instructions here), as well as Jupyter itself. <code>fbr.py</code>, calculates rankings from public fuzzbench data. We include the public data, but it needs to be decompressed first (e.g. <code>gunzip fb-paper-data.csv.gz</code>)E0 corresponds to the delay injection experiment (IRQ1).E1 corresponds to the AFL and LibFuzzer generated corpora discussed in the motivation of the paper (IRQ2).E2 corresponds to the larger experiment with all corpus / program properties (IRQ3 / IRQ4).模糊测试：基准测试结果与基准属性的关联研究 本研究配套工件结构如下： `fuzzbench-per-trial-seeds`：经过修改的Fuzzbench版本，支持为每一次试验提供种子文件，同时附带用于数据采集的预处理与后处理脚本 `final-data-analysis`：包含用于生成论文图表的R语言Jupyter笔记本与Python脚本，以及存储为CSV格式的清洗后聚合数据集 `delay`：用于生成论文中e0（延迟注入）实验相关图表的Python脚本 `raw-data`：本实验中Fuzzbench输出的原始文件集合 本目录下的笔记本与脚本可直接对该目录内的CSV文件运行，无需修改。Python脚本的依赖项已列于`requirements.txt`文件中；R代码的所有依赖项可通过笔记本的首个代码单元格完成安装。请注意，安装依赖可能需要一定时间。运行该笔记本需预先安装搭载IRkernel的R环境（安装说明见此处）以及Jupyter本体。 `fbr.py`：用于从公开Fuzzbench数据中计算排名的脚本。本数据集附带了公开数据，但需先完成解压（例如执行`gunzip fb-paper-data.csv.gz`命令）。 E0对应延迟注入实验（IRQ1）；E1对应论文引言部分讨论的由AFL与LibFuzzer生成的语料库实验（IRQ2）；E2对应涵盖全部语料/程序属性的大型实验（IRQ3/IRQ4）。