Approximation-guided Fairness Testing through Discriminatory Space Analysis

Description: This dataset contains the experimental results from the paper titled "Approximation-guided Fairness Testing through Discriminatory Space Analysis". In this paper, we conducted 24 fairness testing tasks using 5 different fairness testing algorithms: AFT (our proposed algorithm), VBT-X, VBT, THEMIS, and ExpGA. Each execution was repeated 30 times, with a runtime of 1 hour. Files Included: log.txt: This file contains the logs of each execution. Each log is labeled with an identifier, such as "'aft-LogReg-Adult-sex-0", which represents the 1st execution of the fairness testing task on (LogReg, Adult, sex) using AFT. discriminatory_instances.zip: This archive includes all the IDIs (individual discriminatory instances) identified during the experiments. test_cases_1.zip, test_cases_2.zip, and test_cases_3.zip: These archives includes all the test cases generated during the experiments. Find them at https://doi.org/10.5281/zenodo.11650346 and https://doi.org/10.5281/zenodo.11650369. res.txt: This file contains the averaged results of the 30 repetitions. It includes four metrics: #IDIs (the number of indentified IDIs), #Tests (the number of generated test cases), Succ (the success ratio of test case), and DivIDIs (the diversity of IDIs).