Automated Fixing Capabilities of Gemma 4 31b

This dataset contains results of an experiment of automated fixing defects4j using Gemma4 31b with and without additional information. The original code is in https://github.com/kieker-monitoring/defects4j-automate.git The dataset contains The metadata analysis results (tracelength.txt) The raw results of bug fixing on 8 Nvidia L40s (zenodo-v1-9e.tar.xz) The current code of the repo (defects4j-automate.tar), which contains a README how to reproduce the experiments and the analysis For all projects, the correlation between steps, tokens and whether the fix was successful is visualized and stored in the dataset (*.pdf). We see that the count of steps and tokens correlates, but there is no correlation with whether the fix was succesful.