A Survey on How Test Flakiness Affects Developers and What Support They Need To Address It

Replication dataset for the research paper "A Survey on How Test Flakiness Affects Developers and What Support They Need To Address It", which was presented at the 15th IEEE International Conference on Software Testing, Verification and Validation (ICST) 2022Pre-printPlotting scriptsThis package contains the following files:survey.mdthe questionnaire, that we presented to our participants.dataset.csvthe responses that we received. Let's look at the columns:ㅤㅤIdentifier columnsㅤㅤㅤㅤorigin: automotive (BMW) or global participantㅤㅤㅤㅤparticipant_id: unique participant id, which is referred to in the paperㅤGeneral demographic informationㅤㅤㅤㅤ(provided by Prolific -> only available for global participants)ㅤㅤㅤㅤAgeㅤㅤㅤㅤCountry of BirthㅤㅤㅤㅤCurrent Country of ResidenceㅤㅤㅤㅤEmployment StatusㅤㅤㅤㅤFirst LanguageㅤㅤㅤㅤNationalityㅤㅤㅤㅤSexㅤㅤㅤㅤStudent StatusㅤㅤㅤㅤKnowledge of software develpment techniquesDemographic questionsㅤㅤplatformㅤㅤㅤㅤsoftwareTypeㅤㅤㅤㅤcodeSizeㅤㅤㅤㅤteamSizeㅤㅤㅤㅤtestLevelㅤㅤㅤㅤtestingPracticesExperience with Flakinessㅤㅤㅤㅤfrequency (=prevalence)ㅤㅤㅤㅤseverityㅤㅤㅤㅤconsequencesㅤㅤㅤㅤotherConsequencesㅤㅤㅤㅤrootCauseㅤㅤㅤㅤotherRootCausesㅤㅤㅤㅤmitigationStrategiesㅤㅤㅤㅤotherMitigationStrategiesㅤㅤㅤㅤwishescoded_free_text_answers.csvㅤㅤOur quantitative content analysis on all free text answers ㅤㅤㅤㅤ(otherConsequences, otherRootCauses, otherMitigations, wishes).Identifier columnsㅤㅤㅤㅤoriginㅤㅤㅤㅤparticipant_idㅤㅤㅤㅤquestion: which question was this answer given to?Code columnsㅤㅤhierarchical structure of codes: ㅤㅤㅤㅤㅤㅤCode \ ADDRESSED_ISSUE \ PARENT_CODE \ CHILD_CODEㅤㅤㅤㅤparent-codes are independent and not super-sets of child codes!for this purpose, we have \* codes -> these are super-sets of all child-codesㅤㅤㅤㅤexample: Code\A\* unifies Code\A, Code\A\X, and Code\A\Y