Replication package for the paper: "A Study on the Pythonic Functional Constructs' Understandability"

Replication Package for A Study on the Pythonic Functional Constructs' Understandability This package contains several folders and files with code and data used in the study. examples/Contains the code snippets used as objects of the study, named as reported in Table 1, summarizing the experiment design. RQ1-RQ2-files-for-statistical-analysis/Contains three .csv files used as input for conducting the statistical analysis and drawing the graphs for addressing the first two research questions of the study. Specifically: - ConstructUsage.csv contains the declared frequency usage of the three functional constructs object of the study. This file is used to draw Figure 4. - RQ1.csv contains the collected data used for the mixed-effect logistic regression relating the use of functional constructs with the correctness of the change task, and the logistic regression relating the use of map/reduce/filter functions with the correctness of the change task. - RQ1Paired-RQ2.csv contains the collected data used for the ordinal logistic regression of the relationship between the perceived ease of understanding of the functional constructs and (i) participants' usage frequency, and (ii) constructs' complexity (except for map/reduce/filter). inter-rater-RQ3-files/Contains four .csv files used as input for computing the inter-rater agreement for the manual labeling used for addressing RQ3. Specifically, you will find one file for each functional construct, i.e., comprehension.csv, lambda.csv, and mrf.csv, and a different file used for highlighting the reasons why participants prefer to use the procedural paradigm, i.e., procedural.csv. Questionnaire-Example.pdfThis file contains the questionnaire submitted to one of the ten experimental groups within our controlled experiment. Other questionnaires are similar, except for the code snippets used for the first section, i.e., change tasks, and the second section, i.e., comparison tasks. RQ2ManualValidation.csvThis file contains the results of the manual validation being done to sanitize the answers provided by our participants used for addressing RQ2. Specifically, we coded the behavior description using four different levels: (i) correct, (ii) somewhat correct, (iii) wrong, and (iv) automatically generated. RQ3ManualValidation.xlsxThis file contains the results of the open coding applied to address our third research question. Specifically, you will find four sheets, one for each functional construct and one for the procedural paradigm. For each sheet, you will find the provided answers together with the categories assigned to them. Appendix.pdfThis file contains the results of the logistic regression relating the use of map, filter, and reduce functions with the correctness of the change task, not shown in the paper. FuncConstructs-Statistics.r This file contains an R script that you can reuse to re-run all the analyses conducted and discussed in the paper. FuncConstructs-Statistics.ipynbThis file contains the code to re-execute all the analysis conducted in the paper as a notebook.