Dataset for "Evaluation Methods and Replicability of Software Architecture Research Objects"

# Content<br> In this package, please find the following content: * Investigated Papers.bib<br> A BibTeX file with all papers investigated in the paper "Evaluation Methods and Replicability of Software Architecture Research Objects"<br> * Raw-Data-Table Content-Data.html and Raw-Data-Table Meta-Data.html<br> Tables with the raw data as extracted during the systematic literature review<br> * Colection of Data Visualizations.pdf<br> Multiple visualizations of the raw data for analysis. A copy of summary.pdf as described below.<br> * Data and Visualization<br> Contains:<br> - The data as CSV files,<br> - scripts for creating visualizations<br> - *.awk -- Awk scripts are used to create the corresponding of the *.csv files in data<br> - *.rb -- Ruby scripts to build the respective figures in figs as *.tex files<br> - make-all.sh -- A script to call all other scripts for creating diagrams and the summary<br> - make-paper-figures.sh -- A script to build "paper-figures.pdf" with all diagrams used in the accompanying paper<br> - A documentation of the contained scripts (Data and Visualization/README.md)<br> - summary.pdf -- A collection of diagrams (as built by make-all.sh)<br> - paper-figures.pdf -- A collection of all diagrams as used in the accompanying paper (as built by make-paper-figures.sh and make-all.sh)<br> * Wiki/<br> A copy of the wiki used during data extraction.<br> Constains:<br> - descriptions of all data items<br> - the process description<br> - the taxonomy used for data extraction <br> # Reproduction<br> You can reproduce the visualizations with the following commands in a UNIX command line environment. &gt; cd "Data and Visualization"<br> &gt; ./make-paper-figures.sh<br> &gt; ./make-all.sh The requirements are:<br> * A UNIX command line environment (e.g., bash) with awk installed<br> * Ruby (&gt;2.5)<br> * latex (e.g., tex-live) The command "./make-paper-figures.sh" produces the file “paper-figures.pdf”, which contains all diagrams that are used in the paper.<br> The command "./make-all.sh" produces the file "summary.pdf", which contains diagrams used for data analysis, and the file "paper-figures.pdf". All figures describing the results in the paper are also in "summary.pdf".<br> These commands each take about 2 ("/make-paper-figures.sh") / 8 ("./make-all.sh") minutes to run on current standard laptop (Intel i5-8250U, 16 GB memory).<br> Calling the commands produces many log statements (information and warnings), which show the progress and can be ignored.