Cognition in Social Engineering Empirical Research: a Systematic Literature Review

# Description of contents

This repository contains the codebook, dataset and analysis scripts in R used for the following publication: Pavlo Burda, Luca Allodi, Nicola Zannone. "Cognition in Social Engineering Empirical Research: a Systematic Literature Review". ACM Transactions on Computer-Human Interaction (TOCHI).
The repository consists of the following files:

## dataset_and_codebook.xlsx contains the dataset, the codebook and a detailed description of contents.

## scripts/ contains the R scripts used for the analysis

## readme.txt contains this readme

# Dataset and codebook

The dataset_and_codebook.xlsx contains the following sheets:

## Codebook
Contains a detailed description of the dataset (tables, columns, fields, etc.).
The codebook describes the concepts and variables that are present in the dataset. This includes explanations on meaning, numerical values, classification schemes and labels.

## Hypotheses table        
Contains the hypotheses for all analyzed papers and is used in the results of the paper.     
Each row is a hypothesis of an included paper, cells contain one or more values (e.g., value1,value2,...) with or without sub values (e.g., value1,value2(sub-value1, ...)). Any content that is in square brackets [] is ignored in the analysis. Empty cells mean that there is no applicable value for that column.

## Papers table
Contains the analyzed papers and is used in the results of the paper. It is also used in the overview table (Table 6) in Appendix C.
Each row is an included paper, cells contain up to two values (e.g., value1, value2) or the word 'multiple' in case of more than two values. Empty cells mean that there is no applicable value for that column.

## Values table        
Contains the description of cell values of 'Hypotheses' and 'Papers' and sub-values (specific variables in a study) that belong to a value.     
It has a hierarchical structure from left to right where each field on the right column falls under the first non-empty field on the immediate left-top.

# Reproducing results with scripts/ (generate figures)
To run the R scripts included in the 'scripts' directory it is sufficient to follow the instructions in and run the 'RUN_ALL_SCRIPTS.R' in 'scripts' directory.
The scripts use the TSV (Tab Separated Values) format of the dataset, which is the exact copy of the 'Papers' and 'Hypotheses' tables in the 'dataset_and_codebook.xlsx' file.
The resulting figures are stored in the 'scripts/results' directory.