RAGE_Pilot1_SPL-SpaceModules

General description: The data are gathered during an evaluation of the first version of the game Space Modules Incorporated within the RAGE project. This evaluation investigated the quality of the ecologically valid educational setting (game & debriefing) for acquiring IT helpdesk communication skills. More in particular, the quality of the game was examined by looking at participants’ opinions on the usability, the studyability, and their perceived affordances of the game for acquiring communication skills as IT helpdesk employee (i.e., perceived usefulness for learning). In addition, more objective measurements of participants’ learning progress were gathered via in-game traces (i.e. in-game scores on five variables regarded important in IT helpdesk communication) on two game-sessions. The main research question is: Does the educational setting with the game (i.e., game & debriefing) lead to learning progress, and by which effort and satisfaction of the learner (task load, motivation)? In total, 648 students participated, but a far lower number of 172 students completed the first two out of three game sessions. According to the results, the main research question with respect to whether learning gains occurred from the educational setting with the game could be positively answered. Topic ACM CSS 2012: Applied computing~Interactive learning environments • Human-centered computing~Usability testing PsycINFO Classification: 3500 Educational Psychology - 3530 Curriculum & Programs & Teaching Methods; 3550 Academic Learning & Achievement Name entitites Organizational information: Open University of the Netherlands Geographical information: The Netherlands Time information: March 2017 – December 2017 Types: SPSS-file (version 24) RAGCS target group: demand side - end-users - adults - vocational school Evaluation dimensions Evaluation object: Space Modules Incorporated game Methodology/design: Pre-post measure of learning effectiveness of debriefing-formats (four conditions) using in-game traces (by session 1 (pre-measure) & session 2 (post-measure). Evaluation variables: Self-perceived communication knowledge, Usability, Studyability, Task load, Motivation, Communication skills Instruments: Self-perceived communication knowledge (ICKA, Wilkins et al., 2015); Usability (SUS, Brooke, 1996); Studyability (Nadolski & Hummel, 2017); Task load (NASA-TLX, Hart & Staveland, 1988); Motivation (IMI, Ryan & Deci, 2000); Communication skills (in-game-traces) Knowledge/skill elements RAGCS skills: skills - cognitive skills – applying; skills - affective skills - interpersonal ESCO skills: communicate with customers (http://data.europa.eu/esco/skill/0da516ee-e70e-4384-be13-f5ff80be8127); ICT helpdesk agent; IT helpdesk communication Relationships: D8.3 First RAGE Evaluation Report Related dataset: 10.5281/zenodo.2564772