Student's logs and perceptions of an automated assessment tool in a software engineering MOOC specialization

Our dataset contains students' perceptions and usage of an automated assessment tool (MOOCauto) for obtaining formative feedback in software engineering assignments that are part of a MOOC specialization at Universidad Politécnica de Madrid (Spain), delivered by the MiriadaX platform. The dataset has previously been used in a study to evaluate students' perceptions of the tool and to analyze their usage patterns using Growth Mixture Models (López-Pernas et al., 2023). The code of each of the assignments is available on Github: https://github.com/ging-moocs.

Our dataset contains two files:

MOOCauto usage logs

The first file is called moocauto_logs.csv and it contains 8,261 anonymized logs of students' use of the automated assessment tool in the MOOC specialization assignments. The columns of the dataset are as follows:

MOOCid: Unique numeric identifier for the MOOC (1-4)

MOOC: Name of the MOOC: Frontend Development (n = 3,801), Backend Development (n = 2,563), Git & Github (n = 1414), Fullstack Development (n = 483)

AssignmentName: Name of the assignment.

AssignmentId: Unique identifier for each assignment (1-17)

user: Unique identifier of the student (it varies per assignment)

timestamp: Time in which the assessment was performed

score: Score obtained (0-10)

Students' perceptions of MOOCauto

The second file is called moocauto_questionnaire.csv and it contains 213 students' responses to the questionnaire conducted at the end of each MOOC in order to evaluate their opinion of the tool and perception on usefulness, ease of use, and other aspects related to the Technology Acceptance Model (TAM). The questions were as follows:

What is your general opinion of MOOCauto? (1 Horrible - 5 Excellent)

Indicate your level of agreement with the following statements (1 Strongly disagree - 5 Strongly agree) 

MOOCauto has been easy to install

MOOCauto has been easy to use

The feedback provided by MOOCauto was easy to understand

The feedback provided by MOOCauto was useful

The feedback provided by MOOCauto helped me improve my assignments

The documentation Of MOOCauto was useful

MOOCauto has increased my motivation to work on the assignments

I prefer the feedback from MOOCauto than from peer assessment

I would like to have a bot like MOOCauto in other MOOCs

How useful do you perceive the following features of MOOCauto? (1 Useless - 5 Very useful)

It works locally on my computer

It allows to run the test suite as many times as I want

It provides instantaneous feedback every time the test suite is executed

It has documentation that explains its use and available options