Impact of an Automatic Judge in Database Learning (dataset)

This is a anonymized dataset for the assesment of the impact of using an online automatic judge for free practice in a databasecourse over four academic years.

raw_data contains one directory for each group (CSE or CSE/M) of the DB course, which in turn contains one directory for each academic year, which finally contains two CSV files with the anonymized gradebook and the online judge submission submission logs for that academic year and group. There is no submission logs for the year 2019/20 where the online judge was not available. User identifiers have been converted to sequential numbers after random shuffling the original dataset to preserve the anonymity of students.

megatable.csv summarizes in a single table the data contained in the separate tables for each group. Most information for the analyses have been obtained from this table, which can be generated with an attached script. Student identifiers consist of the corresponding identifier in the original table prefixed by the academic year.

src contains several scripts that have been used to process the data, compute statistics on them, and generate the graph and tables included in the submitted paper. They have been included to facilitate the reproducibility of the results.