Dataset for algorithmic thinking skills assessment: Results from the virtual CAT large-scale study in Swiss compulsory education

OverviewThis dataset was collected during a main study that evaluated the virtual Cross Array Task (CAT) platform as an assessment tool for algorithmic thinking (AT) skills among K-12 students in Swiss compulsory education.As algorithmic thinking becomes increasingly vital in our digital age, this study bridges the gap between traditional assessments and the needs of today's learners by introducing a digital platform. The virtual CAT, a digital adaptation of an unplugged assessment activity, offers scalable, automated assessments with reduced human intervention.

Study Context, Location and ParticipantsTo comprehensively investigate algorithmic competencies within compulsory education, exploring their variations and determining the factors influencing them, in Spring 2023 we conducted an experimental study with the virtual CAT's.The sample comprises 129 students (65 girls and 64 boys), selected from nine classes across five public schools in Ticino and Solothurn cantons.

Data CollectionDuring the data collection process, session and participant details were manually recorded by the administrator. Each session has been assigned a unique identifier, and specific details, such as the date, canton, school name and type, and the students’ HarmoS grade (HG) level, have been recorded. Student information are limited to sex and date of birth, with birth dates used to calculate ages, a significant factor in our demographic analysis. To protect student privacy, unique identifiers have been assigned to each participant, keeping the data anonymous and secure. The assessment tool automatically tracked all user interaction within the platform.All data collected have been pseudonymised, aligning with prevailing open science practices in Switzerland (SNSF, 2021). Data collection was integrated into a validation module of the app. 

Data FeaturesThe dataset comprises the following files:

STUDENTS_SESSIONS.csv

RESULTS.csv

LOGS.csv

CANTONS.csv

ALGORITHMS.csv

These files collectively provide insights into the algorithmic actions of the students, demographic details, session logs, results, and more.

Usage & EthicsIn the spirit of open science, this dataset is made available to the public after meticulous anonymisation to ensure all participants' privacy and ethical treatment. Initial authorisations were secured from school administrators, teachers, and parents. Detailed communication regarding the study's nature, data handling, and objectives was transparently shared with all stakeholders.

REFERENCES

[1] A. Piatti, G. Adorni, L. El-Hamamsy, L. Negrini, D. Assaf, L. Gambardella & F. Mondada. (2022). The CT-cube: A framework for the design and the assessment of computational thinking activities. Computers in Human Behavior Reports, 5, 100166. https://doi.org/10.1016/j.chbr.2021.100166

[2] Adorni, G., & Piatti, S., & Karpenko, V. (2023). virtual CAT: An app for algorithmic thinking assessment within Swiss compulsory education. Zenodo Software. https://doi.org/10.5281/zenodo.10027851 On GitHub: https://github.com/GiorgiaAuroraAdorni/virtual-CAT-app/

[3] Adorni, G., & Karpenko, V. (2023). virtual CAT programming language interpreter. Zenodo Software. https://doi.org/10.5281/zenodo.10016535 On GitHub: https://github.com/GiorgiaAuroraAdorni/virtual-CAT-programming-language-interpreter/

[4] Adorni, G., & Karpenko, V. (2023). virtual CAT data infrastructure. Zenodo Software. https://doi.org/10.5281/zenodo.10015011 On GitHub: https://github.com/GiorgiaAuroraAdorni/virtual-CAT-data-infrastructure