Artifact for "Program Repair and LLMs for Intelligent Tutoring of Programming"

This is the supplementary material for our work on "Program Repair and LLMs for Intelligent Tutoring of Programming". The corresponding paper has been submitted to the Technical Symposium on Computer Science Education (SIGCSE TS) 2025.

Our material includes (1) the artifacts for our user evaluations and (beyond what we describe in our paper) (2) additional information on the student projects used in our software engineering course. In this course, third-year CS students focus on developing the intelligent tutoring system.

1. Artifacts for the User Evaluations

The user_evaluation/students folder includes the main artifacts for the conducted experiments with the first-year CS students:

students_questionnaire_part1.pdf -- It shows the PDF version of the web form of our survey for students before they solve the programming assignment.

students_questionnaire_part2_groupA.pdf -- It shows the PDF version of the web form of our survey for group A students after they solve programming assignments with ITS.

students_questionnaire_part2_groupB.pdf -- It shows the PDF version of the web form of our survey for group B students after they solve the programming assignments without ITS.

students_responses.xlsx -- It shows all students' responses.

The user_evaluation/tutors folder includes the main artifacts for the conducted surveys with the CS tutors:

tutors_questionnaire_part1.pdf -- It shows the PDF version of the web form of our survey for tutors before they grade students' programming assignments.

tutors_questionnaire_part3.pdf -- It shows the PDF version of the web form of our in-person interview for tutors after they grade students' programming assignments.

tutors_responses.xlsx -- It shows all tutors' responses.

2. Course Project Descriptions

The projects folder includes the main artifacts for the conducted experiments with the first-year CS students:

2022_project.pdf -- It includes the project descriptions, which have been provided to the third-year students in the first instance of our Software Engineering course.

2023_project.pdf -- It includes the project descriptions, which have been provided to the third-year students in the second instance of our Software Engineering course.

project_schedule.pdf -- It includes the overview of the assignments in our course illustrating the project's overall schedule.