Data from: ChatGPT performance on radiation technologist and therapist entry to practice exams

This dataset contains the data needed to reproduce all results and figures described in "ChatGPT performance on radiation technologist and therapist entry to practice exams".

Details about the data collection can be found in the paper referenced below. Briefly, ChatGPT (GPT-4) was prompted with multiple choice questions from 4 practice exams provided by the Canadian Association of Medical Radiation Technologists (CAMRT). ChatGPT was promted with the questions from each exam 5 times between July 17 and August 13, 2023. Table 1, below, provides details about the dates for data collection.

Variable descriptions

question: Question number, provided by CAMRT. Skipped question numbers indicate image-based questions that were excluded from the study.

discipline: Indicates the CAMRT exam discipline, abbreviated as follows 

RAD: radiological technology

MRI: magnetic resonance

NUC: nuclear medicine

RTT: radiation therapy

question_type: Indicates the type of competency being assessed by the question (Knowledge, Application, or Critical thinking). Competency categories were assigned by CAMRT.

corrrect_response: The correct multiple choice response ("A", "B", "C", or "D"), assigned by CAMRT.

attempt1-5: ChatGPT's response to the multiple choice questions for attempts 1 through 5, indicated using the letters "A", "B", "C", or "D". In a few cases, ChatGPT did not provide a reference to a multiple choice response and "NA" is recorded in the dataset. 

Note: The long-form questions from CAMRT and answers provided by ChatGPT are not available as a part of this dataset.

Table 1: Dates for data collection

Attempt 1
Attempt 2
Attempt 3
Attempt 4
Attempt 5

Radiological technology
2 Aug 2023
2 Aug 2023
8 Aug 2023
9 Aug 2023
11 Aug 2023

Magnetic resonance 
17 Jul 2023
18 Jul 2023
18 Jul 2023
9 Aug 2023
12 Aug 2023

Nuclear medicine
8 Aug 2023
9 Aug 2023
12 Aug 2023
12 Aug 2023
12 Aug 2023

Radiation therapy
9 Aug 2023
12 Aug 2023
12 Aug 2023
13 Aug 2023
13 Aug 2023