Study 2: Development and validation of two bronchoscopy knowledge assessments

<B>Short description of the study</B><BR><BR>
This study developed and evaluated the validity of a bronchoscopy anatomy and theoretical bronchoscopy exam. 19 anatomy and 58 theoretical exam questions, developed by pulmonology experts, were assessed through two Delphi rounds. Both exams were then taken by 53 prepared pulmonology residents. The theoretical exam was also taken by three unprepared groups: novices, intermediates and experts. Using the residents’ data, scoring evidence for the theoretical exam was evaluated using item difficulties and item discrimination indices, and generalization evidence was assessed using Cronbach’s alpha. Extrapolation evidence was obtained by comparing theoretical exam scores across the different groups. Implications evidence for both exams was gathered by evaluating residents’ preparedness, based on exam performance and instructor feedback.<BR><BR>

<B>Short description of the data file</B><BR><BR>
The “250313 scores all groups.sav” file contains the anonymized test results of all participants. Each row represents a participant and includes their experience level, individual question scores, and final exam score. This file was exported to Excel, after which all analyses were performed with R, as described in the study. The methodology and specific analyses are detailed in the study itself.<BR><BR>
Overview of parameters in the .sav file:<BR><BR>
Level = experience level. 0 = novice, 1 = intermediate, 2 = expert, 3 resident.
ID_XX = the participant’s score for each question. 0 = incorrect, 1 = correct.
Final_score = the participant’s final score (max = 31). <BR><BR>