Development and content validation of an instrument for evaluating competencies in Pediatric Surgery Residency

Abstract: Introduction: a specific instrument is needed to monitor the development of competencies in pediatric surgery during the residency. Objective: to develop an instrument in conformity with the “Milestone Project”, using the competencies determined by the Brazilian Association of Pediatric Surgery, for use in the Pediatric Surgery Residency in Brazil. Method: the research was developed in three stages: the development of the initial instrument, qualification with a focal group of experts, and instrument evaluation by Brazilian pediatric surgeons in order to validate and quantify the instrument’s acceptance. Result: The initial instrument was created with 4 competencies and 13 sub-competencies, each with 5 levels of assessment. Four experts performed the initial qualification, which resulted in 44 adaptations, and the instrument was finalized with 4 competencies subdivided into 10 sub-competencies, each with 5 levels of assessment. Subsequently, the instrument was evaluated by the Brazilian Pediatric Surgery Group and the Brazilian Pediatric Urology Group. There were 40 expert responses, with a total of 2394 positive responses from the 50 assessment items. The instrument had a general acceptance of 91.2%, being considered applicable (96.7%), reproducible (93.3), relevant to the covered topics (96%), technically (93.6%) and theoretically appropriate (93.3%), reliable (85.5%), and dependable (79.8%). Conclusion: an instrument was developed to assist in the assessment of competencies developed during residency in pediatric surgery in conformity with the Milestone Project. This instrument has been validated by experts and considered applicable, reproducible, relevant, technically and theoretically adequate, reliable and dependable.