Replication Data and Supplementary Material for: Zero-shot performance of selected large language and multimodal models on the 2023 Brazilian Portuguese medical residency exam

This dataset contains the supplementary material and replication data associated with the article "Zero-shot performance of selected large language and multimodal models on the 2023 Brazilian Portuguese medical residency exam" by Truyts et al., 2025. The dataset includes two components: (A) Data and Scripts.pdf describing raw and processed data along with R and Python scripts used to generate the tables, figures, prompt design, and statistical analyses in the article; and (B) Exam Questions.pdf with the original exam questions in Portuguese, their English translations, and evaluations by three physician observers. Additional analyses and visualizations not included in the manuscript are also provided.