RheumaMIR

This dataset accompanies the research paper entitled: Harnessing ChatGPT and GPT-4 for Evaluating the Rheumatology Questions of the Spanish Access Exam to Specialized Medical Training. Alfredo Madrid-García, Zulema Rosales-Rosado, Dalifer Dayanira Freites-Núñez, Inés Pérez-Sancristobal, Esperanza Pato-Cour, Chamaida Plasencia-Rodríguez, Luis Cabeza-Osorio, Lydia Abasolo Alcazar, Leticia Leon Mateos, Benjamín Fernández-Gutiérrez, Luis Rodríguez-Rodríguez medRxiv 2023.07.21.23292821; doi: https://doi.org/10.1101/2023.07.21.23292821 The dataset contains 145 rheumatology-related questions extracted from the Spanish MIR exams held between the academic years 2009-2010 to 2022-2023. The questions are evaluated by ChatGPT, GPT-4, BARD and CLAUDE. Six rheumatologists assess the clinical reasoning of ChatGPT and GPT-4. A more detailed description of the dataset can be found in "Dataset Description" Sheet本数据集配套的研究论文题为《利用ChatGPT与GPT-4评估西班牙专科医学培训入学考试的风湿病学试题》，作者包括Alfredo Madrid-García、Zulema Rosales-Rosado、Dalifer Dayanira Freites-Núñez、Inés Pérez-Sancristobal、Esperanza Pato-Cour、Chamaida Plasencia-Rodríguez、Luis Cabeza-Osorio、Lydia Abasolo Alcazar、Leticia Leon Mateos、Benjamín Fernández-Gutiérrez、Luis Rodríguez-Rodríguez，发表于medRxiv 2023.07.21.23292821；DOI：https://doi.org/10.1101/2023.07.21.23292821。本数据集包含145道风湿病学相关试题，均提取自2009-2010至2022-2023学年期间举办的西班牙MIR专科医学培训入学考试。上述试题已由ChatGPT、GPT-4、BARD及CLAUDE完成评测，另有6名风湿病学家对ChatGPT与GPT-4的临床推理能力进行评估。该数据集的详细说明可参见"Dataset Description"工作表。