HAM10000 expert-annotated explanations and pseudonymized reader study data.

Reader study was conducted in 3 phases: no ai (phase 1), ai support (phase 2), xai support (phase 3). The data generated in each phase is available in metadata_phase1.csv, metadata_phase2.csv, and metadata_phase3.csv.There are 113 unique participants in phase 1. Additional participants were added in phase 2, resulting in 116 unique clinicians in phases 2 and 3.<b>Important:</b> The 3rd and 13th image in each group are identical. Be careful when performing table joins as the duplicate image_ids can affect them. In metadata_phase1.csv, the AI predictions for the 13th image in each group are null. Please take that into account when performing analysis. In metadata_phase2 and metadata_phase3, the AI predictions for the repeating images are not omitted.<br><i>participant</i>: Each clinician was assigned a participant Id represented by the participant column.<i>group</i>: Each clinician was randomly assigned to a group. Each group was assigned mutually exclusive sets of images.<i>mask</i>: An internal identifier used for the images. Can be ignored.<i>benign_malignant</i>: ground truth diagnosis.<i>prediction</i>: Diagnosis chosen by the clinician. 1 represents melanoma, 0 represents nevus, 0.5 represents a nevus diagnosis but the clinician chose to excise.<i>confidence</i>: Confidence value entered by the clinician.<i>trust</i>: Trust value entered by the clinician.<i>AI_prediction</i>: Diagnosis predicted by the AI. 1 represents melanoma and 0 represents nevus. <i>language</i>: Language chosen by the clinician.

本阅读器研究分为三个阶段开展：无AI辅助阶段（阶段1）、AI辅助阶段（阶段2）及可解释AI（XAI）辅助阶段（阶段3）。各阶段生成的研究数据分别存储于metadata_phase1.csv、metadata_phase2.csv与metadata_phase3.csv文件中。阶段1共有113名独立参与者，阶段2新增部分参与者，使得阶段2与阶段3的独立临床医师总人数达116名。<b>重要提示：</b>每个分组中的第3张与第13张图像完全一致。进行数据表连接操作时需格外谨慎，重复的图像ID可能会对连接结果造成干扰。在metadata_phase1.csv文件中，每个分组内第13张图像对应的AI预测结果为空值，请在数据分析过程中注意该细节。而在metadata_phase2.csv与metadata_phase3.csv文件中，重复图像对应的AI预测结果并未被移除。<br><i>participant（参与者）</i>：每位临床医师均被分配有参与者ID，该ID由participant列标识。<br><i>group（分组）</i>：每位临床医师被随机分配至某一分组，每组所分配的图像集合均与其他分组互斥。<br><i>mask（掩码）</i>：用于标识图像的内部标识符，可忽略不计。<br><i>benign_malignant（良恶性诊断）</i>：基准真值（ground truth）诊断结果。<br><i>prediction（医师诊断结果）</i>：临床医师作出的诊断决策，其中1代表黑色素瘤，0代表色素痣，0.5代表色素痣诊断但医师选择进行切除操作。<br><i>confidence（置信度）</i>：临床医师输入的诊断置信度值。<br><i>trust（信任度）</i>：临床医师输入的对AI的信任度值。<br><i>AI_prediction（AI预测结果）</i>：AI生成的诊断预测结果，其中1代表黑色素瘤，0代表色素痣。<br><i>language（操作语言）</i>：临床医师选择的操作语言。