ImageCLEFmed 2013 case-based retrieval task relevance judgments expansion via an MLLM-as-a-Judge approach

This dataset contains additional relevance judgments (qrels) for the ImageCLEFmed 2013 case-based retrieval task. These judgments were generated using an MLLM-as-a-Judge approach, leveraging the Gemini 1.5 Pro model to simulate human assessment and expand the original qrels of the task. The dataset includes 543,625 new relevance judgments for the ImageCLEFmed 2013 case-based retrieval task. Each row represents a single judgment and follows the format: {topic_number} 0 {article_DOI} {relevance}Where:- {topic_number} refers to the query topic.- {article_DOI} identifies the document.- {relevance} indicates the degree of relevance (0 for non-relevant, 1 for relevant).本数据集为ImageCLEFmed 2013基于案例的检索任务提供了额外的相关性标注（qrels）。该标注采用了以大语言模型作为评判者（MLLM-as-a-Judge）的方法，借助Gemini 1.5 Pro模型模拟人类评估流程，以扩充该任务的原始相关性标注集。 本数据集共包含543,625条针对ImageCLEFmed 2013基于案例检索任务的新增相关性标注。 每一行对应单条标注，其格式为：{topic_number} 0 {article_DOI} {relevance}，其中： - {topic_number} 指代查询主题编号； - {article_DOI} 用于标识文档； - {relevance} 表示相关性程度（0代表不相关，1代表相关）。