ImageCLEFmed 2013 case-based retrieval task relevance judgments expansion via an MLLM-as-a-Judge approach

This dataset contains additional relevance judgments (qrels) for the ImageCLEFmed 2013 case-based retrieval task. These judgments were generated using an MLLM-as-a-Judge approach, leveraging the Gemini 1.5 Pro model to simulate human assessment and expand the original qrels of the task. The dataset includes 543,625 new relevance judgments for the ImageCLEFmed 2013 case-based retrieval task. Each row represents a single judgment and follows the format: {topic_number} 0 {article_DOI} {relevance}Where:- {topic_number} refers to the query topic.- {article_DOI} identifies the document.- {relevance} indicates the degree of relevance (0 for non-relevant, 1 for relevant).本数据集为ImageCLEFmed 2013年基于案例的检索任务提供了额外的相关性判断文件（qrels）。该标注采用MLLM-as-a-Judge（以大语言模型作为评判者）的方法，借助Gemini 1.5 Pro模型模拟人类评估流程，以此扩充该任务的原始相关性判断文件集。 本数据集共包含543,625条针对ImageCLEFmed 2013基于案例检索任务的新增相关性标注。 每一行代表单条标注，格式为：{topic_number} 0 {article_DOI} {relevance}，其中： - {topic_number} 指代查询主题编号； - {article_DOI} 用于标识对应文档； - {relevance} 表示相关性程度（0代表不相关，1代表相关）。