Addition Relevance Assessments for the TREC Medical Records Track, 2011 and 2012

We are making publicly available a set of additional relevance assessments (qrels) for the TREC Medical Records Track. These are in additional to the officials qrels for this task provided by TREC organisers. The qrels are for the same set TREC query topics but are assessments for an additional 950 documents not previously judged by TREC assessors. As with TREC, the assessments were conducted by medical professionals.\n\nFull details about how the assessments were obtained is available in Chapter 7 of:\n\nB. Koopman. Semantic Search as Inference: Applications in Health Informatics. PhD thesis, Queensland University of Technology, Brisbane, Australia, 2014. http://koopman.id.au/papers/KoopmanPhDThesis-SemanticSearchAsInference.pdf\n\nOr for more analysis of this assessment task see also:\n\nB. Koopman and G. Zuccon. Why assessing relevance in medical IR is demanding. In Proceedings of the SIGIR Workshop on Medical Information Retrieval (MedIR), Gold Coast, Australia, July 2014. http://koopman.id.au/papers/medIR2014-relevance_assessment.pdf