LibRank Task Collections

Within the research project LibRank we evaluated a sample of factors for relevance ranking in library information systems by using a test system with EconBiz data. EconBiz is an academic search portal for economics by the German National Library of Economics (ZBW - Zentralbibliothek für Wirtschaftswissenschaften, Leibnitz-Informationszentrum Wirtschaft). We applied standard procedures in Information Retrieval evaluation by using human relevance assessments. The research data were obtained in three evaluation runs and are published in 3 files including: A) Search queries with descriptions; B) Document URLs with relevance assessments; C) Ranking factors and weightings.

在研究项目LibRank中，我们依托搭载EconBiz数据集的测试系统，针对图书馆信息系统中的相关性排序因子开展了抽样评估。EconBiz是由德国国家经济图书馆（ZBW - Zentralbibliothek für Wirtschaftswissenschaften，莱布尼茨经济信息中心）运营的经济学学术搜索门户。本次研究采用信息检索（Information Retrieval）评估的标准流程，并结合人工相关性标注完成实验。本研究数据通过三轮评估运行获取，以3个文件形式发布，具体包含以下内容：A）带描述信息的搜索查询；B）附带相关性标注的文档统一资源定位符（URL）；C）排序因子与权重。