Relevancy_Ranking_Systems_responses (redacted)

We designed a survey instrument to cover the following five survey question topics: System configuration (e.g., ranking model, index methods, query methods) (7 questions) Evaluation methods and benchmark (10 questions) a.What has been evaluated? a.What evaluation methods have been applied? b.How was the evaluation collection built? c.What is the performance under specific configurations? Methods applied to boost searchability by web search engines (two questions) Other technologies or system configurations that have been employed (five questions) Wish list for future activities of the RDA relevance task force (two questions) We also asked five additional questions about the characteristics of each repository so we could assess whether there is any correlation between repository characteristics and the adoption of a certain technology or configuration. Also, we included two additional questions about survey administration.本研究设计了一份调研问卷，涵盖以下5大类调研问题主题： 1. 系统配置（System configuration）：涵盖排序模型（ranking model）、索引方法（index methods）、查询方法（query methods）等内容，共计7个问题； 2. 评估方法与评估基准（evaluation methods and benchmark）：共计10个问题，具体包括：a. 评估对象为何？a. 所采用的评估方法是什么？b. 评估数据集如何构建？c. 特定系统配置下的性能表现如何？ 3. 用于提升网络搜索引擎可检索性的相关方法：共计2个问题； 4. 所采用的其他技术或系统配置：共计5个问题； 5. 研究数据联盟（Research Data Alliance, RDA）相关性任务小组未来工作的愿景清单：共计2个问题。 此外，我们增设了5个关于各资源库特征的问题，以评估资源库特征与特定技术或配置的采用情况之间是否存在相关性。同时，我们还新增了2个关于调研实施管理的问题。