Search System Survey

We designed a survey instrument to cover the following five survey question topics:
1. System configuration (e.g., ranking model, index methods, query methods) (7 questions)
2. Evaluation methods and benchmark (10 questions)
a.What has been evaluated?
a.What evaluation methods have been applied?
b.How was the evaluation collection built?
c.What is the performance under specific configurations?
3. Methods applied to boost searchability by web search engines (two questions)
4. Other technologies or system configurations that have been employed (five questions)
5. Wish list for future activities of the RDA relevance task force (two questions)
We also asked five additional questions about the characteristics of each repository so we could assess whether there is any correlation between repository characteristics and the adoption of a certain technology or configuration. Also, we included two additional questions about survey administration.

本研究设计了一款调研工具（survey instrument），涵盖以下五大调研主题：
1. 系统配置（System configuration）：涵盖排序模型（ranking model）、索引方法（index methods）、查询方法（query methods）等相关内容，共设置7个问题。
2. 评估方法与基准测试集（Evaluation methods and benchmark）：共设置10个问题，具体子问题包括：
a. 评估对象为何？
a. 采用了何种评估方法？
b. 评估数据集的构建方式为何？
c. 特定配置下的性能表现如何？
3. 用于提升网络搜索引擎可检索性的应用方法（Methods applied to boost searchability by web search engines）：共设置2个问题。
4. 已采用的其他技术或系统配置（Other technologies or system configurations that have been employed）：共设置5个问题。
5. RDA相关性工作组（RDA relevance task force）未来工作的期望清单（Wish list for future activities of the RDA relevance task force）：共设置2个问题。

本研究还增设了5个针对各数据存储库（repository）特征的额外问题，以评估数据存储库特征与特定技术或配置的采用情况之间是否存在相关性。此外，还额外纳入了2个关于调研实施流程的问题。