We designed a survey instrument to cover the following five survey question topics: 1. System configuration (e.g., ranking model, index methods, query methods) (7 questions)2. Evaluation methods and b
We considered the following standard and shared collec- tions, each track using 50 different topics: • TREC Adhoc tracks T07 and T08: they focus on a news search task and adopt a corpus of about 528K