Portfolio Evaluation: FWF International Programmes (SUF edition)

Full edition for scientific use. The present evaluation focuses on the international programme portfolio of the Austrian Science Fund (FWF). We assess the appropriateness of the portfolio as well as of its design and management. In addition, we trace evidence for the impact of the international programmes. The evaluation provides results that are relevant for FWF’s strategic discussions on future programme design. In order to address the evaluation questions as specified in the terms of reference, we designed a multi-method approach combining quantitative and qualitative elements: bibliometrics, altmetrics and various descriptive statistics, on the one hand; interviews, a survey and a focus group on the other. In order to assess the additionality and impact of international programme support, we used statistical matching techniques to construct a comparison group of FWF-supported stand-alone projects. FWF’s international programmes mobilise and, thus, support a segment of the Austria-based research community that is able to produce high-quality output with international colleagues. In this light, FWF’s international programmes contribute significantly to the internationalisation of science in Austria. At the same time, FWF’s contribution cannot change systemic issues that easily (e.g. achieve a further international opening of the Austrian research system). Also, the international programmes seem to support a segment of the Austria-based research community that is already well-established. Young researchers use different instruments to cooperation internationally (mobility, individual fellowship programmes, etc.).科研专用完整版。本评估聚焦于奥地利科学基金（Austrian Science Fund, FWF）的国际项目组合。我们将对该项目组合本身、其设计与管理模式的适配性展开评估。此外，我们将追溯相关证据以论证此类国际项目的实际影响。本评估所得结果，可用于奥地利科学基金围绕未来项目规划开展的战略研讨。为解答评估任务书中明确的评估问题，我们设计了一套融合定量与定性研究要素的混合研究方法：一方面采用文献计量学、替代计量学（altmetrics）及各类描述性统计方法；另一方面辅以访谈、问卷调查与焦点小组座谈。为评估国际项目资助的增量效应与实际影响，我们采用统计匹配技术构建了一组由奥地利科学基金资助的独立项目作为对照组。奥地利科学基金的国际项目能够调动并扶持奥地利境内一批可与国际同行合作产出高质量研究成果的科研群体。据此可见，该类国际项目对奥地利科研的国际化进程贡献显著。但与此同时，奥地利科学基金的资助难以轻易改变系统性问题（例如，进一步推动奥地利科研体系的国际化开放程度）。此外，此类国际项目的扶持对象多为奥地利境内已具备成熟基础的科研群体；青年研究者则通过各类途径开展国际合作（如学术交流、个人奖学金项目等）。