Portfolio Evaluation: FWF International Programmes (SUF edition)

Full edition for scientific use. The present evaluation focuses on the international programme portfolio of the Austrian Science Fund (FWF). We assess the appropriateness of the portfolio as well as of its design and management. In addition, we trace evidence for the impact of the international programmes. The evaluation provides results that are relevant for FWF’s strategic discussions on future programme design. In order to address the evaluation questions as specified in the terms of reference, we designed a multi-method approach combining quantitative and qualitative elements: bibliometrics, altmetrics and various descriptive statistics, on the one hand; interviews, a survey and a focus group on the other. In order to assess the additionality and impact of international programme support, we used statistical matching techniques to construct a comparison group of FWF-supported stand-alone projects. FWF’s international programmes mobilise and, thus, support a segment of the Austria-based research community that is able to produce high-quality output with international colleagues. In this light, FWF’s international programmes contribute significantly to the internationalisation of science in Austria. At the same time, FWF’s contribution cannot change systemic issues that easily (e.g. achieve a further international opening of the Austrian research system). Also, the international programmes seem to support a segment of the Austria-based research community that is already well-established. Young researchers use different instruments to cooperation internationally (mobility, individual fellowship programmes, etc.).