Randomised controlled trials and other experimental approaches in the Austrian Research Promotion Agency (FFG) - Experience, learnings and outlook

Abstract

The objective of this paper/presentation is to highlight how experimental approaches, specifically Randomised Controlled Trials (RCTs), can be leveraged to evaluate and measure the impact of new programmes, support programme development and test new services in funding and innovation agencies. RCTs are seen in many facets of public policy, however RCTs as a method for innovation agencies to evaluate new initiatives is relatively new. We present three RCTs implemented in the Austrian Research Promotion Agency (FFG) that have received funding from the European Union’s Horizon 2020 research and innovation programme. The trials are implemented to evaluate the effectiveness of new measures intended to help strengthen R&I in start-ups and SMEs. Through these three examples, we aim to demonstrate the advantages in which RCTs can augment the evaluation of new services as well as challenges that come with implementing RCTs. For one RCT, we will present final results. Two RCTs are ongoing, and we will present the trial design. We also discuss the operational aspects of incorporating experimentation in an innovation agency.