Evaluating Transformative Innovation Policy Instruments

The Example of the Austrian Programme for the Promotion of Female Researchers “Innovatorinnen”

Abstract

This paper focuses on the evaluation of transformative innovation policy (TIP) instruments through the case of the Austrian programme INNOVATORINNEN which promotes women in applied research and innovation. To contextualise the empirical analysis, the paper reviews the evolution of innovation policy, focusing on instruments designed to support female researchers and advance gender equality in Austria, as well as their evaluations. The analysis positions INNOVATORINNEN as a transformative innovation policy instrument.

Using deductive content analysis, the evaluation concept and practice of the INNOVATORINNEN programme are assessed against the requirements for TIP evaluations outlined in recent literature. Key aspects examined include evaluation strategy, the role of evaluation, theory of change, and methodology. The findings reveal a strong alignment between the programme’s evaluation and TIP evaluation criteria, particularly in fostering programme learning, reflection, and evidence-based development. Notably, the evaluation incorporates content-oriented, co-creative processes that actively engage programme participants and programme owners, resulting in a “knowledge-triangle” driving the continuous improvement of the programme. The paper concludes by reflecting on key lessons from the evaluation process emphasizing the importance of openness, flexibility, a willingness to learn, trust and mutual respect among all involved parties.