Field:
A learning innovation policy
- a framework for evaluation and analysis of innovation policy
In 2011,The Swedish Agency for Growth Policy Analysis, henceforth called Growth Analysis, conducted a study called The Performance and Challenges of the Swedish National Innovation System as a basis for the evaluation of Swedish innovation policy made by the OECD. The report was published in November 2012, the same month that the Swedish government published its innovation strategy.
The purpose of the present report is to summarise how Growth Analysis has chosen to approach the two sub-assignments detailed in its appropriation directions for 2012 based on the innovation strategy and the OECD background study:
- develop a framework for analyses and evaluations related to the innovation policy
- further elaboration of the conclusions from The Performance and Challenges of the Swedish National Innovation System.
The research and innovation policy drawn up in Sweden over the past decade, has attempted, in various ways to rectify shortcomings in the innovation system. This has resulted in a complex flora of instruments, where the focus has often been on introducing individual instruments without considering how they might affect the system as a whole. Furthermore, the individual instruments have not been scientifically evaluated and some instruments have had a tendency to remain in place despite evidence that they are not very effective. Both observations bring questions of continued policy learning and the mix of policy instruments to a head, which is the main theme of the report.
Sweden’s innovation policy mix has been analysed on a number of occasions. The results among other things indicate insufficient coordination between the authorities/agencies that provide support. The big picture is fragmented and the national innovation system is not deemed to function optimally.
Proposed innovation policy framework
Growth Analysis proposes a framework to analyse the Swedish policy mix and guide those actors whose task it is to draw up and implement Sweden’s innovation policy. The proposed framework is therefore to be considered a platform to systematically identify analysis and development needs concerning the innovation policy and contribute to better coordination with the executive players. The framework is based on the OECD’s policy mix framework. By using the OECD’s concepts, Growth Analysis can extend the knowledge-base developed in the OECD’s reports.
The framework consists of the following:
- diagnostics
- innovation policy
- mapping of the policy instrument mix
- monitor developments and create learning.
These areas are put forward in the OECD report as requiring further development.
Continued learning with support in the policy instrument mix
One of the underlying reports concerning Sweden’s policy instrument mix supports the findings of both the European Commission’s and the OECD’s studies.¹ Many players in the innovation policy arena often have minor and overlapping instruments. One area where the instrument overlaps is support for SMEs. Another area where the organisations studied have several measures is large collaborations or excellence centres. The OECD’s report emphasises that pursuing several parallel excellence centres is a problem, since it reduces the possibility to join forces and create a critical mass.
The purpose of making a survey of Sweden’s policy instrument mix is to initiate a discussion that can be used to:
- contribute to better coordination on the part of the government players who provide innovation support to avoid overlaps or identify areas not covered or lack critical mass
- increase transparency in how state support is distributed to the recipients
- provide guidance on how existing policy instruments can be changed to better reflect new political priorities
- provide guidance on how new instruments that are launched can complement, or at least not disturb, the existing policy instrument mix
- allow evaluations of existing´policy instruments to influence the shaping of future initiatives
- improve reporting from the organisations studied in order to avoid state support for innovation being counted more than once.
Continued learning on the basis of the diagnostics
Despite Sweden being a leader on international ranking lists, action is needed to improve the results of innovation at both national and regional level. The purpose of systematic diagnostics is to analyse what parts of the innovation system work well and those that need improvement. This knowledge can then be used to shed light on the other parts of the innovation policy framework and improve the effectiveness of the innovation system by showing where measures need to be applied within the framework of the innovation strategy.
Against this background, four different studies have been made. The table describes the findings from the studies and implications for learning concerning the innovation policy.
Title of diagnostics study | Results | How the knowledge can be used to create learning in the innovation policy framework |
|---|---|---|
Meta-study of some of Vinnova’s impact assessments | Empirical experience shows that the evaluations focus on describing the results of programmes rather than on measuring outcomes against a clear contra factual norm. | When designing an innovation policy for Sweden, independent evaluations should be considered in order to ensure that the policy is implemented in the best possible way. |
Fast-growing companies | The findings indicate that fast-growing companies are not captured in the innovation statistics. | More knowledge is needed of how important these companies are to Swedish growth in order to be able to influence the design of the innovation policy, i.e. more diagnostics are needed. |
Measure design | Within the framework of an EU collaboration, Growth Analysis has made recommendations for how design can be measured better. | Proposals for how design can be measured better have been incorporated into the development of indicators at the European Commission and in the OECD's work on revising the Frascati Manual. The diagnostics process is continuing at international level. |
Universities in the Nordic region in pursuit of world class | Growth Analysis’ report shows that the position of the university’s management is clearer at Aarhus University than at the University of Gothenburg, where resources are controlled at department level. | The universities are taking on an increasingly prominent role in innovation policy as education and research nodes, which requires more coordination between innovation and research policy. |
Growth Analysis’ role in the work to come
The analysis framework proposed in this report and the new studies made within the framework of the government’s commission point out the advantages of continuous learning focused on building up competence and proficiency in both the design of Sweden’s innovation policy, the implementation of the innovation strategy and the composition of the policy instrument mix. Learning comprises both adaptation and competence-building to improve the effectiveness of the Swedish innovation system. Since there are no ready answers as to what an optimal design should look like, the ability to learn, linked to governance, is an important feature of the development of the innovation policy.
One difficulty that faces a learning innovation policy is Sweden’s unique way of organising how policies are formulated. Sweden’s system of government is based on a clearly defined distribution of work between the ministries that formulate policy and the authorities and agencies that implement the policies. The proposed framework is therefore to be seen as a common platform to systematically identify analysis and development needs concerning the implementation of innovation policy and contribute to better coordination with the executive players.
¹ The working name of the coming report is ”Stödinstrument för innovation – kartläggning av instrument för att implementera den svenska innovationspolitiken” [Support instruments for innovation – a survey of instruments for implementing Sweden’s innovation policy]. The intention is to publish the underlying material in Growth Analysis’ WP/PM series in early 2014.
A learning innovation policy - a framework for evaluation and analysis of innovation policy
Serial number: Report 2013:12
Reference number: 2012/008
