Posts Tagged ‘evaluation’

Torino Process Expert Roundtable On Policy Evaluation

February 25, 2018 Leave a comment

Relevant policy assessment and evaluation frameworks

The European Training Foundation (ETF) has initiated a reflection on how the Torino Process (TRP) can be used to introduce and promote an evaluation dimension in the exercise.  

To that end, on February 26th an expert roundtable has been organised in Torino (Italy) to share knowledge and practices in the area of policy evaluation, and discuss their applicability in line with the specificities of the TRP and its partner countries.

The expert meeting aims to provide an opportunity to get acquainted with selected aspects of the TRP, and benefit from the knowledge and advice of renowned experts in evaluation concerning key questions, such as whether evaluation could add value to the TRP and if yes, how.

The outcomes of the meeting will inform the preparation of the next cycle of the TRP and help to adjust accordingly the framework and modalities of TRP implementation.

trp logo for web

The Torino Process

The Torino expert meeting offers an excellent opportunity to share lessons learned from state-of-the-art evaluation experiences, such as the twelve (12) key performance indicators (KPIs) considered in VTT’s Strategic and Sound Evaluation Approach (see Hiltunen et al., 2017/forthcoming), the four (4) dimensions and ten (10) key aspects used in the CASI-F Framework for the Assessment and Management of Sustainable Innovation (see Popper et al., 2017) and twenty (20) fully-fledged evaluation criteria used in the (“old but gold”) MIOIR‘s Evaluating Foresight study (Popper et al., 2010).

Relevant reports



Open Advice for the European Research Area (ERA)

May 18, 2015 Leave a comment

The ERA Open Advice report and related Policy Brief come at a time when we seek a renewed momentum to support Europe’s way out of the crisis and tackle grand challenges through an improved European Research Area (ERA). They offer a great opportunity to step back and raise a critical wake-up call on the very purpose, shape and ambition of ERA. Here we have captured the essence of ERA stakeholders’ views on rethinking ERA priorities and broadening the agenda.

Three key messages and a considerable number of policy issues have emerged: First, the existing ERA priorities are of great importance and should be further pursued. Second, however, there is a concern that the definition of those priorities is too narrow and not flexible enough and thus must be re-visited. Third, and even more important, the debate has led to the identification of new ERA dimensions that have not been captured in the ERA discourse so far, but which deserve more policy attention and integration into the evolving dimensions of the European R&I landscape.

To download the report and policy brief please click on the images below or visit the VERA project website at:

ERA Open Advice

ERA Open Advice

Policy Brief on ERA Open Advice

Policy Brief on ERA Open Advice

Abstract of my PhD Thesis on 21st Century Foresight

September 26, 2011 Comments off

21st Century Foresight offers a comprehensive study of ‘foresight’ as an instrument of policy. It covers the development of foresight methodology, the design of foresight activities and their evaluation.

The thesis is based on eleven publications collectively making significant contributions to knowledge about global foresight practices and applications in different domains (i.e. research areas and socio-economic sectors).  New conceptual frameworks developed include the Foresight Diamond, the SMART Futures Jigsaw and the Methods Combination Matrix (MCM), which can be used as tools for futures research, practical work in the design and management of forward-looking activities and knowledge transfer on foresight. The thesis shows both generalised and specific contributions to knowledge. The former is best demonstrated with the development of a “fully-fledged evaluation” framework with twenty criteria, the identification of critical factors influencing the selection of foresight methods (e.g. geo-R&D context) and the use of network analysis techniques in foresight. The latter is prominent throughout the thesis with examples including the results of particular evaluations and the profiles of foresight practices in Europe and Latin America. A prevailing theme is the use of mapping and benchmarking approaches to evaluate foresight practices and reveal a more detailed understanding of the impacts of foresight in science, technology and innovation systems. The theoretical contributions (e.g. using exploratory research and catastrophe theory) are complemented with a set of practical instruments providing methodological basis and guidelines for increasing the efficiency and outcome of foresight and horizon scanning activities.

Overall, the thesis demonstrates original contributions to five distinct yet interconnected areas of knowledge: foresight methodology; foresight practices in Europe and the world; foresight in Latin America; foresight evaluation; and the evaluation of national technology foresight programmes. The various approaches used to frame the morphology of foresight – supported with evidence, comparisons and evaluations – are the main contributions to knowledge.