B. Radej 2010: Synthesis in Policy Impact Evaluation

Friday, 17. June 2011
Kategorie: Externe

 

Hiermit möchte wir Sie auf einen Artikel von Bojan Radej (Slovenian Evaluation Society) zum Thema Impact Assessment hinweisen, der in der Zeitschrift Evaluation erschienen ist (17/2(Apr. 2011):133-150). Eine etwas ältere Version dieses Artikels können Sie kostenfrei unter unten angegebenem Link herunterladen.

Abstract: "Impact evaluators of large-scale and multi-domain policy proposals have had difficulties in aggregating detailed assessment results into summative evaluative conclusions. Assumptions about how to aggregate impacts from micro to macro level across multiple evaluation domains (economic, social, natural environment) differ and different approaches produce different end results. An aggregation problem arises because different policy impacts are not fully commensurable across scales (micro-meso-macro) and across domains of evaluation. A new approach to synthesis of results is proposed that takes incommensurability of policy impacts into account. Detailed impact assessments results are first partially aggregated into an input-output matrix of assessment domains (meso level) and then non-diagonally situated partial aggregates, defined as secondary impacts, are correlated. The aggregation problem is illustrated by the comparative assessment of the sustainability of the development program for the Pomurje region of Slovenia using three methods: micro (no aggregation of impact results), macro (full aggregation) and meso (partial aggregation) approaches. Only the meso approach is consistent with the complexity of the challenge".

Keywords: aggregation, complexity, impact assessment