Testing mechanisms in large-N realistic evaluations

Publikation: Bidrag til tidsskriftTidsskriftartikelForskningpeer review

Resumé

The concept of generative mechanisms is central to the realistic evaluation approach. They are seen as the drivers of change. Qualitative evidence is especially well suited to unearthing how mechanisms work. However, when evaluating a large-N programme, a realist evaluation might benefit from quantitative tests of the mechanisms hypothesized in the programme theory. Despite this, quantitative tests of mechanisms are rarely applied in realistic evaluation. The purpose of this article is therefore to illustrate how widely used quantitative social science methods can be utilized to test mechanisms in realistic evaluation when evaluating large-N programmes. The proposed methods focus on intra-programme comparison based on the strength of a quantitatively measured mechanism. The article illustrates how simple statistical methods in the form of descriptive statistics and logistic regression can be used to test the influence of mechanisms in generating outcomes.
OriginalsprogEngelsk
TidsskriftEVALUATION - The International Journal of Theory,
Vol/bind25
Udgave nummer2
Sider (fra-til)171-188
DOI
StatusUdgivet - 2019

Citer dette

@article{2ac9eee5c1504d8bb0d15473ff50d75e,
title = "Testing mechanisms in large-N realistic evaluations",
abstract = "The concept of generative mechanisms is central to the realistic evaluation approach. They are seen as the drivers of change. Qualitative evidence is especially well suited to unearthing how mechanisms work. However, when evaluating a large-N programme, a realist evaluation might benefit from quantitative tests of the mechanisms hypothesized in the programme theory. Despite this, quantitative tests of mechanisms are rarely applied in realistic evaluation. The purpose of this article is therefore to illustrate how widely used quantitative social science methods can be utilized to test mechanisms in realistic evaluation when evaluating large-N programmes. The proposed methods focus on intra-programme comparison based on the strength of a quantitatively measured mechanism. The article illustrates how simple statistical methods in the form of descriptive statistics and logistic regression can be used to test the influence of mechanisms in generating outcomes.",
author = "Rasmus Ravn",
year = "2019",
doi = "https://doi.org/10.1177/1356389019829164",
language = "English",
volume = "25",
pages = "171--188",
journal = "EVALUATION - The International Journal of Theory,",
publisher = "Research and Practice, Sage Publication in association with The Tavistock Institute.",
number = "2",

}

Testing mechanisms in large-N realistic evaluations. / Ravn, Rasmus.

I: EVALUATION - The International Journal of Theory, Bind 25, Nr. 2, 2019, s. 171-188.

Publikation: Bidrag til tidsskriftTidsskriftartikelForskningpeer review

TY - JOUR

T1 - Testing mechanisms in large-N realistic evaluations

AU - Ravn, Rasmus

PY - 2019

Y1 - 2019

N2 - The concept of generative mechanisms is central to the realistic evaluation approach. They are seen as the drivers of change. Qualitative evidence is especially well suited to unearthing how mechanisms work. However, when evaluating a large-N programme, a realist evaluation might benefit from quantitative tests of the mechanisms hypothesized in the programme theory. Despite this, quantitative tests of mechanisms are rarely applied in realistic evaluation. The purpose of this article is therefore to illustrate how widely used quantitative social science methods can be utilized to test mechanisms in realistic evaluation when evaluating large-N programmes. The proposed methods focus on intra-programme comparison based on the strength of a quantitatively measured mechanism. The article illustrates how simple statistical methods in the form of descriptive statistics and logistic regression can be used to test the influence of mechanisms in generating outcomes.

AB - The concept of generative mechanisms is central to the realistic evaluation approach. They are seen as the drivers of change. Qualitative evidence is especially well suited to unearthing how mechanisms work. However, when evaluating a large-N programme, a realist evaluation might benefit from quantitative tests of the mechanisms hypothesized in the programme theory. Despite this, quantitative tests of mechanisms are rarely applied in realistic evaluation. The purpose of this article is therefore to illustrate how widely used quantitative social science methods can be utilized to test mechanisms in realistic evaluation when evaluating large-N programmes. The proposed methods focus on intra-programme comparison based on the strength of a quantitatively measured mechanism. The article illustrates how simple statistical methods in the form of descriptive statistics and logistic regression can be used to test the influence of mechanisms in generating outcomes.

UR - https://journals.sagepub.com/doi/full/10.1177/1356389019829164

U2 - https://doi.org/10.1177/1356389019829164

DO - https://doi.org/10.1177/1356389019829164

M3 - Journal article

VL - 25

SP - 171

EP - 188

JO - EVALUATION - The International Journal of Theory,

JF - EVALUATION - The International Journal of Theory,

IS - 2

ER -