Saturday, May 26, 2018

Taking Impacts to Mixed Methods Evaluations


It is often difficult to obtain quality assessments of impacts from mixed methods evaluations, especially in formative and developmental settings. Methods developed for Rapid Impact Evaluation (RIE) are being used to assess impacts in mixed methods evaluations. The simplified impact metrics and the Scenario-Based Counterfactual bring systematic impact assessment to surveys and group processes. Mixed methods evaluations using RIE methods have been implemented in evaluations in Canada, the US and in development settings. Face validity and internal reliability testing confirm the quality of the impact assessments.

This workshop will be largely interactive, beginning with short introductions to each of the methods followed by participants working in groups to apply the methods to sample evaluations. The workshop will also include an overview of the use-seeking approach for RIE and explanation of how this co-creation of knowledge enhances the relevance and credibility of evaluations.

Learning Objectives:

  • How Rapid Impact Evaluation methods can be applied in mixed methods evaluations.
  • How to apply simplified impact metrics in the settings where they work.
  • How to apply the Scenario-Based Counterfactual in the settings where they work.


Andy Rowe

Andy developed Rapid Impact Evaluation and provides capacity building in using the methods in a wide range of venues including evaluation conferences, corporate, multilateral and national evaluation settings. With users of Rapid Impact Evaluation, they are developing guidance documents and publications for peer reviewed venues.


Schedule | Saturday, May 26 from 1:00 pm to 4:00 pm

Language | English

Level | Advanced

Prerequisites | Intermediate or advanced evaluators will benefit from this workshop. Necessary knowledge and skills include competency and experience with mixed methods evaluations, with surveys and group processes, and comfort with spreadsheet calculations. Participants should also be knowledgeable about conducting formative and/or developmental evaluations and evaluations that are more summative in nature.