Review: Stephanie D. H. Evergreen. (2019). Eff ective Data Visualization: The Right Chart for the Right Data. Second Edition.

Stephanie Evergreen has a solid reputation as an expert on data visualization (dataviz) and reporting in evaluation. Her blog (https://stephanieevergreen.com/ blog) is on my list of resources for how to make a phonebook of data into a focused visual. Her most recent book on dataviz, the second edition of Eff ective Data Visualization: The Right Chart for the Right Data, and its companion Th e Data Visualization Sketchbook are the “in real life” (IRL) version of her blog.

English

Review: Leila C. Kahwati & Heather L. Kane. (2019). Qualitative Comparative Analysis in Mixed Methods Research and Evaluation.

Though evaluators often want to understand the combination of complex conditions that lead to specific outcomes, many traditional statistical tests merely yield information about the significance of discrete variables rather than how specific configurations of variables lead to an outcome. For these complex situations, qualitative comparative analysis (QCA) is a method worth considering. QCA was initially developed in the late 1980s by Charles C.
English

The Use and Benefits of Evaluation Framework Modules at the Canadian Foundation for Healthcare Improvement: Engaged Capacity Building and Collaborative Program Evaluation Planning

The Canadian Foundation for Healthcare Improvement (CFHI) shares its experience using a collaborative approach to developing evaluation frameworks. CFHI introduced a series of four participatory workshop modules where technical and content experts co-design evaluation frameworks. This method leverages the expertise within the evaluation team to build organization-wide evaluation capacity. This practice note describes the modules, their delivery, and lessons learned.

English

Missing in Action: Indigenous Knowledge Systems in Evaluation of Comprehensive Community Initiatives

Comprehensive community initiatives (CCIs) coordinate social and structural change across multiple community sectors and represent promising approaches to complex social problems. Nowhere is this more relevant than for Indigenous children and families. However, strategies to evaluate initiatives to enhance Indigenous well-being must be meaningful to Indigenous communities. A review of literature regarding evaluation of CCIs identified various principles, case studies, methodologies, and methods grounded in Western ways of knowing and approaches to research.

English

Dancing between “Zoom In” and “Zoom Out” Perspectives to Evaluate Social Innovation Labs

Social Innovation (SI) Labs are increasingly gaining attention as a specifi c class of social innovation promising to effect systems change. Evaluation of SI Labs is in its infancy, and so there is a limited track record of systematic evidence and learning to support the practice of SI Labs. This practice note shares insights and learning from the process of evaluating a certain model of SI Labs grounded in the “zoom in–zoom out” approach.

English

Comparing and Contrasting a Program versus System Approach to Evaluation: The Example of a Cardiac Care System

This article examines the differences between approaching an evaluation problem from a program perspective and doing so from a systems perspective. Th e terms program, systems, systems thinking, and systems concepts are fi rst defi ned. Then, using an actual evaluation of a cardiac care system, it is shown how initial investments in a program theory approach were deemed inadequate to account for the influence of external factors on patient outcomes.
English

Anticipating and Addressing Stakeholders’ Stereotypes of Evaluation

It is likely that program and policy stakeholders hold biases and stereotypes about both evaluators and evaluation. Evaluators can challenge stakeholders’ negative stereotypes through communication strategies and intentional word choice, but first they must recognize the existence of stakeholders’ stereotypes.

English

Sustainability Analysis of Intervention Benefits: A Theory of Change Approach

Abstract: Theories of change (ToCs) are models of how an intervention is expected to bring about changes in results of interest—the benefits. Robust ToCs spell out the conditions under which the intervention should “work,” that is, bring about or contribute to the desired benefits. But rarely does the ToC address issues of the future sustainability of the benefits from the intervention.

English

Toward Learning from Change Pathways: Reviewing Theory of Change and Its Discontents

 Abstract: The concept of Theory of Change (ToC) is well established in the evaluation literature, underpinning substantial research and practice eff orts. However, its ability to facilitate learning has been increasingly debated. The objective of this paper is to identify, characterize, and evaluate concerns over the use of ToCs based on a review of relevant studies.

English

Missing in Action: Indigenous Knowledge Systems in Evaluation of Comprehensive Community Initiatives

 Abstract: Comprehensive community initiatives (CCIs) coordinate social and structural change across multiple community sectors and represent promising approaches to complex social problems. Nowhere is this more relevant than for Indigenous children and families. However, strategies to evaluate initiatives to enhance Indigenous well-being must be meaningful to Indigenous communities. A review of literature regarding evaluation of CCIs identified various principles, case studies, methodologies, and methods grounded in Western ways of knowing and approaches to research.

English