Theories of change (ToCs) are models of how an intervention is expected to bring about changes in results of interest—the benefits. Robust ToCs spell out the conditions under which the intervention should “work,” that is, bring about or contribute to the desired benefits. But rarely does the ToC address issues of the future sustainability of the benefits from the intervention.
Application of an Evaluation Framework for Extra-Organizational Communities of Practice: Assessment and Refinement
Communities of practice (CoPs) are groups of people who work together on an ongoing basis and share knowledge and expertise. CoPs exist both within and outside of organizations, although extra-organizational CoPs have received less evaluation attention. The primary objective of this study was to assess the applicability of a multi-level, multiple-value evaluation framework for extra-organizational CoPs. Qualitative interviews were conducted with an extra-organizational CoP— the Canadian Community of Practice in Ecosystems Approaches to Health (CoPEH-Canada).
Review: Stephanie D. H. Evergreen. (2019). Eff ective Data Visualization: The Right Chart for the Right Data. Second Edition.
Stephanie Evergreen has a solid reputation as an expert on data visualization (dataviz) and reporting in evaluation. Her blog (https://stephanieevergreen.com/ blog) is on my list of resources for how to make a phonebook of data into a focused visual. Her most recent book on dataviz, the second edition of Eff ective Data Visualization: The Right Chart for the Right Data, and its companion Th e Data Visualization Sketchbook are the “in real life” (IRL) version of her blog.
Review: Leila C. Kahwati & Heather L. Kane. (2019). Qualitative Comparative Analysis in Mixed Methods Research and Evaluation.
The Use and Benefits of Evaluation Framework Modules at the Canadian Foundation for Healthcare Improvement: Engaged Capacity Building and Collaborative Program Evaluation Planning
The Canadian Foundation for Healthcare Improvement (CFHI) shares its experience using a collaborative approach to developing evaluation frameworks. CFHI introduced a series of four participatory workshop modules where technical and content experts co-design evaluation frameworks. This method leverages the expertise within the evaluation team to build organization-wide evaluation capacity. This practice note describes the modules, their delivery, and lessons learned.
Missing in Action: Indigenous Knowledge Systems in Evaluation of Comprehensive Community Initiatives
Comprehensive community initiatives (CCIs) coordinate social and structural change across multiple community sectors and represent promising approaches to complex social problems. Nowhere is this more relevant than for Indigenous children and families. However, strategies to evaluate initiatives to enhance Indigenous well-being must be meaningful to Indigenous communities. A review of literature regarding evaluation of CCIs identified various principles, case studies, methodologies, and methods grounded in Western ways of knowing and approaches to research.
Social Innovation (SI) Labs are increasingly gaining attention as a specifi c class of social innovation promising to effect systems change. Evaluation of SI Labs is in its infancy, and so there is a limited track record of systematic evidence and learning to support the practice of SI Labs. This practice note shares insights and learning from the process of evaluating a certain model of SI Labs grounded in the “zoom in–zoom out” approach.
Comparing and Contrasting a Program versus System Approach to Evaluation: The Example of a Cardiac Care System
It is likely that program and policy stakeholders hold biases and stereotypes about both evaluators and evaluation. Evaluators can challenge stakeholders’ negative stereotypes through communication strategies and intentional word choice, but first they must recognize the existence of stakeholders’ stereotypes.