Abstract: Quebec and Canadian organizations, communities, and professionals working collectively to address complex social issues in dynamic contexts are enthusiastically embracing social innovation. Some of this innovation’s limitations have been revealed by formative and summative evaluation approaches. Developmental evaluation (DE) could be a potential solution. This article combines scientifi c literature with the experience of experienced DE practitioners in Quebec. Balancing project management and evaluation, knowledge production and transformation of practices, continuous iterations and setting deadlines is at the very core of an eff ective DE approach.
This paper focuses on the work done by the Commission de révision permanente des programmes (CRPP) in Quebec. Based on a literature review, we present: 1) a description of the CRPP including the context surrounding its creation, its approach, the content of its reports as well as its recommendations; and 2) a portrait of the influence of the CRPP by exploring whether or not government decisions have taken its recommendations into account.
The global financial crisis in 2008 was a significant watershed for governments everywhere. Diminished prospects for growth coupled with continuing demands for government interventions and chronic constraints on resources, prompted in part by the widespread adoption of variants of neo-liberalism (constrain resources to limit spending and shrink governments), have created fiscal environments where rationing expenditures among programs and policies is chronic and even acute.
Comment évaluer les effets des évaluations d'impact sur la santé : le potentiel de l'analyse de contribution
Health impact assessments (HIA) allow the potential impact of nonhealth-related actions (policy, project, program) on health to be analyzed. For example, municipal projects, for urban renewal or urban planning, have an impact on health drivers relating to the created environment, and thus, on public health. In the province of Quebec, the government and affiliated organizations have to comment on potential impacts; they use HIAs to ensure health is factored into public actions.
Faced with the combined pressures of ecc recession and growing healthcare costs, public health administrators recognize the value of using ecc arguments to justify public health interventions. Given the expense and the time involved in conducting new ecc evaluations, decision-makers regularly speculate on the possibility of using results from studies done in a different context. This article analyzes the potential for using the results of ecc evaluations of public health interventions in contexts other than those in which the studies were done.
Les défis de l’évaluation développementale en recherche: une analyse d’implantation d’un projet «Hôpital promoteur de santé»
Developmental evaluation (DE), an approach developed by Patton to support the implementation of innovations, remains relatively untested in research. This article describes an attempt to apply DE as part of an implementation study of a healthpromoting hospital project in a university hospital. The article highlights the dichotomous demands of academic research and evaluation use inherent in applying DE from a research perspective, and analyzes the challenges encountered in this case.
Evaluating complex interventions requires an understanding of the program's logic of action. Logic analysis, a specific type of program theory evaluation based on scientific knowledge, can help identify either the critical conditions for achieving desired outcomes or alternative interventions for that purpose. In this article, we outline the principles of logic analysis and its roots. We then illustrate its use with an actual evaluation case. Finally, we discuss the advantages of conducting logic analysis prior to other types of evaluations.
Theoretically, evaluation should help decision-makers address contemporary health system challenges. Paradoxically, the use of evaluation results by decision-makers remains poor, despite rapid development in the evaluation field. The level of use depends on the evaluator's ability to account for the complexity of health-care systems. The complex nature of an intervention often compels evaluators to adopt unconventional approaches to account for the roles of the players.