Pre- and post-scenarios: assessing learning and behaviour outcomes in training settings

This article discusses the use of pre- and post-scenarios to document training outcomes in learning and behaviour using Guskey's five critical levels of professional development evaluation and Kirkpatrick's four-level model for training evaluation as the backdrop for discussion.

English

The analysis of focus groups in published research articles

This article examines 72 published research articles that utilize a focus group methodology from the fields of health, sociology, and education. The articles are assessed in terms of what type of focus group analysis is conducted on the transcripts, how the methodology is specified, and whether the coding schemes used were emergent or pre-ordinate.

English

Integrating evaluative inquiry into the organizational culture: a review and synthesis of the knowledge base

The purpose of this article is to explore, through an extensive review and integration of recent scholarly literature, the conceptual interconnections and linkages among developments in the domains of evaluation utilization, evaluation capacity building, and organizational learning. Our goal is to describe and critique the current state of the knowledge base concerning the general problem of integrating evaluation into the organizational culture. We located and reviewed 36 recent empirical studies and used them to elaborate a conceptual framework that was partially based on prior work.

English

L'évaluation des technologies de la santé: comment l'introduire dans les hôpitaux universitaires du Québec?

This article describes the level of implementation of health technology assessment in Quebec university teaching health centres and examines structures that may facilitate its development. The data are from a mail survey sent to respondents in all university teaching health centres (response rate of 83/149 = 56%). Interviews with key actors (n = 4) were also conducted to document the broader context in which health technology assessment is implemented. The main obstacles identified are the lack of human, material, and financial resources.

English

Le benchmarking et l'amélioration continue

Benchmarking is driven by the trends toward continuous improvement and quality control and facilitates the identification of best practices imported and adapted by organizations that wish to improve performance. This article describes the benchmarking process illustrated by a case study. Its main contribution lies in its attention to the approach and the effort to clarify the objective of the study and identify relevant performance indicators.

English

Stakeholder involvement in a government-funded outcome evaluation: lessons from the front line

This article describes the process behind a government-initiated outcome evaluation that involved stakeholders from funded projects in planning and decision making. It reviews the strengths, challenges, and limitations of the evaluation. Follow- up consultations with project staff involved in data collection for the evaluation identified strengths of the process as the opportunity for staff to get to know individual program participants through interviews and the good will established between staff, funders, and evaluators.

English

Using multi-site core evaluation to provide "scientific" evidence

Funders of educational and other social service programs are requiring more experimental and performance-oriented designs in evaluations of program effectiveness. Concomitantly, funders are exhibiting less interest in evaluations that serve other purposes, such as implementation fidelity. However, in order to fully understand the effectiveness of most complex social and educational programs, an evaluation must provide diverse information.

English

The role of the evaluator in a political world

Foreword by Alan G. RyanUniversity of SaskatchewanThroughout his long and distinguished career, Ernest House has continuously stressed the moral responsibility of evaluators. His social activist perspective has time and again alerted us to the dangers of being seduced by the agendas of those in power.

English

The lay of the land: evaluation practice in Canada today

A group of 12 evaluation practitioners and observers takes stock of the state of program evaluation in Canada. Each of the contributors provides a personal viewpoint, based on their own experience in the field. The selection of contributors constitutes a purposive sample aimed at providing depth of view and a variety of perspectives. Each presentation highlights one strength of program evaluation practiced in Canada, one weakness, one threat, and one opportunity.

English