Steve Jacob

Fall

L'Ombudsman face aux défis de l'évaluation : est-il possible d'évaluer l'intangible?

Authors:
Pages:
222-243

Owing to its procedural mission and the specific characteristics of rights protection organizations, the evaluation of an Ombudsman's performance is a complex task. This article presents a knowledge synthesis of performance measurement for Ombudsman's Offices and opens the way to new reflections that are both theoretical and practical. In addition to presenting the strengths and weaknesses of the various evaluation models identified in the literature, this study clarifies the purpose of the Ombudsman and the purposes for which it is evaluated. Finally, this article formulates propositions for an integrated assessment of the management of the Parliamentary Ombudsman.

Spring

Assessing the Quality of Aboriginal Program Evaluations

Authors:
Pages:
62-86

Evaluations have gained in popularity in Canada since the 1990s, but statistical data indicate that the resources allocated to this management tool have not increased accordingly, despite the increased demand. During the same period, regardless of significant eff orts to optimize governance, the Canadian federal government’s management of issues related to Aboriginal peoples presents some weaknesses. Because evaluation may directly aff ect the administration of public programs, this study proposes a meta-evaluation of First Nations program evaluations. To do so, we replicate a methodology previously used by the Treasury Board Secretariat in 2004 to complete a vast study assessing the quality of evaluation in Canada. This article, based on the systematic analysis of a nonprobability sampling of more than 20 program evaluation reports, has applied the TBS’s meta-evaluation techniques to the Aboriginal context. The results show that the evaluation of Aboriginal programs is of good, and even excellent, quality and suggest that the TBS’s evaluation policy has had a definitive impact on evaluation quality.

Fall

Réflexions autour d'une typologie des dispositifs institutionnels d'évaluation

Authors:
Pages:
49-68

Recent developments in research on the institutionalization of policy evaluation offer new perspectives for understanding evaluation capacity development. This theoretical article focusses on mechanisms that contribute to ensuring the development and the stability of evaluative practice and suggests a typology for institutional evaluation methods. By combining reflections borrowed from the comparative approach in the social sciences and new institutionalism theories, it opens new avenues for research in this field of analysis. It also identifies the major characteristics of an evaluation method, focusing on two dimensions (openness and results) to outline an ideal-typical model.

Special Issue

Program evaluation in Canada seen through the articles published in CJPE

Authors:
Pages:
1-16

In honour of the 20th anniversary of The Canadian Journal of Program Evaluation, this article presents a retrospective of publication trends from the fi rst edition in Spring 1986 to Fall 2004. This review entailed creating a database by coding all of the abstracts and, when necessary, the full article, according to criteria such as the authors, their origins, the purpose of the articles, the public policy sectors presented, the methodology, and the type of evaluation discussed. As anticipated, the publication trends tend to reflect broader developments in the field of evaluation practice and theory in Canada and abroad. From utilization debates to capacity-building issues, from auditing to empowerment evaluation and beyond, the articles in CJPE sometimes lead and sometimes follow new trends in the evaluation field. Over the years, authors affiliated with universities have progressively increased their share of articles.