Volume 30, 2015 - Spring

From New Public Management to New Political Governance: Implications for Evaluation

Authors :
Pages :
1-22

Public administration scholars have discerned a shift in the federal governance context in Canada, from what was traditionally a strong, nonpartisan public service to a more politicized, even partisan, model of public decision-making with power concentrated in the upper reaches of the political executive. We explore the potential implications of these changes for evaluation in the federal bureaucracy. Our analysis, tentative at this point, suggests that in light of heightened political pressures, and a decline in the use of “evidence” in federal policy circles, evaluations may present an increasingly complex activity for public administrators to manage. these developments raise important questions for the evaluation community about its relationships with public managers and its role and professional values in a democratic institution.

Reflexivity in Evaluating an Aboriginal Women Heart Health Promotion Program

Authors :
Pages :
23-40

The role of reflexivity—the process of examining oneself as a researcher, the research process, and the research relationships—is examined in the context of evaluation. A reflexive account of the evaluation of an Aboriginal heart health promotion program as an inside-outside evaluator is provided to demonstrate evaluator reflexivity in a cross-cultural setting. It is argued that the reflexive process may enrich evaluation by providing context to the processes and the interpretative dialogue, by off ering a space to rethink and rework processes, assumptions, and power dynamics, and by uncovering important learnings and discourses that will assist the evaluator and her/his audiences.

Assessing the Value of Inductive and Deductive Outcome Measures in Community-Based Programs: Lessons from the City Kidz Evaluation

Authors :
Pages :
41-63

Evaluators of community-based programs frequently need to decide whether to adopt an inductive or deductive approach in developing quantitative outcome measures. This article explores this issue using a case example of a child anti-poverty program called City Kidz. Its recent evaluation combined an inductive and deductive approach to develop a survey. The article describes the City Kidz evaluation and its survey before assessing the value of the survey, considering internal consistency and various aspects of validity. The article concludes with a discussion about the factors that helped and hindered the appropriateness of the survey in light of the inductive and deductive approaches used.

Exploring the Leadership Dimension of Developmental Evaluation: The Evaluator as a Servant-Leader

Authors :
Pages :
64-78

Evaluators working on a developmental evaluation are expected to work collaboratively with program developers to marshal evaluation in ways that support ongoing program development and adaptation. This expectation introduces novel challenges to evaluation practice and exposes the evaluator to the treacherous waters of program complexities that are likely unique to each developmental evaluation. What may have become accepted norms about evaluator roles, responsibilities, and evaluator-client relationships may no longer hold true in the course of repurposing evaluation for program development. Early writers on developmental evaluation have suggested that evaluators incorporate elements of servant leadership to help navigate the situational challenges associated with developmental evaluation. This Practice Note extends current dialogue on servant leadership as it is situated in developmental evaluation by contributing a discussion on the utility of servant leadership in guiding developmental evaluator behaviour and decision-making.

Toward an Evaluation Framework for Community-Based FASD Prevention Programs

Authors :
Pages :
79-89

This article discusses creation of common evaluation frameworks for FASD-related programs. The project was guided by a social determinants of health perspective and included a literature search and consultations across Canada to help refine and confirm the final product. The end result was development of three visual maps: FASD prevention programs, FASD support programs, and FASD programs in Aboriginal communities. Each map comprises concentric rings showing theoretical foundations; activities and approaches; and formative (program), participant, and community/systemic outcomes. The project website provides tools and indicators. The visual maps have wide-ranging applications that go beyond evaluation of FASD programs.

Calculating Outcome Rates in Web Surveys

Authors :
Pages :
90-98

Web-based surveys are increasingly used in evaluation practice. To our knowledge, there are no guidelines for calculating outcome rates using newly available tracking methods. In a recent study, up to five recruitment e-mails were sent using an e-mail marketing service: a primer, an invitation with a survey link, and three reminders. Hard and soft bounces and opened e-mails were tracked. Outcome rates varied as a function of decisions made regarding these data. We suggest that several outcome rate calculations be presented to assist the reader in assessing these important measures of study quality.

(Compte-rendu) Program Evaluation and Performance Measurement: An Introduction to Practice (2 nd ed.), J. C. McDavid, I. Huse, and L. R. L. Hawthorn

Authors :
Pages :
99-102

(Compte-rendu) Program Evaluation and Performance Measurement: An Introduction to Practice (2 nd ed.), J. C. McDavid, I. Huse, and L. R. L. Hawthorn

(Book review) Action Research in Education: A Practical Guide, S. E. Efron and R. Ravid

Authors :
Pages :
103-104

(Book review) Action Research in Education: A Practical Guide, S. E. Efron and R. Ravid

(Book review) Feminist Evaluation and Research: Theory and Practice, Sharon Brisolara, Denise Seigart, and Saumitra SenGupta

Authors :
Pages :
105-107

(Book review) Feminist Evaluation and Research: Theory and Practice, Sharon Brisolara, Denise Seigart, and Saumitra SenGupta

(Book review) Case Study Research Design and Methods (5th ed.), Robert K. Yin

Authors :
Pages :
108-110

(Book review) Case Study Research Design and Methods (5th ed.), Robert K. Yin