A Multi-Dimensional Program Evaluation Model: Considerations of Cost-Effectiveness, Equity, Quality, and Sustainability

Program evaluation has become increasingly multi-dimensional to include considerations of cost-effectiveness, equity, quality, satisfaction, and sustainability. The various aspects are interrelated but not necessarily mutually compatible. For example, services rendered cost-effectively to an easy-to-reach urban population are not likely to be distributed equitably. The consequent trade-offs cannot be assessed objectively unless measures of equity, quality, and sustainability are made as explicit as indicators of cost and coverage.

English

A Connoisseurship Evaluation of the Computer Curriculum, Grade 0-7 at Sacred Heart College Primary School, Johannesburg, South Africa: Present Practices and Future Direction

Following three years development of the computer curriculum at Sacred Heart College Primary School, the findings of a descriptive evaluation suggest, unexpectedly, an approach to curriculum resembling a limited form of social reconstructionism presenting opportunities to bridge divides which historically have separated pupils in South Africa. The evidence suggests "ideal" use in this school is linked to creative uses of computers as "tools" rather than linked to "adjunct" use or computer-assisted instruction.

English

Distilling Stakeholder Input for Program Evaluation Priority Setting

As few organizations have enough resources that they can pursue all evaluation questions of interest, the setting of priorities for evaluative work is a critical corporate function. Ideally, evaluation resources should be focused on studies that will most effectively advance the organization by pointing to potential for improved strategy or programming. Identifying what should be studied, and when, requires that the organization have clear feedback from stakeholders on program issues.

English

Comparaison entre le questionnaire auto-administré et l'entrevue téléphonique pour l'évaluation de la satisfaction

Data gathered from 212 clients in a substance abuse program showed that there was no statistically significant difference in the results on measures of satisfaction and perceived changes whether data collection was through a telephone survey or a self-administered questionnaire filled out at the agency. However, on-site respondents who filled out the self-administered questionnaire were more prone to ascribe the perceived changes to the treatment they received.

English

Promoting Accountability and Continual Improvement: A Review of the Respective Roles of Performance Measurement, Auditing, Evaluation, and Reporting

In response to growing demands for accountability and the benefits associated with continual improvement, private and public sector organizations are increasingly applying aspects of performance management. This article provides a synthesis of the literature as it pertains to the principles and practices underlying performance measurement, auditing, evaluation, and reporting. In bringing these elements together to comprise a performance management system, it is argued, an organization can demonstrate accountability and facilitate continual improvement.

English

Perspectives épistémologiques et cadre conceptuel pour l'évaluation de l'implantation d'une action concertée

The current enthusiasm within the health and social services for complex, multi-partner, collaborative interventions has created a need for systematic evaluation. However, given the complexity of both the interventions to be implemented and of the collaborative process itself, the evaluation must be adapted ill light of these factors. From an epistemological point of view, the main consideration is to monitor the intervention-building process with the concerned parties.

English

Findings from the Ontario regional evaluation of the Community Action Program for Children

The Community Action Program for Children (CAPC) is a federal government initiative that funds community groups to develop local projects with the goal of supporting the development of children and strengthening families. This article describes a first round of a regional provincial-level evaluation of 30 CAPC projects in Ontario. A participatory action research approach to evaluation was used to describe the local projects and their achievements to date, and to develop a common evaluation framework for later rounds of evaluation.

English

valuer l'efficacité d'un programme : une question de référents?

The main objectives of this study carried out with 73 people from two organizations in the health field in the Quebec City region are: 1) to verify if several groups of actors associated with the same program (decision makers, participants, users) have identical concepts of the effectiveness of a program; and 2) to verify to what extent the concept of program effectiveness is influenced by temporal, organizational and contextual variables. A non-traditional approach was used. Participants in the study assessed the effectiveness of 20 fictional programs on a four point scale.

English

Evaluating Planning Bodies: Some First Steps from the District Health Council System

The sixteen district health councils (DHCs) in Ontario are mandated to provide advice to the Minister of Health on the health needs of residents in their respective districts. Like much of the broader public service, in recent years DHCs have come under increased pressure to prove their value. This practice note reviews the evaluation efforts of a small rural DHC and discusses some of the challenges facing the DHC system as a whole as it struggles to become more accountable.

English

Linking users' views with utilization processes in the evaluation of interactive software

Taking the users' viewpoints into account in evaluation is increasingly recommended. The rationale and methods of user-oriented approaches have been described in theoretical papers. Less often reported are critical and empirical observations on how evaluators should interpret users' views. In the case of information technology, users' views may b gathered for the purpose of both evaluation and development. This double function is best served when a theory-driven framework clarifies the processes underlying the utilization of technology.

English