Program logic models have provided a method of schematically presenting program objectives and the underlying cause-effect relationships between activities and outcomes. This article presents a model that explicitly recognizes the ultimate societal level benefits, and also accommodates identification of outputs, performance indicators, arid targets for all levels of objectives. The model is illustrated with a hypothetical agricultural technology transfer program, and some anecdotal observations are presented from the author's work with public-sector program managers and staff.
Every evaluation study uses data that are uncertain to a certain degree. Therefore, the analyst and the decision-maker need to know how much the outcome of the evaluation varies given the plausible variation in uncertain data inputs. That is, how sensitive is the outcome of the analysis to a particular input variable? This note discusses what characteristics make for sensitivity, what techniques to use to clarify sensitivity (especially graphic techniques), and how to interpret the results.
An innovative approach to delivering health care is being developed in several Ontario communities. The Ontario Ministry of Health has been guiding and assisting a number of communities as they pursue development of the comprehensive health organization concept (CHO). The CHO initiative has been evolving over the past five to six years and is driven primarily by enthusiasm and work at the grassroots community level. This short report describes the initial framework for quality and evaluation in a CHO.
Facilitating Instrumental Utilization for Policy Development in a Multi-Site, Inter-Ministerially Sponsored Human Service Program
This article focuses on the instrumental utilization of evaluation findings to assist in the development of program policy, including a brief review of some of the literature in this area. The context from which examples are drawn is an innovative human service program/policy that involves multiple funding ministries and participating agencies. A number of instances of the instrumental utilization of findings from an evaluation of multi-site policy and program implementation are discussed.
The Formative Evaluation of Years 1 And 2 of a Pilot Multicultural/Anti-Racist Educational-Leadership Program
This paper describes the evaluation approach, techniques, and instruments adopted during the first two years of a three-year multicultural/antiracist educational leadership program carried out in six different school boards in four Canadian provinces involving approximately 200 secondary students. The purpose of the evaluation during these first two years was primarily to assist the program coordinators, teachers, and students to plan effectively, monitor progress, and fine-tune their training programs in order to more successfully achieve their objectives.
The purpose of the following paper is to define the basis for an evaluation approach viewed as a platform for technological change management strategy in organizations. The success of' technological implementation largely depends on the capacity of' the organization to integrate the various aspects of change as they evolve. It is important to develop information collection and analysis tools in the process, in order to make the necessary technical and operational adaptations and strategic choices for the long-term management of change.
In Quebec over the past ten years many medical technology assessment reports have been submitted to decision-makers in government agencies, hospitals, and professionnal associations. This article traces the way evaluation may influence decision-making. Five topics are discussed: 1) the imperfect.
Despite the importance of assessing the reliability of evaluative measures, there is a confusing array of conceptual scheme, and coefficients for calculating "the reliability" of an item or scale. In particular, reliability may be conceived of and estimated from a true-score model or a sampling precision perspective. The former model is associated with such estimates as parallel or alternate forms reliability, split-half reliability, and coefficient alpha, the latter with standard error, coefficient of variation, and confidence intervals for observed scores.
The study measured the impact of the employment Action Pilot Project for employable immigrants on welfare in Edmonton, Alberta. Participants were expected to achieve greater and lasting independence from welfare, as the project was intended to reduce barriers to employment in the areas of language skills, computer literacy, life skills, and work experience. The authors contend that the reduction in personal barriers to employment as achieved through employability programs is outweighed by ecc incentives and disincentives.
The purpose of this study was to provide formative information to the Indian and Métis Education Branch of Saskatchewan Education, Training and Employment on its Staff Development Program. The evaluation was designed in cooperation with the Indian and Métis Education Branch and with input from the provincial Indian and Métis Education Advisory Committee. Data for the study were collected by means of questionnaires, telephone surveys, group interviews, on-site visits, and document analyses. The evaluation provided information on the extent to which the program has met its objectives.