The Canadian Evaluation Society (CES) has undertaken a project to explore the benefits that can be attributed to program evaluation, the outputs necessary to achieve those benefits, and the knowledge and skills needed to produce the outputs. Benefits, outputs, and knowledge elements were articulated and confirmed through a number of consultations with CES members and the international evaluation community.
Logic models are an important planning and evaluation tool in health and human services programs in the public and non-profit sectors. This Research and Practice Note provides the key content, step-by-step facilitation tips, and case study exercises for a half-day logic model workshop for managers, staff and volunteers. Included are definitions, explanations and examples of the logic model and its elements, and an articulation of the benefits of the logic model for various planning and evaluation purposes for different audiences.
While the role of non-profits in Canadian society has always been important, the sector now plays a greater role as more and more government services have been transferred to the sector as part of the move towards governance over government. Complementing this changing role is the need, within both government and the sector itself, to enhance accountability and transparency based on evidence.
The purpose of this article is to provide an overview of priorities for evaluation capacity building in the voluntary/nonprofit sector and to raise awareness among evaluation professionals of the key issues for nonprofits that may have an effect on evaluations. There are various challenges for nonprofit organizations in the evaluation of their programs, projects and activities that include the availability of resources, evaluation skill levels, the design of evaluations and the nature of nonprofit work.
Validation d'une version française du Outcome Questionnaire et évaluation d'un service de counselling en milieu clinique
The first purpose of this study was to assess the psychometric quality and validity of the Mesure d'Impact-45 (MI-45) and the Mesure d'Impact-22 (MI-22), French translations of 45-item and 22-item versions, respectively, of the Outcome Questionnaire (Lambert & Burlingame, 1996a, 1996b). The second purpose was to evaluate, by means of the MI-22, a French-language counselling program located in a clinical setting in Quebec, which provided additional information on the sensitivity to change and clinical utility of the MI-22.
The Pitfalls And The Potential Of Early Evaluation Efforts: Lessons Learned From The Health Services Sector
Evaluators often find themselves assuming a variety of roles as they examine programs and interact with the people who are connected to programs. The present article proposes that this is especially true when attempting to conduct an impact evaluation very quickly after a new program is initiated. Given the increasing trends toward program accountability, administrators will often undertake evaluations very quickly after new programs are initiated, and evaluators are increasingly asked to determine the impact of program that is not yet fully functioning.
Comprehensive costing of human services remains an understudied issue in evaluating health and social services. Evaluations done to date have considered either only some of the services offered to clients or restricted the examination to costs borne by programs. Most studies to date have been conducted in the United States and Britain, countries that have different systems of health and social services than Canada. This article presents a case study of the use of a “comprehensive costing approach" in a Canadian context.
There is a growing interest in the use of ecc methods to evaluate our investments in public and charitable sector programming. Calculating the costs and consequences of differing interventions provides new and better information on the relative cost effectiveness of competing alternatives. More commonly used to consider and evaluate health options, ecc evaluations are equally useful in prevention programs and community based services.
The paper describes a review of the Language Arts Program in the Primary Division of a large urban school district. Data were gathered from all stakeholders using surveys, interviews and observation. The evidence revealed limitations in the planning and delivery of Language Arts in the early years and provided the groundwork for remarkable system-wide change in the three years that followed.