Céline Mercier

Special Issue

Guest Editors' Remarks: How Does Complexity Impact Evaluation? / Un mot des rédacteurs invités : En quoi la complexité a-t-elle des répercussions sur l’évaluation?

Authors:
Pages:
v-xx

Discussion: Practice-Based Evaluation as a Response to Adress Intervention Complexity

Authors:
Pages:
105-113

Fall

Comparaison entre le questionnaire auto-administré et l'entrevue téléphonique pour l'évaluation de la satisfaction

Authors:
Pages:
105-118

Data gathered from 212 clients in a substance abuse program showed that there was no statistically significant difference in the results on measures of satisfaction and perceived changes whether data collection was through a telephone survey or a self-administered questionnaire filled out at the agency. However, on-site respondents who filled out the self-administered questionnaire were more prone to ascribe the perceived changes to the treatment they received. Once this difference is taken into account, the choice between these two modalities can be based on their respective advantages and limitations depending on the survey context and its objectives.

Spring

C'est pas grave, c'est rien que vos nerfs L'Évaluation d'un programme de prévention géré par le milieu

Authors:
Pages:
57-67

Its just your nerves a prevention program based on information-sharing regarding women's use of minor tranquilizers and alcohol, is sponsored by Health and Welfare Canada. It is available both in English and in French («C'est pas grave, c'est rien que vos nerfs»). This latter version has been distributed to 144 agencies throughout Quebec and was subsequently evaluated a year later. A survey on utilisation patterns aimed at assessing implementation showed that the program was differently used (from extended use to no use) from one site to another and from one region to another. Context was determines in explaining variations in use. An impact evaluation confirmed the quality and appropriateness of the program, in particular when it is used within the context of a long term program and extended by follow-up activities. From this research, it appears that evaluation of the implementation can be helpful to monitor the development of innovative and milieu-based programs, specially with regard to diffusion and promotion, training and monitoring of expected and unexpected results.

Spring

L'évaluation des programmes d'intervention en milieu naturel

Authors:
Pages:
1-16

In the health and social sciences field, recent treatment and service policies advocate interventions. Programs that are directed at social reintegration, aut and maintenance in the individual's normal environment are increasingly frequent. From an evaluative point of view, such programs have constraints with which the evaluator is unfamiliar: difficulty in defining the boundaries of the program (the importance of the envirornment's resources); the multiplicity of the objectives (depending upon the client's situation); the comprehensive nature of the objectives (reintegration and aut); varying lengths of exposure to the program (from crisis intervention to long-term follow-up). This article reiterates the distinction between evaluative research and program evaluation within these new evaluation contexts and suggests a variety of strategies that may be followed. Protocol planning, selection of indicators, and analytical models are discussed.