Evaluability assessment (EA) was conceptualized in the late 1970s following the finding of poor program implementation quality and inability of evaluations to meet stakeholders' needs. EA is an approach that might allow improvement to both the program and the evaluation to be conducted later. In fact, EA may, on the one hand help clarify a program theory and on the other hand, facilitate the elaboration of the logic model, which are helpful for program implementation.
The Essential Skills Series in Evaluation: Assessing the Validity of the ES Participant Workshop Evaluation Questionnaire
Since 2003, the Essential Skills Series training program developed by the Canadian Evaluation Society has been offered to more than 15 groups in the province of Québec. The evaluations of these workshops were based on the participants' reactions collected by a Participant Feedback Questionnaire. This article describes the process used to assess the structure of the questionnaire and document its psychometric properties in order to determine whether it covered all subjects addressed by the training program and the extent to which it measured the items it was intended to measure.
La méthode de cartographie conceptuelle pour identifier les priorités de recherche sur le transfert des conaissances en santé des populations: quelques enjeux méthodologiques
This article discusses methodological issues in the use of the concept mapping technique in a study that identifies research priorities for perspectives on knowledge transfer in the field of population health. This method proved appropriate, and the results produced clearly identify research priorities from the viewpoint of both research and practice. We propose a critical analysis of methodological issues in the use of this technique to facilitate potential replication. Solutions are proposed to reduce obstacles encountered at each step of the procedure.
Évaluation de l'implantation et des effets d'un programme de soutien intensif offert à des familles afin d'éviter un placement en milieu substitut
This article focuses on the evaluation of a form of intervention with families where there is a risk that a child may be placed in a substitute environment. The program, implemented by the Centre jeunesse de Montréal, was reviewed by evaluators for close to five years. Intervention is characterized by: 1) rapid mobilization of various participants, 2) intensity, and 3) a limited time-frame. Caseworkers are available 24 hours a day, 7 days a week, generally intervene in the family environment, and provide varied therapeutic and technical support.
Contribution de la cartographie de concepts à la modélisation des interventions en situation de crise en protection de la jeunesse
This article examines the contribution of concept mapping methodology to the first phase of a study to identify the model(s) implicitly used by staff members of a youth protection agency in crisis situations. Mapping is based on multivariate statistical analyses in which statements produced during a brainstorming session are grouped in weighted clusters. The results are a visual representation of the practitioners' conception of intervention in the context of a crisis.