Evaluating inter-, multi-, and transdisciplinary research in the European Research Area
Europe faces challenges in creating an integrated European Research Area. This article focuses on the use of research evaluations in a framework where knowledge production processes are changing and increasingly take place within inter-, multi-, and transdisciplinary settings. European research policies and instruments such as the Framework Programmes for Research and Technological Development and the recently established European Research Council are discussed in view of new knowledge production processes and evaluation practices. The article concludes with an explanation of the need to rethink evaluation approaches in the European Research Area.
The BC Cancer Agency primary prevention program : Using Negotiated Accountability to evaluate a comunity-determined health initiative
The British Columbia Cancer Agency Centre for the Southern Interior Prevention Program operated from 1997 to 2005, resulting in community-determined cancer prevention initiatives specific to unique local needs. These initiatives included community events and forums, school food and nutrition activities, physical exercise initiatives, environment and air quality programs, early childhood education, tobacco counselling programs, and cancer prevention-related publications. The external evaluation of the program used the concept of negotiated accountability to strengthen collaborative evaluative practices. In this article, we present evaluation findings and provide a detailed example from one partner community.
Editor's Remarks / Un mot du rédacteur en chef
Introduction des rédacteurs invités / Guest Editors' Introduction
L'utilisation de l'évaluation fondée sur la théorie du programme comme stratégie d'application des connaissances issues de la recherche
Research on knowledge application and program theory-driven evaluation are two types of activity associated with research which involve close collaboration between researchers-evaluators and stakeholders and also facilitate maximal use of research results. In this article, first we succinctly present theoretical models of knowledge application emphasizing the conceptual bases and strategic elements common to both approaches. Specifically we examine the crucial role of tacit knowledge and distinguish between the individual and organizational levels in the utilization of knowledge generated by research and evaluation. We examine and discuss the advantages of program theory-driven evaluation as a knowledge application strategy. We suggest that conceptual developments in the field of knowledge application research can also contribute to the advancement of program evaluation.
Comparaison de trois stratégies de travail en réseau afin de favoriser l’application des connaissances issues de la recherche
In research as in practice, establishing strong teams is a recognized necessity and teams are increasingly large and dispersed. In the field of health care, the need for pluridisciplinarity is a further constraint in the organization of such teams or at least communication within them. Despite these difficulties, networking has emerged among groups of practitioners who share common objectives and try to fulfill their mission more effectively by developing, sharing, and applying knowledge targeted based on their fields of interest. This article is a critical analysis of three different networking experiences that all shared the common objective of application of knowledge through networking among practitioners: the suicide prevention practice community (CoP) of the Centre for Research and Intervention on Suicide and Euthanasia (CRISE), the task force on suicide in prisons of the International Association for Suicide Prevention (IASP), and the international Francophone network for safety promotion and trauma prevention.
La méthode de cartographie conceptuelle pour identifier les priorités de recherche sur le transfert des conaissances en santé des populations: quelques enjeux méthodologiques
This article discusses methodological issues in the use of the concept mapping technique in a study that identifies research priorities for perspectives on knowledge transfer in the field of population health. This method proved appropriate, and the results produced clearly identify research priorities from the viewpoint of both research and practice. We propose a critical analysis of methodological issues in the use of this technique to facilitate potential replication. Solutions are proposed to reduce obstacles encountered at each step of the procedure.
Reconnecting knowledge utilization and evaluation utilization domains of inquiry
This article provides commentary for the thematic segment titled "Applying a variety of methods to the evaluation of various efforts aimed at transferring knowledge generated from research." The authors revisit arguments supporting inquiry that takes up the challenge of connecting cognate fields of evaluation utilization and the broader domain of knowledge utilization. The central contribution of each of the foregoing articles is identified and situated within the context of ongoing inquiry in this domain.
Reliability of the Canadian Incidence Study data colection instrument
The Canadian Incidence Study of Reported Child Abuse and Neglect (CIS) provides national estimates of the scope and characteristics of reported child maltreatment. It is the most comprehensive source of information about maltreated children in Canada. The data are used to inform policy and, in secondary analyses, to examine correlates of maltreatment and relationships among case characteristics and service responses. Evaluation of the psychometric properties of the CIS instrument is essential to establish confidence in the data collected and the estimates generated. This study examines the test re-test reliability of the CIS instrument.
A theory-based evaluation framework for primary care: setting the stage to evaluate the "Comparison of Models of Primary Health Care in Ontario" project
Primary care reform has triggered a flood of demonstration projects across Canada that need to be evaluated. This presents a challenge to an evaluator who is uncertain about how to convince clinical investigators to think beyond traditional research designs toward using evaluation approaches. The purpose of this article is to describe the application and benefits of using a theory-based evaluation framework for a large evaluation of four unique models of primary care delivery in Ontario, the Comparison of Models of Primary Health Care in Ontario (COMP-PC) project. Lessons learned are drawn from the authors' experience in applying the theory-based approach, including the benefits and limitations of having a common framework to facilitate model comparison.
Profesional identity of evaluators in Israel
Professional identity is a precondition for the establishment of a profession. This examines the professional identity of program evaluators in Israel. The field of evaluation in Israel has developed differently than in most Western countries—from the ground and with minimal governmental interference—and thus it is an interesting case study. In spite of the diversity of the backgrounds of evaluators, there is strong agreement among them on the core of evaluation as an interdisciplinary profession whose aim is mainly as an advisory tool that serves for learning. They also strongly agree that the borders and essence of evaluation are not clear to evaluators, evaluees, and the public. While half of the respondents practicing evaluation do not identify themselves as evaluators, a professional community is important to them. Evaluators in Israel are not well connected to professional activities and developments outside of the country. They do not participate in international conferences and do not publish in scientific journals, yet they are very active in professional activities in Israel. The context of Israeli society is analyzed for a better understanding of these findings.