Essential Skills Series in Evaluation

Outline

Understanding Program Evaluation

  • Key terms and concepts;
  • Benefits of program evaluation;
  • Basic steps in the evaluation process;
  • Major approaches to program evaluation;
  • Formatting evaluation questions;
  • Designing an evaluation;
  • Evaluating with limited resources;
  • Analyzing and reporting evaluation results;
  • Reducing resistance to evaluation;
  • Involving staff and clients in the evaluation process;
  • Increasing evaluation utilization;
  • Making evaluations ethical and fair

Building an Evaluation Framework

  • Identifying who the client is and what the client needs;
  • Basic concepts of needs assessment;
  • Major approaches to assessing client needs;
  • Evaluation methods for "getting close to the client";
  • Building an evaluation framework through logic models;
  • Involving managers and staff in building an evaluation framework;
  • Relating program design to client needs;
  • Defining program components;
  • Formulating indicators for program success;
  • Using the evaluation framework for linking program performance to client needs.

Improving Program Performance

  • Using evaluation as a management tool for improving program performance and enhancing internal accountability;
  • Basic concepts of monitoring and process evaluation;
  • Monitoring program performance with existing administrative data and information systems;
  • Developing ongoing data collection instruments and procedures;
  • Linking process evaluation to program decision-making;
  • Assessing client satisfaction;
  • Understanding continuous quality improvement;
  • Using program evaluation for building a "learning organization."

Evaluating for Results

  • Defining program results;
  • Major approaches to evaluating results;
  • Developing results measures;
  • Designing outcome evaluations;
  • Validity and reliability;
  • Appropriate use of quantitative and qualitative techniques;
  • Relating program results to program costs;
  • Understanding program benefits;
  • Measuring program equity and responsiveness to community needs;
  • Communicating evaluation findings;
  • Using evaluations to improve program effectiveness and accountability.