Print Page   |   Contact Us   |   Sign In   |   Register for Community
Community Search
Systems Change for Health Evaluating Systems Change Interventions
Share |

Systems Change for Health Training Courses

 Introduction to the Policy Change Process

  1. Assessing and Framing the Problem
  2. Analyzing Potential Solutions
  3. Influencing the Systems Change Process
  4. Implementing Enacted Policies
  5. Evaluating Systems Change Interventions

Online Attendee Group

Evaluating Systems Change Interventions

Timeframe: Two-Days

Learning Objectives: By the end of the workshop, participants will be able to:

  1. Define “evaluation” and distinguish it from “research”
  2. Use a logic model to plan an evaluation
  3. Identify evaluation questions  for a policy change project
  4. Identify an evaluation design for a policy change project
  5. Identify evaluation indicators for a policy change project

Background: Public health professionals are increasingly working on systems and environmental solutions to health problems.  For example, local or state organizations may plan to reduce childhood obesity by changing school district policies related to physical activity and nutrition.  To effectively report on policy change efforts, professionals need to know how to design an evaluation that is appropriate for their policy context.

Workshop Description: During this 2-day interactive workshop, participants learn to plan an evaluation of a systems change project.  The workshop will draw from both theory and practitioner expertise to provide concepts, tools, and skill practice.  Participants will learn about evaluation designs and methods; review examples of policy interventions needing evaluation; critically review and help plan for the evaluation design of a 2-phase case example including developing evaluation questions and selecting evaluation indicators; and explore how policy evaluation has evolved over the past 30 years.

The workshop will rely on multiple learning styles including experiential activities (e.g., small group exercises, individual reading, large group discussions and reviews), as well as PowerPoint slides and written materials.  Emphasis will be on exploring the concepts and practicing techniques.  Facilitators will guide the small group activities and ensure that participants learn from the collective skills and experience present at the training. 

Target Audience: Public health professionals from state and local agencies, including:  division managers; health promotion, health education and environmental health staff; clinical staff managing non-clinical programs; key partners collaborating on environmental or systems change initiatives; and, for evaluation staff from both public health agencies and other partner agencies or groups.

Relevance and Usefulness: Participants will gain a better understanding of how to evaluate policy and environmental change campaigns.  After learning new concepts and practicing techniques, participants will have enhanced their systems evaluation skills – an important step in the public health Essential Service of developing health-supportive policy.  The workshop introduces learners to three of the 21 specialized competencies promoted by the Directors of Health Promotion and Education (www.dhpe.org), and provides information relevant to the CHES competency on advocacy. DHPE is approved as a provider of continuing education contact hours (CECH), Category I in health education by the National Commission for Health Education Credentialing, Inc. (NCHEC). This course is approved for 11.5 CECH (11 of 11.5 are advanced-level MCHES).

Session Agenda

                                                                                   Day 1

Time

Activity

9:00
(30 min)

Opening

  • Welcome and introductory activities

9:30
(30 min)

Background

  • Changing policies, environments and systems;  a competency curricula

10:00
(20 min)

What is Evaluation?

  • Evaluation definition, context, and comparison to research

10:20

Break

10:35
(25 min)

Policy Projects (Description and Evaluation Need)

  • Case stories of policy interventions with evaluation needs

11:00
(20 min)

Your Evaluation Project

  • Identify evaluation needs for your own project

11:20
(15 min)

Evaluation Framework

  • Standards, steps, and CDC framework for evaluation

11:35
(15 min)

Policy Project (Intervention)

  • Putting the project into the larger policy context

11:50
(15 min)

Policy Project Logic Model

  • Considering a template logic model for Systems Change for Health

12:05

LUNCH

1:20
(60 min)

Evaluation Design

  • Evaluation purpose, types, and causal inference potential

2:20

Break

2:35
(45 min)

Evaluation Design (continued)

  • Threats to internal validity and evaluation designs

3:20
(15 min)

Evaluation Questions

  • Developing evaluation questions

3:35
(20 min)

Evaluation Indicators

  • Selecting evaluation indicators

3:55
(25 min)

Data Collection and Analysis

  • Selecting methods for data collection and analysis

4:20
(10 min)

Closing

  • Review and feedback

4:30

END


                                                                                Day 2

Time

Activity

9:00
(45 min)

Opening

  • Review from Day 1
  • Review agenda and materials for Day 2

9:45
(30 min)

Policy Evaluations (Need and Design)

  • Orientation to the evaluation designs of policy intervention case stories

10:15

Break

10:30
(45 min)

CASE:  Phase 1 (The Policy Project)

  • Reviewing information about a pilot policy intervention

11:15
(45 min)

CASE:  Phase 1 (Planning the Evaluation)

  • Planning the formative evaluation using a template

12:00

LUNCH

1:15
(20 min)

CASE:  Phase 2 (The Policy Project)

  • Reviewing information about the expanding policy intervention

1:35
(55 min)

CASE:  Phase 2 (Planning the Evaluation)

  • Planning the summative evaluation using a template

2:30

Break

2:45
(45 min)

Policy Projects and Evaluation Approaches

  • General evolution of policy project evaluations

3:30
(30 min)

Your Evaluation Project

  • Address the evaluation needs for your own project

4:00
(20 min)

Evaluation Steps and Ethical Issues

  • Review evaluation steps and discuss ethical concerns

4:20
(10 min)

Closing

  • Review and Feedback

4:30

END

About DHPE | Membership | Member Institute | Donate

© Copyright DHPE * 1432 K Street NW, Suite 400, Washington, DC 20005 * 202-659-2230