SELECT AN EVIDENCE-BASED PROGRAM

SECTION

3.1

Process evaluation assesses the delivery of a program. It examines factors such as the extent to which the program is being implemented as designed, whether the target population is being reached, and the quality of program delivery. Sometimes process evaluation can also constitute formative evaluation, which is evaluation used to improve or fine tune a program.

 

Numerous aspects of program delivery can be assessed with process evaluation. Important aspects to evaluate are described below.

  • Justification (the extent to which the program addressed an important need) — Justification can be assessed by comparing needs assessment data with the program to determine if the program addresses a need that was identified during needs assessment.

  • Fidelity (the extent to which the program was implemented as designed) — Fidelity can be assessed with the use of tools such as protocol checklists (either self-administered or administered by a trained observer).

  • Dose delivered (the extent to which all program components were implemented) — Dose delivered can be assessed with program component checklists (either self-administered or administered by a trained observer).

  • Dose received (the extent to which participants took part in program components) — Dose received can be assessed by observing participants’ engagement and measuring knowledge and skill acquisition.

  • Reach (the proportion of the intended audience that took part in the intervention) — Reach can be assessed by dividing the number of individuals who took part in the program by the number of individuals in the intended audience. Attendance logs can help facilitate an assessment of reach.

  • Participant satisfaction (the extent to which participants were satisfied with the program) —Participant satisfaction can be assessed by surveying participants to find out how satisfied they are with the program.

  • Recruitment success (which recruitment methods were effective in attracting participants to the program) — Recruitment success can be assessed by surveying participants to find out how they heard about the program.

  • Accountability (the extent to which staff and partners fulfilled their responsibilities) — Accountability can be assessed by a supervisor comparing actual role and task completion with the roles and tasks assigned during program planning.

  • Context (the extent to which environmental characteristics influenced program implementation or outcomes) — Context can be assessed by surveying participants and program personnel with open-ended questions to determine what they saw and experienced that may have influenced implementation or outcomes.