Process Evaluation

Data Collection Techniques

This handout provides examples of five process evaluation data collection techniques that we can use to collect process evaluation data. The smoke alarm installation program described in the example we are using for evaluation was used to provide examples for each data collection techniques below.

A.Project Exposure:

This monitors all project contacts and materials distributed as well as who utilizes the project. The following tables show two examples of how you could use the Project Exposure data collection technique to collect process evaluation data:

Project Contacts (i.e., people you project/activity reaches)
Name /

Location

/ Date / Time / Materials Distributed
John Rain Walker / Head Start / 3-15 / 8:30 am / Fire safety materials
Mary Cloud Chaser / Senior Center / 3-17 / 11:30 am / Smoke alarm information and resources
Target Population / Residence / 3/1-3/31/02 / Varies / Smoke alarm (installed), fire safety information
Media Contacts (i.e., materials used to obtain project exposure)
Media / Location / Date / Time / Person in Charge
Pamphlets on smoke detectors / Given away w/ detectors / 3/1-3/31/02 / Varies / Fire team
Smoke detectors / Target population residences / 3/1-3/31/02 / Varies / Fire Team
  1. Progress Review:

This includes a review of program activities to track progress toward meeting goals and objectives. The following tables provide examples of how goals and objectives for a fire safety project could use the Progress Review data collection technique to collect process evaluation data over time. The format for these tables could be modified to match your needs.

Objective 1: Increase the number of people utilizing smoke alarm project.
Activity / Action / Date
Community-based media campaign with program staff advertising and increasing awareness. / Establish “Fire Team” to go to schools, senior center, churches, stores, and community events to hand out fire safety information and promote project. / Accomplished: 1/1-3/1/02
Objective 2: Increase the number of smoke alarms on the reservation.
Activity / Action / Date
Install smoke alarms in the community. / Train and organize “Fire Team” to install smoke alarm in homes. / Accomplished: 3/1-3/31/02
Objective 3: Increase number of people with functioning smoke alarms in the home after 6 months.
Activity / Action / Date
Institute follow-up education on the importance of smoke alarm maintenance. / Fire team will revisit homes, provide additional batteries and educational information. / Planned: 9/1-9/10/02
  1. Internal Audit:

This documents project staff’s efforts and time devoted to each task. The following table provides an example of how the Internal Audit data collection technique could be used to collect process evaluation data for a fire safety project.

Calls Made by: Julia Walking Cloud, Project Director

Name / Title / Date / Time / Issue Discussed
Fire Marshall Bill / Fire Chief / 1/25/02 / 8:30 am / Fire prevention Education
John Q Public / CEO, smoke detector company / 1/27/02 / 9:00 am / # of free smoke alarms
Chief Walker / Tribal Chairman / 1/28/02 / 10:00 am / Tribal Support
Principal Carr / School Superintendent / 1/29/02 / 1:00 pm / Facility usage; program support
Reverend Rhodes / Priest / 1/30 / 2:00 pm / Facility usage; program support
  1. Target Population Survey:

This measures whether the project is reaching the target audience. The following example survey is an example, using fire safety as the intervention, of how you could use the Target Population Survey data collection technique to collect process evaluation data.

Survey Location: St. Paul’s Church / Date: 5/1/02 / Given by: Mary Smith
1. Do you own a smoke alarm?
2. If not, why not?
3. On a scale from 1-10, rate the importance of having a smoke alarm in your home:
4. Are there programs within the community that offer free smoke alarms?
5. Do you know where to get a free smoke alarm?
  1. Project Site Survey:

This can be used to determine if project materials are being distributed effectively. The following table is an example of how the Project Site Survey data collection technique could be used to collect process evaluation data.

Smoke Detector Pamphlets
Location: / Date: / Number before: / Date: / Number after: / More than half:
Grocery Store / 4/30 / 150 / 5/30 / 80 / N
St. Paul’s Church / 4/30 / 75 / 5/30 / 16 / Y
Head Start / 4/30 / 175 / 5/30 / 56 / Y
Senior Center / 4/30 / 150 / 5/30 / 47 / Y
Fire Station / 4/30 / 100 / 5/30 / 12 / Y
Health Clinic / 4/30 / 150 / 5/30 / 93 / N

IHS Intermediate Injury Prevention CoursePage 1 of 2