Preparing the KAP questionnaire for post campaign survey:

Step 1:Revise your sampling methodology and create a survey plan.

Step 2:Check your SMART objectives and mark them in your survey: objectives should align with your Results Chains & enable you to measure the success of your campaign

Step 3:Revise your campaign survey in word using track changes

Step 4:Hide the questions in Survey-Pro that you deleted from the word version

Step 5 & 6: Implement your survey and carry out data entry

Step 1 - Revise your sampling methodology and create a survey plan.

Documents needed:

  • Pre campaign survey sampling methodology and plan

Action:

  • Decide which groups you will sample for the post campaign KAP survey and revise your sampling methodology accordingly. Finalize in agreement with your PPM.
  • Create a realistic post-campaign survey plan (to be finalized once you have revised your survey and tested survey length). Finalize in agreement with your PPM.

Guiding principle

  • Definitely include primary and secondary target audiences (fishers and community). The other target groups sampled during the pre-campaign survey are optional so you may decide to leave them out.
  • Survey should have exact same sample size for each TA as pre-campaign survey (If you ran out of households, follow same procedure as for pre-campaign survey, if you did not reach planned sample size sample size in pre-campaign discuss with your PPM on best strategy for post-campaign survey)
  • Survey should follow same sampling methodology as last time (even there was some bias during pre-campaign survey, better to have twice the same bias than to have incomparable results)

Key things to make sure

  • You have updated your survey sampling methodology based on reality of pre-campaign survey (so you can replicate it accurately)
  • You create a new realistic survey plan to ensure that you are 100% confident that you will have survey and data entry completed by Module 4 (it is an absolute pre-requisite and you will not be able to join unless you do)
  • Plan to hold a refresher training for your KAP enumerators and any new recruits
  • Plan to keep a record of what happens during post campaign survey (any changes in methodology due to external circumstances)


Step 2 - Check your SMART objectives

Documents needed:

Hard copy of your smart objectives from the KAP monitoring plan section of your work-plan

  • Hard copy of your final KAP survey (English version) (vernacular copy as reference)
  • Copy of table linking results chains to questions in your survey (as reference)

Action:

  • Check all your SMART objectives according to the criteria below and amend if needed.
  • As you do the above, mark all the questions used for your smart objectives in your final word survey (so you can be sure to keep those questions when you revise it later)

Key things to make sure

  • Question numbering in the monitoring plan should match that in the final survey
  • Smart objectives are aligned with your results chain
  • Smart objectives enable you to measure the success of your campaign
  • Data in the smart objectives matched your pre-campaign results and the answer options of those results
  • Smart objectives targets are realistic (see historic pp change results 22K, 13A, 28IC, 14BC)
  • There is at least one (and no more than two smart) objectives for each section of the ToC equation, for each of the primary target audiences (not necessary for other sampled groups)

Guiding principles

You may

  • Remove redundant Smart objectives
  • Replace a smart objective with another one if it is off target, provided that you have a suitable question in the survey to do so
  • Decide to remove smart objective related to audiences which are not your primary or secondary (Fishers and community) target audiences (i.e. LGU, barrier removal groups, etc).
  • Decide that you no longer need to sample for these additional target audiences altogether (see sampling methodology section)

Step 3 & 4 - Shorten/revise the survey for post- campaign KAP:

Documents needed:

  • Hard copy of your pre-campaign survey in English (Vernacular version as reference)
    make sure this is the latest version and matches your Survey-Pro file with data entered
  • For reference: your SMART objectives, Appendix 2 of this document, electronic version of the revised cohort survey template.

Action:

  • Revise your pre-campaign survey following the guidelines below. Your overall objective is to substantially shorten your survey (to a 30min survey) whilst retaining questions needed for analysis (your SMART objectives questions, filter/cross tab questions, socio-economic questions, compulsory questions (listed in Appendix 2) and adding a few exposure questions)
  • Please be sure to make all these changes in the word document (not in Survey-Pro) and finalize with your PPM before making changes in Survey pro (step 5)
  • We recommend making changes in the English word version first (to check it fits with the smart objectives) then later revise the Vernacular
  • Start by marking all the questions needed for your SMART objectives in the final version of your KAP survey (word version) as questions to be kept.

Guiding principlesfor shortening surveys

  • All questions should remain exactly the same (even if they had a mistake)
  • Questions and answer options should remain in the same order
  • Questions needed for your SMART objectives should be retained (double check this with your PPM)
  • Should be retained:
    -Socio-economic data - Section 2
    -Compulsory cohort questions, selection to be retained (see provided list in Appendix 2)
    -Climate change questions should be retained
  • - Questions you used during analysis for cross tabulations and filters (make sure you check which ones these were. i.e. sampling methodology, which category best describes you)
  • Can be removed (but please don’t delete them from your Survey pro file, just hide them):
    -Trusted Sources of Information & Media Access/Exposure- Section 3
    -Flagship sp question - Section 11
    -Any questions that you no longer deem useful, including cohort questions, provided they are not part of the categories to be retained
    -If your survey took longer than 40 minutes per interviewer, please make sure you shorten it to that length second time round! (+-35 questions)
  • To be added:
    - A question asking respondents whether they have taken this survey before
    - 3-5 answer options to the exposure question “I am going to ask you about a number of ways in which you may or may not have seen or heard about the XXX Sanctuary. For each method, I would like you to tell me whether you remember seeing or hearing that source in the past 6 months.” - Section 10
    The answer options you add should relate specifically to campaign events, activities or materials that you implemented over the last 6 month and feel are not yet covered by the current answer option list. For example this could include things like: “boat awnings”, “battle of the bands”, or “MPA blessing”.
    ( You can remove exposure questions that do not pertain to campaign, but should retail at least one or two as a measure of “false negative”)

Key things to make sure

  • You have the latest version of your survey
  • You make all revisions in word using track changes (or marking all changes in color)
  • You are happy with the choice of your SMART objectives before you decide which questions to remove (please review with your PPM)
  • Under “survey period” there is a “post campaign survey” answer option

Step 5 - Hide questions in survey pro

Documents needed:

  • Latest survey pro file with pre-campaign data entry
  • make sure it is really the latest - make a copy labeled “pre-campaign data” and upload it on RP before you start
  • Latest word version in vernacular and answer sheet
  • See appendix 2 for instructions on hiding questions in Survey-Pro

Action:

  • You may now revise the Survey Pro file according to the changes made to your Survey pro file.
    There are two ways to do this:
    1. You can either hide the answer options of the questions you will no longer be using (this way all pre-campaign data will still be stored in the same file)
    2. Or you can delete the questions you want to remove from the file (this means you will lose the pre-campaign data related to it in the file). Make sure you keep an intact pre-campaign data file on Rare planet just in case.

Guiding principles

  • No questions should be deleted from the survey pro file (as you would be losing the pre-campaign survey data)
  • Questions that you removed from word should be hidden in Survey-Pro

Key things to make sure

  • Make sure you don’t delete any questions in Survey pro! You should just hide them
  • Do one test trial in survey pro to check you can save a form whilst leaving some questions blank (there is an option in Survey pro to remove obligatory answer entry should you have problems)
  • When you are finished export your survey from survey pro into word and check that it matches the word version you reviewed in track changes


Step 6 - Implement your survey and carry out data entry

  • As you did for the pre-campaign survey, you can now implement the post campaign survey
  • Before you start: do a refresher course for your enumerators (run through questions make sure they know the process and are clear on the meaning of the questions)
  • Before you start: Do a one day test run of the survey and data entry to make sure it all works
  • Make sure all changes you made have been integrated into the Vernacular version

Key things to make sure

  • Make sure you have the latest survey Pro file that you revised in Legaspi
  • Post campaign data entry is entered into same file as pre-campaign data file (cut questions can be left blank)
  • All post campaign surveys are marked as “post campaign survey” answer option, under the “survey period” question.


Appendix 1

How to hide questions in survey pro:

  1. Open survey pro
  2. Go to the “questionnaire” tab
  3. Double click on the question you want to hide
  4. Click on the “advanced options” tab
  5. On the right select “Hide” for all answer options
  6. The question will still appear in the survey but all answer options will be hidden

For grid questions:
The process is the same as above but at n4 above click on “rows”.
Please note the system will allow you to hide all answer options but one. The person doing data entry will have to leave this answer option blank when they do data entry.


Appendix 2

Questions to be kept for post KAP (in addition to the SMART Objectives questions)
Philippines/PEP2 Reef Rangers

Respondent agrees to be interviewed (If no, keep tally on separate sheet of paper)
[ ] Yes

Have you taken this survey before? (QUESTION TO BE ADDED)
()Yes()No ()Not sure

Section 1
Background information filled in prior to the interview without asking the respondent

Interviewer:
(INSERT NAMES OF ENUMERATORS PRIOR TO PRINTING SURVEY)
[ ] Interviewer #1[ ] Interviewer #2[ ] Interviewer #3[ ] Interviewer #4[ ] Interviewer #5 [ ] Interviewer #6 [ ] Interviewer #7 [ ] Interviewer #8 [ ] Interviewer #9 [ ] Interviewer #10 [ ] Interviewer #11 [ ] Interviewer #12

Barangay (ENTER NAME OF BARANGAY PRIOR TO PRINTING SURVEY):
[ ] Village #1[ ] Village #2[ ] Village #3

Enumeration area (EA):
[ ] EA #1[ ] EA #2[ ] EA #3[ ] EA #4[ ] EA #5[ ] EA #6[ ] EA #7 [ ] EA #8

Date (month/day/year):
______

Survey period:
[ ] Pre campaign - Baseline (Feb 2011)[ ] Post-campaign (June 2012)

Gender of respondent:
[ ] Male[ ] Female

Sampling methodology
[ ] random[ ] selected for target audience

Section 2
Socioeconomic and Demographic Questions

(2) CUSTOMIZE FOR RESIDENTIAL AREAS RELATED TO MPA Where do you live in relation to the Lola Marine Sanctuary? Do you live inside of Lola, In Loondoon, outside of Loondoon, or somewhere else? [choose only one]

[ ] I live in Lola[ ] I do not live in Lola but I live in Loondoon[ ] I live outside of Loondoon[ ] Other ______

(3) How old were you at your last birthday?

[ ] 14 or younger[ ] 15 to 19[ ] 20 to 24[ ] 25 to 29[ ] 30 to 34[ ] 35 to 39 [ ] 40 to 44 [ ] 45 to 49 [ ] 50 to 54 [ ] 55 or older

(4) What is your highest level of education attained?". [choose only one]
[ ] No school completed[ ] Some or all primary completed[ ] Some or all intermediate school completed [ ] Some or all secondary completed [ ] Some or full college/university completed [ ] Some or all trade/professional completed [ ] Some or all of religious school/college completed [ ] Refused to answer

(5) If you belong to a religion, please tell me which religion. If you do not belong to a religion, please say "none". [choose one only]
ADD CATEGORIES AS APPROPRIATE
[ ] Roman catholic[ ] IglesiaFilippinaIndipendente (IFI)[ ] Iglesia Ni Kristo[ ] Church of Latter Day Saints [ ] Hindu [ ] Muslim [ ] Buddhism [ ] Hindu [ ] Protestant [ ] Jewish [ ] Local/traditional [ ] Refuses to answer [ ] None [ ] Other ______

(6) ADD CATEGORIES AS APPROPRIATE - What is your primary occupation or sector in which you work? [choose one only]
[ ] Agriculture[ ] Fishing[ ] Gleaning[ ] Logging, mining, other extractive industry[ ] Small business (shop keeper or sales person) [ ] Office work [ ] Factory or manufacturing [ ] Food preparation or restaurant [ ] Professional (Lawyer, Health care provider) [ ] Artisan (crafts) [ ] Transportation (shipping, trucking, rail) [ ] Education [ ] housework [ ] student [ ] Not currently employed [ ] other private company [ ] non-governmental organization [ ] self employed [ ] government (local) [ ] government (state or national) [ ] Other ______[ ] N/A

(7) ADD CATEGORIES AS APPROPRIATE - What is your secondary occupation or sector in which you work? [choose one only]
[ ] Agriculture[ ] Fishing[ ] Gleaning[ ] Logging, mining, other extractive industry[ ] Small business (shop keeper or sales person) [ ] Office work [ ] Factory or manufacturing [ ] Food preparation or restaurant [ ] Professional (Lawyer, Health care provider) [ ] Artisan (crafts) [ ] Transportation (shipping, trucking, rail) [ ] Education [ ] housework [ ] student [ ] Not currently employed [ ] other private company [ ] non-governmental organization [ ] self employed [ ] government (local) [ ] government (state or national) [ ] Other ______[ ] N/A

(8) How many people live in your household?
[ ] 1 (me)[ ] 2[ ] 3[ ] 4[ ] 5[ ] 6[ ] 7[ ] 8[ ] 9[ ] 10[ ] More than 10

(9) CUSTOMIZE - In the past calendar year, from January to December, what is your best estimate of the total income earned by all family members that currently live in the same home with your. Again, this information will not be shared with anyone.
[ ] Below 30,000 Pesos W[ ] Between 30,000 and 50,000[ ] Between 50,001 and 75,000[ ] Between 75,001 and 100,000 [ ] Greater than 100,000 Pesos W [ ] Not sure [ ] Refused

Section 3
Trusted Sources of Information & Media Access/Exposure

Section 4
Assign Respondent to Stage-of-Behavior-Change

Section 5
Establish Baselines for and Measure Change in Knowledge SMART Objectives

(22) Please state below whether you believe each regulation is either true or false as a Lola Marine Sanctuary Rules/Policies: CUSTOMIZE QUESTION AND STATEMENTS
(B) No-one can fish or collect shells inside Lola Marine Sanctuary
[ ] True[ ] False[ ] Unsure

(23) Some of the questions I am going to ask you are about the no-take fishing area that is going to be or has been created in your local area. A no-take fishing area is a clearly identified area where no fish are allowed to be caught at any time by anyone.(COHORT QUESTION)
(A) Are there any benefits to the local community from having a no-take area nearby? (If respondent answers YES then please also ask next question)
COHORT QUESTION)
[ ] Yes[ ] No[ ] Don't know

(B) (Ask only of those who said yes to previous question)
What local community benefits are there from having the no-take area nearby? You can tell me up to 3 that you know. (Do NOT read out answers but tick as appropriate or add to other)
(COHORT QUESTION - need to choose format B or C for this question)
[ ] more fish[ ] area for fish to reproduce[ ] bigger fish[ ] bigger or better coral / habitat for fish [ ] more fertile fish [ ] bank of the sea / food security [ ] better regulation/management of fishing activities [ ] no more destructive fishing in that area [ ] community ownership [ ] new skills [ ] better/new access to tourism [ ] better community cohesion [ ] Other ______[ ] N/A

Section 6
Establish Baselines for and Measure Change in Attitude SMART Objectives

(27) OPTIONAL-CUSTOMIZE AS APPROPRIATE

Please state below whether you agree or disagree with the following statements on the possible impacts on the local community if the Lola Marine Sanctuary Rules/Policies are not strictly observed by fishers: (B) Fish species will continue to decline in number or disappear
[ ] Strongly Agree[ ] Agree[ ] Disagree[ ] Strongly Disagree

(34) CUSTOMIZE
Has your catch increased, decreased or stayed the same as a result of the Lola Marine Sanctuary? (If the person does not fish or glean mark as NA)
[ ] Decreased[ ] Increased[ ] Stayed the Same[ ] N/A

(36) I am going to read you a number of statements about the management of the local no-take area. For each statement, I would like you to tell me if you strongly agree, agree, disagree, or strongly disagree with it.
(COHORT QUESTION)
(A) There is a clear plan for how the no-take area will be managed
[ ] SA[ ] A[ ] D[ ] SD[ ] NS/DK
(B) Local village fishers regularly participate in management decisions of the no-take area
[ ] SA[ ] A[ ] D[ ] SD[ ] NS/DK
(C) Local people know boundaries of the no-take area
[ ] SA[ ] A[ ] D[ ] SD[ ] NS/DK
(D) There was not enough planning done before the no-take area was established
[ ] SA[ ] A[ ] D[ ] SD[ ] NS/DK
(E) There is enough money and other resources to fully manage and enforce the rules of the no-take area
[ ] SA[ ] A[ ] D[ ] SD[ ] NS/DK
(F) The rules of the no-take area are regularly enforced so that violators are caught and punished
[ ] SA[ ] A[ ] D[ ] SD[ ] NS/DK
(G) The rules of the no-take area are unclear and local fishers don't understand them
[ ] SA[ ] A[ ] D[ ] SD[ ] NS/DK
(H) The rules of the no-take area are designed more to protect the fish than to help the fishers
[ ] SA[ ] A[ ] D[ ] SD[ ] NS/DK