NewZealand Health Survey

Content Guide 2012/13

Citation: Ministry of Health. 2013. New Zealand Health Survey: Content Guide 2012–2013. Wellington: Ministry of Health.

Published in December 2013
by the
Ministry of Health
PO Box 5013, Wellington 6145, New Zealand

ISBN978-0-478-41563-6 (online)
HP 5764

This document is available at

This work is licensed under the Creative Commons Attribution 4.0 International licence. In essence, you are free to: share ie, copy and redistribute the material in any medium or format; adapt ie, remix, transform and build upon the material. You must give appropriate credit, provide a link to the licence and indicate if changes were made.

Authors

This report was compiled by the New Zealand Health Survey team in the Health and Disability Intelligence Group, Ministry of Health. Contributors include Marie Ditchburn, Louise Fawthorpe,Anthea Hewitt, Marianne Linton,Kylie Mason, Anne McNicholas andMaria Turley.

Please refer to the Ministry of Health’s publication New Zealand Health Survey: Annual Update of Key Findings 2012/13 for further acknowledgments (Ministry of Health 2013).

Contents

Introduction

Background

Survey design and methodology

Goal and objectives

Information domains

Questionnaire components

Development of the NewZealand Health Survey

Core component

Module component

Cognitive testing

Pilot testing

Ethics approval

Content of the New Zealand Health Survey

Long-term health conditions

Health service utilisation and patient experience

Health behaviours and risk factors

Module questions on tobacco, alcohol and drug use

Developmental health and wellbeing

Food security

Child exposure to second-hand smoke

Health status

Sociodemographics

Measurements

Exit

References

Appendix 1: 2012/13 NZHS adult questions

Appendix 2: 2012/13 NZHS child questions

List of Tables

Table 1: Questions from the 2012/13 Adult NZHS Survey cognitively tested

Table 2: 2012/13 NZHS long-term health conditions: core topics

Table 3: 2012/13 NZHS health service utilisation and patient experience: core topics

Table 4: 2012/13 NZHS health behaviours and risk factors: core and module topics

Table 5: Source of questions for the tobacco and alcohol and drug modules

Table 6: SDQ questions

Table 7: Suggested scoring for the SDQ

The New Zealand Health Survey: Content Guide 2012–20131

Introduction

This guide describes the content of the New Zealand Health Survey (NZHS) for the period July 2012 to June 2013. It also briefly outlines the history of the NZHS and its development into a continuous survey, describes the process for developing the adult and child questionnaires for 2012/13, and gives an overview of each section of the survey. Appendices 1 and 2 tabulate details of each survey question, including its source and time series, in the adult and child questionnaires.

Background

The NZHS was first undertaken in 1992/93, with further surveys in 1996/97, 2002/03 and 2006/07. The Ministry of Health’s wider health survey programme also included surveys on adult and child nutrition; tobacco, alcohol and drug use; mental health; and oral health. From 2011, the Ministry has integrated the NZHS and the surveys from its wider survey programme into a single survey, which is now in continuous operation. The rationale for this change is detailed in The New Zealand Health Survey: Objectives and topic areas (Ministry of Health 2010).

The NZHS forms part of the Programme of Official Social Statistics, which was established by Statistics New Zealand to develop and coordinate official social statistics across government. As a signatory of the Protocols of Official Statistics (Statistics New Zealand 1998), the Ministry of Health employs best-practice survey techniques to extract high-quality information from the NZHS. Where possible, the Ministry uses standard frameworks and classifications so that data from the NZHS can be integrated with data from other sources.

Survey design and methodology

The target population for the survey is New Zealand’s usually resident population of all ages (including those living in non-private accommodation). The NZHS sample is selected using a stratified, multi-stage area design. The survey questionnaire is administered through face-to-face interviews, using computer-assisted personal interviewing (CAPI) software. Participants are adults aged 15 years and older, as well as children aged 0 to 14 years, who are interviewed through their parent or legal guardian acting as a proxy respondent. The NZHS sample design and methodology will be published online alongside this report.

Goal and objectives

Goal

The goal of the NZHS is to support the formulation and evaluation of policy by providing timely, reliable and relevant health information. This information cannot be collected more efficiently from other sources, and covers population health, health risk and protective factors, and health service utilisation.

Objectives

To achieve this goal, 13 high-level objectives have been identified for the NZHS.

1.Monitor the physical and mental health of New Zealanders and the prevalence of selected long-term health conditions.

2.Monitor the prevalence of risk and protective factors associated with these long-term health conditions.

3.Monitor the use of health services, and patient experience with these services, including access to services.

4.Monitor trends in health-related characteristics, including health status, risk and protective factors, and health service utilisation.

5.Monitor health status and health-related factors that influence social wellbeing outcomes.

6.Examine differences between population groups, as defined by age, sex, ethnicity and socioeconomic position.

7.Provide a means for the rapid collection of data to address emerging issues related to the health of the population.

8.Enable follow-up surveys of at-risk populations or patient groups identified from the NZHS as required to address specific information needs.

9.Measure key health outcomes before and after a policy change or intervention.

10.Facilitate the linking of NZHS to routine administrative data collections to create new health statistics and address wider information needs.

11.Provide data for researchers and health statistics for the general public.

12.Allow the comparison of New Zealand data with international health statistics.

13.Evaluate methods and tools to improve survey quality, including the implementation of objective tests to capture information not accessible to self-report.

Information domains

To meet the high-level objectives of the NZHS, particularly the first six listed above, detailed information is collected across nine information areas or domains. These nine domains are:

1.health status

2.long-term health conditions

3.behaviours and risk factors

4.nutrition

5.mental health

6.oral health

7.health service utilisation

8.patient experience

9.sociodemographics.

There is crossover between some domains. For example, aspects of mental health and oral health could be included within the long-term health conditions domain, and nutrition could be included within the risk and protective factors domain.

Questionnaire components

The NZHS includes a set of questions drawn from each of the nine information domains. These ‘core’ questions will be the same each year. They make up about half of the survey questions.

The NZHS also includes questions that examine a topic in more depth. These ‘module’ questions will change each year and make up the other half of the survey questions.

The topics covered by the modules include:

  • health status
  • long-term health conditions
  • behaviours and risk factors

–physical activity

–tobacco use

–alcohol consumption

–drug use

–problem gambling

–sexual and reproductive health

  • nutrition
  • mental health
  • oral health
  • health service utilisation
  • patient experience
  • sociodemographics.

Because of its size and importance, the behaviours and risk factors domain has been split into a number of modules, as shown above. Some modules may run concurrently (eg, tobacco, drugs and alcohol use).

The continuous nature of the survey also makes it possible to incorporate shorter (one- to three-minute) clip-on modules. These clip-on modules may address an urgent emerging issue, or an important topic where policy development or monitoring requires information that can be obtained through a small number of questions.

Development of the NewZealand Health Survey

The Ministry of Health’s Health and Disability Intelligence Group developed the adult and child questionnaires. In doing so, it consulted with key internal stakeholders (eg, policy groups) and external stakeholders (eg, technical experts and data users) regarding the questionnaire content.

Core component

The NZHS aims to maintain continuity with previous surveys so that time trends can be analysed. To facilitate this approach, the 2006/07NZHS was used as a question bank. Where possible, the wording of the core questions and response options and the use of showcards and interviewer prompts were kept the same as in the 2006/07 NZHS.

Topics for inclusion in the core component of the NZHS were based on those outlined in TheNew Zealand Health Survey: Objectives and topic areas (Ministry of Health 2010). The following criteria were used to determine which topics would be included each year as core components:

  • impact – the topic has a large impact on health, health policy or health care costs
  • measurability – the topic lends itself to robust measurement, including high reliability and validity, and responsiveness to change
  • disaggregation – the data that can be collected on the topic will allow analysis by social group or region
  • international comparability – the topic lends itself to meaningful international benchmarking.

Priority was given to those questions required to produce key indicators or outputs and to monitor time trends of importance to the Ministry of Health. Where the results on an indicator or output were included in A Portrait of Health: Key results of the 2006/07 New Zealand Health Survey (Ministry of Health 2008), it was considered to be a good indication of their importance.

Almost all questions selected for the core component of the survey were from the 2006/07 NZHS. The 2006/07 NZHS included a number of questions from validated instruments, such as the Medical Outcomes Study Short Form (SF-36) and the Alcohol Use Disorders Identification Test (AUDIT). For the NZHS core, the SF-36 has been replaced with the SF-12. Most other questions selected for the core had been included in at least one earlier survey (1992/93, 1996/97 and/or 2002/03).

The need to sustain time series makes it more difficult to amend core questions where they might be improved, and to add new core questions. Where needed, questions will generally be improved as a topic area covered by a core question is reviewed in depth during the development of a related module.

The core component of the NZHS includes measurement of height and weight in participants aged two years and older, waist circumference in participants aged five years and older and blood pressure in participants aged 15 years and older.

Module component

The module topics for 2012/13 were tobacco, alcohol and drug-use modules for adults and developmental health and wellbeing for children. Questions were developed following a review of previous health surveys. A number of well-validated international surveys were also reviewed, particularly in relation to patient experience. For details, see the ‘Content of the New Zealand Health Survey’ section below.

Cognitive testing

Cognitive testing helps ensure questions are understood as intended and that response options are appropriate.The cognitive testing process (Tourangeau 1984; Eisenhower et al 1991) includes:

  • comprehension – how does the respondent understand the question?
  • recall – what knowledge or memory do they select that is relevant to the subject matter?
  • judgement – how do they judge the completeness and relevance of what they remember?
  • selection of response –how do they then decide whether their answer fits and whether or not they actually want to provide that answer?

Adult survey 2012/13

Face-to-face cognitive interviews were conducted to pre-test eight new questions included in the 2012/13 module change to the adult version of the New Zealand Health Survey.

Table 1: Questions from the 2012/13 Adult NZHS Survey cognitively tested

1 / In the last 12months, how often did you drink alcohol at [a particular place] and how frequently?
2 / What types of alcohol would you usually drink on this typical occasion at [a particular place] and how much?
3 / Have you ever had more than [six/four] drinks on one occasion? [men are asked about six drinks; women are asked about four drinks]
4 / About how old were you the first time you had more than [six/four] drinks on one occasion?
5 / How often in the last 12months have you had more than [six/four] drinks on one occasion?
6 / During the last 12months, on those occasions when you drank more than [six/four] drinks, where did you drink?
7 / What is the largest number of drinks you can recall having on one occasion during the last 12months?
8 / About how often during the last 12months did you drink [largest amount] drinks on one occasion?

As part of the testing, surveyors’ and participants’ use of visual aids intended to assist the reporting of alcohol volume intake was observed. Risky drinking and maximum drinking occasion questions were tested without and then with the associated visual aids. Surveyors’ use of grid tables to record alcohol occasions, frequency and volume of intake was also observed. In addition, computer assisted telephone interviewing was carried out to test an additional 25questions for inclusion in the module. Trained interviewers were used to test the approach described above.

Child survey 2012/13

A sample of parents/caregivers were sent the Strengths and Difficulties Questionnaire (SDQ) and the Parents’ Evaluation of Developmental Status (PEDS) self-completion tool, along with an invitation to complete and return the questionnaires. Parents were asked to keep a copy of the completed questionnaires. CBG[1] interviewers then invited participants to take part in a followup computer-assisted telephone interview.

During the interview, parents discussed the completion of the questionnaires. All parents understood the SDQ and PEDS questionnaires, and no questions were highlighted as problematic. Note that it is not possible to change questions from licensed instruments such as the SDQ and PEDS, but cognitive testing is done to highlight potential issues to be addressed in interviewer training.

During the telephone follow-up, six new questions from the child module were also tested with a sample of the parents. Following cognitive testing, one minor amendment was made to the following question from the US National Survey of Children’s Health 2007. The original question read:

Is there someone that you can turn to for day-to-day emotional help with [parenthood/raising children]?

This question was amended to:

Is there someone that you can turn to for day-to-day emotional support with raising children? This can be any person, including your husband or wife or partner.

All changes to questions are signalled in the tables in appendices 1 and 2.

Pilot testing

The main objective of pilot testing was to check the flow and timing of the questionnaires. The child and adult questionnaires were entered into the survey CAPI software and systematically checked in preparation for pilot testing. The questionnaires were pilot tested on approximately 100participants from different age, sex and ethnic groups.

Ethics approval

The Multi-region Ethics Committee provided approval of the NZHS 2012/13 (Multi-region Ethics Committee Reference: MEC/10/10/103).

Content of the New Zealand Health Survey

The 2012/13 adult and child questionnaires included the following sections:

  • long-term conditions
  • health service utilisation and patient experience
  • health behaviours
  • health status
  • sociodemographics
  • anthropometric measurements
  • exit.

Core questions were included under each of these sections. The adult questionnaire in 2012/13 included tobacco, alcohol and drug-use modules. An outline of the content of each section is provided below.

In 2012/13 the developmental health and wellbeing section in the child questionnaire included two standardised instruments: the Parents’ Evaluation of Developmental Status (PEDS) and the Strengths and Difficulties Questionnaire (SDQ).

For details of each question, including its response options and source, see appendices 1 and 2.

Long-term health conditions

Long-term health conditions cover any ongoing or recurring health problem, including physical and mental illness, which has a significant impact on the life of a person and/or the lives of family, whānau or other carers. These are conditions generally not cured once acquired. For the purposes of monitoring population health, a long-term health condition is defined in the NZHS as a doctor-diagnosed health condition that has lasted, or is expected to last, for more than six months.

This section collects information on the prevalence of major long-term conditions (see Table 2) as well as treatments for these conditions.

Table 2: 2012/13 NZHS long-term health conditions: core topics

Adult / Child
Heart disease
Stroke
Diabetes
Asthma
Arthritis
Mental health conditions
Chronic pain
Oral health / Asthma
Eczema
Diabetes
Rheumatic heart disease
Autism spectrum disorder
Depression
Anxiety disorder
Attention deficit disorder or attention deficit hyperactivity disorder
Oral health

Health service utilisation and patient experience

The use of appropriate and effective health care services is an important determinant of population health. Areas of interest include the frequency of health care contact, the range and comprehensiveness of services, their accessibility, availability and affordability, and the continuity and coordination of care.

Patient experience includes the processes or events that occur (or do not occur) in the course of a specific episode of care. It addresses the interpersonal aspects of care: the interaction between health professionals and health care users. Examples include communication skills, the building of trust, the discussion and explanation of symptoms, and the involvement of patients in decisions about treatment and care.