Cross-National Bias in Questionnaires: Supplementary Material

Cross-national bias in questionnaires: Supplementary Material1

Cross-national bias in questionnaires: Supplementary material

Table 1: British SDQ prevalence estimators for the parent, teacher and youth SDQ

Proportion of individuals with a disorder: for percent, multiply by 100
Parent / 1 /( 1 + exp( - [(0.303*TDS) + (0.539* p(Old)) - 5.102 ] ))
Teacher / 1 /( 1 + exp( - [(0.394*TDS) + (0.450* p(Old)) + (0.411* p(Fem)) - 5.313] ))
Youth / 1 / (1 + exp( - [(0.524*TDS) - (0.220* p(Fem)) -7.419] ))

exp=exponential; TDS=total difficulty score;p(Old)=proportion of sample aged 11-16 (vs. 5-10); p(Fem)=proportion of sample female. Published in Goodman, A. and R. Goodman, Population mean scores predict child mental disorder rates: validating SDQ prevalence estimators in Britain.JCPP, 2011. 52(1): p. 100-108.

Table 2: Parent SDQ measures and prevalence of disorder: data from seven countries

Country / Subpopulation / N / Parent SDQ / DAWBA
Mean SDQ total difficulty score (95% CI) / Estimated prevalence (%) disorder from SDQ (95% CI) / Percent of SDQ symptoms+impact (95% CI) / Percent with ‘definite’ or ‘severe’ difficulties (95% CI) / Measured prevalence (%) of disorder from DAWBA (95% CI) / Discrepancy (%) estimated minus measured prevalence
Britain / Deprivation decile 1 (low) / 1,791 / 6.8 (6.5, 7.1) / 5.8 (5.3, 6.2) / 4.7 (3.8, 5.9) / 6.8 (5.8, 8.0) / 5.7 (4.8, 6.9) / 0.1
Deprivation decile 2 / 1,843 / 7.0 (6.7, 7.3) / 6.1 (5.6, 6.6) / 5.4 (4.4, 6.5) / 6.1 (5.1, 7.2) / 6.9 (5.8, 8.2) / -0.8
Deprivation decile 3 / 1,806 / 7.3 (7.0, 7.5) / 6.7 (6.2, 7.2) / 6.2 (5.2, 7.5) / 7.4 (6.3, 8.7) / 6.2 (5.2, 7.3) / 0.5
Deprivation decile 4 / 1,830 / 7.8 (7.5, 8.1) / 7.6 (7.0, 8.2) / 7.1 (6.1, 8.3) / 7.3 (6.1, 8.7) / 8.2 (6.9, 9.6) / -0.6
Deprivation decile 5 / 1,821 / 7.7 (7.4, 8.0) / 7.5 (6.9, 8.1) / 6.4 (5.4, 7.7) / 7.1 (5.9, 8.5) / 9.0 (7.8, 10.3) / -1.5
Deprivation decile 6 / 1,821 / 8.0 (7.8, 8.3) / 8.2 (7.6, 8.8) / 6.3 (5.3, 7.4) / 7.1 (6.1, 8.2) / 8.8 (7.5, 10.2) / -0.6
Deprivation decile 7 / 1,818 / 8.9 (8.6, 9.3) / 10.5 (9.5, 11.5) / 8.9 (7.6, 10.5) / 10.2 (8.7, 11.8) / 12.3 (10.8, 14.0) / -1.8
Deprivation decile 8 / 1,819 / 9.2 (8.9, 9.5) / 11.3 (10.4, 12.2) / 9.6 (8.3, 11.2) / 10.9 (9.5, 12.5) / 11.4 (9.8, 13.2) / -0.1
Deprivation decile 9 / 1,813 / 9.6 (9.3, 9.9) / 12.3 (11.4, 13.4) / 9.5 (8.2, 10.9) / 9.5 (8.2, 11.1) / 12.2 (10.8, 13.9) / 0.1
Deprivation decile 10 (high) / 1,828 / 9.9 (9.6, 10.2) / 13.3 (12.2, 14.4) / 8.9 (7.6, 10.4) / 9.7 (8.3, 11.1) / 13.5 (11.9, 15.4) / -0.2
Norway / 6,658 / 5.9 (5.8, 6.0) / 3.5 (3.4, 3.6) / 2.6 (2.3, 3.1) / 4.0 (3.6, 4.5) / 6.1 (4.9, 7.6) / -2.6
Brazil / Middle class (Southeast) / 236 / 9.1 (8.3, 9.9) / 10.7 (8.6, 13.3) / 9.8 (6.8, 13.7) / 30.5 (27.9, 33.2) / 5.9 (3.7, 9.5) / 4.8
Rural (Southeast) / 264 / 10.2 (8.2, 12.1) / 14.6 (8.6, 23.7) / 11.4 (5.8, 21.1) / 22.7 (15.2, 32.5) / 11.4 (7.6, 16.6) / 3.2
Urban slum (Southeast) / 745 / 11.8 (10.8, 12.8) / 22.2 (17.4, 27.9) / 15.8 (14.0, 17.9) / 33.6 (30.3, 37.0) / 14.0 (10.9, 17.7) / 8.2
Quilombo (Northeast) / 430 / 14.5 (13.9, 15.2) / 38.9 (34.2, 43.8) / 1.1 (0.7, 2.0) / 3.5 (2.1, 5.7) / 7.1 (3.6, 13.5) / 31.8
India (Goa) / 1,169 / 4.5 (4.3, 4.7) / 3.9 (3.7, 4.2) / 0.26 (0.05, 0.7) / 0.17 (0.02, 0.06) / 2.2 (1.5, 3.2) / 1.7
Yemen / Urban / 1,007 / 12.7 (12.4, 13.1) / 22.3 (20.5, 24.3) / 8.6 (7.0, 10.5) / 6.9 (5.4, 8.6) / 16.1 (11.7, 21.8) / -3.4
Rural / 203 / 18.2 (17.4, 18.9) / 59.9 (54.5, 65.1) / 34.4 (28.0, 41.4) / 23.1 (17.5, 30.0) / 15.3 (10.9, 20.9) / 2.9
Bangladesh / 922 / 14.3 (13.9, 14.7) / 31.7 (29.4, 34.1) / 5.8 (4.4, 7.5) / 5.1 (3.9, 6.7) / 15.2 (10.9, 20.8) / 16.5
Russia / 447 / 13.2 (10.8, 15.6) / 30.6 (17.5, 47.7) / 18.9 (7.7, 39.4) / 27.8 (14.2, 47.3) / 17.1 (10.1, 24.2) / 13.5

Table 3: Teacher SDQ measures and prevalence of disorder: data from sixcountries

Country / Subpopulation / N / Teacher SDQ / DAWBA
Mean SDQ total difficulty score (95% CI) / Estimated prevalence (%) disorder from SDQ (95% CI) / Percent of SDQ symptoms+impact (95% CI) / Percent with ‘definite’ or ‘severe’ difficulties (95% CI) / Measured prevalence (%) of disorder from DAWBA (95% CI)† / Discrepancy (%) estimated minus measured prevalence
Britain / Deprivation decile 1 (low) / 1,436 / 5.5 (5.2, 5.7) / 6.0 (5.5, 6.7) / 5.8 (4.8, 7.0) / 7.5 (6.2, 8.9) / 5.9 (4.8, 7.3) / 0.1
Deprivation decile 2 / 1,510 / 5.4 (5.1, 5.7) / 5.9 (5.3, 6.6) / 6.0 (4.8, 7.4) / 7.4 (6.0, 9.0) / 7.0 (5.7, 8.5) / -1.1
Deprivation decile 3 / 1,469 / 5.6 (5.3, 5.9) / 6.4 (5.8, 7.0) / 7.2 (6.0, 8.7) / 8.9 (7.4, 10.5) / 5.9 (4.8, 7.3) / 0.5
Deprivation decile 4 / 1,493 / 6.2 (5.9, 6.5) / 7.8 (6.9, 8.8) / 8.0 (6.7, 9.5) / 9.8 (8.4, 11.4) / 8.0 (6.7, 9.7) / -0.2
Deprivation decile 5 / 1,429 / 6.3 (6.0, 6.6) / 8.1 (7.2, 9.1) / 8.2 (6.8, 9.9) / 9.9 (8.5, 11.5) / 8.7 (7.4, 10.3) / -0.6
Deprivation decile 6 / 1,410 / 6.7 (6.3, 7.0) / 9.4 (8.3, 10.7) / 9.8 (8.2, 11.7) / 11.6 (10.0, 13.4) / 9.1 (7.6, 10.8) / 0.3
Deprivation decile 7 / 1,429 / 7.0 (6.6, 7.3) / 10.3 (9.1, 11.7) / 10.8 (9.3, 12.6) / 13.8 (12.0, 15.8) / 12.1 (10.4, 13.9) / -1.8
Deprivation decile 8 / 1,390 / 7.2 (6.8, 7.5) / 11.1 (9.8, 12.5) / 10.8 (9.3, 12.5) / 14.4 (12.6, 16.4) / 11.4 (9.7, 13.3) / -0.3
Deprivation decile 9 / 1,300 / 7.6 (7.3, 8.0) / 12.8 (11.4, 14.4) / 11.8 (10.2, 13.7) / 16.1 (14.2, 18.2) / 13.2 (11.4, 15.1) / -0.4
Deprivation decile 10 (high) / 1,297 / 8.1 (7.7, 8.4) / 15.0 (13.3, 16.9) / 14.4 (12.5, 16.5) / 17.8 (15.6, 20.3) / 14.5 (12.5, 16.9) / 0.5
Norway / 6184 / 4.1 (4.0, 4.2) / 3.0 (2.8, 3.1) / 4.2 (3.7, 4.8) / 7.5 (6.9, 8.2) / 6.1 (4.8, 7.6) / -3.1
Brazil / Middle class (Southeast) / 234 / 5.8 (5.5, 6.2) / 6.8 (6.0, 7.7) / 2.2 (1.0, 4.9) / 7.5 (3.4, 15.6) / 6.0 (3.7, 9.6) / 0.8
Rural (Southeast) / 256 / 7.2 (6.0, 8.4) / 11.4 (7.5, 16.9) / 5.2 (3.1, 8.7) / 6.0 (4.1, 8.8) / 11.3 (7.5, 16.7) / 0.1
Urban slum (Southeast) / 690 / 8.7 (7.9, 9.5) / 18.7 (14.3, 24.1) / 8.2 (5.7, 11.5) / 12.9 (9.9, 16.7) / 14.4 (11.2, 18.2) / 4.3
Quilombo (Northeast) / 406 / 10.0 (9.4, 10.6) / 27.7 (23.4, 32.5) / 1.7 (0.9, 3.2) / 4.1 (2.5, 6.6) / 7.4 (3.7, 14.2) / 20.3
Yemen / Urban / 1,007 / 11.1 (10.7, 11.5) / 32.3 (29.2, 35.7) / 10.9 (9.1, 13.0) / 8.3 (6.6, 10.2) / 16.1 (11.7, 21.8) / 16.2
Rural / 203 / 11.3 (10.6, 12.0) / 34.5 (28.6, 40.8) / 7.4 (4.2, 11.9) / 11.3 (7.3, 16.5) / 15.3 (10.9, 20.9) / 19.2
Bangladesh / 759 / 11.5 (11.1, 11.9) / 35.8 (32.5, 39.2) / 4.4 (3.2, 6.1) / 6.9 (5.3, 8.9) / 15.5 (10.9, 21.6) / 20.3
Russia / 438 / 12.2 (8.3, 16.1) / 48.6 (16.9, 81.4) / 13.2 (7.1, 23.3) / 21.5 (11.8, 36.1) / 17.1 (10.2, 24.2) / 36.4

†Estimates based only on children with teacher SDQ data, and are therefore slightly different to the figures in Table 2

Table 4: Youth SDQ measures and prevalence of disorder: data from fourcountries

Country / Subpopulation / N / Youth SDQ / DAWBA
Mean SDQ total difficulty score (95% CI) / Estimated prevalence (%) disorder from SDQ (95% CI) / Percent of SDQ symptoms+impact (95% CI) / Percent with ‘definite’ or ‘severe’ difficulties (95% CI) / Measured prevalence (%) of disorder from DAWBA (95% CI)† / Discrepancy (%) estimated minus measured prevalence
Britain / Deprivation decile 1 (low) / 779 / 9.6 (9.1, 10.0) / 7.5 (6.1, 9.2) / 2.9 (1.9, 4.4) / 4.9 (3.5, 6.7) / 6.1 (4.6, 8.0) / 1.4
Deprivation decile 2 / 805 / 9.7 (9.3, 10.0) / 7.8 (6.6, 9.2) / 3.6 (2.4, 5.3) / 4.2 (2.9, 6.0) / 7.8 (6.0, 10.1) / 0
Deprivation decile 3 / 806 / 9.8 (9.5, 10.2) / 8.5 (7.2, 10.1) / 3.8 (2.8, 5.3) / 5.6 (4.1, 7.6) / 6.6 (5.0, 8.7) / 1.9
Deprivation decile 4 / 767 / 9.9 (9.5, 10.2) / 8.6 (7.4, 10.1) / 4.1 (3.0, 5.8) / 6.1 (4.6, 8.2) / 8.2 (6.5, 10.4) / 0.4
Deprivation decile 5 / 760 / 10.0 (9.6, 10.4) / 9.3 (7.8, 11.2) / 4.6 (3.2, 6.5) / 5.5 (4.1, 7.4) / 9.6 (7.7, 11.9) / -0.3
Deprivation decile 6 / 769 / 10.4 (10.0, 10.8) / 11.1 (9.2, 13.2) / 4.2 (3.0, 6.0) / 4.8 (3.4, 6.6) / 10.3 (8.2, 12.8) / 0.8
Deprivation decile 7 / 753 / 10.5 (10.1, 10.9) / 11.6 (9.6, 13.9) / 5.7 (4.2, 7.7) / 6.2 (4.6, 8.4) / 14.0 (11.5, 17.0) / -2.4
Deprivation decile 8 / 743 / 10.7 (10.2, 11.1) / 12.5 (10.1, 15.3) / 4.8 (3.4, 6.8) / 6.1 (4.6, 8.1) / 12.4 (9.9, 15.3) / 0.1
Deprivation decile 9 / 689 / 10.7 (10.3, 11.1) / 12.8 (10.6, 15.4) / 4.9 (3.5, 6.8) / 7.1 (5.4, 9.3) / 13.9 (11.3, 17.0) / -1.1
Deprivation decile 10 (high) / 671 / 10.8 (10.3, 11.2) / 13.2 (10.7, 16.1) / 4.4 (3.2, 6.1) / 7.0 (5.5, 9.0) / 14.3 (11.3, 17.8) / -1.1
Brazil / Middle class (Southeast) / 99 / 9.3 (7.3, 11.4) / 6.7 (2.4, 17.4) / 5.1 (2.4, 10.5) / 19.2 (12.1, 29.2) / 8.1 (5.7, 11.4) / -1.4
Rural (Southeast) / 125 / 10.8 (9.4, 12.1) / 13.2 (7.0, 23.6) / 4.8 (1.8, 12.5) / 13.7 (7.2, 24.6) / 13.6 (5.9, 28.3) / -0.4
Urban slum (Southeast) / 388 / 11.8 (10.8, 12.9) / 20.9 (13.2, 31.5) / 7.2 (5.4, 9.6) / 18.3 (14.7, 22.5) / 13.4 (9.2, 19.1) / 7.5
Quilombo (Northeast) / 91 / 12.6 (11.7, 13.5) / 27.9 (19.4, 38.4) / 1.2 (0.4, 3.5) / 5.2 (2.7, 9.7) / 10.4 (4.1, 24.1) / 17.5
India (Goa) / 1,158 / 4.5 (4.3, 4.7) / 0.6 (0.5, .0.6) / Zero cases / 0.08 (0.002, 0.5) / 2.2 (1.4, 3.2) / -1.6
Russia / 218 / 11.8 (9.8, 13.8) / 20.6 (8.4, 42.4) / 4.0 (1.8, 8.5) / 9.1 (3.5, 21.6) / 17.2 (10.1, 24.4) / 8.8

†Estimates based only on children with youth SDQ data, and are therefore slightly different to the figures in Table 2

Table 5: Prevalence of emotional, behavioural, hyperactivity and any disorder: data from seven countries

Country / N / Measured prevalence (%) of disorder from DAWBA (95% CI) / Proportion (%) out of children with any disorder
Emotional disorders / Behavioural disorders / Hyperactivity disorders / All disorders / Emotional disorders / Behavioural disorders / Hyperactivity disorders
Britain / 18,190 / 4.0 (3.7, 4.3) / 5.0 (4.7, 5.4) / 2.2 (2.0, 2.5) / 9.4 (9.0, 9.9) / 43 / 53 / 23
Norway / 6,658 / 3.2 (2.2, 4.7) / 2.5 (1.9, 3.1) / 1.3 (0.9, 1.8) / 6.1 (4.9, 7.6) / 52 / 41 / 21
South-East Brazil / 1,245 / 6.2 (4.6, 8.3) / 6.2 (4.9, 7.8) / 1.5 (0.9, 2.5) / 11.9 (9.7, 14.5) / 52 / 52 / 13
South-East Brazil / 430 / 3.7 (1.4, 9.0) / 3.4 (1.3, 8.9) / 0.9 (0.3, 2.6) / 7.1 (3.6, 13.5) / 52 / 48 / 13
India (Goa) / 1,169 / 1.3 (0.6, 1.9) / 0.7 (0.2, 1.2) / 0.3 (0.0, 0.7) / 2.2 (1.4, 3.1) / 59 / 32 / 14
Yemen / 1,210 / 9.5 (6.5, 13.6) / 7.1 (4.8, 10.4) / 1.3 (0.5, 3.2) / 16.0 (12.1, 20.7) / 59 / 44 / 8
Bangladesh / 922 / 8.1 (5.1, 12.7) / 8.8 (5.6, 13.6) / 2.6 (1.3, 5.3) / 15.2 (10.9, 20.8) / 53 / 58 / 17
Russia / 447 / 9.0 (5.3, 14.7) / 8.1 (6.0, 11.0) / 3.8 (2.0, 7.0) / 17.1 (11.2, 25.4) / 53 / 47 / 22
RANGE / 430-18,190 / 1.3-9.5% / 0.7-8.8% / 0.3-3.8% / 2.2-17.1% / 43-59% / 32-58% / 8-23%

Table 6: R2 values comparing SDQ measures to the DAWBA prevalence, stratified by ages.

R2 ages 5-16 (shown in Figures 1-3) / R2 ages 5-10 only / R2 ages 11 to 16 only
Parent SDQ / SDQ prevalence estimator / 0.28 / 0.25 / -0.07
Symptoms+impact / 0.37 / 0.36 / 0.55
'Definite/severe' difficulties / 0.14 / 0.11 / 0.11
Teacher SDQ / SDQ prevalence estimator / 0.56 / 0.55 / 0.48
Symptoms+impact / 0.32 / 0.43 / 0.56
'Definite/severe' difficulties / 0.30 / 0.47 / 0.50

Figure 1: Estimated prevalence of disorder from teacher and youth SDQ versus mean SDQ impact score, stratified by disorder status

Bang=Bangladesh; Br,mc=Brazil, middle class; Br,r=Brazil, rural; Br,sl=Brazil, urban slum; Br,q=Brazil, quilombo; Ind = India; Rus=RussiaNor=Norway, Y,u = Yemen, urban; Y,r = Yemen, rural; Unlabelled points=Great Britain