Pre and Post Test Data Summary for ECEPD Grant
Table 1
Participant Classrooms whose Early Childhood Educators Participated
In Fall 2005 through Spring 2007
Pre-Test Fall: 2005 / Post-Test: 2007 / T-Test / Effect SizeAssessment / n / Mean / SD / n / Mean / SD
ELLCO
Literacy Envir. Checklist / 24 / 21.25 / 6.16 / 24 / 26.50 / 7.18 / P = 0.0092 / 0.79
Classroom Observation: total / 24 / 42.42 / 7.0 / 24 / 53.96 / 6.05 / P = 0.0000 / 1.77
Classroom Observation: avg / 24 / 3.03 / .50 / 24 / 3.85 / .43 / P = 0.0000 / 1.76
Lit Activities Rating scale / 24 / 6.54 / 3.37 / 24 / 6.54 / 3.40 / P = 1.0000 / 0
ECERS
Grand Total / 24 / 198.25 / 24.68 / 24 / 211.67 / 19.53 / P = 0.0423 / .61
Grand Total Avg / 24 / 4.78 / .61 / 24 / 5.049 / .46 / P = 0.0913 / .50
Early Childhood Competency Classroom Checklist *(n reflects individual educator scores)
Total / *61 / 1.92 / .988 / 60 / 2.87 / 1.016 / P = 0.000 / .94
+ Note: Response rates were 100%.
Table 2
Comparison Classrooms whose Early Childhood Educators were Assessed
in Fall 2005 through Spring 2007
Pre-Test Fall: 2005 / Post-Test: 2007 / T-Test / Effect SizeAssessment / n / Mean / SD / n / Mean / SD
ELLCO
Literacy Envir. Checklist / 7 / 23.71 / 9.142 / 7 / 25.57 / 7.04 / P = 0.6773 / .23
Classroom Observation: total / 7 / 46.71 / 13.62 / 7 / 56.43 / 7.93 / P = 0.1287 / .90
Classroom Observation: avg / 7 / 3.42 / .9143 / 7 / 4.05 / .58 / P = 0.1496 / .84
Lit Activities Rating scale / 7 / 6.86 / 2.80 / 7 / 8.71 / 3.50 / P = 0.2963 / .59
ECERS
Grand Total / 7 / 203.71 / 36.79 / 7 / 212.71 / 27.31 / P = 0.6127 / .28
Grand Total Avg / 7 / 4.97 / .90 / 7 / 5.11 / .63 / P = 0.7418 / .18
+ Note: Response rates were 100%
Table 3
Participant and Non-Participant Classrooms Whose Early Childhood Educators Were Assessed in Fall 2005 through Spring 2007
Participant Group / Comparison Group / T-Test / Effect SizeAssessment / n / Mean / SD / n / Mean / SD
ELLCO
Literacy Envir. Checklist F05
S07 / 24
24 / 21.25
26.50 / 6.15
7.18 / 7
7 / 23.71
25.57 / 9.14
7.04 / P = 0.5086
P = 0.7617 / -0.32
.13
Classroom Observ: Total score F05
S07 / 24
24 / 42.42
53.96 / 7.00
6.05 / 7
7 / 46.71
56.43 / 13.62
7.93 / P = 0.4285
P = 0.4522 / -0.42
-0.35
Classroom Observ:
Avg F05
S07 / 24
24 / 3.03
3.86 / .50
.43 / 7
7 / 3.42
4.05 / .91
.58 / P = 0.2860
P = 0.4276 / -0.55
-0.38
Lit Activities Rating scale F05
S07 / 24
24 / 6.54
6.54 / 3.36
3.40 / 7
7 / 6.86
8.71 / 2.80
3.50 / P = 0.8015
P = 0.1571 / -0.10
-0.63
ECERS
Grand Total F05
S07 / 24
24 / 198.25
211.67 / 24.68
19.53 / 7
7 / 203.71
212.71 / 36.79
27.31 / P = 0.7147
P = 0.9258 / -0.18
-0.04
Grand Avg F05
S07 / 24
24 / 4.78
5.05 / .61
.46 / 7
7 / 4.97
5.11 / .90
.63 / P = 0.6039
P = 0.8163 / -0.25
-0.11
+ Note: Response rates were 100%
Table 4
Participant Group Children Who Were Enrolled in Fall 2005 through Spring 2007
and Completed at Least One Test in Both Fall 2005 and Spring 2007.
N57 / Pre-Test Fall: 2005 / Post-Test: 2007 / T-Test / Effect SizeAssessment / n / Resp. Rate / Mean / SD / n / Resp. Rate / Mean / SD / (P value)
Brigance 3
Total Score / 46 / 100% / 54.76 / 22.17 / -- / -- / -- / --- / --
Percentile / 43 / 93% / 40.21 / 30.79 / -- / -- / -- / -- / --
Brigance 4
Total Score / 7 / 100% / 50.00 / 26.55 / -- / -- / -- / -- / --
Percentile / 7 / 100% / 36.00 / 27.10 / -- / -- / -- / -- / --
Brigance 4
Total Score / -- / -- / -- / -- / 41 / 91% / 74.44 / 14.70 / -- / --
Percentile / -- / -- / -- / -- / 41 / 91% / 47.88 / 26.55 / -- / --
Brigance 5
Total Score / -- / -- / -- / -- / 9 / 100% / 61.44 / 14.46 / -- / --
Percentile / -- / -- / -- / -- / 9 / 100% / 48.00 / 20.88 / -- / --
PPVT
Raw Score / 48 / 91% / 22.00 / 14.14 / 54 / 100% / 47.65 / 16.97 / P = 0.0000 / 1.65
Standard Score / 48 / 91% / 75.71 / 18.27 / 54 / 100% / 88.06 / 14.25 / P = 0.0003 / .76
Percentile / 48 / 91% / 16.61 / 20.17 / 54 / 100% / 29.74 / 26.19 / P = 0.0053 / .57
Stanine / 48 / 91% / 2.53 / 1.68 / 54 / 100% / 4.48 / 6.11 / P = 0.0265 / .50
G3
Picture Naming / 46 / 87% / .13 / 6.60 / 54 / 100% / 25.02 / 5.91 / P = 0.0000 / 1.92
Rhyming / 46 / 87% / .30 / 1.50 / 54 / 100% / 4.13 / 7.72 / P = 0.0000 / 2.99
Alliteration / 46 / 87% / .22 / .66 / 54 / 100% / .63 / 2.10 / P = 0.1778 / .30
PALS PreK
Uppercase / 26 / 49%* / .27 / 1.00 / 54 / 100% / 12.89 / 9.73 / P = 0.0000 / .48
Lowercase / 26 / 49%* / 0.00 / 0.00 / 54 / 100% / 7.44 / 9.64 / P = 0.0000 / 1.54
*The Evaluation Team believed only 26 of the children showed enough ability to recognized individual letters to take the test; so the test was not given to the others (rather than letting them fail and recording a score), thereby affecting the response rate.
Table 5
Comparison Group Children Only Who Were Enrolled in Fall 2005 Through Spring 2007 and Completed at Least One Test in Both Fall 2005 and Spring 2007.
N14 / Pre-Test Fall: 2005 / Post-Test: 2007 / T-Test / Effect SizeAssessment / n / Resp.
Rate / Mean / SD / n / Resp. Rate / Mean / SD
Brigance 3
Total Score / 10 / 100% / 59.80 / 18.38 / -- / -- / -- / -- / -- / --
Percentile / 8 / 80% / 36.87 / 36.72 / -- / -- / -- / -- / -- / --
Brigance 4
Total Score / 4 / 100% / 72.50 / 11.12 / -- / -- / -- / -- / -- / --
Percentile / 4 / 100% / 57.00 / 12.08 / -- / -- / -- / -- / -- / --
Brigance 4
Total Score / -- / -- / -- / -- / 4 / 100% / 66.63 / 20.77 / -- / --
Percentile / -- / -- / -- / -- / 4 / 100% / 36.50 / 37.90 / -- / --
Brigance K
Total Score / -- / -- / -- / -- / 10 / 100% / 60.40 / 21.19 / -- / --
Percentile / -- / -- / -- / -- / 10 / 100% / 49.10 / 31.27 / -- / --
PPVT
Raw Score / 13 / 93% / 33.38 / 23.88 / 10 / 71% / 59.9 / 23.24 / P = 0.0140 / 1.11
Standard Score / 13 / 93% / 82.31 / 22.18 / 10 / 71% / 96.1 / 18.83 / P = 0.1222 / .67
Percentile / 12 / 86% / 28.92 / 31.93 / 10 / 71% / 43.7 / 36.46 / P = 0.3287 / .44
Stanine / 13 / 93% / 3.31 / 2.43 / 10 / 71% / 10.8 / 18.50 / P = 0.2719 / .72
G3
Picture Naming / 14 / 100% / 19.00 / 8.55 / 10 / 71% / 30.30 / 5.14 / P = 0.0006 / 3.18
Rhyming / 14 / 100% / 0.00 / 0.00 / 10 / 71% / 3.70 / 6.53 / P = 0.0869 / 1.13
Alliteration / 14 / 100% / .14 / .535 / 10 / 71% / 0.00 / 0.00 / P = 0.3382 / -.52
PALS PreK
Uppercase / 13 / 93% / 5.62 / 8.44 / 10 / 71% / 11.4 / 11.54 / P = 0.1968 / .58
Lowercase / 12 / 86% / 2.75 / 6.84 / 10 / 71% / 8.0 / 10.34 / P = 0.1845 / .61
Table 6
Comparison of Children From Participating and Nonparticipating Educators in Fall 2005 Through Spring 2007 and Completed at Least One Test in both Fall 2005 and Spring 2007.
Participant Group / Comparison Group / T-Test / Effect SizeAssessment / n / Resp. Rate / Mean / SD / n / Resp Rate / Mean / SD / (P value)
Brigance 3
Total Score F05 / 46 / 100% / 54.76 / 22.17 / 10 / 100% / 59.80 / 18.38 / P = 0.4531 / -0.25
Percentile F05 / 43 / 93% / 40.21 / 30.79 / 8 / 80% / 36.87 / 36.72 / P = 0.8098 / 0.10
Brigance 4
Total Score F05 / 7 / 100% / 50.00 / 26.55 / 4 / 100% / 72.50 / 11.12 / P = 0.0815 / -1.20
Percentile F05 / 7 / 100% / 36.00 / 27.10 / 4 / 100% / 57.00 / 12.08 / P = 0.1112 / -1.07
Brigance 4
Total Score S07 / 41 / 91% / 74.44 / 14.70 / 4 / 100% / 66.63 / 20.77 / P = 0.2671 / .44
Percentile S07 / 41 / 91% / 47.88 / 26.55 / 4 / 100% / 36.50 / 37.90 / P = 0.3739 / .35
Brigance K
Total Score S07 / 9 / 100% / 61.44 / 14.46 / 10 / 100% / 60.40 / 21.19 / P = 0.9012 / .06
Percentile S07 / 9 / 100% / 48.00 / 20.88 / 10 / 100% / 49.10 / 31.27 / P = 0.9286 / -.04
PPVT
Raw Score F05
S07 / 48
54 / 91%
100% / 22.00
47.65 / 14.14
16.97 / 13
10 / 93%
71% / 33.38
59.90 / 23.88
23.24 / P = 0.1059
P = 0.3503 / -0.60
-0.61
Stand ScoreF05
S07 / 48
54 / 91%
100% / 75.71
88.06 / 18.27
14.25 / 13
10 / 93%
71% / 82.31
96.10 / 22.18
18.83 / P = 0.3281
P = 0.2040 / -0.33
-0.49
Percentile F05
S07 / 48
54 / 91%
100% / 16.61
29.74 / 20.17
26.19 / 12
10 / 86%
71% / 28.92
43.70 / 31.93
36.46 / P = 0.2079
P = 0.2518 / -0.47
-0.45
Stanine F05
S07 / 48
54 / 91%
100% / 2.53
4.48 / 1.68
6.11 / 13
10 / 93%
71% / 3.31
10.8 / 2.43
18.50 / P = 0.2806
P = 0.2890 / -0.38
-0.51
G3
Pict Name F05
S07 / 46
54 / 87%
100% / 13.00
25.02 / 6.60
5.91 / 14
10 / 100%
71% / 19.00
30.30 / 8.55
5.14 / P = 0.0189
P = 0.0696 / -0.79
-0.96
Rhyming F05
S07 / 46
54 / 87%
100% / .30
4.13 / 1.50
7.72 / 14
10 / 100%
71% / 0.00
3.70 / 0.00
6.53 / P = 0.1802
P = 0.0392 / .40
.06
Alliteration F05
S07 / 46
54 / 87%
100% / .22
.63 / .66
2.10 / 14
10 / 100%
71% / .14
0.00 / .54
0.00 / P = 0.6475
P = 0.3120 / 1.33
.60
PALS PreK
Uppercase F05
S07 / 26
54 / 49%
100% / .27
12.89 / 1.00
9.73 / 13
10 / 93%
71% / 5.62
11.40 / 8.44
11.54 / P = 0.0286
P = 0.7024 / -1.13
0.11
Lowercase F05
S07 / 26
54 / 49%
100% / 0.00
7.44 / 0.00
9.64 / 12
10 / 86%
71% / 2.75
8.00 / 6.84
10.34 / P = 0.1722
P = 0.8742 / -0.80
-0.06