FY17 Summative Evaluation Report
Regarding
Pulaski County
21st Century Community Learning Centers Grant
June 2017
Prepared by:
Norris Consulting Group, Inc.
(External Evaluator)
Post Office Box 8332
Warner Robins, GA 31095
Phone 478.923.2955
Fax 478.923.2956
Table of Contents
I.Overview and History
II.Student Attendance and Enrollment
III.Program Operation
IV.Quality of Staffing
V.Objective Assessment
VI.Other Observations...... 17
VII.Progress Towards Sustainability...... 20
VIII.Overall Recommendations
Appendices
Appendix A: Data Tables by Site
Appendix B: Annual Student Satisfaction Survey...... 28
Appendix C: Annual Family Satisfaction Survey
Appendix D: Annual Staff Satisfaction Survey...... 34
Appendix E: Focus Group Summary...... 40
Appendix F: Classroom Teacher Survey...... 45
Appendix G: Quarterly Worksheets...... 48
Pulaski County 21st Century Community Learning Centers Grant
Summative Evaluation Report
I.Overview and History
The Pulaski County Board of Education received funding to support the Pulaski County Schools 21st CCLC Initiative. The target population is 133 at-risk students and their families. We are providing these services at three sites – Pulaski County Elementary School, Pulaski County Middle School and Hawkinsville High School during the regular school year and during the summer.
Activities selected to address our proposed outcomes include: academic remediation and enrichment, art, character education, drug and violence prevention, technological activities and tutoring services. Also included in the program is an increased emphasis on family/parental involvement, recreation activities and family literacy services.
II.Student Attendance and Enrollment
Number of Students EnrolledAfter School Program
2016 – 2017 School Year
Site / Number Enrolled / Percent of Total
Pulaski Elementary / 87 / 50%
Pulaski Middle / 46 / 26%
Hawkinsville High / 41 / 24%
Total / 174 / 100%
The Initiative served a total of 174 students during the 2016-2017 school year. Sessions began September 12, 2016 at all sites. The sessions ended on March 31, 2017at the elementary, middle, and high school sites.
Number of Sessions Attended by Participating Youth2016 – 2017 School Year
Number of Sessions / Number of Students / Percent of Total
1 – 9 sessions / 23 / 13%
10 – 19 sessions / 14 / 8%
20 – 29 sessions / 14 / 8%
30 – 39 sessions / 14 / 8%
40 – 49 sessions / 13 / 7%
50 – 59 sessions / 10 / 6%
60 – 69 sessions / 13 / 7%
70 – 79 sessions / 4 / 2%
80 – 89 sessions / 15 / 9%
90 – 99 sessions / 22 / 13%
100 or more sessions / 32 / 18%
Total / 174 / 100%
Avg. # of sessions/student / 58 sessions/student
After school sessions were offered Monday thruThursday for 2.5 hours daily at the elementary, middle, and high school sites. Programming was offered for a total of 110days at all three sites. The average number of sessions attended per student was 58,and a total of 10,106 contacts were completed during the year. The average daily attendance at the elementary school site was 60; the average daily attendance at the middle school site was 18 and at the high school site was 14.
Race and Gender: Sixty-onepercent (61%) of the participating students are African American, 21% are Caucasian, 8% Hispanic, and 9% of another race. This is compared to a school system profile of 41% African American; 48% Caucasian; 7% Hispanic; and 4% other. Regarding gender, 48% of our students are male and 52% female.
Grade Levels and Schools: Our participating students are enrolled in grades 1 – 12 at the local elementary, middle, and high schools.
Free and Reduced Lunch: All of our students (100%) are eligible for free or reduced lunch pricing.
III.Program Operation
Daily Programming Schedule for After School Programs:
The Pulaski County Elementary after school program ran from 3:20 PM to 5:50 PM, Monday thru Thursday. The program began with a nutritious snack/enrichment, followed by homework assistance, recreation activities, and individualized/small group tutoring. On Fridays, the program ran from 3:20 PM to 5:20 PM. It started with a snack/enrichment, followed by individualized/small group tutoring, and recreation activities. Parents were invited to join events, including: parent orientation, "Meet and Treat", Fall Festival, and family fun day making Christmas decorations with the children.
The Pulaski County Middle after school program ran from 3:30 PM to 6:00 PM, Monday thru Thursday. The program began with a nutritious snack/enrichment, followed by homework assistance, recreation activities, and individualized/small group tutoring. On Fridays, the program ran from 3:30 PM to 5:30 PM. It started with a snack/enrichment, followed by individualized/small group tutoring, and recreation activities. Parents were invited to join events, including: parent orientation, Annual Title I/PTO and chili cook-off, bullying educationand equipping parents on social media, and fall festival.
The Hawkinsville High after school program ran from 3:30 PM to 6:00 PM, Monday thru Thursday. The program began with a nutritious snack/enrichment, followed by homework assistance, recreation activities, and individualized /small group tutoring. On Fridays, the program ran from 3:30 PM to 5:30 PM. It started with a snack/enrichment, followed by individualized/small group tutoring, and recreation activities. Parents were invited to join events, including: parent orientation and Fall Festival.
Success Stories:A parent wrote a letter telling us how much she appreciated the help/support given to her daughter through this program. Her daughter was more motivated to do the work - in class and after school program – that it had made a difference in your daily performance. (Pulaski Elementary Site Coordinator, 1st Semester)
This comes from our 3rd grade group with new teacher! One little girl started off really scared and worried about things at home. The new teacher spent extra time getting to know her, as well as love her. The student began “soaking up” the tutoring offered to her. She became engaged in all the activities and loved trying new things. This group really responded very well to the new teacher! (Pulaski Elementary Site Coordinator, 3rdQuarter)
A 7th grade student, returning from the Alternative School, was encouraged to join the after school program. He has attended regularly after meeting with his mother and explaining the purpose of the after school program. His regular day teachers have reported an increase in his grades. (Pulaski Middle Site Coordinator, 1st Semester)
Our 7th and 8th grade class enjoyed cooking on 2 different occasions. The old home economics room at our high school was used for enrichment by the after school program teacher. The first attempt was preparing sausage and eggs – all done by students, and then eating together. The second time, the class prepared spaghetti sauce, noodles, and bread, then ate together as a family. We plan to do more cooking activities next year! (Pulaski Middle Site Coordinator, 3rdQuarter)
Students (as part of enrichment) worked to build rockets and then successfully launched them at the practice field. (Hawkinsville High Site Coordinator, 1st Semester)
One student in particular made great strides and is now passing all of her core classes. (Hawkinsville High Site Coordinator, 1st Semester)
A 9th grader came to our program after failing 4 subjects at the half-year mark. Through the dedicated work of our teachers, that student is now passing all 4 of those classes. All she needed was supervision, some direction, and tutoring. Also, being with other students – working together, and helping each other, made a tremendous difference in her efforts to improve! (Hawkinsville High Site Coordinator, 3rdQuarter)
Family Literacy and Involvement Activities
Eleven (11) family literacy events were held during the school year totaling 29 hours of programming. An average of six (6) parents attended these events. A total of 63 adults attended at least one session, resulting in 82 contacts.
Family Literacy Activities2016 – 2017 School Year
Site / Event / Date / Time Offered / # of family members
Pulaski Elementary / Parent orientation / 9/8/16 / 9:00 A.M. to 6:00 P.M. / 22
Annual Meet and Treat / 10/27/16 / 6:00 to 7:30 P.M. / 30
Fall Festival / 10/31/16 / 5:00 to 7:00 P.M. / 17
Family fun day making Christmas decorations and the importance of reading / 12/2/16 / 4:15 to 5:15 P.M. / 15
Parent 2 Parent luncheon: “What’s the Big Idea Behind Inclusion” / 2/28/17 / 12:00 to 1:00 P.M. / 0
Pulaski-Bleckley Baptist Association Health Fair / 3/15/17 thru 3/18/17 / 8:30 A.M. to 4:30 P.M. / 0
Family science night / 3/23/17 / 5:00 to 7:00 P.M. / 6
Pulaski Middle / Parent orientation / 9/8/16 / 9:00 A.M. to 6:00 P.M. / 6
Bullying education and equipping parents on social media (Snapchat generation) with speaker from Jerry Ackerman and Associates / 10/20/16 / 5:00 to 6:00 P.M. / 7
Annual Title I/PTO and chili cook-off / 10/20/16 / 6:00 to 7:00 P.M. / 5
Fall Festival / 10/31/16 / 5:00 to 7:00 P.M. / 2
Parent 2 Parent luncheon: “What’s the Big Idea Behind Inclusion” / 2/28/17 / 12:00 to 1:00 P.M. / 0
Pulaski-Bleckley Baptist Association Health Fair / 3/15/17 thru 3/18/17 / 8:30 A.M. to 4:30 P.M. / 0
Hawkinsville High / Parent orientation / 9/8/16 / 9:00 A.M. to 6:00 P.M. / 4
Fall Festival / 10/31/16 / 5:00 to 7:00 P.M. / 2
Making teacakes / 11/18/16 / 4:00 to 5:00 P.M. / 1
Meet and greet new sheriff session / 1/18/17 / 4:00 to 5:30 P.M. / 0
Parent 2 Parent luncheon: “What’s the Big Idea Behind Inclusion” / 2/28/17 / 12:00 to 1:00 P.M. / 0
Pulaski-Bleckley Baptist Association Health Fair / 3/15/17 thru 3/18/17 / 8:30 A.M. to 4:30 P.M. / 0
Total / 11 activities / 13 days / 29 hours / 6 parents per event
IV.Quality of Staffing
The initiative employs a total of 54 staff members. All teachers utilized by our initiative are certified. The staff demographic profile is as follows: 80% female and 20% male; 76% white,20% African American and 4% Hispanic. Our student:staff ratio is 10:1 for the academic activities and 15:1 for the enrichment activities.
Staff Meetings
Two (2) staff meetings were held this year with an average of 20 participants attending.
Staff Meetings2016 – 2017 School Year
Meeting Date / Topics Discussed / Number of Participants
9/7/16 / Summative assessment, new objectives, and policies and procedures / 21
12/8/16 / Lakeysha Hallmon provided enrichment ideas, and discussed how attendance can make or break your program / 18
Staff Development/Trainings
Staff and volunteer training is a major focus throughout the program. A total of two (2) opportunities were held during the year with an average of 20 participants attending. Opportunities include:
Staff and/or Volunteer Training2016 – 2017 School Year
Date of training / Description of Training Provided / Number of Participants
9/7/16 / Employee orientation / 21
12/8/16 / Mid-year professional development with Lakeysha Hallmon, ERES / 18
V.Objective Assessment
The evaluation data was collected by the identified staff members. Demographic, contact and grades data and regular classroom teacher surveys relevant for the state’s Cayen Afterschool 21 database was subsequently entered into the Cayen Afterschool 21 database by our staff members. Additional data collection tools (e.g. additional worksheets, student surveys, parent surveys, after school program staff surveys and key stakeholder focus group sessions) and key results data (attendance, discipline, test scores and year end promotion records) were forwarded directly to our evaluator (Norris Consulting Group). Norris Consulting Group staff subsequently downloaded relevant demographic, student and parent contact and grades information from the Cayen Afterschool 21 database and combined it with the other identified data to establish a county evaluation database. They utilized the information from this customized local database; an analysis of the student, parent, regular classroom teacher and after school program staff surveys; and a compilation of other relevant quantitative and qualitative information to prepare this report.
Status of Achievement of Goals and Objectives:
During the year, the Pulaski County 21stCCLC Initiative met 7 of the 12 outcome objectives.
Goal #1: Participating students will reach high standards at a minimum attaining proficiency or better in Mathematics
Objective 1.1: 45% of regularly participating 1st and 2nd graders (those attending 30 days or more) will meet their individual growth target on the District Assessment for Math.
Did Not Meet Objective #1.1: During the 2016-2017 school year, 43% of the regularly participating 1st and 2nd grade students met their individual growth target on the Math SLO test.
Objective 1.2: 50% of regularly participating students (attending 30 days or more) in grades 3 - 8 will score at the Developing Learner Level or higher on the Georgia Milestones Assessment for Math.
Met Objective #1.2: During the 2016-2017 school year, 59% of the regularly participating students scored at the Developing Learner Level or higher on the Georgia Milestones Assessment for Math.
Objective 1.3: 70% of the regularly participating students (attending 30 days or more) will maintain or increase their grades in Math during the academic year.
Did Not Meet Objective #1.3: During the 2016-2017 school year, 68% of the regularly participating students maintained or increased their grades in Math.
Goal #2: Participating students will reach high standards at a minimum attaining proficiency or better in Reading/ELA
Objective 2.1: 45% of regularly participating 1st and 2nd graders (those attending 30 days or more) will meet their individual growth target on the District Assessment for Reading/ELA.
Did Not Meet Objective #2.1: During the 2016-2017 school year, 40% of the regularly participating 1st and 2nd grade students met their individual growth target on the Reading DIBEL test.
Objective 2.2: 50% of regularly participating students (attending 30 days or more) in grades 3 - 8 will score at the Developing Learner Level or higher on the Georgia Milestones Assessment for Reading/ELA.
Did Not Meet Objective #2.2: During the 2016-2017 school year, 43% of the regularly participating students scored at the Developing Learner Level or higher on the Georgia Milestones Assessment for Reading/ELA.
Objective 2.3: 70% of the regularly participating students (attending 30 days or more) will maintain or increase their grades in Reading and ELA during the academic year.
Met Objective #2.3: During the 2016-2017 school year, 72% of the regularly participating students maintained or increased their grades in Reading.
Goal #3: School involvement of adult family members of participating students will increase
Objective 3.1: A minimum of 25% of regularly participating students (attending 30 days or more) parents will participate in family involvement activities at least one time during the program year.
Met Objective #3.1: During the 2016-2017 school year, 51% (63) of the regularly participating students' parents participated in family involvement activities at least one time during the program year.
Objective 3.2: A minimum of 25% of regularly participating students (attending 30 days or more) parents will participate in literacy or educational activities at least one time during the program year.
Met Objective #3.1: During the 2016-2017 school year, 51% (63) of the regularly participating students' parents participated in literacy or educational activities at least one time during the program year.
Goal #4: Increase the Graduation Rate
Objective 4.1: 50% of the regularly attending students (those attending 30 days or more) in Credit Recovery will earn at least one unit of credit.
Met Objective #4.1: During the 2016-2017 school year, all three (100%) of the regularly attending students in Credit Recovery earned at least one unit of credit.
Objective 4.2: 50% of the regularly attending high school students (those 9th - 12th graders attending 30 days or more) will pass their Math and ELA classes having state mandated tests.
Met Objective #4.2: During the 2016-2017 school year, 57% of the regularly attending high school students passed their Math EOC test and 65% passed their ELA EOC test.
Goal #5: Participating students will increase in positive behavior
Objective 5.1: 85% of the regularly attending students (those attending 30 days or more) will not miss more than 10 regular school days in any of their academic classes.
Met Objective #5.1: During the 2016-2017 school year, 86% of the regularly attending students missed 10 days or less.
Objective 5.2: 65% of regularly participating students (attending 30 days or more) will have one or less discipline referrals for the year during the regular school day hours.
Did Not Meet Objective #5.2: During the 2016-2017 school year, 60% of the regularly participating students had one or less discipline referrals during the regular school day hours.
Satisfaction with the Initiative:
We distributed surveys to participating students and their families. Their responses indicate a high satisfaction level with initiative related activities. For example:
-81% of students reported that they liked the After School Program. 10% did not like the program, 8% were uncertain, and 1% did not respond.
-75% of the students reported that their behavior has improved. 11% did not believe their behavior has improved, and 14% were uncertain.
-89% of students stated the program helps them complete and turn in homework on time. 6% didnot believe the program helped them complete and turn in homework on time, 4% were uncertain, and 1% did not respond.
Opinions Regarding Progress Made Since Attending the After School ProgramOverall Student Response (n=119)
Question / Strongly agree / Somewhat agree / Neither agree nor disagree / Somewhat disagree / Strongly disagree / Not stated
# / % / # / % / # / % / # / % / # / % / # / %
I like the after school program / 73 / 61% / 24 / 20% / 10 / 8% / 2 / 2% / 9 / 8% / 1 / 1%
My behavior has improved / 61 / 51% / 28 / 24% / 17 / 14% / 6 / 5% / 7 / 6% / 0 / 0%
The program helps me complete and turn in my homework on time / 87 / 73% / 19 / 16% / 5 / 4% / 3 / 3% / 4 / 3% / 1 / 1%
I’m doing better in school since I started coming here / 80 / 67% / 22 / 19% / 11 / 9% / 3 / 3% / 3 / 3% / 0 / 0%
I feel better about myself and my abilities / 67 / 56% / 22 / 19% / 16 / 13% / 4 / 3% / 10 / 8% / 0 / 0%
I have made new friends / 57 / 48% / 14 / 12% / 9 / 8% / 6 / 5% / 32 / 27% / 1 / 1%
-95% of parents stated that they were satisfied with the program. 2% were dissatisfied, and 4% were uncertain.
Parent’s Satisfaction with the After School ProgramOverall Family Response
Program Site / Very Satisfied / Somewhat Satisfied / Neither satisfied nor dissatisfied / Somewhat dissatisfied / Very dissatisfied / Not stated
# / % / # / % / # / % / # / % / # / % / # / %
Pulaski Elementary / 50 / 74% / 14 / 21% / 2 / 3% / 1 / 2% / 1 / 2% / 0 / 0%
Pulaski Middle / 15 / 65% / 8 / 35% / 0 / 0% / 0 / 0% / 0 / 0% / 0 / 0%
Hawkinsville High / 14 / 67% / 5 / 24% / 2 / 10% / 0 / 0% / 0 / 0% / 0 / 0%
Total / 79 / 71% / 27 / 24% / 4 / 4% / 1 / 1% / 1 / 1% / 0 / 0%
-78% of parents reported that the after school program has helped improve their child’s behavior. 5% did not believe the program has helped their child’s behavior, 17% were uncertain, and 1% did not respond.
Program Has Helped Improve My Child’s BehaviorOverall Family Response
Program Site / Strongly agree / Somewhat agree / Neither agree nor disagree / Somewhat disagree / Strongly disagree / Not stated
# / % / # / % / # / % / # / % / # / % / # / %
Pulaski Elementary / 21 / 31% / 35 / 52% / 8 / 12% / 1 / 2% / 2 / 3% / 1 / 2%
Pulaski Middle / 9 / 39% / 8 / 35% / 5 / 22% / 1 / 4% / 0 / 0% / 0 / 0%
Hawkinsville High / 9 / 43% / 5 / 24% / 6 / 29% / 1 / 5% / 0 / 0% / 0 / 0%
Total / 39 / 35% / 48 / 43% / 19 / 17% / 3 / 3% / 2 / 2% / 1 / 1%
-96% of parents reported that the program helped their child complete and turn in their homework in a timely manner. 5% disagree.