Fiscal Year 2013 Year End Report
March 2014
Massachusetts Department of Elementary and Secondary Education
75 Pleasant Street, Malden, MA 02148-4906
Phone 781-338-3000 TTY: N.E.T. Relay 800-439-2370
www.doe.mass.edu
This document was prepared by the
Massachusetts Department of Elementary and Secondary Education
Mitchell D. Chester, Ed.D.
Commissioner
The Massachusetts Department of Elementary and Secondary Education, an affirmative action employer, is committed to ensuring that all of its programs and facilities are accessible to all members of the public.
We do not discriminate on the basis of age, color, disability, national origin, race, religion, sex, gender identity, or sexual orientation.
Inquiries regarding the Department’s compliance with Title IX and other civil rights laws may be directed to the
Human Resources Director, 75 Pleasant St., Malden, MA 02148-4906. Phone: 781-338-6105.
© 2013 Massachusetts Department of Elementary and Secondary Education
Permission is hereby granted to copy any or all parts of this document for non-commercial educational purposes. Please credit the “Massachusetts Department of Elementary and Secondary Education.”
This document printed on recycled paper
Massachusetts Department of Elementary and Secondary Education
75 Pleasant Street, Malden, MA 02148-4906
Phone 781-338-3000 TTY: N.E.T. Relay 800-439-2370
www.doe.mass.edu
TABLE OF CONTENTS
Introduction 1
Program Information 3
Survey of Academic Youth Outcomes (SAYO) 7
School Year SAYO Results 9
Summer SAYO Results 16
SAYO-Youth Pilot Results 17
APPENDIX A: Program Goals 20
APPENDIX B: FY13 21ST CCLC Grantees & Sites 21
21st Century Community Learning Centers Program
Fiscal Year 2013 Year End Report
Introduction
The following report provides information on the fiscal year 2012-2013 (FY13) 21st Century Community Learning Centers (CCLC) grant program. In particular, it examines program information related to participation, activities, and hours of service. Additionally, it details the results of the Survey of Academic Youth Outcomes (SAYO) evaluation tool, which was developed by the Department of Elementary and Secondary Education (Department) and the National Institute of Out-of-School Time (NIOST) to track information on the effect participation in the 21st CCLC programs has in increasing student achievement, as well as to provide feedback for ongoing program improvement.
Fiscal year 2013 was the eleventh year that 21st Century Community Learning Centers grants were distributed through the Department and funded through Title IVB of the 2001 No Child Left Behind Act (NCLB). These grants were awarded on a competitive basis with continuation funding available for up to four additional years.
The results described in this report point to the significant contributions that 21st CCLC programs have made to the academic achievement and youth development of the nearly 17,000 students served across the state during fiscal year 2013.
Highlights of FY13 21st CCLC Programs and SAYO Results
School Year and Summer (September 2012—August 2013)
· In FY13, the Department awarded approximately $15.7M to 45 grantees through competitive and continuation grants.
· Approximately 17,000 students in grades K-12 participated in 21st CCLC program services at 156 sites across the state.
· 21st CCLC participants included nearly 12,000 students who received free or reduced priced lunch, 3,300 students with disabilities, and 3,300 students considered English language learners (ELL).
· As rated by school-day teachers, statewide figures for student participants showed positive gains in all eight academic and six intermediary outcomes that the SAYO tool measures, with the greatest average pre to post increases being in reading, written communication, mathematics problem solving, and analysis.
· As rated by 21st CCLC staff, statewide figures for student participants showed positive gains in all five intermediary outcomes measured, with the greatest average pre to post program increases in initiative and relationships with adults.
· Approximately 5,600 SAYO surveys were collected from school-day teachers (school year only) and 9,500 from 21st CCLC program staff members (school year and summer).
School Year (September 2012—June 2013)
· Approximately 13,000 students participated in 21st CCLC program services offered by 49 grantees at 156 sites across the state during the school year.
· Students who participated in the 21st CCLC program attended an average of 143 (and median of 106) hours of programming offered outside of regular school hours during the school year.
· Approximately 9,200 students who received free or reduced price lunch, including 2,500 students with disabilities and 2,500 ELL students participated in the 21st CCLC program during the school year.
· Approximately 5,600 SAYO surveys were collected from school-day teachers and 6,000 after-school staff members.
· Approximately 4,300 SAYO surveys were collected from afterschool youth in the fall and 5,100 in the spring.
Summer (July 2013—August 2013)
· Approximately 5,900 students participated in 21st CCLC program services offered by 38 grantees at 103 sites across the state during the summer.
· Students who participated in the 21st CCLC program attended an average of 97 (and a median of 81) hours of programming offered during summer hours.
· Approximately 4,400 students who received free or reduced price lunch, including 1,200 students with disabilities and 1,200 ELL students participated in summer 21st CCLC programs.
· Nearly 3,500 SAYO surveys were collected from summer program staff members.
For additional information on this report or the 21st CCLC Program in
Massachusetts, visit the web site: http://www.doe.mass.edu/21cclc, or contact
Karyl Resnick, 21st CCLC Program Coordinator, or Allison Smith, Data Specialist,
via 781-338-3010 or .
Massachusetts 21st Century Community Learning
Centers Programs, FY13
Program Information
Participation
As reported by the 49 entities serving students through fiscal year 2013, a total of 12,906 children and youth participated in 21st CCLC school year programs and 5,924 participated in 21st CCLC summer programs. (A total of 16,733 individual students participated in either or both time frames). Figure 1 below shows that 56 percent of all fiscal year 2013 program participants were children in elementary school (K-5), while children in middle school (grades 6-8) accounted for 30 percent and high school students (grades 9-12) accounted for 14 percent of those served.
Figure 1: Percentage of Student Participants by Grade Level, FY13
Source: Student Information Management System and grant recipient reports.
Table 1 below compares grade participation by school year and summer and illustrates that the relative proportion of elementary versus middle school students served differs during the school year and the summer. More specifically, during the school year 55 percent of students served were elementary school students and 30 percent were middle schools students, while during the summer there was a higher percentage of elementary (62 percent) and a lower percentage of middle school students (27 percent). The percentage of participants that were high school students was higher during the school year (15 percent) than the summer (11 percent).
Table 1: Percentage of Student Participation by Grade Level, FY13
School Year / SummerGrade Level / N / % / N / %
Elem. Total / 7,101 / 55% / 3,697 / 62%
Middle Total / 3,904 / 30% / 1,581 / 27%
H.S. Total / 1,901 / 15% / 646 / 11%
Source: Student Information Management System and grant recipient reports.
The racial breakdown of students served is illustrated in Figure 2 below. The majority of students served (59 percent) in fiscal year 2013 21st CCLC programs were members of a minority group, while 41 percent of students were white. Hispanic students were the largest minority group (32 percent) followed by African American students (16 percent) and Asian students (7 percent). Table 2 below compares the racial breakdown by school year and summer. As it shows, a marginally higher percentage of minority students as compared to white students were served during the school year (60 percent) than during the summer (58 percent); and in both timeframes, percentages of minority students served were substantially higher than their statewide proportion (34 percent).
Figure 2: Percentage of Student Participation by Race/Ethnicity, FY13
Source: Student Information Management System and grant recipient reports.
Table 2: Student Participation by Race/Ethnicity during School Year and Summer Programs, FY13
School Year 21st CCLC / Summer 21st CCLC / StatewideRace/ Ethnicity / N / % / N / % / %
African American / 1,999 / 15% / 1,067 / 18% / 9%
Asian / 1,052 / 8% / 333 / 6% / 6%
Hispanic / 4,245 / 33% / 1,769 / 30% / 16%
White / 5,130 / 40% / 2,491 / 42% / 66%
Other / 480 / 4% / 264 / 4% / 3%
Source: Student Information Management System and grant recipient reports.
Additionally, during fiscal year 2013 21st CCLC programs, data was collected by grantees on the number of students served who were classified as receiving special education services, as free or reduced price lunch participants, and as English language learners (ELL). Overall, 72 percent of students served received federal free or reduced lunch, 20 percent received special education services, and 20 percent were ELL.
Table 3 on the next page examines the percentage of students served in these classifications during the school year and summer. The proportions of low-income, students with disabilities, and ELL students served during the school year were very similar to those served during the summer (approximately 71 compared to 74 percent were low-income, 20 compared to 21 percent were students with disabilities, and 19 compared to 21 percent ELL. During both the school year and summer, the percentages of these selected populations served were substantially higher than their statewide proportion, in particular for low-income students and ELL students.
Table 3: Student Participation by Free/Reduced Price Lunch, SPED, and ELL during
School Year and Summer Programs, FY13
School Year 21st CCLC / Summer 21st CCLC / StatewideSpecial Population / N / % / N / % / %
Free/Reduced Price Lunch / 9,197 / 71% / 4,390 / 74% / 37%
Students with Disabilities / 2,548 / 20% / 1,219 / 21% / 17%
English Language Learner / 2,500 / 19% / 1,240 / 21% / 8%
Source: Student Information Management System and grant recipient reports.
Table 4 below examines the 2013 English Language Arts (ELA) MCAS performance levels of students served in 21st CCLC school year and summer programs and compares them to statewide percentages. The 21st CCLC programs served a substantially greater percentage of students in the Needs Improvement (NI) and Warning (W) / Failing (F) levels. During the school year, 54 percent of students served by 21st CCLC programs were in either the NI or W/F performance levels, while statewide only 31 percent of students were in these levels. This percentage difference was even higher in the summer, where 60 percent of all in 21st CCLC programs had scored at the NI or W/F level in ELA.
Similarly, Table 5 demonstrates that a higher percentage of students in the NI or W/F levels on the 2013 Mathematics MCAS were served in 21st CCLC programs as compared to statewide figures. During school year 21st CCLC programs, 59 percent of students served were in either of those performance levels, as compared to 39 percent of students statewide. As with ELA, this percentage was even higher during summer programs as 64 percent of students served in 21st CCLC programs had performed at the NI or W/F level in mathematics.
Table 4: Student Participation by ELA 2013 MCAS Performance Levels during
School Year and Summer Programs, FY13
School Year 21st CCLC / Summer 21st CCLC / StatewideMCAS Performance Level / N / % / N / % / %
Advanced
Proficient
Needs Improvement
Warning / Failing / 539
3,499
3,333
1,431 / 6%
40%
38%
16% / 161
1,282
1,528
641 / 4%
36%
42%
18% / 19%
50%
23%
8%
Source: 2013 MCAS mega file (grades 3-10) and grant recipient reports.
Table 5: Student Participation by Mathematics 2013 MCAS Performance Levels during
School Year and Summer Programs, FY13
School Year 21st CCLC / Summer 21st CCLC / StatewideMCAS Performance Level / N / % / N / % / %
Advanced
Proficient
Needs Improvement
Warning / Failing / 1,130
2,501
3,030
2,160 / 13%
28%
34%
25% / 365
929
1,390
944 / 10%
26%
38%
26% / 28%
33%
25%
14%
Source: 2013 MCAS mega file (grades 3-10) and grant recipient reports.
Hours of Service
Students were served in 21st CCLC programs from September 2012 through August 2013. During the school year (September through June), students each participated an average of 143 (and a median of 106) hours. During the summer (July through August), students were served an average of 97 (and a median of 81) hours each. Table 6 below shows the percentage of students served by hour ranges. During the school year, 52 percent of students served participated for at least 100 hours in 21st CCLC programs; and during the summer, 38 percent of students served participated for at least 100 hours.
Table 6: Percentage of Students Served in Program Hour Ranges, FY13
School Year(Mean: 143 hrs/ Median: 106 hrs) / Summer
(Mean: 97 hrs / Median: 81 hrs)
Program Hour Ranges / N / % / N / %
1-50 Hours / 3,010 / 23% / 1,092 / 18%
51-100 Hours / 3,262 / 25% / 2,616 / 44%
101-200 Hours / 3,288 / 26% / 1,947 / 33%
201+ Hours / 3,346 / 26% / 269 / 5%
Source: Grant recipient reports.
Academic Subjects/Activities Offered
During fiscal year 2013, all 21st CCLC program sites provided comprehensive programming by offering a wide variety of academic and enrichment activities. Almost all districts offered a homework component during the school year (replaced by learning skills during the summer), and many focused on helping students develop specific mathematics and English language arts skills. See below for a sampling of the academic subjects and activities that were offered at the 21st CCLC sites.
20
Subjects Activities
English Language Arts (ELA) / Reading Academic Enrichment Projects
ELA/Verbal Communication Adventure Education
ELA/Written Communication Arts (Includes Performing, Music/Dance, Graphic, Drawing/Painting)
Mathematics Communication Character Education / Bullying Prevention Education
Mathematics Problem Solving College/Career Preparation
Mathematics Reasoning Culinary Arts
Science Entrepreneurial
Social Studies Family Engagement