Professional Development for Arts Educators (PDAE)

Professional Development for Arts Educators (PDAE)

Aggregation of Year One Annual Performance Report Data (2011-12)

for Grantees Funded in 2011

This document presents a summary of the Year One Annual Performance Report (APR) data for the 14 Professional Development for Arts Educators (PDAE) grantees funded in 2011. Specifically, the summary presents aggregate Government Performance and Results Act (GPRA) measures for the PDAE program and grantee project performance measures across grantees.

GPRA Measure 1

GPRA Measure 1 is the percentage of teachers participating in the PDAE Program who received sustained and intensive professional development. A participant has received sustained and intensive professional development during a project period when he/she:

• completes a minimum of 40 hours of professional development,
• completes 75 percent of the total professional development hours offered (This criterion was not applicable to one project because there was no maximum number of hours offered. Participants could complete “self-guided” professional development (e.g., journal writing), and
• participates in professional development activities for six months or more.

As shown in GPRA measure 1, 71 percent of PDAE grantees (10 out of 14) submitted complete data. The aggregate data excludes four grantees: three had no data to submit because their professional development started at the end of the project period (i.e., summer 2012), and one did not submit complete data. Overall, 546 participants received professional development through PDAE projects during the first year of the grant. Of these participants, 145 or 27 percent received intensive and sustained professional development.

Aggregate Data for GPRA Measure 1

Percentage of Projects with Complete Data for GPRA Measure 1: 71% (10/14)

Aggregate Percentage of Participants Who Received Sustained and Intensive Professional Development: 27% (145/546)

Because it was the first year of the grant, many grantees started providing professional development mid-way through the project period. As a result, five projects (n=261 participants total) had no participantsreceive sustained and intensive professional development because participants were unable to meet the criteria. Four projects (n= 210 participants total) did not offer professional development activities over a period of six months or more. However,119 of the 210 participants from these projects did completea minimum of 40 hours of professional development and 75 percent of the total professional development hours offered.Additionally, one project (n=51) provided less than 40 hours of professional development during the project period. It is expected that the percentage of participants receiving sustained and intensive professional development will increase during the second year of the grant because grantees will be able to provide professional development starting at the beginning of the project period.

GPRA Measure 2

GPRA Measure 2 is the percentage of PDAE projects whose teachers showed a statistically significant increase in content knowledge in the arts. An increase is statistically significant when the p value from a paired-samples t-test or Wilcoxon test is 0.05 or less. (The PDAE Program Office encourages grantees to use the PDAE Excel file it provides to analyze data for GPRA Measure 2. The spreadsheet runs a paired-samples t-test when the number of participants with pre- and posttest scores is 20 or greater and a Wilcoxon test when the number of participants with pre- and posttest scores is between 12-19.)

The term “content knowledge in the arts” includes any content knowledge area that the PDAE-funded project aims to improve or increase. Because there are few standardized instruments available that assess content knowledge in the arts and are relevant to the objectives of funded projects, grantees developed their own instruments.

As shown in GPRA measure 2, 57 percent of PDAE grantees (8 out of 14) submitted complete data. The aggregation excludes six grantees: five grantees did not have pre- and posttest data because theirprofessional developmentstarted at the end of the project period ortheyexperienced instrument development delays,and one grantee did not submit complete data.The percentage of participants with pre- and posttest scores (i.e., the test rate) for the eight projectswith complete data was 76 percent. All eight projects showed a statistically significant increase in the arts content knowledge of their participants.As noted earlier, grantees developed their own instruments and the reliability and validity of these instruments are established.

Aggregate Data for GPRA Measure 2

Percentage of Projects with Complete Data for GPRA Measure 2: 57% (8/14)

Aggregate Test Rate: 76% (304/401)

Percentage of Projects WhoseTeachers Showed a Statistically Significant Increase in Arts Content Knowledge: 100% (8/8)

Project Performance Measures

As shown in the aggregate data below, 71 percent of grantees (10 out of 14) submitted complete data on one or more applicable project measures (i.e., project measures that were relevant to and had a target forthe first project period). The aggregation excludes four grantees: three had no data to submit because their professional development started at the end of the project period, and one did not include project measures in its APR. Overall, projects provided complete data on 76 percent of the applicable project measures. Grantees met their annual targets for 67 percent of the applicable project measures with complete data.

Aggregate Data for Project Performance Measures

Percentage of Projects with Complete Data on One or More Applicable Project Measures:71% (10/14)

Aggregate Percentage of Applicable Project Measures with Complete Data: 76% (57/75)

Aggregate Percentage of Applicable Project Measures with Complete Data for Which Annual Targets Were Met: 67% (38/57)