State of West Virginia
Consolidated State Application
Accountability Workbook
for State Grants under Title IX, Part C, Section 9302 of the Elementary and
Secondary Education Act (Public Law 107-110)
REVISED JUNE 2010
Steven L. Paine
State Superintendent of Schools
PART I: Summary of Required Elements for State Accountability Systems
Summary of Implementation Status for Required Elements of
State Accountability Systems
Status / State Accountability System Element / PagePrinciple 1: All Schools
F / 1.1 / Accountability system includes all schools and districts in the state. / 4
F / 1.2 / Accountability system holds all schools to the same criteria. / 5
F / 1.3 / Accountability system incorporates the academic achievement standards. / 7
F / 1.4 / Accountability system provides information in a timely manner. / 8
F / 1.5 / Accountability system includes report cards. / 9
F / 1.6 / Accountability system includes rewards and sanctions. / 11
Principle 2: All Students
F / 2.1 / The accountability system includes all students. / 14F / 2.2 / The accountability system has a consistent definition of full academic year. / 16
F / 2.3 / The accountability system properly includes mobile students. / 17
Principle 3: Method of AYP Determinations
F / 3.1 / Accountability system expects all student subgroups, public schools, and LEAs to reach proficiency by 2013-14. / 18F / 3.2 / Accountability system has a method for determining whether student subgroups, public schools, and LEAs made adequate yearly progress. / 25
F / 3.2a / Accountability system establishes a starting point. / 27
F / 3.2b / Accountability system establishes statewide annual measurable objectives. / 29
F / 3.2c / Accountability system establishes intermediate goals. / 30
Principle 4: Annual Decisions
F / 4.1 / The accountability system determines annually the progress of schools and districts. / 32STATUS Legend:
F – Final state policy
P – Proposed policy, awaiting State approval
W – Working to formulate policy
Status / State Accountability System Element / PagePrinciple 5: Subgroup Accountability
F / 5.1 / The accountability system includes all the required student subgroups. / 34F / 5.2 / The accountability system holds schools and LEAs accountable for the progress ofstudent subgroups. / 35
F / 5.3 / The accountability system includes students with disabilities. / 36
F / 5.4 / The accountability system includes limited English proficient students. / 39
F / 5.5 / The State has determined the minimum number of students sufficient to yield statistically reliable information for each purpose for which disaggregated data are used. / 40
F / 5.6 / The State has strategies to protect the privacy of individual students in reporting achievement results and in determining whether schools and LEAs are making adequate yearly progress on the basis of disaggregated subgroups. / 42
Principle 6: Based on Academic Assessments
F / 6.1 / Accountability system is based primarily on academic assessments. / 43Principle 7: Additional Indicators
F / 7.1 / Accountability system includes graduation rate for high schools. / 45
F / 7.2 / Accountability system includes an additional academic indicator for elementary and middle schools. / 46
F / 7.3 / Additional indicators are valid and reliable. / 47
Principle 8: Separate Decisions for Reading/Language Arts and Mathematics
F / 8.1 / Accountability system holds students, schools and districts separately accountable for reading/language arts and mathematics. / 48Principle 9: System Validity and Reliability
F / 9.1 / Accountability system produces reliable decisions. / 50F / 9.2 / Accountability system produces valid decisions. / 51
F / 9.3 / State has a plan for addressing changes in assessment and student population. / 53
Principle 10: Participation Rate
F / 10.1 / Accountability system has a means for calculating the rate of participation in the statewide assessment. / 54F / 10.2 / Accountability system has a means for applying the 95% assessment criteria to student subgroupsand small schools. / 55
STATUS Legend: F – Final State policy P – Proposed policy, awaiting State approval
W – Working to formulate policy
PART II: State Response and Activities for Meeting State Accountability System Requirements
PRINCIPLE 1. A single statewide Accountability System applied to all public schools and LEAs.
1.1 How does the State Accountability System include every public school and LEA in the State?
Every West Virginia public school and Local Education Agency (LEA) is required to make adequate yearly progress (AYP) and is included in the State Accountability System, as specified in West Virginia Board of Education Policy 2320.
For the purpose of determining AYP, West Virginia public schools are defined as those elementary and secondary schools established and maintained at public expense through the total basic foundation program/state aid formula outlined in W.Va. Code §18-9A-3 and W.Va. Code §18-9A-12. For the purposes of AYP determination, an elementary school is one that has a grade configuration that may include grades K-4, but does not contain grade 8 or higher. A middle school is a school that does not meet the definition of an elementary school and contains grade 8, but does not contain grade 12. A high school is any school that contains grade 12. The LEA is defined as the county school district.
Students who attend alternative education programs as defined in West Virginia Board of Education Policy 2418 are included in the state accountability system by having individual test scores aggregated in the results of the home county school district/school of referral.
The West Virginia Office of Education Performance Audits, through periodic on-site reviews completed at least once every three years, determines AYP for public schools without grades assessed (i.e., K-2 schools). The performance audit includes a review of informal reading and mathematics student assessment results and verifies compliance with legislation and policies required by the State of West Virginia.
There are approximately 41 small schools in West Virginia that do not have a total of 50 in the tested class levels. For those small schools, the Office of Education Performance Audits determines AYP using the total subgroup only and averaging the scores for the current year tested plus the previous two years in order to make the AYP decision more reliable.
Evidence*:
W.Va. Code §§18-1-2, 18-9A-3 and 18-9A-12
West Virginia Board of Education Policy 2418,
West Virginia Board of Education Policy 2320
*Note: A policy citation that does not include a website address is an indication that the policy is under revision.
1.2 How are all public schools and LEAs held to the same criteria when making an AYP determination?
The current systems of assessment and accountability are defined in West Virginia Board of Education Policy 2340: Statewide Assessment System and proposed Policy 2320: A Process for Improving Education--Performance Based Accreditation System.
- The Accreditation System Policy 2320, Section 5 includes the state assessment, participation, graduation or attendance accountability standards revised to meet the No Child Left Behind (NCLB) federal language.
All West Virginia public schools and LEAs are systematically judged on the basis of the same criteria when making an AYP determination.
For the purpose of determining AYP, West Virginia public schools are defined as those elementary and secondary schools established and maintained at public expense through the total basic foundation program/state aid formula outlined in W.Va. Code §18-9A-3 and W.Va. Code §18-9A-12. For the purposes of AYP determination, an elementary school is one that has a grade configuration that may include grades K-4, but does not contain grade 8 or higher. A middle school is a school that does not meet the definition of an elementary school and contains grade 8, but does not contain grade 12. A high school is any school that contains grade 12. The LEA is defined as the county school district.
Students who attend alternative education programs as defined in West Virginia Board of Education Policy 2418 are included in the state accountability system by having individual test scores aggregated in the results of the home county school district/school of referral.
The West Virginia Office of Education Performance Audits, through periodic on-site reviews completed at least once every three years, determines AYP for public schools without grades assessed (i.e., K-2 schools). The performance audit includes a review of informal reading and mathematics student assessment results and verifies compliance with legislation and policies required by the State of West Virginia.
All students with disabilities in West Virginia public schools as defined under Section 602(3) of the Individuals with Disabilities Education Act (IDEA) amendments of 1997 and West Virginia Board of Education Policy 2419: Regulations for the Education of Exceptional Students, participates in the West Virginia Assessment Program. The Individualized Education Program (IEP) Team determines how students with disabilities will participate in the statewide assessment program (i.e., West Virginia Educational Standards Test (WESTEST) or West Virginia Alternate Performance Task Assessment (WV APTA)) as defined in West Virginia Board of Education Policies 2340 and 2419. The WV APTA yields reading/language arts and mathematics assessment results for inclusion in AYP determination.
West Virginia has identified five performance levels for the new assessments (WESTEST). WESTEST is comprised of custom-developed assessments that include multiple measures in the areas of reading/language arts, mathematics, science, and social studies. The assessments are administered in grades 3 through 8 and grade 10, and beginning in 2008-2009, these assessments will be administered in grades 3 through 8 and 11.
Students’ scores from the WV APTAare aggregated with those from the WESTEST for all students and each subgroup. The following process was developed to aggregate the scores from the WV APTA with those from the WESTEST for the school, district and state results (See Section 5.3.).
Not more than 1% of the student scores on the APTA may be counted as Proficient in the county and state accountability calculations. The local school districts will identify the students whose scores will be excluded as proficient in the annual accountability calculation as per the language in Principle 5: 5.3 (page 39).
All of the required subgroups, including students with disabilities, who are enrolled in a public school for a full academic year are included in the performance measures that determine AYP, accreditation status of schools and the approval status of LEAs. (West Virginia Board Policy 2320: A Process for Improving Education—Performance Based Accreditation System, 2003)
Evidence:
W. Va. Code §18-1-2
WV Board of Education Policy 2418,
WV Board of Education Policy 2340
WV Board of Education Policy 2320
WV Board of Education Policy 2419,
1.3 Does the State have, at a minimum, a definition of basic, proficient, and advanced student achievement levels in reading/language arts and mathematics?
West Virginia has defined five levels of student achievement for the WESTEST: distinguished, above mastery, mastery, partial mastery and novice. A general description of each of these levels is listed below:
■Distinguished:Student demonstrates knowledge, comprehension, application, analysis, synthesis, and evaluation of skills, which exceed the standard.
■Above Mastery:Student demonstrates knowledge, comprehension, application, and analysis of skills, which exceed the standard.
■Mastery**:Student demonstrates knowledge, comprehension, and application of skills, which meet the standard.
■Partial Mastery:Student demonstrates knowledge and recall of skills toward meeting the standard.
■Novice:Student does not demonstrate knowledge and recall of skills needed to meet the standard.
For each of the content standards in reading and English language arts and mathematics, five levels of performance descriptors have been developed. Mastery Level is the Proficient Level of performance for West Virginia.
All of the WESTEST assessments are aligned to the content standards and descriptors. There are two cuts below proficient and two cuts above proficient as per the above-mentioned performance levels. In order to determine achievement levels, the four cut scores have been set on a composite scale using Bookmark methodology.
**West Virginia has identified the mastery level as meeting the proficient level specified in No Child Left Behind.
Evidence:
WV Board of Education Policy 2510
WV Board of Education Policy 2520.1
WV Board of Education Policy 2520.2
West Virginia Standard Setting Procedure
Request for Proposal for Alignment Study
1.4 How does the State provide accountability and adequate yearly decisions and information in a timely manner?
West Virginia provides decisions about adequate yearly progress (AYP) in time for LEAs to implement the required provisions of No Child Left Behind before the beginning of the next academic year.
Current West Virginia Board of Education Policy 2340 and W.Va. Code §18-2E-4 requires data input, scoring and the reporting of results to schools and parents. For the purpose of determining AYP, the West Virginia Department of Education ensures that results of the State academic assessment are available to the LEAs in a timely manner (See Chart 1.).
Chart 1. Timeline
Timeline / ActivityMay Test Administration Week (annually) / Statewide Assessment Administration
The week following Test Administration will become the Make-Up Week (annually) / Statewide Assessment Make-Up window
At the end of the testing window (annually) / Collection of information on students enrolled for full academic year
Six to Eight Weeks from Assessment Administration / Assessment vendor required to provide assessment results to the WVDE
Early August (annually) / Schools receive assessment results
Early August (annually) / Schools are notified of preliminary AYP status
No later than the first day of school / LEA notification to parents regarding school choice and supplemental services
No later than thirty days after preliminary identification of Schools/LEAs not meeting AYP (annually) / District/LEA Appeals Process Begins
Challenged agency renders final determination in response to appeal
Evidence:
W.Va. Code §18-2E-4
WV Board of Education Policy 2340
WV Board of Education Policy 2320
Right Response Summaries: Student, School, County and State
1.5Does the State Accountability System produce an annual State Report Card?
West Virginia has published a State Report Card as required by W. Va. Code §18-2E-4 since 1989. Using the existing management information system, a No Child Left Behind (NCLB) Report Card for schools and LEAs are published annually according to NCLB requirements for state reporting.
The West Virginia Department of Education operates a management information system for all schools and all county boards of education. The system is on-line, is interactive and operates over a privately addressed Intranet. Standard data element definitions and codes are used statewide.
The West Virginia Department of Education collects from school files the information needed for state and federal reporting and decision-making. The enrollment collection contains information about the enrollment of the student attributes such as active special education, limited English proficient (LEP), migrant, grade level, gender, race, free/reduced lunch status, etc. This file is collected three times during the school year for NCLB purposes: mid-October, early February, and May (end of the testing window). Schools are required to verify the data submitted in these files to assure accuracy.
The NCLB Report Card includes information, in the aggregate, on student achievement at each proficiency level on the state academic assessment (WESTEST) including the West Virginia Alternate Performance Task Assessment (WV APTA), disaggregated by (1) all students, (2) race, (3) gender, (4) disability, (5) migrant status, (6) limited English proficiency status and (7) economically disadvantaged status. The report card includes the most recent two-year results in student achievement in reading/language arts and mathematics performance levels. The percent of students not tested, graduation rates for secondary schools and attendance rates for elementary/middle schools are reported in aggregate.
The professional qualifications of teachers in the State and the number of such teachers teaching with emergency or provisional credentials are provided on the State report card. The percent of classes not taught by highly qualified teachers are disaggregated by high poverty compared to low poverty schools.
The NCLB Report Card contains information on schools not making AYP according to NCLB, Section 1116. A listing of all schools that failed to make AYP for the year is reported.
The NCLB Report Card is published for libraries and schools in printed form and is made available to the public on the West Virginia Department of Education website.
Statewide assessment results are provided to the West Virginia Department of Education in August and the NCLB Report Card is made available to schools prior to the first day of October.
Evidence:
West Virginia State Code § 18-2E-4
1.6 How does the State Accountability System include rewards and sanctions for public schools and LEAs?
The system of assessment is defined in West Virginia Board of Education Policy 2340: Statewide Assessment System. The current accountability standards are described in proposed Policy 2320: A Process for Improving Education: Performance Based Accreditation System.
West Virginia’s state accountability system includes rewards and sanctions for public schools and LEAs. The State’s accreditation policy, West Virginia Board of Education Policy 2320, prescribes consequences for schools/LEAs that do not meet accreditation standards. These consequences range from revision of the Unified School Improvement Plan or Unified County Improvement Plan to possible State takeover of the school or LEA. In addition, all Title I public schools are subject to the requirements of Section 1116 of NCLB. (See Chart 2: West Virginia School Sanctions; and Chart 3: West Virginia LEA Sanctions.)
Chart 2. West Virginia School Sanctions
West Virginia School SanctionsNot Meeting AYP After / State School
Policy 2320 / Title I School
Section 1116
Year 1 / Recommend Unified School Improvement Plan revision to address identified deficiencies / Recommend Unified School Improvement Plan and Title I Plan revision to address identified deficiencies
Year 2 / Temporary Accreditation Status
- Revise USIP with improvement date certain (1-5 yrs)
- Upgraded to Conditional Status when approved
- State will provide assistance
- Improvement Plan
- 10% of Title I allotment identified for staff development
- Technical Assistance (SEA & LEA)
- LEA must offer School Choice
Year 3 / Continue Conditional Status or be designated as Seriously Impaired if date certain not met
- State assigns Improvement Consultant Team
- State may designate a Distinguished Educator to provide assistance
- Previous year sanctions plus
- Supplemental Services for eligible students
Year 4 / Continue Conditional Status or be designated as Seriously Impaired
- Schools revise USIP with a date certain
- School Choice after 1 year as Seriously Impaired
- Previous year sanctions plus
- Corrective Action
Chart 2. West Virginia School Sanctions (continued)