Part VII: Rating Educator Impact on Student Learning Using District-Determined Measures of Student Learning, Growth and Achievement
August 2012
Massachusetts Department of Elementary and Secondary Education
75 Pleasant Street, Malden, Massachusetts 02148-4906
Phone 781-338-3000 TTY: N.E.T. Relay 800-439-2370
This document was prepared by the
Massachusetts Department of Elementary and Secondary Education
Mitchell D. Chester, Ed.D.
Commissioner
Board of Elementary and Secondary Education Members
Ms. Maura Banta, Chair, Melrose
Ms. Beverly Holmes, Vice Chair, Springfield
Dr. Vanessa Calderón-Rosado, Milton
Ms. Harneen Chernow, Jamaica Plain
Mr. Gerald Chertavian, Cambridge
Mr. Matthew Gifford, Chair, Student Advisory Council, Brookline
Dr. Jeff Howard, Reading
Ms. Ruth Kaplan, Brookline
Dr. Dana Mohler-Faria, Bridgewater
Mr. Paul Reville, Secretary of Education, Worcester
Mr. David Roach, Sutton
Mitchell D. Chester, Ed.D., Commissioner and Secretary to the Board
The Massachusetts Department of Elementary and Secondary Education, an affirmative action employer, is committed to ensuring that all of its programs and facilities are accessible to all members of the public.
We do not discriminate on the basis of age, color, disability, national origin, race, religion, sex or sexual orientation.
Inquiries regarding the Department’s compliance with Title IX and other civil rights laws may be directed to the
Human Resources Director, 75 Pleasant St., Malden, Massachusetts 02148-4906. Phone: 781-338-6105.
© 2012 Massachusetts Department of Elementary and Secondary Education
Permission is hereby granted to copy any or all parts of this document for non-commercial educational purposes. Please credit the “Massachusetts Department of Elementary and Secondary Education.”
This document printed on recycled paper
Massachusetts Department of Elementary and Secondary Education
75 Pleasant Street, Malden, Massachusetts 02148-4906
Phone 781-338-3000 TTY: N.E.T. Relay 800-439-2370
Contents
A Letter From the Commissioner
The Massachusetts Model System for Educator Evaluation
About This Guide
Introduction and Purpose
Implementation Timetable
Getting Started
Identifying and Selecting District-Determined Measures
Key Criteria
Selecting Appropriate Measures of Student Learning
Resources
Matching Educators with Appropriate Measures
Matching Students to Their Educators
Implementation Timelines and Reporting Requirements for District-Determined Measures
Rating Educator Impact on Student Learning
Defining Student Growth as High, Moderate, or Low
Identifying Trends and Patterns in Student Growth
Using the Impact Rating
Looking Ahead: Reporting the Rating of Impact to ESE
Identifying and Beginning to Address District Capacity and Infrastructure Needs
Identifying and Addressing District and School Needs
Accessing More Resources From ESE
Planning Collective Bargaining
Immediate Next Steps
Appendix A. What the Regulations Say
Appendix B. Technical Guide A (District-Determined Measures)
Appendix C. Technical Guide B (Rating Educator Impact on Student Learning)
Appendix D. Looking Ahead: Attribution and Roster Verification
Appendix E. Educator Evaluation and Collective Bargaining
A LetterFrom the Commissioner
Massachusetts Department of
Elementary and Secondary Education
75 Pleasant Street, Malden, Massachusetts 02148-4906 Telephone: (781) 338-3000
TTY: N.E.T. Relay 1-800-439-2370
Mitchell D. Chester, Ed.D.Commissioner
August 10, 2012
Dear Educators and other interested Stakeholders,
I am pleased to present Part VII of the Massachusetts Model System for Educator Evaluation. Since late June, when the Board of Elementary and Secondary Education adopted regulations to improve student learning by overhauling educator evaluation in the Commonwealth, staff here at the Department has been working closely with stakeholders to develop the Model System called for in the regulations. With the help of thoughtful suggestions and candid feedback from a wide range of stakeholders, we have now developed the first six components of the Model System:
- District-Level Planning and Implementation Guide
- School-Level Planning and Implementation Guide
- Guide to Rubrics and Model Rubrics for Superintendent, Administrator, and Teacher
- Model Collective Bargaining Contract Language
- Implementation Guide for Principal Evaluation
- Implementation Guide for Superintendent Evaluation
- Rating Educator Impact of Student Learning Using District—Determined Measures of Student Learning, Growth, and Achievement
I am excited by the promise of Massachusetts’ new regulations. Thoughtfully and strategically implemented, they will improve student learning by supporting analytical conversation about teaching and leading that will strengthen professional practice.At the same time, the new regulations provide the opportunity for educators to take charge of their own growth and development by setting individual and group goals related to student learning.
The Members of the State Board and I know that improvement in the quality and effectiveness of educator evaluation will happen only if the Department does the hard work ahead “with the field,” not “to the field.” To that end, we at the Department need to learn with the field. We will continue to revise and improve the Model System including the Implementation Guides based on what we learn with the field over the next few years. To help us do that, please do not hesitate to send your comments, questions and suggestions to us at . Please also visit the Educator Evaluation webpage at We will be updating the page regularly.
Please know that you can count on the Department to be an active, engaged partner in the challenging, but critical work ahead.
Sincerely,
Mitchell D. Chester, Ed.D.
Commissioner of Elementary and Secondary Education
The Massachusetts Model System for Educator Evaluation
The Model System is a comprehensive educator evaluation system designed by the Department of Elementary and Secondary Education (ESE), pursuant to the new educator evaluation regulations, 603 CMR 35.00. The following eight-part series was developed to support effective implementation of the regulations by districts and schools across the Commonwealth.
Part I: District-Level Planning and Implementation Guide
This Guide takes district leaders—school committees, superintendents and union leaders—through factors to consider as they decide whether to adopt or adapt the Model System or revise their own evaluation systems to meet the new educator evaluation regulation. The Guide describes the rubrics, tools, resources and model contract language ESE has developed, and describes the system of support ESE is offering. It outlines reporting requirements, as well as the process ESE will use to review district evaluation systems for superintendents, principals, teachers and other licensed staff. Finally, the Guide identifies ways in which district leaders can support effective educator evaluation implementation in the schools.
Part II: School-Level Planning and Implementation Guide
This Guide is designed to support administrators and teachers as they implement teacher evaluations at the school level.The Guide introduces and explains the requirements of the regulation and the principles and priorities that underlie them. It offers guidance, strategies, templates and examples that will support effective implementation of each of the five components of the evaluation cycle: self-assessment; goal setting and Educator Plan development; plan implementation and evidence collection; formative assessment/evaluation; and summative evaluation.
Part III: Guide to Rubrics and Model Rubrics for Superintendent, Administrator, and Teacher
The Guide presents the Model Rubrics and explains their use. The Guide also outlines the process for adapting them.
Part IV: Model Collective Bargaining Contract Language
This section contains the Model Contract that is consistent with the regulation, with model language for teacher evaluation. The Guide will contain model language for administrators represented through collective bargaining by March 15, 2012.
Part V: Implementation Guide for Principal Evaluation
This section details the model process for principal evaluation and includes relevant documents and forms for recording goals, evidence and ratings. The Guide includes resources that principals and superintendents may find helpful, including a school visit protocol.
Part VI: Implementation Guide for Superintendent Evaluation
This section details the model process for superintendent evaluation and includes relevant documents and a form for recording goals, evidence and ratings. The Guide includes resources that school committees and superintendents may find helpful, including a model for effective goal setting.
Part VII: Rating Educator Impact on Student Learning Using District-Determined Measures of Student Learning, Growth and Achievement
This document contain guidance for districts on identifying and using district determined measures of student learning, growth and achievement, and determining ratings of high, moderate, or low for educator impact on student learning.
Part VIII: Using Staff and Student Feedback in the Evaluation Process (May 2013)
Part VIII is scheduled for publication in May 2013.It will contain direction for districts on incorporating student and staff feedback into the educator evaluation process.
Part VII: Rating Educator Impact on Student LearningAugust 2012page 1 of iv
About This Guide
Advancing the academic growth of students is the core work of schools. The state’s new educator evaluation framework also puts it at the center of the evaluation and development of teachers and administrators by asking districts to identify at least two district-determined measures of student growth for all educators and to use those measures to assess each educator’s impact on student learning. This will help support a primary function of the new system, which is to provide timely, useful feedback to teachers to improve their practice andbetter support student learning.
The use of common measures of student performance for all educators also provides a groundbreaking opportunity to better understand student knowledge and learning patterns throughout the Commonwealth. What does it look like to achieve excellence in musical expression, or to excel in reading comprehension in a foreign language? Are there discrepancies in Grade 1 growth rates within a school or across a district, and what types of instruction support higher growth rates? Not only can multiple measures of learning better inform the instructional practice of individual educators, they have the potential to inform our overall understanding of how students learn and excel throughout the educational continuum.
Identifying credible, instructionally useful measures of student growth will require districts to think deeply about their instructional priorities and how those are reflected in their assessment strategies. Selecting district-determined measures gives districts a long-sought opportunity to broaden the range of what knowledge and skills they assess and how they assess learning.
Yet measuring how much students have learned is challenging, particularly in subjects and grades not typically covered by traditional assessments. This guide is meant to help districts as they begin this process. Questions this guide will answer include:
- How does student growth fit into the 5-Step Cycle?
- What criteria should I use when selecting district-determined measures of growth?
- Which types of measures work best for which types of educators?
- For which educators must I use state assessment data?
- What is meant by high, moderate, and low impact on student learning?
- By when must Iestablish my district’s measures?
- What supports will I need to establish in my district to implement this system?
- What do I need to report to ESE, and when?
- When will additional information be available from ESE?
While this guide will help districts start these important conversations, it will not address all the questions educators are likely to have or issues they are likely to confront as they undertake this work. Responses to many critical questions will evolve over the next months and years as districts in Massachusetts undertake this important work and as research and results from other states engaged in similar work accumulates. ESE will continue to provide updated guidance as new information becomes available.
Introduction and Purpose
On June 28, 2011, the Massachusetts Board of Elementary & Secondary Education adopted new regulations to guide evaluation of all licensed educators: superintendents, principals, other administrators, teachers and specialized instructional support personnel. Under these regulations, all educators will participate in a 5-Step Cycleof continuous improvement, at the end of which they receive a summative rating based on both their performance against the Standards and Indicators contained in the regulations, as well as attainment of goals established in their Educator Plans.[1] Educators in Level 4 schools and early adopter districts began implementing the 5-Step Cyclein 2011–12. All Race to the Top (RTTT) districts will be launching the 5-Step Cyclein fall 2012.
The regulations include a second dimension to the educator evaluation system: Every educator will receive a rating of high, moderate, or low for their impact on student learning. This impact rating is based on trends and patterns in student learning, growth, and achievement using at least two years of data and at least two measures of student learning, each of which is comparable across grade or subject district-wide.[2] These measures are referred to as district-determined measures and are defined in the regulations as:
…measures of student learning, growth, and achievement related to the Massachusetts Curriculum Frameworks, Massachusetts Vocational Technical Education Frameworks, or other relevant frameworks, that are comparable across grade or subject level district-wide. These measures may include, but shall not be limited to:portfolios, approved commercial assessments and district-developed pre and post unit and course assessments, and capstone projects.” (CMR 35.02)
At the heart of the work for districts in this phase of educator evaluation work is selecting and using credible district-determined measures of student learning, growth and achievement for a broad range of subjects and grade levels.Selecting district-determined measures gives districts a long-sought opportunity to broaden the range of whatknowledge and skills they assess and also howthey assess learning. Districts will be identifying or developing at least two measures for assessing student learning for educators in all grade spans and subject areas, including English language arts, family and consumer science and industrial arts, fine and performing arts, foreign languages, history and social studies, mathematics, physical education and health, science and technology, vocational and business education, and others.
Districts will be able to consider measures of both academic and social/emotional learning. The Department encourages districts to assess the application of skills and concepts embedded in the new English language arts and mathematics curriculum frameworks that cut across subjects, such as expository writing, non-fiction reading,reasoning and analysis, and public presentation. Districts are encouraged by the regulations and the Department to look beyond traditional standardized, year-end assessments to performance assessments and capstone projects scored against district rubrics and scoring guides, as well as interim and unit assessments with pre-and post- measures of learning. A district might consider, for example, using:
- Annual science fair projects in grades 6, 7, and 8 as the basis for assessing student growth in critical scientific skills and knowledge, as well as public presentation skills;
- Periodic student surveys of nutritional and exercise knowledge and practices, combined with annual fitness assessments, to assess student growth in critical life skills; and,
- The essay portion of common quarterly exams in U.S. History to assess growth in persuasive writing skills.
In short, the requirement to identify district-determined measures can be the impetus for broadening the range and strengthening the relevance of assessments and assessment practices used in schools and districts in the Commonwealth.
Selecting and using credible district-determined measures will also support successful implementation of the 5-Step Cycle.Strong student learning goals need to be built upon strong assessments. Sound district-determined measures will provide educators with useful data for self-assessment and a basis for relevant targets to consider for the “specific, actionable, and measurable” goal(s) for improving student learning required in the 5-Step Cycle. Since district-determined measures of student learning are “comparable across grade or subject level district-wide,” their existence will be especially helpful for teams of educators as they analyze data about student learning together and consider shared goals. Finally, and most importantly, credible district-determined measures focused on student growth will improve educator practice and student learning.
Districts will not be left alone to find and develop district-determined measures on their own. ESE has ambitious plans, described in more detail later in this Guide, to work with knowledgeable practitioners—administrators, teachers and others—to identify, share, and, in some cases, develop exemplar assessments for a wide range of content and grade levels that districts can consider.
This guide is designed to assist district leaders and other educators as they begin to explore appropriate district-determined measures and begin to envision a process for using results from district-determined measures to rate each educator’s impact on student learning.It is intended to lay the groundwork and provide tools for districts to begin planning for the challenging and important work of establishing multiple, instructionally useful, and credible measures of student learning, and using results from these measures to arrive at ratings of educator impact on student learning.
This guide will not address all the questions educators are likely to have or issues they are likely to confront as they undertake this work. Responses to many critical questions will evolve over the next months and years as districts in Massachusetts undertake this important work and as research and results from other states engaged in similar work accumulates. The Department is working on several supplements to this guide, based on continuing consultation with stakeholders and lessons learned locally and nationally.