Selecting Screening and Progress Monitoring Tools

Schools implementing a Response to Intervention (RtI) framework often seek recommendations for scientific, research-based, and evidence-based interventions, and assessment tools. In response, the National Center on Response to Intervention (NCRtI) has developed three different tools charts: 1) screeningtools, 2) progress monitoringtools, and 3) instructiontools. The charts do not recommend specific products but are intended to be used as consumer reports for educators. It is important for schools to consult these charts with care as the assessment tools are very specific in nature and must be considered in light of the needs of the particular student or students.

The tool charts can be found at:

The following questions in this document are intended to be used while navigating the tools charts. This document was created in an effort to help schools furtherevaluate the numerous screening and progress monitoring resources listed on the NCRtIwebsite and other websites. Each section will highlight some essential questions that schools should ask to more adequately evaluate the use of these tools within a comprehensive and effective process. Finally, it is important to consider the perspectives of the professional organizations in the content areas (see Professional Resources at the end of this document). They offer important information about high quality core instructional practices in their respective disciplines and critical considerations about assessment tools.

Table of Contents

Essential Questions for Selecting a Screening Tool

Essential Questions for Selecting a Progress Monitoring Tool

Professional Resources

Essential Questions for Selecting a Screening Tool

NCRtI screening tools chart:

UNIVERSAL SCREENERS arevalid and reliable data collection tools and processes used to assess students’ current level of performance in relation to grade level benchmarks. Because screening takes place multiple times per year with all students, screeners are typically designed to be easy, quick, and repeatable.

UNIVERSAL SCREENINGPROCESSis a process in which data from multiple measures are analyzed to determine whether each student is likely to meet, not meet, or exceed academic benchmarks or behavioral expectations.This process typically involves screening all students multiple times in a school year to assure all students equitable access to timely interventions/challenges. Multiple types of data, including consideration of students’ culture, should be collected to assist in a complete universal screening process. As a part of the screening process, teams use decision rules to determine levels of support for students based on results. Teams also use a process to analyze aggregated and disaggregated universal screening results as a way to measure the effectiveness of their overall curriculum and instruction for all students as well as for sub-groups of students.

Need

  1. What content area are you considering screening (e.g., general math, calculation, general reading, phoneme segmentation, fluency)? Click here to enter text.
  1. Which grade level(s) are you considering screening?Click here to enter text.
  1. Which screening tool are you considering?Click here to enter text.

Evaluation of Scientific Rigor

  1. For the screening tool you are considering, how is the evidence for the following criteria rated?[1]
  2. Classification accuracyChoose an item.
  3. GeneralizabilityChoose an item.
  4. ReliabilityChoose an item.
  5. ValidityChoose an item.
  6. Disaggregated reliability, validity, and classification data for diverse populationsChoose an item.

Evaluation of Efficiency

  1. Is the tool administrated to groups or individual students?Click here to enter text.
  1. How much time does this screening tool require for administration?Click here to enter text.
  1. Is there a scoring key and what is the format?Click here to enter text.
  1. Are results in benchmark/norm form?Click here to enter text.

Evaluationof Deliverability

  1. In what format is this tool (e.g., software, web-based, paper/pencil)?Click here to enter text.

Do you have the resources to support that format?Click here to enter text.

  1. What is the cost for this screening tool?
  2. InitialClick here to enter text.
  3. AnnualClick here to enter text.
  4. Do we have the financial ability and budget to support this cost? Choose an item.
  1. How are data reports generated and received?Click here to enter text.
  1. What type(length, schedule, format) of training will be required to administer the tool? To analyze reports?Click here to enter text.
  1. How much time will you allocate for analyzing and making decisions with the results?Click here to enter text.
  1. What decisions will you make with the results?Click here to enter text.
  1. How will parents be informed of results and decisions?Click here to enter text.
  1. What strengths do you note?Click here to enter text.
  1. What weaknesses do you note?Click here to enter text.
  1. Other considerations?Click here to enter text.

Based on our responses to the analyzing questions above, does this tool match our need, and can it be delivered by us as intended with fidelity? YES or NO Click here to enter text.

Essential Questions for Selecting a Progress Monitoring Tool

NCRtI progress monitoringtools chart:

PROGRESS MONITORINGis a process used to assess students’ academic/behavioral performance, to measure student responsiveness to interventions/challenges, and to evaluate the effectiveness of interventions/challenges.

PROGRESS MONITORING TOOLS arevalid and reliable assessments used to quantify a student’s rate of improvement in response to an intervention/challenge; these tools are designed to be easy, quick, repeatable, and highly sensitive to change in student performance

Need

  1. For what student skill(s) are you investigating a progress monitoring tool (e.g., calculation, math concepts/applications, reading comprehension, oral reading fluency, letter naming, letter sound fluency)?Click here to enter text.
  1. At which grade(s) level?Click here to enter text.
  1. Which progress monitoring tool are you considering? Click here to enter text.

Evaluation of Technical Adequacy Standards

  1. Forthe progress monitoring tool you are considering, how is the evidence for the following criteria rated?
  1. ReliabilityChoose an item.
  2. ValidityChoose an item.
  3. Alternative formsChoose an item.
  4. SensitivityChoose an item.
  5. BenchmarksChoose an item.
  6. Rates of improvementChoose an item.
  7. DisaggregateddataChoose an item.

Evaluation ofDeliverability

  1. In what format is this tool administered (e.g., software, web-based, paper/pencil)? Click here to enter text.

Do we have the resources to support that format?Click here to enter text.

  1. What is the cost for this progress monitoring tool?
  2. InitialClick here to enter text.
  3. AnnualClick here to enter text.
  1. How much time does this tool require for administration? Click here to enter text.
  1. How are data reports generated and received? Click here to enter text.
  1. How does the progress monitoring tool identify whether a student is making sufficient progress or insufficient progress? Using what type of measurement (e.g., percentile, raw.)? Click here to enter text.
  1. What type of training will be required to administer the tool? To analyze reports? Click here to enter text.
  1. How much time will you allocate for analyzing and making decisions with the results?Click here to enter text.
  1. Who (what personnel) will deliver this progress monitoring tool? Click here to enter text.
  1. What decisions will you make with the results? Click here to enter text.
  1. How will parents be informed of results and decisions?Click here to enter text.
  1. What strengths do you note? Click here to enter text.
  1. What weaknesses do you note? Click here to enter text.
  1. Other considerations? Click here to enter text.

Based on our responses to the analyzing questions above, does this tool match our need, and can it be delivered by us as intended with fidelity? YES or NO Click here to enter text.

Professional Resources

The Wisconsin Department of Public Instruction recommends NCRtI’s resources. However, there are other quality resources available for schools. Below is a listing of some of those resources.

Screeners

National Center for RtI /
Electronic Learning Assessment Resources /
RTI Action Network /
Center on Instruction /

Progress Monitoring

RTI National Center /
Intervention Central- Curriculum Based Measurements /
Electronic Learning Assessment Resources /
RTI Action Network /
Center on Instruction /

Professional Organizations

International Reading Association Resources /
Wisconsin State Reading Association /
Wisconsin Reading Coalition /
National Council of Teachers of Mathematics /
Wisconsin Mathematics Council / wismath.org
National Association of School Psychologists / nasponline.org
Wisconsin Association of School Psychologists / wspaonline.net/PositionPapers.aspx
Wisconsin Association for Bilingual Education /
Wisconsin Association for Talented & Gifted /
Wisconsin Early Childhood Association /
Wisconsin Association for Supervision & Curriculum Development /

[1] NCRtI evaluates tools in its tool charts based on these criteria. Other sites you use may evaluate tools in different ways.