FPS Response to Instruction Research Rubric

Intervention Name / Intervention Type: Program and/or Individual Intervention

Although the term scientifically based research is not defined in the Individuals with Disabilities Education Improvement Act of 2004 (IDEA 2004), Congress clearly aligned many of the 2006 IDEA regulations (e.g., interventions based on scientifically based research) with requirements of the No Child Left Behind (NCLB) Act of 2001 (U.S. Department of Education, 2006, 34 C.F.R. § 300.315 et seq.). According to the NCLB requirements, scientifically-based research (A) Means research that involves the application of rigorous, systematic, and objective procedures to obtain reliable and valid knowledge relevant to education activities and programs; and

Statistics: / Not Applicable / Poor /
Not Available / Average / Good / Excellent
(B) Includes research that—
(i) Employs systematic, empirical methods that draw on observation or experiment;
Clarifying Question: Does the “methods” of the research make reasonable sense?
(ii) Involves rigorous data analyses that are adequate to test the stated hypotheses and justify the general conclusions drawn;
Clarifying Question: Does the data suggest “significance” for the intervention?
(iii) Relies on measurements or observational methods that provide reliable and valid data across evaluators and observers, across multiple measurements and observations, and across studies by the same or different investigators;
Clarifying Question: Can the results be replicated in different settings?
(iv) Is evaluated using experimental or quasi-experimental designs in which individuals, entities, programs, or activities are assigned to different conditions and with appropriate controls to evaluate the effects of the condition of interest, with a preference for random-assignment experiments, or other designs to the extent that those designs contain within-condition or across-condition controls;
Clarifying Question: Does the research have an experimental and control group? Is the research outcome due to the intervention?
(v) Ensures that experimental studies are presented in sufficient detail and clarity to allow for replication or, at a minimum, offer the opportunity to build systematically on their findings; and
Clarifying Question: Can you read the research and replicate the study?
(vi) Has been accepted by a peer-reviewed journal or approved by a panel of independent experts through a comparably rigorous, objective, and scientific review. (No Child Left Behind Act of 2001, 20 U.S.C. § 1411(e)(2)(C)(xi))
Clarifying Question: Is the journal peer-reviewed, or independently reviewed?
Efficiency: / Not Applicable / Poor /
Not Available / Average / Good / Excellent
Administration Time
Clarifying Question : Will the administration time be worth the instructional time?
Clear Administration Procedures
Clarifying Question : How easy are the administration procedures?
Skills taught related to skills we want to teach?
Clarifying Question : Will the intervention match the skills we intended to teach?
Cost
Clarifying Question : Cheap?! J
Training Time
Clarifying Question : useful training done as quickly as possible to protect instructional time
Appropriate for K-6
Clarifying Question : your call J
Appropriate for 7-12
Clarifying Question : your call J