EPA Phoenix
Forms for Detailed Scoring
Instructions
The following introduces forms and processes you can use to score students item by item, using the rubrics expounded in the EPA Phoenix Item-Specific Scoring Guide (which may be downloaded as either a Word or PDF file on the EPA Phoenix downloads page). The process involves:
Step A: using the Scoring Guide as your reference as you score students item-by-item, recording the scores on the scoring form described below
Step B: converting each score to a simple measure of adequate performance (e.g., whether the student's level of performance on the item was adequate)
Step C: aggregating the scores to obtain composite scores for the students by outcome area (e.g., technology use, reasoning with information, communication)
Step B provides a precise diagnosis of student proficiency. Step C allows you to aggregate performance across items. C is optional.
Use the Scoring Form to score students on Steps A and B. Use the Aggregation Form for Step C.
You may download the forms shown below in either Microsoft Word format or in Adobe Acrobat format.
Using the Scoring Form
Use the Scoring Form to score each individual student work. If the students are working in pairs or larger groups, use the same form for each student who contributed to the work, or use a separate form for each. Columns A-E provide item-by-item information about the scoring. Each row is for a different scoring instance. Some items need multiple scoring instances because they yield different evidences of different proficiencies. For example, item 17 has five scoring instances, which is another way of saying that it can be scored on five different dimensions (see rows N-R). Here steps to follow for each scoring instance (i.e., each row):
Step 1: Enter into column F the student's raw score. Before you score, consult the Item-Specific Scoring guide to study the rubric for the scoring instance you are focusing on, and its illustrative examples of student work. Enter "M" for missing if the student did not attempt to answer.
Step 2: Enter into column G whether or not the student's score constitutes adequate performance -- "1" for yes, "0" for no; "M" for missing. This process of extrapolating an adequate score from the raw scores has been developed to permit aggregating scoring instances into composite scores for the three outcome areas (see the Aggregation Form below for more on this). Consult Column E to determine what the minimum score is for adequate performance. For example, the proficiency of formulating an evidence-based conclusion from data (covered in items 5 and 6 -- row E) is scored on a 3-point rubric but either a 2 or 3 constitutes adequate performance according to the bar that has been set. (Note: You may alter Step 2 by raising or lowering the bar on what constitutes adequate performance if you think that a different bar would be more appropriate for your student population.)
Item-by-Item Scoring Form
Student 1 Name ______Student 2 Name______
School ______Date ______
A / B / C / D / E / F / G
Row / Item-by-Item Scoring Information
(for your reference) / Student Scores
(fill these in)
Item # / Outcome area / Proficiency component / Highest possible score / Minimum score for adequate performance / Score
(M=
missing) / Adequate Performance? (1=yes; 0=no; M=missing)
A / 1 / Technology Use / using attribute-based query tool to find targeted information in Web-based data base / 3 / 2
B / 2 / Reasoning with Information / interpreting
information on Web-based charts / 1 / 1
C / 3 / Reasoning with Information / transferring appropriate information from one data representation (chart) to another (data table) / 3 / 2
D / 4 / Reasoning with Information / recognizing patterns of data in data tables / 3 / 3
E / 5&6 / Reasoning with Information / formulating evidence-based conclusion from data / 3 / 2
F / 7 / Reasoning with Information / interpreting information on Web-based map / 1 / 1
G / 8 & 9 / Reasoning with Information / analyzing information on Web-based map / 4 / 3
H / 10 / Reasoning with Information / critically evaluating information on Web-based map / 1 / 1
I / 11 / Reasoning with Information / formulating evidence-based conclusion from data / 3 / 2
J / 12 / Reasoning with Information / interpreting information on data table / 3 / 3
K / 14&15 / Technology Use / formulating targeted phrase-based Web search query / 4 / 3
L / 16 / Reasoning with Information / finding relevant Web-based information / 2 / 2
M / 16 / Technology Use / citing URL / 3 / 3
N / 17 / Reasoning with Information; Communication / formulating and communicating argument (i.e., evidence-based conclusion from data) / 4 / 3
O / 17 / Communication / displaying adequate organization in written composition / 4 / 3
P / 17 / Communication / displaying correct mechanics in written composition / 4 / 3
Q / 17 / Technology Use * / using clip graphics in a composition developed on the computer / 3 / 2
R / 17 / Technology Use * / manipulating productivity tool interface to meet formatting requirements for composition / 3 / 2
* (Assign these scores only if your students are writing their compositions on the computer using a productivity tool that you have provided for them, such as Word, PowerPoint, HyperStudio, or ClarisWorks. For more about this, click "Home" or "administering the assessment."
Using the Aggregation Form
Following the item-by-item scoring, use the Aggregation Form to consolidate scores into the three general outcome areas. For each outcome area, use the following procedure:
*in column C, sum how many non-missing scores you can assign to the student (e.g., how many scores you could assign on items the student attempted)
*in column D, sum the number of student's scores that constitute adequate performance
*in column E, divide the number of scores you were able to assign (column C) into the number that were adequate (column D) to get a "percent adequate" score for the outcome area represented by the row
*in the bottom row, at your option, aggregate across the three outcome areas to get a a total score and percentage (e.g., C4=C1+C2+C3; D4=D1+D2+D3), then divide C4 into D4 to get a total percentage, which you put into E4.
The "percent adequate" score for each outcome area (e.g., row) is the percentage of attempted tasks that the student performed adequately on.
Aggregation Form
Student 1 Name ______Student 2 Name______
School ______Date ______
A / B / C / D / E
Row / Outcome area
(cells from the table are in parentheses) / Number of score-able instances if the student attempted to answer everything / Number of score-able instances on items the student has attempted to answer / Number of adequate scores / Percent of scores that are adequate
1 / Technology Use
(Column G, Rows
A, K, M, Q, R) / 5
2 / Reasoning with information
(Column G, Rows B, C, D, E, F, G, H, I, J, L, N*) / 11
3 / Communication
(Column G, Rows N*, O, P) / 3
4 / TOTALS
across outcome areas / 19
* Note: Some scores are aggregated in two outcome areas. For example, the quality of the argument provided in the student's composition is both a reasoning and communication proficiency.
Example of Scoring
The following is an example of how the forms can be used to score a student. All the data about the student are in italics and boldfaced in columns F and G.
Item-by-Item Scoring Form
Student 1 Name ______Student 2 Name______
School ______Date ______
A / B / C / D / E / F / G
Item-by-Item Scoring Information
(for your reference) / Student Scores
(fill these in)
Row / Item # / Outcome area / Proficiency component / Highest possible score / Minimum score for adequate performance / Score
(M=
missing) / Adequate Performance? (1=yes; 0=no; M=missing)
A / 1 / Technology Use / using attribute-based query tool to find targeted information in Web-based data base / 3 / 2 / 3 / 1
B / 2 / Reasoning with Information / interpreting
information on Web-based charts / 1 / 1 / M / M
C / 3 / Reasoning with Information / transferring appropriate information from one data representation (chart) to another (data table) / 3 / 2 / 2 / 1
D / 4 / Reasoning with Information / recognizing patterns of data in data tables / 3 / 3 / 2 / 0
E / 5&6 / Reasoning with Information / formulating evidence-based conclusion from data / 3 / 2 / 1 / 0
F / 7 / Reasoning with Information / interpreting information on Web-based map / 1 / 1 / 0 / 0
G / 8 & 9 / Reasoning with Information / analyzing information on Web-based map / 4 / 3 / 4 / 1
H / 10 / Reasoning with Information / critically evaluating information on Web-based map / 1 / 1 / 1 / 1
I / 11 / Reasoning with Information / formulating evidence-based conclusion from data / 3 / 2 / 2 / 1
J / 12 / Reasoning with Information / interpreting information on data table / 3 / 3 / 3 / 1
K / 14&15 / Technology Use / formulating targeted phrase-based Web search query / 4 / 3 / 4 / 1
L / 16 / Reasoning with Information / finding relevant Web-based information / 2 / 2 / 2 / 1
M / 16 / Technology Use / citing URL / 3 / 3 / 2 / 0
N / 17 / Reasoning with Information; Communication / formulating and communicating argument (i.e., evidence-based conclusion from data) / 4 / 3 / 3 / 1
O / 17 / Communication / displaying adequate organization in written composition / 4 / 3 / 4 / 1
P / 17 / Communication / displaying correct mechanics in written composition / 4 / 3 / 3 / 1
Q / 17 / Technology Use / using clip graphics in a composition developed on the computer / 3 / 2 / 3 / 1
R / 17 / Technology Use / manipulating productivity tool interface to meet formatting requirements for composition / 3 / 2 / 3 / 1
Aggregation Form
Student 1 Name ______Student 2 Name______
School ______Date ______
A / B / C / D / E
Row / Outcome area
(cells from the table are in parentheses) / Number of score-able instances if the student attempted to answer everything / Number of score-able instances on items the student has attempted to answer / Number of adequate scores / Percent of scores that are adequate
1 / Technology Use
(Column G, Rows
A, K, M, Q, R) / 5 / 5 / 4 / 80%
2 / Reasoning with information
(Column G, Rows B, C, D, E, F, G, H, I, J, L, N*) / 11 / 10 / 7 / 70%
3 / Communication
(Column G, Rows N*, O, P) / 3 / 3 / 3 / 100%
4 / TOTALS
across outcome areas / 19 / 18 / 14 / 78%
1 1