SMILE

JohnsHopkinsUniversity

Baltimore, MD USA

Guidelines for Manual Evaluation of CAP Urinalysis Results

Author:
Heidi Hanes, BS, MT (ASCP) SH / Document Number: / Pro22-23
Effective (or Post) Date: / 10 Dec 08
Date of last review: / 5 Aug 2010
Reviewed by: / Heidi Hanes
SMILE Comments: This document is provided as an example only. It must be revised to accurately reflect your lab’s specific processes and/or specific protocol requirements. Users are directed to countercheck facts when considering their use in other applications. If you have any questions contact SMILE.

Purpose: These instructions are for performing a manual evaluation of CAPUrinalysis survey results. They can be adapted for performing manual evaluations for results from other EQA providers. Manual evaluations are performed when official grading is not done by your EQA provider. This can be because the survey was not resulted by the due dateor when an additional instrument is tested.

Materials: You will need the following documents:

  • A list of the instruments and methods that your laboratory uses for each analyte tested.
  • CAP Kit Instructions – These will be used to find your instrument/method codes. You will need this information to decide on a peer group.
  • CAP Participant Summary Report (PSR) – This lists the peer group means and standard deviations.
  • Urinalysis Manual Evaluation Template (Appendix A) – You complete this spreadsheet to determine if your results are acceptable according to the CAP/CLIA criteria used by SMILE.

Procedure: How to complete and interpret the manual evaluation:

  1. Open the CAP Urinalysis Manual Evaluation Template excel file. Save the file according to your naming convention – it should be specific for the instrument used and the survey module (e.g. Seimen Diag Clinitech 500 CAP2008 Urinalysis CM--A Manual Evaluation).
  2. Each analyte has its own section on the template (Appendix A). Depending on whether the results are quantitative or qualitative there are two table formats. Refer to Appendix B for an example of where to find necessary information in the CAP Participant Summary Book and for how to enter information in the correct area of the template.

Quantitative Analyte Procedure:

Qualitative Analytes
Specific Gravity
Acceptable Criteria = ± 2 SD or 0.010, whichever is greater
Your result / Mean / SD / Lower / Upper / SDI / Your Grade
CM-01 / 1.000 / 1.0198 / 0.0044 / 1.010 / 1.030 / -4.50 / Unacceptable
CM-02 / 1.015 / 1.0169 / 0.0045 / 1.007 / 1.027 / -0.42 / Acceptable
CM-03 / 1.010 / 1.0238 / 0.0039 / 1.014 / 1.034 / -3.54 / Unacceptable
  1. Analyte Name: Found in the top box.
  2. Acceptability Criteria: The acceptability criteria are listed below the analyte name. SMILE uses acceptability criteria that have been established by CAP and/or CLIA regulations.
  3. For most analytes, you will see only one type of acceptability criteria (e.g. + 20%).
  4. For other analytes, two sets of acceptability criteria are listed (e.g. + 20% or +1.0, whichever is greater). In this case, you can evaluate the results using both criteria and choose the one that gives the wider acceptability range.
  5. Peer Group: Use this information to determine your peer group. Sometimes, CAP does not have a peer group for your specific instrument and method combination. In this case, you can contact SMILE, and your primary or back-up representativecan help you determine the correct peer group to use.
  6. Your Result: Enter your results for each specimen. These results should be entered in columns B or J on the template.
  7. Mean: Use the CAP Participant Summary Report (PSR) to find the peer group mean. The peer group mean should be entered in column C or K on the template.
  8. SD: Use the CAP PSR to find the peer group standard deviation for each specimen. The peer group standard deviations are entered in columns D or L on the template.
  9. Lower and Upper: The template has been arranged so that your acceptable range is automatically calculated when you enter your result, the peer mean, and the peer standard deviation.
  10. Lower: Columns E and M list the lower limit of the acceptable range.
  11. Upper: Columns F and N list the upper limits of the acceptable range.
  12. SDI: The SDI is automatically calculated when you enter your result, peer mean, and peer SD. Use the SDI listed in column G or O to determine if there is a positive or negative bias present.
  13. Any SDI greater than + 2.0 indicates a bias for that specimen.
  14. If two or more specimens demonstrate a bias in the same (positive or negative) direction, then there is a bias for that analyte.
  15. Your Grade: If your results fall within the acceptability limits, column H or P should indicate “Acceptable” for your grade. If your results are outside of the acceptable limits, your grade will be “Unacceptable.” (Note that if the result is on the upper or lower limits of the acceptable range the spreadsheet may read “unacceptable” when the result is really acceptable. Under these circumstances, the acceptability column should be corrected).

NOTE: The quantitative analytes are Gastric pH, Osmolality and Specific Gravity.

Qualitative Analytes Procedure:

Qualitative Analytes
Protein, Urine
Your result / Good/Acceptable Responses / Your Grade
CM-14 / Negative / Negative / Good
CM-15 / 300 - 600 mg/dL (2+) / 300-600, or ≥ 1000 mg/dL / Good
CM-16 / 300 - 600 mg/dL (2+) / 100-150 or 300-600 mg/dL / Good
  1. Analyte Name: Found in the top box.
  2. Acceptability Criteria: For qualitative procedures in urinalysis, evaluation is based on participantconsensus by method and instrument. For each analyte, a minimum of two, butnot more than four, responses will be given a passing score. Analyte resultsgraded “Good” performance must have 80% participant consensus. Eightypercent participant consensus can be determined by grouping the mode with thenext one or two most frequent responses. This group will be given “Good “performance.

“Acceptable” performance will be given to additional responsesuntil a minimum of 90% of participant results are given a passing score.

In thecase of a negative specimen, negative responses must constitute 90%

participant consensus. Specimens with results for one of more methods

distributed over both negative and positive responses (non consensus) will not

be evaluated.

Specimens for which there is greater than 90% of participantresponses distributed over more than four responses will be graded as “Non- Consensus”

  1. Peer Group: Use this information to determine your peer group. For the Qualitative analytes there will be several results. The category with the most entries is the “Good” result. Results on either side of the “Good” resultare Acceptableresults. Occasionally, CAP will allow up to 3 results to be included in the acceptable range. Read the PSR Evaluation Criteria for detail gradinginformation or contact your SMILE representative for assistance.

If CAP does not have a peer group for your specific instrument and method combination, you can contact SMILE, and your primary or back-up representativecan help you determine the correct peer group to use.

  1. Your Result: Enter your results for each specimen. These results should be entered in columns B-D orJ-L on the template.
  2. Good/Acceptable Response: Enter the Good and Acceptable response in columns E-G or M-O on the template.
  3. Your Grade: For the qualitative analytes you must type in Acceptable or Unacceptable manually.
  1. Evaluate your results. Conduct investigations for any analytes demonstrating unacceptable results or a positive/negative bias.

Appendices:

  1. Urinalysis Manual Evaluation Template
  2. Urinalysis Manual Evaluation Example

Pro22-23 Guidelines for Manual Evaluation of CAP Urinalysis Results (with comments) .docPage 1 of 4