An Assessment of XXXXXX RCS Range
Compliance with ANSI-Z-540 (ISO-25)
RCS Range Book Certification Compliance,
Comments and Evaluation
By
XXXXXXX RCS Certification
Review Committee
MEMBERS
Member #1, Committee Chair
Member #2
Member #3
Date of Midterm Report
This report contains information and data from the XXXXX Corporation. The information is considered Company Proprietary, and is therefore not approved general public dissemination. If you have received this report in error, contact Company XXX Focal Point (Mr. Law Suitsrus) at yyy-yyy-yyyy, or The Committee Chair, Mr. Brainless Idiot at (zzz-zzz-zzzz).
{This report is a general boilerplate and
contains no specific review information}
Foreword to RCC RCS Review Committee Assessment
This report is the midterm assessment of the Radar Cross Section (RCS) Range Certification Compliance Review Committee. The members of the XXX RCS Certification committee includes [Committee member 1, company 1, Committee member 2, company 2, committee member 3, company 3]
The RCS range book review was conducted according to procedures identified in Report RADAR CROSS SECTION (RCS) CERTIFICATION FOR STATIC AND DYNAMIC RCS MEASUREMENT FACILITIES VOLUME I – CERTIFICATION PROCESS, RCC/SMSG Document 804-01, produced for DoD by the Range Commanders Council Signature Measurements and Standards Group (RCC/SMSG). This report contains objective evaluation criteria for assessing the compliance with the above-cited standard.
In addition to the review conducted by the three RCC/SMSG review panel members, four “priority one” sections of the XXX range book were also reviewed by scientists from NIST Boulder Laboratory (RF Technology Division’) technical staff, who by prior agreement are acting as informal (non-endorsing) consultants to the RCC/SMSG review committee. The presence of the NIST reviewers in no way is an official NIST endorsement of the certification process or methods. The NIST review comments are included with this midterm assessment as Appendix A.
Overall, the XXXX Compliance report carries the grade “Insert Midterm Grade Here”. This is not to be construed as bad or unusual at this point in the review process, as nearly 20% of the evaluation criteria are assessed on site. Once the range has had the opportunity to digest the assessment, they nominally have 60 days to correct before scheduling the review committee’s “on-site review”. We strongly suggest that XXX range make arrangements with the committee chair to set up that on-site review date as soon as possible.
Please note the distribution restrictions of Appendix A, pages YY-YY. It is not authorized for general public dissemination. If you should have a question regarding who can see the Appendix A report, contact the RCC/SMSG Radar Committee Chair, Mr. Bob. Bender, at 410-278-4319, or the XXX Range Review Committee Chair [POC and Phone Number here].
This interim RCS Certification Report has been reviewed by the committee and is hereby released to XXX Corporation for disposition. Please refer questions back to the committee chair, (POC and phone number) or (Chair email address).
______
Member 1 Signature Member 2 Signature Member 3 Signature
XXX RCS Certification Review Milestones
Range Book Received From XXX Corp: (Insert Appropriate Dates Here)
Priority I Sections to NIST: “
Priority 1 Sections Received by NIST “
Priority I Review Completed: “
Priority I NIST Comments Received & Reconciled: “
Priority I Reconciled with Review Committee: “
Priority I Preliminary Report to XXX Corp: “
Priority II Review Completed: “
Priority II Reconciled with Review Committee: “
Priority II Preliminary Report to XXX Corp: “
Priority III Review Completed “
Priority III Reconciled with Review Committee: “
Complete Midterm Report Mailed to XXX Corp1:: “
On-Site Review Scheduled: “
On-Site Review Executed: “
Final Corp XXX Inputs Received to correct outstanding
Technical issues (if needed): “
Final Report Complete:
Final Report Transmitted to RCC/SMSG & XXX Corp: “
1 Note that NIST comments are integrated in the midterm report
as an Appendix. The Review committee may make introductory comments
to this appendix.
Table of Contents
Cover…………………………………………………………………..1
Foreword………………………………………………………………2
Corp XXX Certification Review Deadlines…………..…………….3
Table of Contents……………………………………………………..4
Evaluation Method……………………………………………………5
Section 1………………………………………………………………..
Section 2………………………………………………………………..
Section 3………………………………………………………………..
Section 4………………………………………………………………..
Section 5………………………………………………………………..
Section 6………………………………………………………………..
Section 7………………………………………………………………..
Section 8………………………………………………………………..
Section 9………………………………………………………………..
Section 10………………………………………………………………
Section 11………………………………………………………………
Section 12………………………………………………………………
Section 13………………………………………………………………
Section 14………………………………………………………………
Section 15………………………………………………………………
Section 16………………………………………………………………
Section 17………………………………………………………………
Section 18………………………………………………………………
Section 19………………………………………………………………
Section 20………………………………………………………………
Appendix A – NIST Assessment Report & Review Committee
Introduction to NIST assessment…………………….
RCS Range Book
Certification Report Passing Criteria
The following scale applies to ALL Evaluation Criteria:
S = Fully Satisfactory - meets or exceeds standard (No review comments required)
N = Marginally Satisfactory but needs improvement (Marginally meets standard but may be improved using mandatory reviewer comments as guidance)
U = Unsatisfactory (Does not meet standard and should be re-accomplished using mandatory reviewer comments as guidance)
N/A = Not Applicable (Reviewer comments needed if the N/A reason is non-obvious)
Grading Criteria: Each Range Book section carries a priority for grading purposes. The grading priorities have been selected to be consistent with the sections of the Range Book that have the most impact on the quality, accuracy and repeatability of RCS range measurements. The sections of the Range Books have been divided into the following priorities:
Priority 1 – Sections 9, 10, 11, 17, 18 and 19
Priority 2 – Sections 5, 8, 13, and 20
Priority 3 – Sections 1, 2, 3, 4, 6, 7, 12, 14, 15 and 16
A PASSING Certification Evaluation Report shall meet all the following Evaluation Criteria:
The total of the Priority 1 section criteria shall receive minimum composite scores of 85% Satisfactory (S) grades and 15% Needs Improvement (N) grades. No Unsatisfactory (U) grades are allowed.
The total of the Priority 2 section criteria shall receive minimum composite scores of 75% Satisfactory (S) grades and not more than 10% Unsatisfactory (U) grades permitted with the balance of 100% being Marginally Satisfactory (N). (e.g. 77%S, 8%U, 15%S passes the Priority 2 sections)
The total of the Priority 3 section criteria shall receive minimum composite scores of 65% Satisfactory grades and not more than 20% Unsatisfactory grades permitted with the balance of the 100% being Marginally Satisfactory. (e.g. 69%S, 18%U, and 12%N would pass the Priority 3 sections)
Note that “N/A” grades are excluded from the percentage count. Standard round-up techniques will be used: (i.e. 84.5%=85%, 84.49%=84%)
The composite score is the average score derived from the three reviewers if the reviewers disagree. The following scale will be used:
Individual reviewer grade / Composite Grade / CommentsS, S, N or S, S, U / S / N or U minority comments required
S, N, N or S, N, U or N, N, U / N / N or U comments required
S, U, U or N, U, U or U, U, U / U / majority comments required
Only one of two possible grades will be assigned to the overall certification report:
Passing or Revision Required Before Passing
A report receiving the Revision Required Before Passing grade may be upgraded to Passing upon closure of the requisite number of graded items under the proposed grading criteria. Note that at the conclusion of the on-site review, the review committee will share with the range where it stands at that point and will give the range ample opportunity to respond to issues. If closure of these issues takes longer than 30 days, the range can ask for an additional 30-day extension of the final report issuance until they correct the requisite number of outstanding issues.
Corp XXX RCS Range Book
Evaluation Criteria by Section
(Note: Sample grades are in bolded red. These are fabricated, and represent nothing specific to any previous or ongoing review. )
Section 1 – Introduction and Endorsement (Priority 3):
Key information for this section: This section should contain a brief statement of compliance with the ANSI/NCSL Z540-1 standard as customized to RCS [1], as well a clear policy statement regarding the organization's commitment to continuous quality improvement. The Range Book should be signed as approved by an appropriate manager or director, who should be near or at the top of the reporting chain of the range quality manager or technical lead engineer. The exact format and wording can be customized to suit the host organization.
Evaluation Criteria (See Page 2):
_N__ 1.1: Does the Range Book identify the host organization?
Since this is not an “S”, insert appropriate comments to guide the range to raise the grade to an “S”.
_S__ 1.2: Is the endorsement signed by an appropriate manager or director who has the responsibility and authority to direct changes and corrections should range or product deficiencies be found? (Alternate location for section 5.2f)
Although there are no requirements to provide comments for “S” grades (except minority comments), the reviewers often make comments even to acceptable range book sections. .
_U_ 1.3: Is there a clear commitment to quality in the introduction and endorsement?
Since this is not an “S”, insert appropriate comments to guide the range to guide the range how to raise the grade to an “S”.
___ On-site Review: Ask to meet the endorser. Is the endorser clearly committed to the quality process?
Section 2 - Applicable Documents (Priority 3)
Key information for this section: This section should list documents cited in the Range Book. In particular, it may be convenient to complete stand-alone reports covering various aspects of range operations (e.g., operational security, measurement procedures, uncertainty analysis procedures, equipment documentation) which could be included in the Range Book by reference only.
Evaluation Criteria:
___ 2.1: Does the Range Book include a list of documents and references external to the Range Book?
___ 2.2: Are all references unambiguous enough to identify documents?
___ 2.3: Are the documents listed cross-referenced or linked to the appropriate Range Book section?
___ On-site Review: Ask to see 5 documents at random in this list.
Section 3 – Glossary (Priority 3)
Key information for this section: This section should list or reference the relevant definitions from NCSL Z-540-1 Section 3, in addition to specific range-related definitions and acronyms. Other specialized terms related to the acquisition and processing of RCS data should also be defined. The information in this section should aid the reviewers in translating technical jargon from the body of the report.
Evaluation Criteria:
___ 3.1: Does the Range Book contain an appropriate glossary?
___ 3.2: Do acronyms (jargon) occur in any other Range Book section that is not defined (immediately) in that section or listed here?
(No On-site Review Criteria)
Note to reviewers: Please list any undefined acronym below.
______
______
______
______
Note to Range Book Authors: After review, please include in the glossary any acronyms or terms identified by reviewers as undefined.
Section 4 – Organizational and Management Structure (Priority 3)
Key information for this section: This section should fully define the organization that is chartered to operate the range. The management hierarchy from the range-line technicians and engineers through the highest levels of the range management should be defined. Lead personnel and approved signatories should be identified. The range quality manager and technical managers must be identified. Ideally, complete work phone numbers should be available for all critical range personnel. Standard company organization charts are acceptable. Also, a policy statement on customer confidentiality and or proprietary rights protection must be included here.
Evaluation Criteria:
___ 4.1: Does the Range Book contain a complete reporting chain or organizational chart of the range?
___ 4.2: Does the range identify a range technical manager?
___ 4.3: Does the range identify the range quality manager?
___ 4.4: Does the range identify the management chain from the technician level to the highest level of the organization?
___ 4.5: Does the range quality manager have direct and unfettered access to the individual signing the endorsement in Section 1, Introduction and Endorsement?
___ 4.6: Is there a clear policy on non-disclosure and/or company proprietary data or information?
___ 4.7: If range operators, engineers and/or technicians are from a different organization or company than the range owners, are the respective roles and responsibilities of the two organizations and their interfaces clearly spelled out?
___ 4.8: Are personnel qualifications available or referenced in other Range Book sections?
___ 4.9: In cases of absence, are alternate technical and quality managers identified?
___ On-site Review: Ask range technicians whom technical and quality managers are.
___ On-site Review: Ask the quality manager if he has direct access to Endorser of Section 1.
___ On-site Review: Check to see if the range technicians and engineers know who the Primary and Alternate technical and quality managers are.
___ On-site Review: Is the range supervision done by person(s) familiar with the calibration methods and procedures, the objective of the calibration and how to assess the results?
Section 5 - Quality System, Audit Trails and Reviews (Priority 2)
Key information for this section: All items of section 5 need to be addressed at some point in the Range Book. Because of their importance, some of these items are treated in separate sections of the Range Book. Any such information requested in Section 5, but appearing elsewhere in the Range Book must be appropriately documented. For example, Section 5.2(a) appears in this book in Section 1. Here we include all items that are not treated separately, as listed after the section heading. The purpose of this section is to ensure that a complete overview of the company's quality system and its self-auditing process are given. Important miscellaneous items are to be included here. We recommend closely following the appropriate parts of section 5 of the main text. Section 5.2(s) should be the section where the certification audit report is attached.
Evaluation Criteria:
Note: Z540 5.2(e) is found in Range Book Section 6
Z540 Sections 5.2.f is found in Range Book Section 1
Z540 Section 5.2g is found in Range Book section 9
Z540 Sections 5.2h, j, l, m and n is found in Range Book Section 10
Z540 Section 5.2k is found in Range Book Section 11
Z540 Section 5.2q is found in Range Book Section 16
Z540 Section 5.2r is found in Range Book Section 4