American Institute of Constructors

Constructor Certification Commission Document No. 33

Instructions to Score Level I (AC) Writing Skills Examination Questions

These instructions are in two parts. Part A contains the instructions to the Leader of the Scoring Session and Part B are the instructions for the Scorers.

Part A -Instructions to the Leader of the Scoring Session for the Level 1 (AC) Writing Skills Examination Question

These instructions are to help organize the training session and the scoring of the Level 1 (AC) Writing Skills Examination Question in a 4 – 5 hour period of time.

Prior to the start of writing skills scoring training, the Scoring Session Leader is to:

1.Review the Writing Skills Scoring Subcommittee Operations Manual (Commission Document No. 21), and the Commission Policy and Procedures No. 1.4 titled Scoring of Writing Skills Portion of the Level I (AC) Certification Examination.

2.Review the Commission Examination Committee Member Training Power Point presentation - Training of Scorers for the Writing Skills Portion of the Level 1 Examination.

3.Read Document 33 Part A - Instructions to the Leader of the Grading Session Level 1 (AC) Writing Skills Examination Question and follow the instructions for organizing the scoring session.

4.Read Document 33 Part B - Instructions to Scorers in the Scoring Session Level 1 (AC) Writing Skills Exam Question to organize and prepare for the scoring session with scorers.

At the start of the writing skills scoring training, the Scoring Session Leader shall:

1.Have each Scorer complete and submit Document No. 32 titled the Non-Disclosure Statement for the Scoring of Level I (AC) Certification Examination Writing Skills Questions.

2.Verify that each Scorer has the following documents in the order noted before starting the training session:

Exhibit A - Writing Assignment Skills Examination Candidate Question

Exhibit B – A DAY AT THE JOB SITE AIC EXHIBIT #118

Exhibit C – 9 Sample Business Letters with Candidate ID numbers 12561 – 12569

Commission Document No. 33 Part B - Instructions to Scorers

Commission Document No. 34 - Writing Assignment Score Submission Form

Commission Document No. 37 – Training Session Participant Evaluation

Conduct the Scorer training session using Document No. 33 Part A, Exhibits A – C, Commission Documents 33, 34 and 37 and the power point presentation titled Training of Scorers for the Writing Skills Portion of the Level I Certification Examination in the following order:

1.Present the power point presentation titled Training of Scorers for the Writing Skills Portion of the Level I Certification Examination.

2.Discuss the A Day at the Job Site scenario using specific paragraphs from Exhibit B, than review the point distribution using Commission Document No. 33 - Part B.

3.Ask each Scorer to read the first sample business letter in Exhibit C and using the Business Letter Scoring Criteria, and the Business Letter Scoring Criteria / Descriptors score the sample.

4.After, everyone has read and scored the sample letter they share their scores and the Session Leader states what the Consensus Score was for that sample letter from the answers provided for each letter (Refer to the Master Consensus Scores enclosed with the Exam Package).

5.The Session Leader describes the items that were missing from the letter to have the Scorers in the session become consistent in their scoring of the writing samples.

6.The Session Leader will repeat this process for all nine sample letters.

7.Upon completion of the scoring of the samples, each Scorer will place their score for each sample letter on Commission Document 34 titled Writing Assignment Score Submission Form along with completing the top of the form by printing their last name, first name and the Scorer’s phone number.

8.The Session Leader then collects Exhibits A, B, C and Commission Document No. 34.

9.Have each Scorer complete Commission Document No. 37titled Constructor Certification Commission Training Session Participant Evaluation and return to the Session Leader before moving on to the actual scoring exercise.

10.Next the Scoring Session Leader shall have each Scorer print and sign their name and provide their, CPC or AC number on Commission Document No. 43 titled Scoring Session Leader Training Assessment Form and provide the information along with his or her signature and date on the bottom of the form.

11.Within the allocated time, the writing skills questions are scored and the scores entered onto Commission Document No. 34 – Writing Assignment Score Submission Form.

12.The completed and signed scoring forms are compiled by the Scoring Session Leader and sent to the Examination Contractor along with the business letters and all supplementary materials.

13.The Scoring Session Leader sends the signed and date Commission Document No. 43 along with the completed Scorer’s training session evaluations to the Subcommittee Chair for review and forwarding to the Chair of the Examination Committee and then to the Certification Manager.

The actual Scoring of the Formal Business Letter begins with each Scorer having the Business Letter Scoring Criteria, and the Business Letter Scorer Criteria / Descriptors from Part B of this Document in front of them.The Scoring Session Leader will distribute paper clipped packages of 30 actual Candidate Writing Assignments along with Document No. 34 Writing Assignment Grade Submission Form on top and each Scorer will score the packet in silence without any discussion.

1.After the Scorer has completed that packet of 30, and the scores are entered onto Commission Document No. 34 by the Scorer. Then each Scorer returns the packet and completed Document 34 to the Session Leader and in turn will receive another packet for scoring until all Writing Assignments are completed.

2.Upon completion of all Writing Assignment packets, the Scoring Session Leader will collect all materials from the Scorers including Document 33 - Instructions to Scorer Level I (AC) Writing Skills Examination Questions and place them into a box with the other items.

3.The Scoring Session Leader will gather all Document No. 34 - Writing Assignment Grade Submission Forms into one packet (separate from the Candidate’s Writing Assignment Answer Sheets) and fax all Documents No. 34 to the number provided on the bottom of the document.

4.The Scoring Session Leader will put all Candidates Writing Assignment Answer Sheets, the Document No. 34 Grade Submission Forms and any other items back into the box and return immediately in their prepaid envelop to the Examination Contractor. No documents can leave the room with the Scorers and the Scoring Session Leader must ensure that all documents that were sent are returned to the Examination Contractor.

5.The Scoring Session Leader will complete Document No. 51 titled Meeting Minutes Template and fax

or email it back to the Writing Skills Scoring Subcommittee Chair.

Part B - Instructions to Scorers in Scoring the Level 1 (AC) Writing Skills Exam Question

The AIC Constructor Certification Commission decided that a portion of the Level 1 Associate Constructor Examination would require each candidate to demonstrate their written communication skills using the scenario exhibit #118 titled A Day at the Job Site. The Level 1 Examination Booklet question, the specific paragraphs from the scenario, and the Answer sheet instructions with the exact wording provided to each candidate is provided below:

Points XXX – XXX are based on Exhibit #118 ( A day at the Job Site).

On side 2 of your answer sheet, write a formal letter to the Owner’s Representative confirming the change to the door finishes as stated in the scenario A Day at the Job Site.

This assignment is a test of your written communication skills. You will be graded on the final letter written by you. Use appropriate business letter format and copy appropriate parties. Write clearly and legibly using complete sentences. Scratch paper is provided in the Exhibit Booklet for drafts.

Your formal business letter will NOT be scored unless it appears on side 2 of your answer sheet.

A DAY AT THE JOB SITE

XYZ Hospital Expansion Project

(Job # 123R)

Milltown, RI 02819

Paragraph 7 from the top of the A Day at the Job Site reads:

You-the Project Manager; the Architect, Dennis D’Amigo; and the Owner’s Representative for XYZ Medical Services Incorporated, Mary Fenworth, were coming at 10:00 to review finishes in the old wing under renovation.

Paragraph 13 from top or 5 from bottom on meeting with the Owner’s Representative reads:

The meeting with the Owner’s Representative was brief. For once she was glad to see so much happening. For the existing wing, the Architect chose MAB puce 591-1 for the walls and clear satin varnish for the doors over a walnut stain. You pointed out that this finish would require you to strip the doors and the specs had only called for re-varnishing. The cost will run an additional $150 per door. The Owner’s Representative agreed the walnut would be a richer finish with the puce walls and approved the change.

Before leaving, the Owner’s Representative gave you her new business card. Fenworth Consultants had changed their address to 500 N. Wayne Avenue, Ipswich, RI 02814.

In addition, the side 2 answer sheet instructions are provided below:

Writing Assignment (Level 1 Only) - Formal Business Letter to the Owner’s Representative

Write a formal letter to the Owners Representative, confirming the change to the door finishes as stated in the scenario A Day at the Job Site, Exhibit 118.

This assignment is a test of your written communication skills. You will be graded on the final letter written by you on this page. Use appropriate business letter format, and copy appropriate parties. Write clearly and legibly using complete sentences. Scratch paper is provided in the Exhibits Booklet for drafts.

ID No (Copy from Admission Notice. Enter all five digits.)

1 / 2 / 5 / 6 / 0

Before actually scoring the responses to the Level 1 (AC) writing skills question, under the direction of the Scoring Session Leader, you will review the instructions provided to the candidates and evaluate some writing samples to ensure consistency in scoring the elements of the business letter.

The procedures to be followed by the Scorers in scoring the Level 1 (AC) writing skills examination question are outlined below:

1.The Business Letter Scoring Criteria Table shown below provides each Scorer with the point distribution with 2 points for Format and 5 Points for Content. To better assist the Scorer each of the two major categories and further described by a series criteria worth one point each. In addition, the Business Letter Grading Criteria / Descriptors Table shown below provides each Scorer with the Criteria and Descriptors for each point score.

2.Read each Business Letter, and write the Score (0 to 7) on the letter, you may want to indicate what is missing by noting the criteria missing with a minus sign, such as no price per unit (-1).

Transcribe the score for each Candidate ID Number at the top of the letter to the Commission Document No. 34 titled Writing Assignment Grade Submission Form and return the entire packet to the Scoring Session Leader.

BUSINESS LETTER SCORING CRITERIA

FORMAT ( 2 Points) / Points
Date; Proper and complete placement of Addresses: Contractor and Mary Fenworth of Fenworth Consultants, Owner’s Representative Names/Titles; Salutation: / 1
Closing, Title, Personal Signature, cc: Dennis Amigo, Architect, bc, file / 1
CONTENT (5 Points)
Correctly and completely identified Hospital Project and Doors in existing wing / 1
Created relevant Content; clearly described and detailed requested Scope change (e.g. strip; add new finish of walnut stain with a clear satin glow varnish. / 1
Referenced that the specifications call for re-varnishing only; compared the change order to the original specifications, explained/provided consequences (e.g. financial, time, other such as environmental) / 1
Stated the unit cost of $150 per door and referenced and met the legal response time / 1
Requested written confirmation of the change and provided contact information, Referenced agreement at the site with Mary Fenworth, Owner’s Representative and Dennis Amigo, Architect / 1

Business Letter Scoring Criteria / Descriptors

Pts. / CRITERIA / DESCRIPTORS
7 /
  • Exemplary attention to and mastery of all elements of professional format; content; and style and clarity.
  • Content is complete, Logical, Clear, Accurate, Persuasive, Stylistically effective, professional in tone and presentation.
  • Customer-Centered presentation of information.
  • Demonstrated understanding of what information needs to be created in order to make message complete, effective, and professional.
/
  • Format contained correct date, proper and complete addresses, project location and address, tracking number, project name/number, salutation, Closing, signature and title, cc: D/Amigo, bc, and enclosure, file name / track number for correspondence.
  • Content was complete and correctly stated in a professional tone.
  • Referenced the complete scope description change request properly created any missing information.
  • Referenced the specifications description as it related to the original contract / Referenced contract terms.
  • Created and developed a detailed explanation of the unit price and total price change which referenced all site agreement parties.
  • Requested written and timely confirmation of change (confirmation signatures and acceptance time required to proceed).
  • Provided multiple contact options.
  • Style used a highly sophisticated and professional tone with advanced structure (e.g. page design elements for emphasis and scan ability).

6 /
  • Excellent letter format, content, and style with meaningful and highly professional.
  • Content is correct, complete and logical with appropriate format, content and style.
  • Creates some missing information in order to fulfill all needs of the communication task.
  • Has effective and professional organization, sophisticated and highly professional word choice and message organization.
  • Careful attention to ethical communication standards.
  • Sensitive to audience’s needs (e.g. used you-attitude).
/
  • Evidence of the Majority of advanced elements of format (e.g. multiple methods of contact, cc, bc, enclosure, job name, file name).
  • Content was clear, correct, and complete in description of the key requested change with discussion of relevant details.
  • Referenced to the specifications and relevant contract information with a discussion of most of the legal ramifications.
  • All cost (e.g. economic, time, quality of work, consistency of design) consequences were detailed and discussed with any relevant implications made clear.
  • Offered to provide further explanation and clarification if requested.
  • Style used a professional tone.

Business Letter Scoring Criteria / Descriptors -AC Level I Examination

Pts. / CRITERIA / DESCRIPTORS
5 /
  • Well written in an appropriate style and format but missing minor details, and it clearly demonstrate a legal and professional awareness.
/
  • Some advanced elements of format (e.g. cc, bc, enclosure, file name, job name).
  • Content contained proper scope description of all key information with some additional details (e.g. detailed and totaled cost changes, mentioned other consequences such as deadlines and consistency of design with other project elements) and basic contact information.
  • Style and clarity are appropriate and professional with only minor errors.

4 /
  • Competent / proficient in format, content, style, and clarity.
/
  • All basic elements of format in place and correct.
  • Content is organized, correct and effective in addressing key points of information, and some details (e.g. consequences).
  • Purposeful, clear and basically professional in sending a logical and complete message.
  • Style and clarity are appropriate with only a few minor errors.

3 /
  • Some flaws in format.
  • Some key points of information missing, incorrectly, or inappropriately presented.
  • Some errors in style and clarity.
/
  • Missing or incorrect elements of formal business letter format
  • Content contained only some key points of information (e.g. did not mention costs consequences)
  • Some details on change order missing, miscommunicated, or left out of letter.
  • Unprofessional / inappropriate tone or message.

2 /
  • Very inappropriate, incorrect, or incomplete format, content, style, and clarity.
/
  • Absence or misuse of format.
  • Illogical ideas; misinformation; unethical.
  • Absent or unorganized presentation of some key information.
  • Significant errors in style (e.g. Slang, jargon, etc.), garbled or inaccurate and incomplete message, leaving out key elements in the communication.

1 /
  • Substantially incomplete and inappropriate format, content, and clarity of information.
  • Minimal evidence of attempting to complete the assignment.
  • Response is Illegible.
/
  • Basic elements of format left out, misplaced, or misused.
  • Absence of or misrepresentation of all key points of communication.
  • Illegal content communication.
  • Offensive and unprofessional languages.
  • Persistent patterns of multiple stylistic errors.

0 /
  • No evidence (or absence of) attempt to complete the assignment

May 17, 2013