Annual Assessment of Student Learning Outcomes Report

Colorado School of Mines

Annual Assessment of Student Learning Outcomes Report

For Academic Year 2013-14 Undergraduate Programs

The purpose of assessment is to promote excellence in student learning and educational practices by fostering a campus culture of self-evaluation and improvement. The annual assessment report enables CSM to document engagement in continuous improvement efforts.Provide responses to the following questions/items and email this completed document to by September 26. Feel free to expand the tables below as needed.

The Assessment Committee will provide written feedback in response to the department annual report, using thisrubric as the basis for their feedback. Components of this annual report that are specific to ABET re-accreditation are noted below.

Department/Program: Metallurgical and Materials Engineering

Person Submitting This Report: Ivar Reimanis, Chester Van Tyne

Phone: X3549

Email address:

1. Describe your assessment plan (list not only the activities completed in the past year, but your entire ongoing plan.)
Student Outcome 1: an ability to apply knowledge of mathematics, science, and engineering.
Direct assessment measure(s)/method(s) / Performance
criteria / Population/sample/ recruitment strategies / Frequency/timing of assessment
Senior Diagnostic Exam. This exam is written and given by MME faculty. Results are compiled by the Assessment Committee and discussed at the Annual Faculty Retreat. / 90% of students score above 60. / All seniors take this exam in five to six installments during the spring semester as part of senior design. / Once a year.
Senior Diagnostic Exam Beta Test. A 30 question general, multiple choice test is given to the incoming junior class during MT272 Summer Field Session. The same test is given two years later to graduating seniors during MT466 Senior Design / An improvement is achieved in scores from the incoming junior class to the exiting seniors. / All incoming juniors take the test. The same class takes the same test two years later just prior to graduation. / Once a year for incoming juniors and once a year for exiting seniors.
Specific Course Assessment. For each MME core class, faculty answer specific assessment questions and present them as PowerPoint slides at the Faculty Retreat. The answers are discussed openly. Based on the following:
MTGN272 - student answers on worksheets and student responses to questions on quizzes.
MTGN311 - student responses to questions on exams.
MTGN334 - student responses to questions on quizzes, final exam and homeworks.
MTGN348 - student responses to questions on homework, quizzes and exams.
MTGN351 - student responses to questions on homeworks and exams.
MTGN352 - students' performance on problem sets and student responses to exam questions.
MTGN381 - judgment by the instructor.
MTGN415 - student responses to questions on homeworks and exams.
MTGN445 - student responses to questions on exams.
MTGN461 - student responses to questions on homeworks and exams.
MTGN466 - details of final design report. / Specific course objectives (e.g., those tied to this outcome) are met. Challenges/problems from previous year were mitigated or successfully addressed. / Data from all MME core classes are examined. / Once a year.
Indirect assessment measure(s)/method(s) / Performance
criteria / Population/sample/ recruitment strategies / Frequency/timing of assessment
Senior Exit Survey and Interview. Responses are discussed in Annual Faculty Retreat. / Students rate themselves. If they rate themselves below a ‘B’ average, there should be concern. / All seniors take this within a few weeks of graduation. / Twice a year
Student Outcome 2: an ability to design and conduct experiments, as well as to analyze and interpret data.
Direct assessment measure(s)/method(s) / Performance
criteria / Population/sample/ recruitment strategies / Frequency/timing of assessment
Specific Course Assessment. For each MME core class, faculty answer specific assessment questions and present them as PowerPoint slides at the Faculty Retreat. The answers are discussed openly. Based on the following:
MTGN272 -technical details of reports.
MTGN311 - technical details of lab reports.
MTGN348 - technical details of lab reports.
MTGN445 - technical details of lab reports.
MTGN450 - student responses to questions on design of experiments on quiz 5.
MTGN461 - technical details of lab reports.
MTGN466 - technical details of final design report. / Specific course objectives (e.g., those tied to this outcome) are met. Challenges/problems from previous year were mitigated or successfully addressed / Data from all MME core classes are examined. / Once a year (usually May)
Indirect assessment measure(s)/method(s) / Performance
criteria / Population/sample/ recruitment strategies / Frequency/timing of assessment
Senior Exit Survey and Interview. Responses are discussed in Annual Faculty Retreat. / Students rate themselves. If they rate themselves below a ‘B’ average, there should be concern. / All seniors take this within a few weeks of graduation. / Twice a year
Student Outcome 3: an ability to design a system, component, or process to meet desired needs within realisticconstraints such as economic, environmental, social, political, ethical, health and safety,manufacturability, and sustainability.
Direct assessment measure(s)/method(s) / Performance
criteria / Population/sample/ recruitment strategies / Frequency/timing of assessment
Specific Course Assessment. For each MME core class, faculty answer specific assessment questions and present them as PowerPoint slides at the Faculty Retreat. The answers are discussed openly. Based on the following:
MTGN466 - design aspect of final design report. / Specific course objectives (e.g., those tied to this outcome) are met. Challenges/problems from previous year were mitigated or successfully addressed / Data from all MME core classes are examined. / Once a year.
Indirect assessment measure(s)/method(s) / Performance
criteria / Population/sample/ recruitment strategies / Frequency/timing of assessment
Senior Exit Survey and Interview. Responses are discussed in Annual Faculty Retreat. / Students rate themselves. If they rate themselves below a ‘B’ average, there should be concern. / All seniors take this within a few weeks of graduation. / Twice a year
Student Outcome 4: an ability to function on multidisciplinary teams.
Direct assessment measure(s)/method(s) / Performance
criteria / Population/sample/ recruitment strategies / Frequency/timing of assessment
Specific Course Assessment. For each MME core class, faculty answer specific assessment questions and present them as PowerPoint slides at the Faculty Retreat. The answers are discussed openly. Based on the following:
MTGN466 - team work and participation on team. / Specific course objectives (e.g., those tied to this outcome) are met. Challenges/problems from previous year were mitigated or successfully addressed / Data from all MME core classes are examined. / Once a year.
Indirect assessment measure(s)/method(s) / Performance
criteria / Population/sample/ recruitment strategies / Frequency/timing of assessment
Senior Exit Survey and Interview. Responses are discussed in Annual Faculty Retreat. / Students rate themselves. If they rate themselves below a ‘B’ average, there should be concern. / All seniors take this within a few weeks of graduation. / Twice a year
Student Outcome 5: an ability to identify, formulate, and solve engineering problems.
Direct assessment measure(s)/method(s) / Performance
criteria / Population/sample/ recruitment strategies / Frequency/timing of assessment
Specific Course Assessment. For each MME core class, faculty answer specific assessment questions and present them as PowerPoint slides at the Faculty Retreat. The answers are discussed openly. Based on the following:
MTGN272 - student responses to parts of worksheets.
MTGN334 - student responses to questions on quizzes, final exam and homeworks.
MTGN348 - student responses to questions on homeworks, quizzes and exams.
MTGN352 - student responses to some problem set questions.
MTGN381 – judgment of instructor.
MTGN415 - student responses to questions on homeworks and quizzes.
MTGN445 - student responses to questions on exams.
MTGN461 - student responses to questions on homeworks and quizzes.
MTGN466 –student recommendations on final design report. / Specific course objectives (e.g., those tied to this outcome) are met. Challenges/problems from previous year were mitigated or successfully addressed / Data from all MME core classes are examined. / Once a year.
Indirect assessment measure(s)/method(s) / Performance
criteria / Population/sample/ recruitment strategies / Frequency/timing of assessment
Senior Exit Survey and Interview. Responses are discussed in Annual Faculty Retreat. / Students rate themselves. If they rate themselves below a ‘B’ average, there should be concern. / All seniors take this within a few weeks of graduation. / Twice a year
Student Outcome 6: an understanding of professional and ethical responsibility.
Direct assessment measure(s)/method(s) / Performance
criteria / Population/sample/ recruitment strategies / Frequency/timing of assessment
Specific Course Assessment. For each MME core class, faculty answer specific assessment questions and present them as PowerPoint slides at the Faculty Retreat. The answers are discussed openly. Based on
MTGN466 - presentation on professional ethics code. / Specific course objectives (e.g., those tied to this outcome) are met. Challenges/problems from previous year were mitigated or successfully addressed / Data from all MME core classes are examined. / Once a year.
Indirect assessment measure(s)/method(s) / Performance
criteria / Population/sample/ recruitment strategies / Frequency/timing of assessment
Senior Exit Survey and Interview. Responses are discussed in Annual Faculty Retreat. / Students rate themselves. If they rate themselves below a ‘B’ average, there should be concern. / All seniors take this within a few weeks of graduation. / Twice a year
Student Outcome 7: an ability to communicate effectively.
Direct assessment measure(s)/method(s) / Performance
criteria / Population/sample/ recruitment strategies / Frequency/timing of assessment
Specific Course Assessment. For each MME core class, faculty answer specific assessment questions and present them as PowerPoint slides at the Faculty Retreat. The answers are discussed openly. Based on the following:
MTGN348 - communications aspects lab reports.
MTGN445 - communications aspects of lab reports.
MTGN461 - communications aspects of lab reports.
MTGN466 - communications aspects of final oral presentation and final design report. / Specific course objectives (e.g., those tied to this outcome) are met. Challenges/problems from previous year were mitigated or successfully addressed. / Data from all MME core classes are examined. / Once a year.
Indirect assessment measure(s)/method(s) / Performance
criteria / Population/sample/ recruitment strategies / Frequency/timing of assessment
Senior Exit Survey and Interview. Responses are discussed in Annual Faculty Retreat. / Students rate themselves. If they rate themselves below a ‘B’ average, there should be concern. / All seniors take this within a few weeks of graduation. / Twice a year
Student Outcome 8: the broad education necessary to understand the impact of engineering solutions in a global,economic, environmental, and societal context.
Direct assessment measure(s)/method(s) / Performance
criteria / Population/sample/ recruitment strategies / Frequency/timing of assessment
Specific Course Assessment. For each MME core class, faculty answer specific assessment questions and present them as PowerPoint slides at the Faculty Retreat. The answers are discussed openly. Based on the following:
MTGN334 - implications of economic, environmental and societal aspects of chemical processing are presented.
MTGN466 - economic, societal and environmental aspects of final design report. / Specific course objectives (e.g., those tied to this outcome) are met. Challenges/problems from previous year were mitigated or successfully addressed. / Data from all MME core classes are examined. / Once a year.
Indirect assessment measure(s)/method(s) / Performance
criteria / Population/sample/ recruitment strategies / Frequency/timing of assessment
Senior Exit Survey and Interview. Responses are discussed in Annual Faculty Retreat. / Students rate themselves. If they rate themselves below a ‘B’ average, there should be concern. / All seniors take this within a few weeks of graduation. / Twice a year
Student Outcome 9: a recognition of the need for, and an ability to engage in life-long learning.
Direct assessment measure(s)/method(s) / Performance
criteria / Population/sample/ recruitment strategies / Frequency/timing of assessment
Specific Course Assessment. For each MME core class, faculty answer specific assessment questions and present them as PowerPoint slides at the Faculty Retreat. The answers are discussed openly. / Specific course objectives (e.g., those tied to this outcome) are met. Challenges/problems from previous year were mitigated or successfully addressed. / Data from all MME core classes are examined. / Once a year.
Indirect assessment measure(s)/method(s) / Performance
criteria / Population/sample/ recruitment strategies / Frequency/timing of assessment
Senior Exit Survey and Interview. Responses are discussed in Annual Faculty Retreat. / Students rate themselves. If they rate themselves below a ‘B’ average, there should be concern. / All seniors take this within a few weeks of graduation. / Twice a year
Student Outcome 10: a knowledge of contemporary issues.
Direct assessment measure(s)/method(s) / Performance
criteria / Population/sample/ recruitment strategies / Frequency/timing of assessment
Specific Course Assessment. For each MME core class, faculty answer specific assessment questions and present them as PowerPoint slides at the Faculty Retreat. The answers are discussed openly. Based on the following:
MTGN348 - student responses to questions on exams about new developments in materials engineering. / Specific course objectives (e.g., those tied to this outcome) are met. Challenges/problems from previous year were mitigated or successfully addressed. / Data from all MME core classes are examined. / Once a year.
Indirect assessment measure(s)/method(s) / Performance
criteria / Population/sample/ recruitment strategies / Frequency/timing of assessment
Senior Exit Survey and Interview. Responses are discussed in Annual Faculty Retreat. / Students rate themselves. If they rate themselves below a ‘B’ average, there should be concern. / All seniors take this within a few weeks of graduation. / Twice a year
Student Outcome 11: an ability to use the techniques, skills, and modern engineering tools necessary for engineeringpractice.
Direct assessment measure(s)/method(s) / Performance
criteria / Population/sample/ recruitment strategies / Frequency/timing of assessment
Senior Diagnostic Exam. This exam is written and given by MME faculty. Results are compiled by the Assessment Committee and discussed at the Annual Faculty Retreat. / 90% of students score above 60. / All seniors take this exam in five to six installments during the spring semester as part of senior design. / Once a year.
Senior Diagnostic Exam Beta Test. A 30 question general, multiple choice test is given to the incoming junior class during MT272 Summer Field Session. The same test is given two years later to graduating seniors during MT466 Senior Design / An improvement is achieved in scores from the incoming junior class to the exiting seniors. / All incoming juniors take the test. The same class takes the same test two years later just prior to graduation. / Once a year for incoming juniors and once a year for exiting seniors.
Specific Course Assessment. For each MME core class, faculty answer specific assessment questions and present them as PowerPoint slides at the Faculty Retreat. The answers are discussed openly. Based on the following:
MTGN311 - student responses to questions on exams.
MTGN348 - student responses to questions on homeworks, quizzes and exams.
MTGN351 - student responses to questions on homework and exams.
MTGN352 – student review of three current journal articles.
MTGN381 - judgment by instructor.
MTGN415 - student responses to conceptual questions on exams.
MTGN445 - student responses to questions on exams.
MTGN450 - student responses to questions on statistical process control in quiz 3.
MTGN461 - student responses to questions on homeworks and quizzes.
MTGN466 - final design report. / Specific course objectives (e.g., those tied to this outcome) are met. Challenges/problems from previous year were mitigated or successfully addressed. / Data from all MME core classes are examined. / Once a year.
Indirect assessment measure(s)/method(s) / Performance
criteria / Population/sample/ recruitment strategies / Frequency/timing of assessment
Senior Exit Survey and Interview. Responses are discussed in Annual Faculty Retreat. / Students rate themselves. If they rate themselves below a ‘B’ average, there should be concern. / All seniors take this within a few weeks of graduation. / Twice a year
2. Map your assessment methods to your outcomes.
Table 1
Assessment method 1: / Assessment method 2: / Assessment method 3: / Assessment method 4: / Assessment method 5: / Assessment method 6:
Student outcome 1 / X / X / X / X
Student outcome 2 / X / X
Student outcome 3 / X / X
Student outcome 4 / X / X
Student outcome 5 / X / X
Student outcome 6 / X / X
Student outcome 7 / X / X
Student outcome 8 / X / X
Student outcome 9 / X / X
Student outcome 10 / X / X
Student outcome 11 / X / X / X / X

Key:

Assessment Method 1: Senior Diagnostic Exam. This exam is written and given by MME faculty. Results are compiled by the Assessment Committee and discussed at the Annual Faculty Retreat.
Assessment Method 2: Senior Diagnostic Exam Beta Test. A 30 question general, multiple choice test is given to the incoming junior class during MT272 Summer Field Session. The same test is given two years later to graduating seniors during MT466 Senior Design
Assessment Method 3: Specific Course Assessment. For each MME core class, faculty answer specific assessment questions and present them as PowerPoint slides at the Faculty Retreat. The answers are discussed openly. Based on a variety of methods.
Assessment Method 4: Senior Exit Survey and Interview. Responses are discussed in Annual Faculty Retreat.

3. Map the student outcomesto courses and to the ABET outcomes.You may use check marks or designate P=primary emphasis and S=secondary emphasis. If your assessment plan only includes the ABET outcomes and you have no additional outcomes, you do not need to complete table #3.

Table 2
Courses
272 / 311 / 351 / 381 / 348 / 352 / 334 / 445 / 461 / 450 / 415 / 466
Student outcome 1 / P / P / P / P / P / P / P / P / P / P / P / P
Student outcome 2 / P / P / P / P / P / P / P
Student outcome 3 / P
Student outcome 4 / S / P
Student outcome 5 / P / P / P / P / P / P / P / S / P / P
Student outcome 6 / S / P
Student outcome 7 / S / P / S / P / P / P
Student outcome 8 / P / S / P
Student outcome 9 / S / S
Student outcome 10 / P / S
Student outcome 11 / S / P / P / P / P / P / P / S / P / P / P

P = primary, S = secondary

Table 3
ABET Outcomes
A / B / C / D / E / F / G / H / I / J / K
Student outcome 1 / X / X / X / X / X / X / X / X / X / X / X
Student outcome 2 / X / X / X / X / X / X / X / X / X / X / X
Student outcome 3 / X / X / X / X / X / X / X / X / X / X / X
Student outcome 4 / X / X / X / X / X / X / X / X / X / X / X
Student outcome 5 / X / X / X / X / X / X / X / X / X / X / X
Student outcome 6 / X / X / X / X / X / X / X / X / X / X / X
Student outcome 7 / X / X / X / X / X / X / X / X / X / X / X
Student outcome 8 / X / X / X / X / X / X / X / X / X / X / X
Student outcome 9 / X / X / X / X / X / X / X / X / X / X / X
Student outcome 10 / X / X / X / X / X / X / X / X / X / X / X
Student outcome 11 / X / X / X / X / X / X / X / X / X / X / X

4. Identify the assessment activities that your program has implemented in the past year.