GeologyM.S.Program Assessment Report 2014
Assessment Results, 2013-2014 Overview
We present four assessments fromthe M.S. programinGeologythatspanarangeoflearning
outcomes, butherewe focus onourPLO#3(Communication), both written and oral, based ontraditionaltermpapers, précis of journalarticles, oral presentations oftimely and topicalsubjects, and Universitythesesandtheir associated prospecti. These four assessments analyze 38separate pieces of student work, and in only onecasedidastudentnot meet the competencystandardsetforthinthepertinentgrading rubric.Furthermore, there was only one case where astudentfailedtoachievebasic competence (minimumscore),otherwisestudentsscoredabovethe level"competence".
GEOL 6310 – Groundwater: Term Paper
Graduate-level term paper.A course average of 8.5/15, where 5/15indicates “competence” and10/15 indicates “accomplishment”.The large standard deviation (3.87)indicatesthatthereisawiderangeofabilities,andthe lowest averagescores inthe area of‘Syntax Mechanics’ isconsistent with difficulties in writingformanyofourstudents.
We would be wise to continue and in factincrease the number ofwritingassignments in order toproduce students with stronger writing and analysis skills.
GEOL 6414 – Earthquake Geology: Complex JournalArticlePrécis-Mid-Term
Précis of a difficult and complex journal article.Useda modified rubric that takes into accountthe requirements of the précis. Course average is 6.1/9 , where 3/9 indicates competence and 6/9indicatesaccomplishment. The lowestscoresindicate that the rigorous nature of the précis styleisdifficulttoapply.
Again,wewouldbewisetocontinueandinfact increase the number of writing assignments inorder to producestudents with stronger writing andanalysisskills.Theprécis is a writing formthatencouragesthestudenttofocuson reading, criticalanalysis and written communication.
Studentsarewell served bythese exercises inthat they easily transferto the writing of critical orexecutive summaries,journalabstracts, and articles.
GEOL 6414 – Earthquake Geology: Oral Presentation on Earthquake or Region
A 30-45 minute oral presentation on an importantearthquake or earthquake-producing region.Studentsareaskedtofocusonsubstancerather than styleandusediscipline-specificlanguageina formal presentation. Course average is7.8/12,where4/12is ‘competent’ and8/12is‘accomplished’. One student barely met the competence threshold (5/12),butotherwisetheresults are strong.
Oralpresentationsarean important aspecttoourM.S.students training, however focus shouldremain on organization and presentation, projecting a comfort with the material, and usingdiscipline-specific terminologyand aprofessionalratherthan informal speakingstyle.
GEOL 6910 – University Thesis: Prospectus and Thesis
Approved thesis and associated prospectus.The department isoneofthefewinwhichstudentsproduce University Theses.With a sample size, n=2, the statistics are not important relative tothe accomplishment of proposing, producing andbringingtosuccessful completion aproperthesis that passes not only 3 member faculty review,butoftenoutside advisors fromindustry andgovernment agencies. Students fromthe M.S.Programin Geology have been awarded theHarringtonAwardforOutstandingUniversity Thesis in 2013 (Daniel Segal) and 2014 (PamelaBeitz).
CSUEBGeologyM.S.Program‐CRITICALTHINKINGWRITINGRUBRIC
Definition: Criticalthinkingisahabit of mindcharacterizedbythecomprehensiveexplorationof issues,ideas,artifacts,andeventsbeforeacceptingorformulatingan opinionorconclusion.WrittencommunicationisthedevelopmentandexpressionofideasinwritingItcaninvolveworkingwithmanydifferentwritingtechnologies,andmixingtexts,data,and images.Thisrubricmay be applied to studentwritingassignments thatinvolveallorpartsofanyof theM.S. in GeologyProgramLearningOutcomes (PLOs).
1. ContextandPurposeConsideration ofaudience,purpose (i.eprécis, term papers
reports). / Demonstratesthoroughunderstandingofcontext,audiencepurpose.
Completesassignedtask(s)andfocuses allelementsofthework. / Demonstratesadequateunderstandingofcontext,audiencepurpose.
Completesassignedtask(s)andfocuses allelementsofthework. / Demonstratesawarenessofcontext,audiencepurpose.Minimally completesandfocusesassignedtask(s)andall elementsofthework. / Demonstratesminimal ornoattentionofcontext, audiencepurpose.Barely completesordoes not complete assignedtask(s)andfocus all elements ofthework.
2.DisciplinaryConventions Formalandinformal
rulesforwritingin
particularforms andacademic fields / Demonstrates detailedattentionto,andsuccessfulexecution of, writingtask(s)including organization,content,presentation,formatting,andstyle. / Demonstrates consistentattentionto,andsuccessfulexecution of, writingtask(s)including organization,content,presentation,formatting,andstyle. / Demonstrates someattentionto,andsuccessfulexecution of,writingtask(s)includingorganization,content,presentation,formatting,and style. / Demonstrates poorattentionto,andexecution of,writingtask(s)includingorganization,content,presentation,formatting,andstyle.
3.SyntaxandMechanics / Uses gracefullanguage thatskillfullycommunicatesmeaningto readers withclarityand fluency,and isvirtuallyerror‐free. / Uses straightforwardlanguage thatgenerallyconveysmeaningtoreaders.Thelanguageintheportfoliohasfewerrors. / Uses language thatgenerallyconveysmeaningto readers withclarity,althoughwritingmayincludesomeerrors. / Uses poororinappropriatelanguage choicesthatsometimes impedemeaningbecauseoferrorsin usage.
4. ExplanationofIssues / Issueisstated clearlyanddescribedcomprehensively,deliveringallinformationnecessaryforfullunderstanding. / Issueisstated,described,andclarifiedsothatunderstandingisnotseriouslyimpededbyomissions. / Issueisstatedbut leavessometermsundefined,ambiguitiesunexplored. / Issueisstatedwithoutclarificationordescription.
5. Evidence Selecting andusinginformationtoinvestigatea point ofvieworconclusion / Informationistakenfromappropriatesource(s);allowscomprehensiveanalysis.
Viewpointsofexpertsare
questionedthoroughly. / Informationistakenfromappropriatesource(s);allowscoherentanalysisorsynthesis.
Viewpointsofexpertsaresubjecttoquestioning. / Informationistakenfrommostlyappropriatesource(s)withoutcoherentanalysisorsynthesis.Viewpointsofexpertsaretakenasmostlyfact,withlittlequestioning. / Informationistakenfromsource(s)withoutanyinterpretationorevaluation.Viewpointsofexpertsaretakenasfact,withoutquestion.
Modified from:CriticalThinking Value Rubric, AAC&U
CSUEBGeologyM.S.Program‐ORALCOMMUNICATIONVALUERUBRIC
Definition: Oral communicationis aprepared,purposefulpresentationdesignedto increaseknowledge,to foster understanding,or to promotechangeinthelisteners'attitudes,values,beliefs,orbehaviors.ThisrubricmaybeappliedtostudentoralpresentationassignmentsthatinvolveallorpartsoftheM.S.inGeologyProgramLearningOutcomes(PLOs)2(DataAnalysis),3(Communication),4(Research),and5(GeologicTime).
Exemplary3 / Accomplished
2 / Competent
1 / InsufficientEvidence
0
1.Organization / Organizationisclear,consistent,observableandskillfulandcontentiscohesive. / Organizationisclear,consistent
observable. / Organizationisintermittentlyobservable. / Organizationispoorornotobservable.
2.Language / Languageisclear,accurate,compelling,andenhancestheeffectivenessofthepresentation,andaudienceappropriate / Languageisclear,thoughtfulandsupportstheeffectivenessofthepresentation,andaudienceappropriate / Language ismundane,commonplaceandpartiallysupportstheeffectivenessofthepresentation,andaudienceappropriate / Languagechoiceisunclear,informalandminimallysupportseffectivenessofpresentation.Language inpresentationisnotappropriatetoaudience.
3.Delivery / Deliverytechniquesmakepresentationcompelling.Speakerappearspolishedandconfident. / Deliverytechniquesmakepresentationinteresting. Speakerappearscomfortable. / Deliverytechniquesmakethepresentationunderstandable.Speakerappearstentative. / Deliverytechniquesdetractfromtheunderstandabilityofthepresentation.Speakerisuncomfortable.
4.SupportingMaterial / Appropriatetype(s)ofsupportingmaterialsmakereferencetoinformationoranalysisthatsignificantlysupportsthepresentationorestablishesthepresenter'scredibility/authorityonthetopic. / Appropriatetype(s)ofsupportingmaterialsmakereferencetoinformationoranalysisthatgenerallysupportsthepresentationorestablishesthepresenter'scredibility/authorityonthetopic. / Appropriatetype(s)ofsupportingmaterialsmakereferencetoinformationoranalysisthatpartiallysupportsthepresentationorestablishesthepresenter'scredibility/authorityonthetopic. / Insufficientsupportingmaterials
5.CentralMessage / Messageiscompelling(preciselystated,appropriatelyrepeated,memorable,and stronglysupported.) / Centralmessageisclearandconsistentwiththesupportingmaterial. / Centralmessageisbasicallyunderstandablebut isnotoftenrepeatedandisnotmemorable. / Centralmessagecanbededuced,butisnotexplicitlystatedinthepresentation.
Modified from: OralCommunication Value Rubric, AAC&U
CSUEBGeologyM.SProgramAssessment
Rubric: / WrttenComm. / ClassAverage: / 8.5/15Course: / GEOL6320 / Std.Dev. / 3.87
Quarter: / Winter2014 / Min.Competance / 5.0/15
Assignment: / TermPaper
Student / ContextPurpose / DisciplinaryConventions / SyntaxandMechanics / ExplanationofIssues / Evidence / Total
1 / 1 / 1 / 0 / 0 / 0 / 2
2 / 2 / 1 / 1 / 2 / 3 / 9
3 / 1 / 2 / 2 / 2 / 2 / 9
4 / 3 / 3 / 2 / 3 / 2 / 13
5 / 3 / 3 / 3 / 3 / 2 / 14
6 / 1 / 1 / 1 / 2 / 1 / 6
7 / 3 / 2 / 2 / 3 / 3 / 13
8 / 1 / 1 / 2 / 1 / 1 / 6
9 / 1 / 2 / 2 / 1 / 1 / 7
10 / 1 / 1 / 1 / 1 / 2 / 6
Classaverage / 1.7 / 1.7 / 1.6 / 1.8 / 1.7 / 8.5
Standarddeviation / 0.95 / 0.82 / 0.84 / 1.03 / 0.95 / 3.87
CSUEB Geology M.S Program Assessment
Rubric: / Oral Communication / Class Average: / 7.8/12Course: / GEOL 6414/4414 / Std. Dev. / 1.22
Quarter: / Winter 2014 / Min. Competence / 4.0/12
Assignment:EQ Region Presentation
Student / Organization / Language / Delivery / SupportingMaterial / Total1 / 2 / 2 / 3 / 2 / 9
2 / 2 / 2 / 2 / 2 / 8
3 / 2 / 2 / 2 / 1 / 7
4 / 2 / 2 / 2 / 3 / 9
5 / 2 / 2 / 2 / 2 / 8
6 / 2 / 2 / 2 / 2 / 8
7 / 2 / 2 / 2 / 2 / 8
8 / 2 / 2 / 2 / 2 / 8
9 / 2 / 2 / 3 / 2 / 9
10 / 1 / 2 / 1 / 2 / 6
11 / 2 / 2 / 2 / 2 / 8
12 / 2 / 2 / 3 / 2 / 9
13 / 2 / 1 / 2 / 2 / 7
14 / 2 / 2 / 2 / 2 / 8
15 / 1 / 1 / 1 / 2 / 5
Classaverage / 1.8 / 1.8 / 2.0 / 2.1 / 7.8
Standarddeviation / 0.39 / 0.39 / 0.60 / 0.29 / 1.22
CSUEB Geology M.S Program Assessment
Rubric: / Crit. Think/Writing / Class Average: / 6.1/9Course: / GEOL 6414/4414 / Std. Dev. / 1.24
Quarter: / Winter 2014 / Min. Competence / 3.0/9
Assignment:Midterm Journal Article Precis
Student / GenreConventions / SyntaxMechanics / Explanation / Total1 / 2 / 2 / 2 / 6
2 / 2 / 3 / 2 / 7
3 / 2 / 2 / 2 / 6
4 / 2 / 1 / 2 / 5
5 / 3 / 3 / 2 / 8
6 / 2 / 1 / 3 / 6
7 / 2 / 2 / 2 / 6
8 / 3 / 2 / 2 / 7
9 / 2 / 2 / 2 / 6
10 / 2 / 2 / 1 / 5
11 / 3 / 3 / 2 / 8
12 / 2 / 1 / 2 / 5
13 / 1 / 1 / 2 / 4
Classaverage / 2.2 / 1.9 / 2.0 / 6.1
Standarddeviation / 0.58 / 0.79 / 0.43 / 1.24
CSUEBGeologyM.SProgramAssessment
Rubric: / Crit.Think/Writing / ClassAverage: / 12.0/15Course: / GEOL6910 / Std.Dev. / 1.41
Quarter: / Winter2014 / Min.Competence / 5.0/15
Assignment:UniversityThesisProspectus
Student / ContextPurpose / DisciplinaryConventions / SyntaxandMechanics / ExplanationofIssues / Evidence / Total1 / 3 / 3 / 2 / 3 / 2 / 13
2 / 2 / 2 / 2 / 3 / 2 / 11
Classaverage / 2.5 / 2.5 / 2.0 / 3.0 / 2.0 / 12.0
Standarddeviation / 0.71 / 0.71 / 0.00 / 0.00 / 0.00 / 1.41