Comprehensive ProgramReviewInstructions

History

TheComprehensiveProgramReviewtemplatewasdevelopedasasummativereportingvehicleforacademicprogramreview.Thisreporting vehicleisforusebyUniversitySystem ofGeorgia(USG)institutionsandthesystemofficeinordertoensureadherencetoBoardofRegentsPolicy3.6.3ComprehensiveProgramReviewandtoenableconsistencyinexecutivelevelreportingtotheBoardofRegents,thesystemaswhole, and external constituents.The assessments provide the institution and the university system, as a whole, with performance measures and benchmarks upon which to determine if programmatic threshold criteria are being met in terms of academic program inputs and outcomes, fiscal sustainability, access for workforce preparedness, degree and major investment planning, cost reduction, constituent transparency, the stewardship of state resources, and critical decision-making concerning the overall academic health of institutions and their respective programs. TheExecutiveViceChancellorforAcademicAffairsrequestedataskforcebeformedwithrepresentativesfromtheinstitutionalsectorstodesignandrecommendareportingtemplatetobeusedbyallUSGinstitutions.ThesubcommitteeonComprehensiveProgramReviewbeganitsworkonJuly6,2015andcompleteditschargeonJune1,2016.Thetaskforcemembershipwascomprisedofacross-sectionofvicepresidentsforacademicaffairsandinstitutionalresearchpersonnel,comprehensiveprogramreviewcommitteemembershipreflectedthevariedsectorsoftheuniversitysystemandperspectivesconcerningacademicprogramassessment.Thegoalofthereportingvehiclewastoprovidebothstandardizationofreportingalongwithinstitutionalflexibilityandconsiderationofsuchfactorsasmission,programvariability,levelofdegreeandmajor,studentand institutionalinputsand outcomes,and academicunitcomposition.

Parameters

Thereportingvehicledoesnotsupplantinstitutionalacademicprogramreviewprocesses.Institutionalprocessesaretoremainintact.ItisintendedthatthereportingvehiclebecomesastandardizedformthatallinstitutionsusetosubmittoUSG.Foranysectionsofthereportingvehiclethatdonotapplytospecificacademicprograms(e.g.,institutiononlyawardsassociateandbaccalaureateleveldegreesandmajors),pleaseindicatenotapplicable(“NA”)inspacesprovidedthroughoutthedocument.Consistentwithacademicprogramreviews,theattachedreportingvehicleisasuccinctrepresentationoftheinstitution’sdemonstrationthatithasassessedanacademicprogramandmadedecisionsaboutitsfuturewithinacultureofevidence.Academicprogramreviewswillbeusedforcontinuousimprovementandtheadjustmentofprogramswithinaninstitution’smission,strategicplan,andsectorwithintheuniversitysystem.Definitionsandpotentialsourcesforindicators/measuresofquality,viability,andproductivityarefoundon successivepageswithin thisdocument.

UnitofAnalysis

Theacademicprogramistheunitofanalysis.Dataresourcesinvolveacombinationofuniversitysystemreports,researchandpolicyanalysisdatabasesandreports,academicunitdata,institutionaldatafromBanner,ADP/PeopleSoft,andotherstudentandacademicinformationsystems,institutionalassessments,unitself-studies,and/orexternalreviews.Themetricsincludequalitativeandquantitativemeasuresofprogressthatprovideaninstitutionalcontext,environmentalscan,academicandgeographicindicators,andfactorsspecifictothediscipline,degree,major,andinstitution.Informationusedinpreparationforregionalanddisciplinaryaccreditationreportsaswellasexternalfundingagenciesandfederalagenciesmayalsobereplicatedwhereapplicableinthereportingvehicle.Itispreferablethatthefinalnarrativesummaryofthecomprehensiveprogramreviewbesuccinctandsimultaneouslyprovideenoughdetailforinstitutionalcontextsuchthattheresultiscontainedtoamaximumoften(10)pages.Narrativesectionsareincludedthroughoutthedocumentwithincategoricalindicatorsofproductivity,viability,andqualitytoprovideinstitutionalflexibilityinrelayingcontextualanddisciplinarynarrativeswhendiscussingprogrammatichealth.Theinstitutionalprovost/vicepresidentforacademicaffairs(ordesignee)hasthefinalsignature/sign-offoncompletedacademicreportsummaries forcomprehensiveprogramreview.

Accessibilityand FinalInstitutionalApproval

ThereportingvehiclecanbedownloadedfromtheSharePoint–newprogramreviewteam site (reference url:

forwhichaccessisavailabletoeachprovost/vicepresidentforacademicaffairsandher/hisdesignee.Thedocumentisavailableinadownloadable,write-ableformat.TheblankformitselfwillbeavailableintheSharePointfolderentitled“Forms/SupportingDocumentsforInstitutions.”Inaddition,tofurtherassisttheprovost/vicepresidentforacademicaffairsinsharingtheinformationwithacademicdeansanddepartmentheads,the blankformwillbeavailableonthepublicacademicprogramswebsiteatthefollowingurl: for uploading newprograms.

ReportingVehicle

Institution:

AcademicProgramName:

CIPCode:CollegeorSchoolandDepartment:

DateofLastInternal Review:

OutcomeofPreviousProgramReview (briefnarrativestatement):CurrentDate

ProgramReviewedattheInstitutionforthisreport:

StudentInput-GraduatePrograms / AY 2013 / AY 2014 / AY 2015
Average Graduate and/or Undergraduate GPA admitted and enrolled.
Also, indicate the number of students reported (Total N).
Standardized TestScores(ifapplicable),forgraduateprograms---GRE, GMAT,LSAT,MCAT-Choosethestandardizedexamination andindicate in thespaceprovidedbelow.
Also, indicate the number of students reporting scores for the test(s) (Total N):
InstitutionalIndicatorsofQuality-Student Input (campusdetermined). Please define what Indicators are used and how they are interpreted.
StudentOutput–GraduatePrograms / AY 2013 / AY 2014 / AY 2015
Average ExitScoreson Nationaland State Licensureand/orCertificationExams OR Average Pass Rate (as appropriate)
Specific Exam:
Also, indicate the number of students reporting scores for the test(s) (Total N):
Graduating Majoror stand-alonedegreeGPAscores
Indicatewhether MajorGPAorCumulative Graduation GPAis used:
Indicate the number of students reported (Total N).
ExternalQuality Assurance(e.g.,professionalaccreditation,surveys,marketrankings)
InstitutionalIndicatorsofQuality-StudentOutput(campusdetermined). Please define what Indicators are used and how they are interpreted.
Narrative Section: Describe additionaldetails asdeemed appropriate (the box is expandable).
Faculty / AY 2013 / AY 2014 / AY 2015
Numberof TerminallyDegreed Faculty in the Department
(regardless of whether the faculty teach in the program)
Numberof Non-terminallyDegreedFaculty In the Department (regardless of whether the faculty teach in the program)
Undergraduate or Graduateprograms:
Total amount of sponsored research fundingawardedfor the academic year
Undergraduate or Graduateprograms:
OtherExternalfunds for programsupport.
Provide the total amount for the academic year.
Undergraduate or Graduateprograms:
Number of peer-reviewedpublications for the academic year.
Undergraduate or Graduateprograms:
Number of facultyresearchfellowships awarded in the academic year.
InstitutionalIndicators of Faculty Quality- Output (campus determined)
Please define what Indicators are used and how they are interpreted.
ExternalQuality Assurance(e.g.professionalaccreditation surveys; marketrankings)
Please define what Indicators are used and how they are interpreted.
IndicatorsofMeasuresof Viability:
InternalDemandfortheProgram / AY 2013 / AY 2014 / AY 2015
Numberof studentswhocompleted an application tothe program(if an applicableprocessis in place)-Institution determinesthemilestoneforreporting purposes(e.g.point in timeformalapplications arereviewed andacceptancesare granted)
Numberof studentswhoareadmittedto theprogram---Institutiondeterminesthemilestoneforreporting purposes(e.g.,formaladmittancetoadegreeprogram)
Numberof studentsinthe degreeprogram---Institution determinesthemilestoneforreporting purposes
Standard FacultyWorkloadforthedegree program
(example: 3/3, 4/3, etc.)
Numberof Faculty(tenured/track and non-tenured) supporting thedegreeprogram within thedepartment
Numberof Faculty(tenured/track and non-tenured) supporting thedegreeprogram outsidethedepartment
NumberofFull-Timefaculty teaching in the program
NumberofPart-Timefaculty teaching in the program
Narrative Section: Describe additionaldetails asdeemed appropriate (the box is expandable).
IndicatorsofMeasuresofProductivity:
TimetoDegree / AY 2013 / AY 2014 / AY 2015
Undergraduatestudenttimetodegree (average, in years) for non-transfer students graduating in the academic year (AY)
Undergraduatestudenttimetodegree (average, in years) for transfer students graduating in the academic year (AY)
Institution specific factorsimpacting timetodegree.Describeadditionaldetailsas deemedappropriate.
Graduatestudent timetodegree (average, in years) graduating in the academic year.
Institution specific factorsimpacting timetodegreeDescribeadditionaldetailsas deemedappropriate.
Graduation-Only provide data for the level of program being reviewed. / AY 2013 / AY 2014 / AY 2015
Number of degrees awarded in the program for the academic year.

Provost/VPAA CategoricalSummation:

Checkanyofthe followingto categoricallydescribe action(s)the institution willtake concerningthisprogram.

□ProgramMEETSInstitution’sCriteria

_Programiscritical tothe institutionalmission and will beretained.

_Programiscritical tothe institutionalmission and isgrowingor a high demand field andthuswill be enhanced.

□ProgramDOES NOT MEETInstitution’sCriteria

Programwill be placed on a monitoringstatus.

Programwillundergo substantive curricularrevisions.

Programwill be deactivated.

Programwill bevoluntarilyterminated.

Other(identify/add text): ______

ContextualClosingNarrative: In thespace providedbelow(and can be expanded),provide asummative narrativeconcerningthe academicprogram. The finalstatement,among otherpoints,includesinformationconcerningtheacademic program’sachievements,benchmarksofprogress,and areasofdistinction, challenges, andaspirations,in addition toplansforaction. Please share how comprehensive program review results were used for continuous improvement. The closingstatementalsois anopportunity to highlightshiftingtrendsand marketforcesthat mightimpactprogramdemand (1,500word limit).

Provost/VPAASignature and Date:

------OR ------

Provost/VPAA’sDesigneeSignature and Date: ______

Definitions, Guidelines, and Examples

StudentInput–UndergraduatePrograms

*Standardized TestScores(ifapplicable),forundergraduateprograms

For test score reporting, please use the highest score utilized for admission. Provide the average score for all students admitted in the program for the academic year.

Forthe SAT, use either the SAT Combined score (if available) or sum the student’s Verbal and Math score before averaging. If the institution is using the new SAT score, please convert to the old score.

For ACT, please use the ACT Composite score.

Noteon GED: If reporting GED Scores, please provide the GED Total Score.

FreshmanIndex

Provide an average FI for students admitted to the program for the academic year.

Defined:FromtheAcademicStudentAffairsHandbook,theFreshman Index(FI) is computedas thefollowing:

FI = 500x (HSGPA)+ SATVerbal/CriticalReading + SAT I Math(or)FI = 500x (HSGPA)+ (ACTComposite x42) +88

ExternalQualityAssurance(e.g.,professionalaccreditation surveys; marketrankings)-

Examples:

Programmatic/DisciplinaryAccreditors

NationalSurveyof StudentEngagement(NSSE)

CommunityCollegeSurveyof StudentEngagement (CSSE)NationalResearchCouncil

In providing these data, please discuss what metric(s) are used and how they adequately reflect the quality of the program. Provide definitions and context for comparison as necessary.

InstitutionalIndicatorsofQuality–StudentInput(campusdetermined)

Examples:

Numberof studentsand distribution

Averageability ofstudentsanddistribution

Standard testingmeasures

Incoming GradePointAverage/Entering GPAScore (GPA used in entry to the program)

In providing these data, please discuss what metric(s) are used and how they adequately reflect the quality of the program. Provide definitions and context for comparison as necessary.

StudentOutput –UndergraduatePrograms

Exitscoreson national/stateexamsforlicensure (pass rate or number of passing students, as appropriate)

Graduatingmajor orCumulativeGPAscores(campusdetermined)

MajorGPAiscalculatedusing gradesearned incoursesdesignated as'major' courses.Majorcoursesare determinedbytheacademicdepartmentand aredirectlyassociatedwith thefieldof study. Either/Or

Cumulative GPA at Graduation iscalculatedusing thegradesearned inall coursestakenwhilethestudent isenrolled.

Employmentrates(ifavailable). When providing, include the time period (i.e. 45% employment rate 1-year post-graduation, 78% employment rate 5 years post-graduation). Also, note the graduating cohort (i.e. employment rate, 1-year post-graduation for AY 2012 graduates reported in AY 2013).

Entryintograduateprograms (if available). When providing, include the time period (i.e. 5% in graduate study 1-year post-graduation, 22% in graduate study 5 years post-graduation). Also, note the graduating cohort (i.e. graduate study rate, 1-year post-graduation for AY 2012 graduates reported in AY 2013).

InstitutionalIndicatorsofQuality–StudentOutput (campusdetermined)

Examples:

Completion andcontinuation rates

Completersatisfaction

Employersatisfaction

AttritionRates

Starting Salaries

StakeholderSatisfaction

Undergraduatestudentlearning outcomesand competencies

In providing these data, please discuss what metric(s) are used and how they adequately reflect the quality of the program. Provide definitions and context for comparison as necessary.

StudentInput–GraduatePrograms

EnteringGPAScore

Provide the Average GPA (Graduate and/or Undergraduate)of students admitted and enrolled in the programfor the academic year as appropriate to the degree level. Report the Entering GPA average that is appropriate to the program (i.e. Undergraduate GPA for Master’s program, Graduate GPA for Doctoral program). Please use the GPA that was reported and used for admission. Provide the average score for all students in the program.

*Standardized TestScores(ifapplicable),forgraduateprograms---GRE,GMAT,LSAT,MCAT-

The average test score for a particular test utilized for admission should be reported for that academic year. For test score reporting, please use the highest score utilized for admission. Also, please include subject test score averages for those tests which report them (i.e. GRE).

Include the number of test takers for each test.

InstitutionalindicatorsofQuality–StudentInput(campusdetermined) -

Examples:

Numberof studentsand distribution

Averageability ofstudentsand distribution

Standard testingmeasures

In providing these data, please discuss what metric(s) are used and how they adequately reflect the quality of the program. Provide definitions and context for comparison as necessary.

StudentOutput –GraduatePrograms

Exitscoreson national/stateexamsforlicensure (pass rate or number of passing students, as appropriate)

Graduatingmajor or CumulativeGPAscores(campusdetermined)

MajorGPAiscalculatedusing gradesearned incoursesdesignated as'major' courses.Majorcoursesare determinedbytheacademicdepartmentand aredirectlyassociatedwith thefieldof study. Either/Or

Cumulative GPA at Graduation iscalculatedusing thegradesearned inall coursestakenwhilethestudent isenrolled.

Externalqualityassurance(e.g.,professionalaccreditation,surveys,marketrankings)

InstitutionalIndicatorsofQuality–StudentOutput(campusdetermined)

Examples:

Completion andcontinuation rates

Completersatisfaction

Employersatisfaction

AttritionRates

Starting Salaries

Graduatestudentlearningoutcomesandcompetencies

In providing these data, please discuss what metric(s) are used and how they adequately reflect the quality of the program. Provide definitions and context for comparison as necessary.

Faculty

Number of Terminally Degreed Faculty in the Academic Department where the program resides.

Include all faculty, whether supporting the program or not.

Number of Non-Terminally Degreed Faculty in the Academic Department where the program resides.

Include all faculty, whether supporting the program or not.

UndergraduateorGraduateprograms:Amountofsponsored research fundingawarded during the academic year.

Provide the dollar amount of new sponsored research funding awarded for the academic year by faculty in the academic program.

UndergraduateorGraduateprograms:Otherexternalfundsforprogramsupportawardedduring the academic year.

Provide the dollar amount of new external funding awarded for the academic year by the academic program.

UndergraduateorGraduateprograms:Numberofpeer-reviewed publicationspublished by the program facultyduring the academic year.

UndergraduateorGraduateprograms:Numberoffacultyresearch fellowshipsawarded to the program faculty during the academic year.

InstitutionalIndicatorsofFacultyQuality –Output(campusdetermined)

Examples:

Meet therequirementsof theparentinstitutionforundergraduateeducation

Meet therequirementsof theparentinstitutionforgraduateresearch and doctoral education

In providing these data, please discuss what metric(s) are used and how they adequately reflect the

quality of the program. Provide definitions and context for comparison as necessary.

InternalDemandfortheProgram

Numberofstudentswhosubmitted a completed application to the degree program(ifan applicableprocess is in place) for the academic year

Numberofstudentswho are admittedto the program for the academic year

Numberofstudents enrolled inthedegree programfor the academic year

Enrollment by Program Report- Enrollment metrics are available per program at the following

system office web link:

Faculty workload

The standard workload of faculty teaching in the program. Do not attempt to average the workload; instead, provide the most common workload (i.e. 3/3 or 4/3).

Numberoffaculty(tenured/track and non-tenured)supportingthe degree programwithin the academicunit.

This number should be equal to the number of faculty within the department/academic unit that actually teach courses within the program under review. For example, a department has 10 faculty; however, only four of the faculty regularly teach courses in the program under review. Four faculty should be reported in this case.

Numberoffaculty (tenured/track and non-tenured)supportingthe degree outside the academicunit.

This number will be equal to the count of faculty outside the program’s home department/unit which regularly teach in the program. Three Sociology Department faculty who regularly teach courses in the Master of Social Work program would be an example.

Total number of full-time faculty teaching within the program

This number will be equal to the total number of all full-time faculty, regardless of home department, teaching courses in the program.

Total number of part-time faculty teaching within the program

This number will be equal to the total number of all part-time faculty, regardless of home department, teaching courses in the program.

TimetoDegree

Undergraduatestudenttime to degree

Theaverage timerequired to complete anundergraduateprogramof study in termsofyears tograduation. Provide data separately for both non-transfer and transfer students who graduated from the program. Provide data for those students who graduated in the academic year noted in the form.

Count each semester as .33 of a year. For example, a student starts in a program Fall 2010 and graduates Spring 2012. This student’s time to degree is 1.66 years (5 semesters X .33).

Institutionalspecificfactorsimpactingtimeto degree(institution toprovidenarrativedetails)

Graduatestudenttime todegree

Theaverage timerequired to complete a graduateprogram ofstudy in termsofyearstograduation. Provide data for those students who graduated in the academic year noted in the form. Count each semester as .33 of a year.

Institution specificfactorsimpactingtime to degree(institutiontolistor providenarrativedetails)

Graduation

Provide a count of all degrees awarded in the program for the academic year.

Degrees Conferred Report – Degrees conferred/completion metrics are available per program at the following system office web link: