Assessment Plans
Student Affairs
Compiled by Lori E. Varlotta,
Vice President for Student Affairs
In October 2005, the Vice President of Student Affairs launched a new assessment initiative within the Division. From Fall 2005 forward, she expected all departments to augment their current program improvement plans with student learning outcomes. Presently, each Student Affairs Director is charged with identifying and measuring at least one outcome related to student learning.
The following pages detail each department’s emerging assessment plan.
If you have general comments about the document, please send them to . If you have specific questions about the programs associated with a certain area, please contact the Director identified as point person for that particular department.
Academic Advising Center
As of July 2007
Mission Statement
Note: Departmental mission must be directly aligned with those of the University and the Division. This statement should include approximately 3-5 sentences that identifies the name of the department, its primary functions, modes of delivery and target audience.
Mission: The Academic Advising Center offers new student orientation, mandatory freshman advising, and advising on general education and graduation requirements for all students. The Center engages students in a developmental process that helps clarify and implement individual educational plans consistent with their skills, interests, and values. Through individual appointments, group advising sessions, and presentations help students understand the university’s academic requirements as well as its policies and procedures. As a result, students are better prepared to take responsibility for their education and persist towards a timely graduation.
Planning Goals
Note: Planning Goals are broad statements that describe the overarching, long-range intentions of an administrative unit. Goals are used primarily for general planning, as the starting point for the development and refinement of program objectives or student learning outcomes. (UCF Administrative Handbook, University of Central Florida).
Goal 1: Help students take responsibility for their education and persist towards a timely graduation.
Goal 2: Contribute to increasing freshman to sophomore retention rates of Sacramento State students.
Program Objective or Student Learning Outcomes
Note: The Objectives or Outcomes can be one of two types: program objectives or student learning outcomes. The former are related to program improvement around issues like timeliness, efficiency and participant satisfaction. The latter addresses what a student learns or how a student changes by participating in the program or utilizing the service. Both program objectives and student learning outcomes are measurable statements that provide evidence as to how well you are reaching your goals.
Student Learning Outcome: After participating in a comprehensive freshman or transfer orientation program, eighty-five percent of incoming students will understand General Education requirements and University resources.
Rationale: The newly implemented mandatory orientation policy will enable more students to gain a sense of belonging to the University and derive benefits from the information provided. A variety of modalities will be implemented to ensure that students have access to the University orientation program.
Possible Measures
Note: Measures describe the methodology and timeframe for data collection. Measures also should identify the population being surveyed and/or tested.
Develop an Orientation Survey of new students (pre/post test or post test only) to immediately assess the impact of orientation (through both online and traditional sessions) on students’ knowledge and understanding of academic requirements and resources.
Actual Measures
Note: (If different from possible measures): Specify the data collection timeframe, population and methodology. Provide materials such as survey instruments, check lists, focus group protocols, etc. in an appendix.
The data were collected at summer orientation (11 freshman sessions in June and July) to measure learning outcomes. Transfer data were collected in June via scantrons to measure satisfaction with orientation.
Data were collected via an online survey at the end of orientation before the students registered for classes. A random sample pre-test was conducted via pencil/paper. Transfer satisfaction data were collected via scantron forms.
Results
Note: Results include a brief narrative of findings, and/or essential tables or graphs. The results should indicate the extent to which the program objective or student learning outcome was met.
Data collected right after the point-of-contact showed that students learned, for the most part, the information we had presented. See Attachment D1 for the pre-test and post-test survey results.
Conclusions
Note: The conclusion should summarize briefly the collection and analyses of data. It also should “close the loop” by identifying what decisions and/or program modifications were made on the basis of these analyses.
The data were analyzed last fall and minor changes were made to the survey. The post-test will be given online via StudentVoice.
The data showed that some areas need to be emphasized more during the orientation sessions. For instance, less than sixty percent of orientation attendees could identify correctly the three academic areas that constitute the bachelorette degree. Because of this low correct response rate, future Orientation Leaders will participate in a two-day freshman program instead of the one day training currently in place.
After the data was collected in Summer 2006, we noticed a very high correct response rate on pre-test questions. Though we saw an increase in knowledge on the post-test, it wasn’t as dramatic as we thought it would be. Later the Orientation Coordinator discovered that some of the Orientation Leaders had coached orientation attendees on the pre-test, because they thought low response rates would reflect poorly on their performance as a leader. Understanding the leaders’ misguided fear helped us better inform them about pre and post test methodology we are duplicating the data collection this year (2007) to see if we get different pre-test results.
Program Objective: All freshmen will participate in a three-phase comprehensive, proactive advising and major/career exploration program by spring 2007.
Rationale: This program will increase student confidence in their academic plan and enable them to make informed course selections and major/career decisions.
Possible Measures
All 2006-2007 advising appointments and sessions will be tracked through a database. Baseline data will be collected to measure the level of participation.
Actual Measures
The data were collected via the Academic Advising sign-in database. Also the Freshman Advisor tracked appointments in Microsoft Outlook and double-checked it with the sign-in system.
Results
Of the 2006 freshmen who were to participate in the phase 2 Freshman Advising Program, during Fall ’06 992 students were seen by peer mentors. The remaining 1014 students were scheduled for appointments in Academic Advising. Of the 1014 students scheduled, 856 were seen in the office. Of the 158 not seen, 33 withdrew from the university, 13 were disenrolled, and 41 had no holds placed because they received major advising through their academic departments. At the end of fall semester (minus the withdrawals, disenrolled, and major advising) the Freshman Advising Program saw 96.3% of participating freshmen.
For Spring 2007 (Phase III), of the 1888 freshmen scheduled for appointments, the Freshman Advising Program saw 1715. Of the 173 not seen, 30 withdrew, 2 were disenrolled, and 36 had no holds placed because they received major advising through their academic departments. At the end of spring semester (minus the withdrawals, disenrolled, and major advising) the Freshman Advising Program saw 94.2% of participating freshmen. See Attachment D2 for complete details.
Conclusions
To keep the newly implemented freshmen advising program afloat we need at least two permanent academic advisors. Throughout the 2006-07 academic year we were able to secure- on a temporary basis- two EOP advisors who worked with the academic advising center on a one year appointment. To meet the basic expectations of the program these positions must be retained on a permanent basis.
Program Objective: By December 2006, develop an instrument that measures the impact of proactive advising on freshmen continuation rates.
Rationale: This freshmen advising program should increase first to second year continuation rates. Ultimately, it should also increase graduation rates, specifically impacting students’ time to degree.
Possible Measures
Have 70 percent of students participate in a survey that measures the impact of the advising program and how it affected their confidence in selecting a major and making informed decisions.
Actual Measures
Data was collected via StudentVoice and through a comprehensive online survey sent to all students via SacNotes.
Results
Two forms of data were collected for the Freshman Advising Program. Immediate (point-of-contact) responses were collected via PDAs and a web-based follow-up survey was emailed to the freshmen. We received 77% response rate from the point-of-contact surveys. We had only 82 responses to the web-based survey.
The advisors each had a PDA with the Freshman Advising Program survey loaded on it. After each advising session the freshmen completed the survey. There were 1327 responses collected throughout the Phase III advising sessions. The survey included questions to evaluate Phase II as well. The data indicate that the freshmen overwhelmingly found the advising sessions helpful and useful, particularly with major advising and course selection (98% very to somewhat helpful). Although most of the advisors were not career counselors, students still felt that the advising they received on possible careers was helpful (88% very to somewhat helpful). A complete summary of the survey results are in Attachment D3 and D4.
Conclusions
We discussed preliminary survey results at length in staff meetings (including faculty/staff meetings, professional staff meetings, and joint meetings with the Career Center) starting the first part of May 2007. From the data, the program was a huge success. Everyone is anxious to see retention numbers to see if this may have contributed to students returning for a second year. Basically, the data collected was to justify how useful and helpful the program was to the students. We are already developing new surveys for next fall to measure areas that were not examined this year. Also, starting in Phase II, students will be surveyed at the point-of-contact after each advising session.
There are going to be some changes made to the program in Phases II and III not necessarily pointed out from the data. We are in the process of creating a home-grown career/advising assessment instrument targeted for Sac State freshmen. We found the Choices instrument not that useful for this venue. We are also going to switch the career component to Phase III. Students were not ready to discuss career options six weeks into their first semester. Basic career exploration will be discussed with students who are ready, and will be included in the talking points for the advisors to cover if relevant in Phase II. A more complete year-end report will be written in detail by the end of summer evaluating all aspects of the Freshman Advising Program.
Program Objective: Increase the retention of students who have been reinstated as Undeclared majors by five percent. Eighty-five percent of these students indicate via survey that they received comprehensive advising and have achieved good academic standing by the following semester after reinstatement, and that the advising they received assisted them in staying at the University.
Rationale: Students reinstated as Undeclared majors to the University will receive more mandatory proactive advising starting Fall 2006.
Possible Measures
Measure: Track through database and advising sessions. Grades will be analyzed by the end of the following semester after reinstatement.
Measure: Have students participate in focus groups to discuss the impact of the advising sessions.
Measure: Administer exit survey to students who do not return.
Actual Measures
Grade lists will be run to see academic progress of students reinstated as Undeclared students at the end of fall and spring semesters.
Results
The Academic Advising Center compared Fall 2005 reinstatements to Fall 2006 reinstatements to measure an increase in retention. The only data collected was retention rates.
In Fall 2005 Academic Advising reinstated 68 Undeclared students. As of Summer 2006, 29 students were still enrolled and in good standing, academic probation, continued probation, or subject to academic review. In total, 42 percent of the Fall 2005 reinstatements were enrolled after one year. In Fall 2006 Academic Advising reinstated 94 Undeclared students. As of Summer 2007, 50 students were still enrolled and in good standing, academic probation, continued probation, or subject to academic review. In total, 53 percent of the Fall 2006 reinstated students are still registered and in better academic standing than before. This is an 11 percent increase in retention.
Conclusions
This objective received the least amount of attention because of the implementation of the Freshman Advising Program. The academic advisor responsible for this population met with reinstated students regularly but there was not an effective tracking system in place. Academic Advising is implementing a new scheduling/tracking system for Fall 2007 that will address this dilemma. No surveys were given and no focus groups were planned for 2006-07. This objective is being carried over to the 2007-08 academic year.
Questions regarding the programs and outcomes delineated in this section should be addressed to Beth Merritt Miller, Academic Advising. (916) 278-6231. .
Attachment D1
1. What are the three areas of classes that make up an undergraduate degree at Sac State?Pre-test / Post-test / % Change
Count / Percent / Count / Percent
A. / Major, Minor, GE / 131 / 39.34% / 445 / 22.72% / -16.62%
B. / Elective, GE & Major / 121 / 36.34% / 1091 / 55.69% / 19.36%
C. / Upper Division, Lower Division, Elective / 55 / 16.52% / 353 / 18.02% / 1.50%
D. / None of the above / 26 / 7.81% / 70 / 3.57% / -4.23%
Total / 333 / 100.00% / 1959 / 100.00% / 0.00%
2. What is the minimum number of required units to graduate?
Pre-test / Post-test / % Change
Count / Percent / Count / Percent
A. / 135 / 42 / 12.54% / 19 / 0.97% / -11.57%
B. / 120 / 252 / 75.22% / 1917 / 97.86% / 22.63%
C. / 60 / 33 / 9.85% / 7 / 0.36% / -9.49%
D. / 51 / 8 / 2.39% / 16 / 0.82% / -1.57%
Total / 335 / 100.00% / 1959 / 100.00% / 0.00%
3. How many classes would you have to take each semester to graduate in 4 years, if each course is 3 units?
Pre-test / Post-test / % Change
Count / Percent / Count / Percent
A. / 3 / 14 / 4.18% / 28 / 1.43% / -2.75%
B. / 4 / 120 / 35.82% / 348 / 17.82% / -18.00%
C. / 5 / 144 / 42.99% / 1405 / 71.94% / 28.96%
D. / 6 / 57 / 17.01% / 172 / 8.81% / -8.21%
Total / 335 / 100.00% / 1953 / 100.00% / 0.00%
4. Where do students go on campus to get information about student clubs and organizations?
Pre-test / Post-test / % Change
Count / Percent / Count / Percent
A. / Career Center / 17 / 5.06% / 78 / 4.00% / -1.06%
B. / Student Activities / 298 / 88.69% / 1823 / 93.39% / 4.70%
C. / Library / 3 / 0.89% / 11 / 0.56% / -0.33%
D. / WPE Office / 18 / 5.36% / 40 / 2.05% / -3.31%
Total / 336 / 100.00% / 1952 / 100.00% / 0.00%
5. Which of the following examples fulfill the foreign language requirement to graduate at Sac State?
Pre-test / Post-test / % Change
Count / Percent / Count / Percent
A. / Fluent in a language / 12 / 3.57% / 9 / 0.46% / -3.11%
B. / Passed the AP exam with a score of 3 / 42 / 12.50% / 33 / 1.69% / -10.81%
C. / Took three years of one language in high school / 81 / 24.11% / 370 / 18.92% / -5.19%
D. / All of the above / 201 / 59.82% / 1544 / 78.94% / 19.12%
Total / 336 / 100.00% / 1956 / 100.00% / 0.00%
6. When can a student begin taking Upper Division courses, which are numbered 100-199?
Pre-test / Post-test / % Change
Count / Percent / Count / Percent
A. / Freshman year / 28 / 8.36% / 36 / 1.84% / -6.51%
B. / After they pass a test / 100 / 29.85% / 280 / 14.34% / -15.51%
C. / Senior year / 33 / 9.85% / 135 / 6.91% / -2.94%
D. / Sophomore year / 174 / 51.94% / 1502 / 76.91% / 24.97%
Total / 335 / 100.00% / 1953 / 100.00% / 0.00%
7. Aside from special programs (athletes, EOP, CAMP, MEP), where can students get academic advising help?
Pre-test / Post-test / % Change
Count / Percent / Count / Percent
A. / Academic Advising, Major Department, Minor Department / 208 / 63.03% / 1519 / 77.98% / 14.95%
B. / Career Center / 39 / 11.82% / 190 / 9.75% / -2.06%
C. / Associated Students / 14 / 4.24% / 34 / 1.75% / -2.50%
D. / Tutoring office, major department / 69 / 20.91% / 205 / 10.52% / -10.39%
Total / 330 / 100.00% / 1948 / 100.00% / 0.00%
8. What is the minimum GPA a student needs to be considered in good academic standing and graduate?
Pre-test / Post-test / % Change
Count / Percent / Count / Percent
A. / 1.75 (D+) / 1 / 0.30% / 5 / 0.26% / -0.05%
B. / 4.0 (A) / 123 / 36.94% / 176 / 8.98% / -27.95%
C. / 2.0 (C) / 195 / 58.56% / 1752 / 89.43% / 30.87%
D. / 3.0 (B) / 13 / 3.90% / 26 / 1.33% / -2.58%
Total / 333 / 100.00% / 1959 / 100.00% / 0.00%
9. Which of the following factors should you take into consideration when making your class schedule?
Pre-test / Post-test / % Change
Count / Percent / Count / Percent
A. / Work Load / 6 / 1.81% / 41 / 2.10% / 0.29%
B. / Number of Classes / 5 / 1.51% / 22 / 1.13% / -0.38%
C. / Family Commitments / 3 / 0.90% / 5 / 0.26% / -0.65%
D. / Commute Time / 2 / 0.60% / 16 / 0.82% / 0.22%
E. / All of the above / 316 / 95.18% / 1870 / 95.70% / 0.52%
Total / 332 / 100.00% / 1954 / 100.00% / 0.00%
10. What is the registration system called at Sac State?
Pre-test / Post-test / % Change
Count / Percent / Count / Percent
A. / CASPER Web / 301 / 90.39% / 1944 / 99.69% / 9.30%
B. / SAILOR Web / 1 / 0.30% / 2 / 0.10% / -0.20%
C. / REGISTER Web / 10 / 3.00% / 3 / 0.15% / -2.85%
D. / HORNET Web / 21 / 6.31% / 1 / 0.05% / -6.26%
Total / 333 / 100.00% / 1950 / 100.00% / 0.00%
11. What is the minimum number of units an undergraduate student has to take to be considered as a full-time student?
Pre-test / Post-test / % Change
Count / Percent / Count / Percent
A. / 15 units / 43 / 12.95% / 257 / 13.17% / 0.22%
B. / 12 units / 237 / 71.39% / 1557 / 79.81% / 8.42%
C. / 10 units / 14 / 4.22% / 39 / 2.00% / -2.22%
D. / 9 units / 38 / 11.45% / 98 / 5.02% / -6.42%
Total / 332 / 100.00% / 1951 / 100.00% / 0.00%
12. During the first week of classes you notice a class on your schedule that you don't remember registering
for and don't want to take, you should:
Pre-test / Post-test / % Change
Count / Percent / Count / Percent
A. / Not worry about it because it wasn't your fault / 5 / 1.52% / 9 / 0.46% / -1.05%
B. / Not attend the class because you think the instructor
will just drop you / 3 / 0.91% / 7 / 0.36% / -0.55%
C. / Go to a computer lab and drop it online / 215 / 65.15% / 1749 / 89.46% / 24.31%
D. / All of the above / 107 / 32.42% / 190 / 9.72% / -22.71%
Total / 330 / 100.00% / 1955 / 100.00% / 0.00%
Attachment D2
Students-Actual Numbers
Phase II - Fall 2006 / Phase III - Spring 2007Beginning of Semester / 2006 / 1888
Seen by Peer Mentor / 992 / NA
Seen in Academic Advising / 1014 / 1715
Withdrew / 33 / 30
Disenrolled / 13 / 2
No Hold - Major Advising / 41 / 36
Not Seen - Hold Remains / 71 / 105
Attachment D3
Q1. Are you a first-time freshman?Count / Percent
1372 / 97.72% / Yes
32 / 2.28% / No
1404 / Respondents
Q2. In which of the following classes are you currently/have you been enrolled? (Check all that apply; please scroll down)
Count / Respondent % / Response %
625 / 45.99% / 31.41% / ENGL 1
129 / 9.49% / 6.48% / ENGL 1X
162 / 11.92% / 8.14% / LS 7A
197 / 14.50% / 9.90% / LS 7B
262 / 19.28% / 13.17% / LS 10A
0 / 0.00% / 0.00% / LS 10I
24 / 1.77% / 1.21% / LS 10X
65 / 4.78% / 3.27% / LS 15
32 / 2.35% / 1.61% / LS 86
80 / 5.89% / 4.02% / LS 87
44 / 3.24% / 2.21% / MATH 9
15 / 1.10% / 0.75% / MATH 11
355 / 26.12% / 17.84% / None of the above
1359 / Respondents
1990 / Responses
Q3. How did you learn about your Fall 2006 semester advising session? (Check all that apply)
Count / Respondent % / Response %
961 / 70.77% / 56.83% / Email & SacNote invitation
321 / 23.64% / 18.98% / Peer mentor
156 / 11.49% / 9.23% / Friend told me
253 / 18.63% / 14.96% / Registration hold
1358 / Respondents
1691 / Responses
Q4. During Fall 2006 was your advising session at the Academic Advising Center?
Count / Percent
827 / 60.90% / Yes
531 / 39.10% / No
1358 / Respondents
Q5. Which type of session did you have?
Count / Percent
745 / 90.08% / I had an individual advising session.
82 / 9.92% / I attended a group advising session.
827 / Respondents
Q6. Were you advised by your peer mentor as part of your freshman seminar or learning community?
Count / Percent
467 / 87.95% / Yes
64 / 12.05% / No
531 / Respondents
Q7. This semester (spring 2007), how did you learn about your advising session? (Check all that apply)
Count / Respondent % / Response %
1068 / 78.65% / 65.56% / Email & SacNote invitation
89 / 6.55% / 5.46% / Peer mentor
203 / 14.95% / 12.46% / Friend told me
269 / 19.81% / 16.51% / Registration hold
1358 / Respondents
1629 / Responses
Q8. This semester (spring 2007), what type of advising session did you have at the Academic Advising Center?
Count / Percent
1310 / 96.47% / An individual advising session
48 / 3.53% / A group advising session
1358 / Respondents
Q9. How helpful was the advising you received about majors available at Sac State?
Count / Percent
1060 / 78.11% / Very
267 / 19.68% / Somewhat
24 / 1.77% / Not very
6 / 0.44% / Not at all
1357 / Respondents
Q10. How helpful was the advising you received about possible careers?
Count / Percent
590 / 43.48% / Very
608 / 44.80% / Somewhat
104 / 7.66% / Not very
55 / 4.05% / Not at all
1357 / Respondents
Q11. How helpful was the advising you received about course selection?
Count / Percent
1076 / 79.29% / Very
257 / 18.94% / Somewhat
18 / 1.33% / Not very
6 / 0.44% / Not at all
1357 / Respondents
Q12. How helpful was the advising you received about GE requirements?
Count / Percent
1137 / 83.79% / Very
209 / 15.40% / Somewhat
8 / 0.59% / Not very
3 / 0.22% / Not at all
1357 / Respondents
Q13. How helpful was the advising you received about how best to complete my degree (long-term planning)?
Count / Percent
653 / 48.12% / Very
594 / 43.77% / Somewhat
87 / 6.41% / Not very
23 / 1.69% / Not at all
1357 / Respondents
Q14. Please complete the sentence: As a result of my advising sessions, I know more about... (Check all that apply)
Count / Respondent % / Response %
379 / 27.93% / 10.63% / Career options
555 / 40.90% / 15.56% / Major choices
1135 / 83.64% / 31.82% / General education requirements
990 / 72.96% / 27.75% / Choosing courses
508 / 37.44% / 14.24% / Graduation requirements
1357 / Respondents
3567 / Responses
Q15. Do you have a major?
Count / Percent
1015 / 74.80% / Yes
342 / 25.20% / No
1357 / Respondents
Q16. When did you choose your major? (Check all that apply)
Count / Respondent % / Response %
865 / 85.22% / 74.70% / Before enrolling in Sac State
131 / 12.91% / 11.31% / After taking classes that interest me
23 / 2.27% / 1.99% / After talking with professors in the department
54 / 5.32% / 4.66% / As a result of freshman advising sessions
71 / 7.00% / 6.13% / After talking with friends
14 / 1.38% / 1.21% / After going to the Career Center
1015 / Respondents
1158 / Responses
Q17. How confident are you regarding your choice of major?
Count / Percent
617 / 60.79% / Very
309 / 30.44% / Somewhat
63 / 6.21% / Not very
26 / 2.56% / Not at all
1015 / Respondents
Q18. Are you close to choosing a major?
Count / Percent
127 / 37.13% / Yes - I'm seriously considering a couple majors
134 / 39.18% / Somewhat - I'm taking some classes that will help me choose a major
72 / 21.05% / Not really - I'm still uncertain about choosing a major
9 / 2.63% / No - I'm completely lost
342 / Respondents
Q19. Did freshman advising introduce you to new major possibilities?
Count / Percent
202 / 59.06% / Yes
140 / 40.94% / No
342 / Respondents
Q20. Are you going to take classes at Sac State next semester?
Count / Percent
1331 / 98.08% / Yes
26 / 1.92% / No
1357 / Respondents
Q21. Why are you not continuing at Sac State next semester? (Check all that apply; please scroll down)
Count / Respondent % / Response %
1 / 3.85% / 2.70% / Academic difficulty
11 / 42.31% / 29.73% / Family or personal issues
1 / 3.85% / 2.70% / Work responsibilities
5 / 19.23% / 13.51% / Money concerns
1 / 3.85% / 2.70% / Military service
11 / 42.31% / 29.73% / Moving
5 / 19.23% / 13.51% / Campus environment
2 / 7.69% / 5.41% / Major I want is not offered here
0 / 0.00% / 0.00% / Could not enroll in the classes I need
26 / Respondents
37 / Responses
Q22. What are your plans for next semester? (Check all that apply)
Count / Respondent % / Response %
9 / 34.62% / 27.27% / Classes at community college
15 / 57.69% / 45.45% / Transferring to another 4-year college
1 / 3.85% / 3.03% / Trade or technical school
5 / 19.23% / 15.15% / Taking time off from school
1 / 3.85% / 3.03% / Enlisting in the military
2 / 7.69% / 6.06% / Working full-time
26 / Respondents
33 / Responses
Q23. When do you plan on returning to Sac State?
Count / Percent
8 / 30.77% / After 1-2 semesters
5 / 19.23% / At some point in the future
13 / 50.00% / Never
26 / Respondents
Attachment D4