Physics Program - KFUPM
Self-Evaluation Scales for Higher Education Programs - NCAAA
Standard 4: Learning and Teaching
Prepared by
Dr. Hocine Bahlouli (Committee Chairman)
Dr. Nabil Maalej
Dr. Saeed Al-Marzoug
March 13, 2010
4.1 Student Learning Outcomes
# / Sub-Standards / Supporting Documents / True?Y/No/NA / How well done?
((# of stars
Document/Source / Relevant Material/comments / Location
4.1.1 / Intended learning outcomes are specified after consideration of relevant academic and professional advice. / Self Assessment Report of Undergraduate Program , Department of Physics (April -2005) / Criterion 1;
1.3 Outcomes
Standard 1-2
Criterion 2; Curriculum design and organization / Program Assessment Center at the Deanship of Academic Development
http://www.kfupm.edu.sa/dad/assess/self.assess/reports.htm / Y / *****
4.1.2 / Intended learning outcomes are consistent with the Qualifications Framework. (covering all of the domains of learning at the standards required) / Self Assessment Report of Undergraduate Program , Department of Physics (April -2005) / Criterion 1-2;
1.4 Outcomes assessment / Program Assessment Center at the Deanship of Academic Development
http://www.kfupm.edu.sa/dad/assess/self.assess/reports.htm / Y / ****
4.1.3 / Intended learning outcomes are consistent with requirements for professional practice in Saudi Arabia in the fields concerned. (These requirements should include local accreditation requirements and also take account of international accreditation requirements for that field of study, and any Saudi Arabian regulations or special regional needs.) / Self Assessment Report of Undergraduate Program , Department of Physics (April -2005)
KFUPM Teaching and Learning Key Performance Indicators (T.L.KPI)(2008-2009).
American association of physics teachers / 1.4 Outcomes assessment;
b) Employers survey;
c) Alumni survey.
T.L.KPI. 8-9-10
http://education-portal.com/articles/Physics_Teacher_Employment_Info_and_Requirements_for_Becoming_a_High_School_Physics_Teacher.html
Comment: The absence of accreditation body for the college of science deprived us from putting these requirements on solid ground. / Program Assessment Center at the Deanship of Academic Development
http://www.kfupm.edu.sa/dad/assess/self.assess/reports.htm
http://www.aapt.org/
Deanship of Academic Development / Y / ***
4.1.4 / If an institution has identified special attributes to be developed in students graduating from the institution comprehensive strategies are established for these to be developed. (This means that the attributes to be developed in students are clearly defined, strategies for developing them planned and implemented across the program, and mechanisms for assessing and reporting on the extent to which graduating students have developed them, are in place.) / NA
4.1.5 / Appropriate program evaluation mechanisms including graduating student surveys, employment outcome data, employer feedback and subsequent performance of graduates are used to provide evidence about the appropriateness of intended learning outcomes and the extent to which they are achieved. (see also sections 4.3 and 4.4 dealing with program evaluation processes and verification of standards of student achievement) / Self Assessment Report of Undergraduate Program , Department of Physics (April -2005)
Deanship of Academic Development / 1.4 Outcomes assessment; b)Employers survey; c) Alumni survey.
Appendix D
The following relevant surveys are conducted by the Deanship of Academic Development
- Graduating students Survey
- Employer survey
- Alumni survey
Comment: More attention should be paid by the department to use the feedbacks of these surveys to improve its program learning outcomes. / Deanship of Academic Development
http://www.kfupm.edu.sa/dad/assess/self.assess/reports.htm
http://www.kfupm.edu.sa/dad/assess/self.assess/surveys.htm / Y / ****
Overall Assessment / ****
Comments: As noted above in relevant sections.
Priorities for Improvement:
Our Department is really concerned about the quality of teaching and leaning but we need adjust our present rules, regulations and forms to be conform to those of NCAAA. In particular faculty recommendations, students and employers feedback should be taken into account on a regular and timely basis.
4.2 Program Development Processes
# / Sub-Standards / Supporting Documents / True?Y/No/NA / How well done?
((# of stars
Document/source / Relevant Material/Comments / Location
4.2.1 / Plans for the delivery of programs and for their evaluation are set out in detailed program specifications that include knowledge and skills to be acquired, and strategies for teaching and assessment for the progressive development of learning in all the domains of learning. / Deanship of Academic Development
Self Assessment Report of Undergraduate Program , Department of Physics (April -2005) / Guidelines for Developing Academic Programs
Criterion 2; Standards 2.1-2.7 / http://www.kfupm.edu.sa/dad/deanship/services/guidelines.files/Developing.Academic.Programs.pdf
Program Assessment Center at the Deanship of Academic Development
http://www.kfupm.edu.sa/dad/assess/self.assess/reports.htm / Y / ****
4.2.2 / Plans for courses are set out in course specifications that include knowledge and skills to be acquired and strategies for teaching and assessment for the domains of learning to be addressed in each course. / Self Assessment Report of Undergraduate Program , Department of Physics (April -2005)
Course Syllabus / Matrix Relating Course Outcomes Table2.2 / Deanship of Academic Development
http://www.kfupm.edu.sa/dad/assess/self.assess/reports.htm
Course webpage / Y / ***
4.2.3 / The content and strategies set out in course specifications are coordinated with other courses and followed in practice to ensure effective progressive development of learning for the total program in all the domains of learning. / Self Assessment Report of Undergraduate Program , Department of Physics (April -2005) / Criterion 2: Curriculum design and organization;
Flow chart for degree plan / Deanship of Academic Development
http://www.kfupm.edu.sa/dad/assess/self.assess/reports.htm / Y / ****
4.2.4 / Planning should include any action necessary to ensure that teaching staff are familiar with and are able to use the strategies included in the program and course specifications. / Teaching & Learning Center Events / DAD Teaching and Learning Workshops.
Comment: Our faculty presently are not enforcing these novel strategies and efforts should be made in this regard. / http://www.kfupm.edu.sa/dad/tlcenter/events / Y / ****
4.2.5 / The academic and/or professional fields for which students are being prepared are monitored on a continuing basis with necessary adjustments made in programs and in text and reference materials to ensure continuing relevance and quality. / . / Comment: Improvements in the program to make it more relevant to the physicist profession in Saudi Arabia will be very desirable. Unfortunately there is no major effort in making this issue of high priority / Y / **
4.2.6 / In professional programs continuing advisory panels that include leading practitioners from the relevant profession monitor and advise on content and quality of programs. / . / Comment: Usually this assistance is obtained by consultation with experts in the area but not in a systematic and recorded manner / NA
4.2.7 / New program proposals are assessed and approved or rejected by the institution’s senior academic committee using criteria that ensure thorough and appropriate consultation in planning and capacity for effective implementation. / The University Academic Committee chaired by the vice rector of academic affairs and having as members all Deans plus two representative senior faculty assess and approve all new programs.
Program Evaluation / Regular Program Evaluation
Guidelines for Developing Academic Programs / Office of Vice Rector of Academic Affairs.
http://www.kfupm.edu.sa/dad/deanship/services/guidelines.files/Developing.Academic.Programs.pdf / Y / *****
Overall Assessment / ****
Comments: Have been made in relevant sections.
Priorities for Improvement:
- Encourage all instructors to adhere to the prescribed course specifications and adjust their strategies to convey the necessary knowledge and skills.
- Use the different survey feedbacks from students/alumni/faculty and employers to improve course and program specifications.
4.3 Program Evaluation and Review Processes
Y/No/NA / How well done?
((# of stars
Document/Source / Relevant Material/Comments / Location
4.3.1 / Courses and programs are evaluated and reported on annually with information about the effectiveness of planned strategies and the extent to which intended learning outcomes are being achieved. / 1- Course and Instructor Evaluation
2- The Faculty Handbook, Online Edition, DAD, KFUPM, July 2009 / 1- Online forms
2- 4.2.12 Course Evaluation by Students
Comment: The program is not evaluated annually. / 1. http://fac-evaluation.kfupm.edu.sa/wftes/
2. http://www.kfupm.edu.sa/dad/fhb/ / Y / ***
4.3.2 / When changes are made as a result of evaluations, details of those changes and the reasons for them should be retained in course and program portfolios. / Guidelines for Developing Courses
College of science self assessment (2005 & 2009). / 3. Approval Process
Assessment report
Comment:
Instructors may introduce minor changes to their courses and such changes are included in the course syllabus. However, major changes in courses must be approved by the KFUPM Academic Committee. / http://www.kfupm.edu.sa/dad/assess/self.assess/Guidlines.Developing.Courses.pdf
Dean of college of sciences / Y / ***
4.3.3 / Quality indicators that include learning outcome measures are identified and used for all courses and the program as a whole. / 1- 2.3 Course learning outcomes
2- 2.4 Program learning outcomes
3- KFUPM Key Performance indicators / 1- Guidelines for Developing Courses
2- Guidelines for Developing Academic Programs
KPI-4-5-6 / 1- http://www.kfupm.edu.sa/dad/assess/self.assess/Guidlines.Developing.Courses.pdf
2- http://www.kfupm.edu.sa/dad/deanship/services/guidelines.files/Developing.Academic.Programs.pdf
3- Office of planning & quality(DAD). / Y / ***
4.3.4 / Records of student completion rates in all courses and the program as a whole are kept and used as quality indicators. / University Annual Report
Physics Annual Report
KFUPM Key Performance indicators
. / Chapter 1: Academic Sector
KPI-4
Comment: These records are also kept in the Registrar’s Office / Office of Planning and Quality, KFUPM
Office of planning & quality (DAD). / Y / *****
4.3.5 / Annual reports including quality assurance data are provided and reviewed by senior administrators and quality committees. / Program Assessment Center / Department Annual Report
Being reviewed by a
Local committee in consultation with experts. / Deanship of Academic Development (DAD).
Physics Department & Office of Planning and Quality, KFUPM / Y / ***
4.3.6 / Course completion, program progression and completion rates, and student course and program evaluations, are retained in central records in a form that can be readily accessed by the department and college, and analyzed centrally with summaries and comparative data distributed automatically to departments, colleges, senior administrators and relevant committees at least once each year. / Registrar’s office
Online Course Evaluation
University Annual Report / Registrar’s Database
Comment: We need to have these feedbacks be readily accessible by Department for further action. / Deanship of Admission and Registration
http://regweb.kfupm.edu.sa/
Deanship of Academic Development (DAD).
Office of Planning and Quality. / Y / ***
4.3.7 / If problems are found through program evaluations appropriate action is taken to make improvements / Program Assessment Center
Assessmemt of College of Sciences (2009). / Action Plan
Action Plan
Comment: More rigorous follow up from the Deanship of Academic Development should be put in place to ensure the implementation of the Action Plan. / Deanship of Academic
Development
Dean of Sciences / Y / ***
4.3.8 / In addition to annual evaluations a comprehensive reassessment of the program should be conducted at least once every five years. Procedures for conducting these reassessments should be consistent with policies and procedures established for the institution. / Self Assessment Report of Undergraduate Program , Department of Physics (April -2005) / Whole document
Comment: This program assessment is made compulsory every three years. / Program Assessment Center at the Deanship of Academic Development
http://www.kfupm.edu.sa/dad/assess/self.assess/reports.htm / Y / *****
4.3.9 / Program reviews conducted within the institution involve experienced people from relevant industries and professions, and experienced teaching staff from other institutions. / Program Evaluation / Guidelines for Developing Academic Programs / http://www.kfupm.edu.sa/dad/deanship/services/guidelines.files/Developing.Academic.Programs.pdf / Y / ***
4.3.10 / Procedures are followed that ensure that in program reviews information about the appropriateness of learning outcomes sought and the extent to which they are achieved is sought from students and graduates through surveys and interviews, discussions with teaching staff, and other stakeholders such as employers. / Program Assessment Center / Guideline for developing academic programs / Deanship of Academic Development
http://www.kfupm.edu.sa/dad/assess/self.assess/guidelines.htm / Y / ****
4.3.11 / If the program is offered in sections for male and female students evaluations should provide data for each section as well as for the program as a whole, and any deficiencies in one or the other section dealt with appropriately in recommendations for action. / NA
Overall Assessment / ****
Comments: See comments in relevant sections.
Priorities for Improvement:
- Conduct an Annual Program Review to evaluate the effectiveness of planned strategies and achievement of intended learning outcomes.
- Create a Program Portfolio which includes all relevant material relevant to evaluations and review processes of the General Physics Program.
- Establish a rigorous mechanism of follow up by the Deanship of Academic Development to ensure that the Action Plan by the Physics Department is adequately implemented.
4.4 Student Assessment
Y/No/NA / How well done?
((# of stars
Document/Source / Relevant Material/Comments / Location
4.4.1 / Student assessment mechanisms should be appropriate for the different forms of learning sought / Self Assessment Report of Undergraduate Program , Department of Physics (April -2005)
Deanship of Academic Development / Criterion 1;
1.3 Outcomes
Standard 1-2
Criterion 2; Curriculum design and organization
Student Survey / Program Assessment Center at the Deanship of Academic Development
http://www.kfupm.edu.sa/dad/assess/self.assess/reports.htm
http://www.kfupm.edu.sa/dad/assess/self.assess/surveys.htm / Y / ****
4.4.2 / Assessment practices should be clearly communicated to students at the beginning of courses / The Faculty Handbook, Online Edition
DAD, K F U P M July 2009
Course syllabus / 4.2.9 Course Management
Grading policy / http://www.kfupm.edu.sa/dad/fhSb/
Instructors and course files in department. / y / *****
4.4.3 / Appropriate, valid and reliable mechanisms should be used for verifying standards of student achievement in relation to relevant internal and external benchmarks. The standard of work required for different grades should be consistent over time, comparable in courses offered within a program and college and the institution as a whole, and in comparison with other highly regarded institutions. (Arrangements for verifying standards may include measures such as check marking of random samples of student work by teaching staff at other institutions, and independent comparisons of standards achieved with other comparable institutions within Saudi Arabia, and internationally.) / Program Assessment Center / Exit exam
Comment: The exit exam is not applied yet. / Deanship of Academic Development / NA
4.4.4 / Grading of students tests, assignments and projects should be assisted by the use of matrices or other means to ensure that the planned range of domains of student learning outcomes are addressed. / Comment: Presently our test and project are not designed explicitly to address specific cognitive skills. To reach this stage our faculty need to have continuous training to meet this requirement in the near future. However all instructors do grading keeping in mind few cognitive skills the student should have acquired through the course/project. / Y / **
4.4.5 / Arrangements should be made within the institution for training of teaching staff in the theory and practice of student assessment / Faculty Development Program / Faculty Development Program
DAD Workshops and Seminars.
Comment: However the department should make it compulsory on faculty to attend such workshop or training. / http://www.kfupm.edu.sa/dad/tlcenter/services/Faculty%20Development%20Plan%20document%20June%202004%20revised%20Aug%202006.pdf
http://www.kfupm.edu.sa/dad/deanship/links/tlcenter.links.htm / Y / ***
4.4.6 / Policies and procedures should include action to be taken to deal with situations where standards of student achievement are inadequate or inconsistently assessed / 4.2.4 Student Advising
6.5.1 Counseling and Advising Center / The Faculty Handbook, Online Edition, DAD, KFUPM, July 2009 / http://www.kfupm.edu.sa/dad/fhb/
www.kfupm.edu.sa/cac / Y / ****
4.4.7 / Effective procedures should be used to ensure that work submitted by students is actually done by the students concerned / 4.2.8.10 Student Conduct and Cheating
Guidelines for conducting exams at KFUPM. / The Faculty Handbook, Online Edition, DAD, KFUPM, July 2009
Faculty and Student sections of the document.
Comment: Nowadays with availability of internet ethical issue are becoming a real concern. It is up to discretion of the faculty to take further steps and measure to ensure ethiticity. / http://www.kfupm.edu.sa/dad/fhb/
http://regweb.kfupm.edu.sa/news11.htm / Y / ****
4.4.8 / Feedback to students on their performance and results of assessments during each semester should be given promptly and accompanied by mechanisms for assistance if needed / University Registrar's Office
Web Site
Posting of grades / 4.2.8.11 Mid-term warnings for Students
via faculty’s homepages, WebCT
Blackboard CE
The Online System for Teaching & Learning at KFUPM / http://regweb.kfupm.edu.sa/
http://webcourses.kfupm.edu.sa/webct/entryPageIns.dowebct / Y / *****
4.4.9 / Assessments of student work should be conducted fairly and objectively / The Faculty Handbook, Online Edition, DAD, KFUPM, July 2009 / 4.2.11 Grades
4.2.11.9 Request for a Review of Final Grades by a Student / http://www.kfupm.edu.sa/dad/fhb/ / Y / *****
4.4.10 / Criteria and processes for academic appeals should be made known to students and administered equitably / Y / ****
Overall Assessment / ****
Comments: See comments in relevant sections.
Priorities for Improvement:
- Train faculty to use suitable cognitive skills in each domain of learning and design their tests/exams/projects to address theses learning outcomes.
4.5 Educational Assistance for Students