UKOER 2 - Collections Evaluation Framework

Isobel Falconer

7/12/10

Focus area / Evaluation question / Evidence / Projects
Practice change / What are the main motivations for, and barriers to, creating static or dynamic collections of OERs? / Project plans and reports / All
How are different means of raising the profile of OERs within disciplines and engaging communities of users in adapting and repurposing resources effective? / Community discussion
Student focus group, feedback from users, usage stats
Community feedback
Focus group
Project plans and reports / OF(GEES)
Triton
OERBITAL
EALFCO
All
How are different means of engaging stakeholders (eg. Professional bodies, learned societies) effective? / GEES SC ongoing evaluation
Project plans and reports / OF(GEES)
All
What policies enable contribution of OERs to cross-institutional collections / Policy documents developed
Project plans and reports / Triton
All
What makes discipline-based collections usable across institutions? / Project plans and reports / All
Development/release issues / How are different means of making OERs discoverable within disciplines effective? / Metadata guide. Project report. Evaluation report based on usability testing and community feedback
Student focus group, feedback from users, usage stats
Report on web2.0 tools
Community survey
Focus group
Usage statistics and user traffic data
Project plans and reports / OF(GEES)
Triton
C-SAP
OERBITAL
EALFCO
EALFCO
All
What issues arise in linking social technology-based marketing/community portals to resources from a number of institutions? / Project plans and reports / All
What issues arise in collecting and making OERs available dynamically? / Project plans and reports / All
What selection and quality processes are appropriate for dynamic and dynamically collected OERs / Review of templates by project advisors and critical friends. Evaluation report based on user testing, focus groups and community feedback
Feedback from academic and departmental staff
Good practice guide
Collection framework developed
Consultation with reviewers; feedback from users
Focus group
Project plans and reports / OF(GEES)
Triton
C-SAP
C-SAP
C-SAP
EALFCO
All
How are different ways of organising, and guiding users to and through, resources effective? / Student focus group, feedback from users, usage stats
Community survey
Focus group
Comparison of usage statistics and user traffic data
Project plans and reports / Triton
OERBITAL
EALFCO
EALFCO
All
Organisational/institutional issues / What issues arise in collecting together and sharing disciplinary collections of OERs across institutional boundaries / Project plans and reports
Policies developed / All
Triton
How do cultures of OER release, adoption and use differ, eg. Between different subject disciplines / Project plans and reports / All
What issues arise in “curation” of discipline collections? / Project plans and reports / All
How are existing academic/subject discipline cultures being challenged, strengthened, contested, changed etc through the availability of OERs? / Project plans and reports / All
Impact/benefits issues / How are different means of ensuring sustainability of OER collections effective? / Project plans and reports / All
Evidencing issues: / How can we demonstrate that disciplinary collections of OERs are effective in aiding discoverability? / Webstats on downloads
Feedback from users, usage stats
Observation; interviews
Access statistics, User feedback and comment
Usage statistics and visitor traffic data
Project plans and reports / OF(GEES)
Triton
C-SAP
OERBITAL
EALFCO
All