Strumento informatizzatoCOMPUTERISEDICT COMPETENCY ASSESSMENT TOOL

QUESTIONNAIRE ON SOFTWARE USABILITY

SUMMARY OF RESULTS

1. Personal data

GENERAL INFORMATION
GENDER: / MALE: 11
FEMALE: 20
PRESENT SITUATION
STUDENT: 8
EMPLOYED: 29
IF EMPLOYED: / SELF-EMPLOYED 3 / EMPLOYEE 26
ECONOMIC SECTOR: / INDUSTRY 5 / SERVICES 23 / COMMERCE 2 / AGRICULTURE 0 / HANDICRAFT 0
IF EMPLOYEE:
KIND OF JOB: / FULL-TIME 18 / PART-TIME 9
IF FULL-TIME
TEMPORARY: / YES 2 / NO 26
POSITION: / WORKMAN
1 / CLERK
8 / FIRST-LINE
7 / MANAGER
13
EDUCATION AND TRAINING
TITLE OF QUALIFICATION: / COMPULSORY EDUCATION 7 / BACHELORATE
6 / DEGREE
4 / MASTER/
DOCTORATE 13
VOCATIONAL TRAINING: / 7

2. The test

GENERAL INFORMATION
DATE OF TEST / TOTAL TIME SPENT IN TESTING
TOTAL TIME: 1.975 minutes
AVERAGE X TEST: 60 minutes
DID YOU TAKE
THE TEST: / IN A SINGLE RUN = 26 / IN SEVERAL STEPS (I STARTED, THEN SUSPENDED, THEN CAME BACK, ETC.) = 5
PLEASE TICK DOMAINS AND/OR UNITS TESTED:
WHOLE DOMAIN
CIVIL AND SOCIAL COMPETENCIES = 14 / SINGLE UNITS
PARTICIPATION IN CIVIL LIFE= 5
PARTICIPATION IN SOCIAL LIFE= 12
PARTICIPATION IN WORKING LIFE= 9
CULTURAL AWARENESS = 13 / CULTURAL HERITAGE= 10
FOUNDATION OF CULTURAL IDENTITY IN EUROPE= 10
INDIVIDUAL CULTURAL EXPRESSION= 8
ENTREPRENEURSHIP = 17 / ENTREPRENEURIAL SKILLS= 15
ENABLING ENTREPRENEURSHIP= 10
PROJECT MANAGEMENT= 12
INTERPERSONAL AND INTERCULTURAL COMPETENCIES = 11 / INTERCULTURAL INTERACTION= 9
INTERPERSONAL INTERACTION= 6
TEAMWORK INTERACTION= 9
LEARNING TO LEARN= 18 / CAREER DEVELOPMENT= 12
LEARNING TECHNIQUES= 12
SELF-DEVELOPMENT= 14
DID YOU RECEIVE ANY KIND OF INDUCTION (E.G. PRIOR INFORMATION ON TOPICS, AIMS, LIMITS, FIELD OF APPLICATION, ETC.) BEFORE TAKING THE TEST? / YES= 15
NO= 16
DID YOU NEED HELP IN UNDERSTANDING HOW THE TEST WORKS? / YES= 2
NO= 29
IF YES, TO WHOM DID YOU REFER TO GET HELP? / A COLLEAGUE= 1
THE SPECIFIED MAIL ADDRESS
OTHER (specify)= 1
DID YOU TRY AND REPEAT A TEST ON A UNIT OR DOMAIN? / YES= 8
NO= 23
GETTING STARTED
DID YOU EXPERIENCE PROBLEMS IN REGISTERING
TO THE WEBSITE? / YES= 4
NO= 27
IF YES, PLEASE EXPLAIN: / I DID NOT RECEIVE MY PASSWORD
MY PASSWORD DID NOT WORK= 1
OTHER (specify)= 2
WAS IT DIFFICULT TO UNDERSTAND HOW THE PROGRAMME WORKS? / NOT AT ALL= 15
NOT TOO MUCH= 15
A LITTLE= 1
YES= 0
BROWSING
DID YOU EXPERIENCE PROBLEMS IN BROWSING THE PROGRAMME’S WEBSITE? / YES= 1
NO= 30
IF YES, PLEASE EXPLAIN: / TOO COMPLICATED= 0
NO CLEAR DIRECTIONS FOR USE= 1
WRONG RETURN LINKS= 1
OTHER (specify)
HOW DO YOU RATE INFORMATION PROVIDED ABOUT DOMAINS AND UNITS? / VERY POOR= 0
POOR= 0
GOOD= 23
VERY GOOD= 8
TAKING TESTS
PLEASE STATE YOUR OPINION ABOUT THE FOLLOWING STATEMENTS
ABOUT QUESTIONS AND ANSWERS
(1 = fully disagree, 2 = disagree, 3= agree, 4 = fully agree) / 1 / 2 / 3 / 4
  1. TOO EASY
/ 10 / 17 / 1 / 2
  1. TOO DIFFICULT
/ 4 / 14 / 10 / 2
  1. TOO FEW TO ASSESS MY COMPETENCE
/ 8 / 14 / 6 / 1
  1. TOO MANY TO ASSESS MY COMPETENCE
/ 10 / 8 / 7 / 1
  1. INTERESTING
/ 5 / 10 / 13
  1. USEFUL
/ 7 / 10 / 12
  1. TOO GENERAL
/ 11 / 15 / 2 / 1
  1. TOO SPECIFIC/TECHNICAL
/ 3 / 17 / 9 / 1
  1. QUESTIONS FOR A GIVEN DOMAIN ARE TOO SIMILAR AMONG THEM
/ 1 / 14 / 13 / 1
  1. NOT OBJECTIVE, I.E. TOO MUCH RELATED TO OPINIONS, AND NOT TO FACTS
/ 2 / 20 / 4 / 3
  1. RELEVANT TO RELATED TOPICS
/ 6 / 15 / 8
  1. EFFECTIVE TO THEIR AIM
/ 8 / 16 / 6
  1. MOSTLY RELATING TO KNOWLEDGE
/ 15 / 11 / 4
  1. MOSTLY RELATING TO SKILLS
/ 3 / 16 / 10 / 1
  1. MOSTLY RELATING TO ATTITUDES/BEHAVIOUR
/ 4 / 15 / 9 / 1
  1. IT IS TOO EASY TO SPOT THE RIGHT ANSWER
/ 9 / 17 / 2 / 1
  1. PROPOSED ANSWERS ARE TOO SIMILAR AMONG THEM
/ 7 / 19 / 5
  1. THERE IS NO POINT IN HAVING “DO NOT KNOW” AMONG POSSIBLE ANSWERS
/ 6 / 7 / 7 / 7
  1. ANSWERING QUESTIONS GOT ME ANXIOUS
/ 11 / 6 / 5 / 8
  1. FEEDBACK WAS USEFUL
/ 1 / 2 / 17 / 8
  1. FEEDBACK WAS COMPLETE
/ 1 / 8 / 9 / 10
OVERALL EVALUATION
YOUR OVERALL RATING FOR THIS PILOT PRODUCT IS: / VERY POOR= 0
POOR= 0
FAIR= 7
GOOD= 13
VERY GOOD= 11
POSSIBLE COMMENTSAND SUGGESTIONS:
  • Add own questions to enrich the database
  • Translation in national language
  • Sometimes questions are difficult to understand
  • Need for specification of the target group
  • Possibility to print out the test
  • Needs for a historical archive to collect data for the trainer/tutor
  • Do not provide a “don’t’ know” box
  • More explanations about what the test are about
  • Sometimes wording of the civic and social domain is hard to understand
  • Sometimes formulations and questions are too much “institutional” (EU, UNESCO, etc.)

1