Usability report EMC 3315.001
You will work with your group to test the functionality of your assigned site. Your group will turn in a single written usability report and give a presentation to the class about your findings on April 24.
First, you’ll individually conduct usability tests with two people (only requirement: he or she isn’t in this class). The usability test includes:
· Pre-test survey (2-3 min.)
· Free exploration (~5 min.)
· Usability tasks (10 min.)
· Post-test (~7 min.)
As a group, your first task is to set deadlines for yourself. Each member of your group needs to become thoroughly familiar with the site you are testing, contribute some questions/tasks to help compile the test you all will administer, perform a usability test on two participants, and share thorough notes about your observations with your group. As a group, you need to decide on a final list of tasks to use in your usability tests, agree on operational definitions of positive findings and minor and major problems, and divide responsibilities to compile a full written report of your tests and a presentation that covers the highlights of your findings.
Your group’s usability report should contain five main sections:
· Demographics and methodology
· Positive findings (remember to define)
· Minor problems (remember to define)
· Major problems (remember to define)
· Recommendations
Bring a hard copy of your report and presentation to class on April 24. Your group should be prepared to make a 10- to 12-minute presentation about your findings to the class that day.
Grading
Points
140 Usability report Did you address each of the five sections? Did your report
show thoughtful analysis? Did you make recommendations that flowed from observations? Were your recommendations reasonable given constraints? Was your report written and edited well?
40 Presentation Did your presentation focus on the positive findings, minor
problems, major problems, and recommendations from your report? Did you engage the audience with examples from your site and statements from your participants? Did your presentation last at least 10 minutes and no longer than 12 minutes?
20 Participation Did your participation reach group standards and expectations?
Group member assessment
How well did each group member fulfill his or her obligations to the group? You may make your judgment based on the individual tasks outlined in the assignment:
· become thoroughly familiar with the site you are testing
· contribute some questions/tasks to help compile the test you all will administer
· perform a usability test on two participants
· share thorough notes about your observations with your group
You may also consider each group member’s contribution to the preparation of the usability test, report, and presentation.
You should rate yourself and each group member using the following scale. These are ratings, not rankings; that is, you can give a “4” to more than one person in your group, for example. The average will form the participation portion of each individual’s grade.
5 This group member was instrumental in the work on this project. All contributions were excellent and on time. The group member contributed useful insights, a good attitude, and went beyond group expectations in some aspect of the division of labor.
4 This group member was a reliable part of the team. All contributions were very good and on time. The group member contributed useful insights, a good attitude, and met group expectations in the division of labor.
3 This group member met basic expectations set by the team. All contributions were complete and on time. The group member did his or her fair share of work but showed no special effort or willingness to make the final products better.
2 This group member made little contribution to the team’s final products. Contributions may have been deficient or late. The group member had few insights or suggestions about the process or findings and failed to meet group expectations about the standards of work or division of labor.
1 This group member’s behavior and contributions hurt the team’s final products. Contributions were of poor quality or did not meet deadlines. Others in the group had to complete this group member’s tasks.
Group members
Riley Davis
Travis Westbrook
Teague Dill
Kerri Hatcher
Tyson Earl
Lauren Ervin
Alex Pedrini
Alicia Keene
Cleveland Manley
Katelin Kelly
Cari McCoy
Chandler Keilberg
Lauren Pape
Thomas Gebremeskel
Andrew White
Cameron Duckworth
Russell Mills
Morgan Crump
Elizabeth Sewell
Cody Nitcher
Angela Barrera
Brady Gorman
Art Mora
Clay Young
Brian Brandon
Katie Webb
Aaron Smith
Megan Seaton
Jason Cannon
Shannon Wilson
Usability test template
Demographic and pre-test survey
Please circle or write the best answer to the following questions.
1. Gender M F
2. Age
3. Race. Please circle one.
African-American
Asian
Caucasian
Hispanic
Other (please specify):
3. How many days a week do you go online?
0 1 2 3 4 5 6 7
4. How long, on average, do you spend online for personal use each day?
0 hrs .5 hrs 1 hr 1.5 hrs 2 hrs 2.5 hrs 3 hrs More than 3 hrs
5. How comfortable are you in your ability to use the Internet effectively?
Uncomfortable
Slightly comfortable
Moderately comfortable
More comfortable than average
Extremely comfortable
6. A question unique to your test site.
7. A question unique to your test site.
Free view checklist
Note the operating system, browser, and connection type the user has.
1. What is the first thing he/she does independently?
2. What is the first link selected?
3. Document any failed navigation where the user selects a link and then immediately backs out.
4. Does he/she scroll to the bottom of each page, scroll partially, doesn’t scroll at all?
5. Does he/she complete any of the tasks listed on the next page without any prompting? If so, which ones? Include notes on the interaction.
Usability tasks (think aloud)
I’m going to ask you to find and view a few things on the site. Don’t be overwhelmed or frustrated if you can’t complete a task. We’re testing the site, not you.
1. Please find a list of…
2. Find…
3. Please go back to the home page from where you are.
4. Find information about…
5. Find out how to contact…
6. Show me where to find details about…
7. Show me…
8. Please find contact information for…
9. Please find a useful tip about...
10. Find the forms you need…
11. Choose …
12. How do you…
Post-test
Rate your impression of the site by circling the point that best represents your opinion about each component.
1. How useful did you find the site content?
Useful Useless
1 2 3 4 5 6 7
2. How hard was it to find content on the site?
Difficult Easy
1 2 3 4 5 6 7
3. How complete did the information on the site seem to be?
Incomplete Complete
1 2 3 4 5 6 7
4. How professional did the site appear to be?
Professional Unprofessional
1 2 3 4 5 6 7
5. How well were pictures used on the site?
Used poorly Used well
1 2 3 4 5 6 7
6. What is your overall impression of the site?
Negative Positive
1 2 3 4 5 6 7
7. What was the most useful thing about this site?
8. What was the least useful thing about this site?
9. If you could change one thing about this site, what would it be?
10. How does this site make you feel about product/company name?