Rating an interface against the useability principles

Tip: Choose Save as PDF in the print dialog to download. Use A4 paper size.

Rating an interface against the useability principles

Name:
Date:
Class:

Quick Questions

Shade in the A or B circle for each question.

1. A tester completes every task in a booking app with no errors. Which rating fits the effectiveness principle?
A Met, because all tasks were completed correctly
B Not met, because the app has too many screens
2. Which statement is a rating with evidence?
A Safety is partly met: I just feel the app is okay
B Safety is partly met: 3 of 5 testers deleted a file by accident with no warning
3. A text-to-speech option exists, but screen reader users cannot reach the Submit button. What is the best accessibility rating?
A Met
B Partly met
4. Only 1 of 6 new users could find the settings menu without help. Which rating suits learnability?
A Not met
B Met
5. Which rating options can be used for each useability principle?
A Met, partly met or not met
B Pass, merit or distinction

Match the Pairs

Draw a line connecting each item on the left to its match on the right.

Left columnRight column
1Effectiveness: Met AEvery tester finished the task they were given, so the interface does what users need it to do
2Safety: Not met BTesters deleted data by accident and nothing warned them or let them undo it
3A Partly met rating needs evidence showing some success and some problems CLearnability: Partly met - 3 of 5 testers found Save without help
4Every rating must be backed by evidence from testing, not just an opinion DThe evidence does not support the rating: only 1 of 5 testers completed the task, so it should be Not met or Partly met
5Utility: Met - I think the app looks nice EThe rating is based on an opinion about looks, not testing evidence, and looks do not show utility
6Effectiveness: Met - 1 of 5 testers finished the task FAccessibility: Met - all 5 testers read the text and used alt text

Definitions

Useability rating

Fill in the Blanks

Complete each line of code by filling in the missing parts.

1.
Principle: ______ Evidence: Delete asks "Are you sure?" first Rating: Met
2.
Principle: Effectiveness Evidence: 5 of 5 users finished the task Rating: ___
3.
Principle: Accessibility Evidence: No alt text on any image Rating: _______
4.
Principle: Learnability Evidence: 3 of 5 users found Help unaided Rating: __________
5.
Principle: Utility ________: Search works but has no filters Rating: Partly met

Spot the Error

Shade in the letter of the line that contains an error.

Question 1
A Principle: Effectiveness
B Task: Book a ticket
C Result: 5 of 5 users finished
D Rating: Not met
Question 2
A Principle: Safety
B Rating: Met
C Good: Delete shows a warning
D Gap: Quit has no warning
Question 3
A Principle: Accessibility
B Evidence: 3 images no alt text
C Rating: Almost met
Question 4
A Principle: Utility
B Need: Check due dates
C Evidence: I like the colours
D Rating: Met
Question 5
A Principle: Attractiveness
B Test: New users, no help given
C Evidence: 4 of 5 done in 2 min
D Rating: Met

Answer Key

Rating an interface against the useability principles
Section A: Quick Questions
Q1
A — Met, because all tasks were completed correctly
Q2
B — Safety is partly met: 3 of 5 testers deleted a file by accident with no warning
Q3
B — Partly met
Q4
A — Not met
Q5
A — Met, partly met or not met
Section B: Match the Pairs
Q1
Effectiveness: Met → Every tester finished the task they were given, so the interface does what users need it to do
Q2
Safety: Not met → Testers deleted data by accident and nothing warned them or let them undo it
Q3
A Partly met rating needs evidence showing some success and some problems → Learnability: Partly met - 3 of 5 testers found Save without help
Q4
Every rating must be backed by evidence from testing, not just an opinion → Accessibility: Met - all 5 testers read the text and used alt text
Q5
Utility: Met - I think the app looks nice → The rating is based on an opinion about looks, not testing evidence, and looks do not show utility
Q6
Effectiveness: Met - 1 of 5 testers finished the task → The evidence does not support the rating: only 1 of 5 testers completed the task, so it should be Not met or Partly met
Section C: Definitions
Q1
Useability rating — Judging an interface against accessibility, effectiveness, safety, utility and learnability as met, partly met or not met, with testing evidence for each rating.
Section D: Fill in the Blanks
Q1
Principle: Safety Evidence: Delete asks "Are you sure?" first Rating: Met
Q2
Principle: Effectiveness Evidence: 5 of 5 users finished the task Rating: Met
Q3
Principle: Accessibility Evidence: No alt text on any image Rating: Not met
Q4
Principle: Learnability Evidence: 3 of 5 users found Help unaided Rating: Partly met
Q5
Principle: Utility Evidence: Search works but has no filters Rating: Partly met
Section E: Spot the Error
Q1
D — All 5 of 5 users finished the task, so the evidence supports a rating of Met. The line should read 'Rating: Met'.
Q2
B — The evidence shows one safety feature works and one is missing, so the principle is only partly met. The line should be 'Rating: Partly met'.
Q3
C — Ratings must be one of Met, Partly met or Not met. 'Almost met' is not a valid rating. It should be 'Rating: Partly met'.
Q4
C — Evidence must come from testing and relate to the user need. A personal opinion about colours says nothing about utility. It should be something like 'Evidence: App lists all dates'.
Q5
A — The five useability principles are accessibility, effectiveness, safety, utility and learnability. Attractiveness is not one of them. The test is about learnability.