Evaluating an existing digital solution

Tip: Choose Save as PDF in the print dialog to download. Use A4 paper size.

Evaluating an existing digital solution

Name:
Date:
Class:

Quick Questions

Shade in the A or B circle for each question.

1. Which is the best way to start evaluating a school library app?
A Look at the colours and decide if you like them
B Use it the way a student would, then compare it with the requirements
2. The requirement says: 'Students can search for a book by title.' You type a title and the right book appears. What does this show?
A This requirement is missing
B This requirement works well
3. The requirements say: 'Show if a book is borrowed.' You test the app and find no borrowed information at all. What do you record?
A What is missing: borrowed status is not shown
B What works well: borrowed status is shown
4. Who should you think like when you test a solution?
A The person who will use it
B The person who made it
5. What do you compare the solution with when you evaluate it?
A The requirements
B Your favourite game

Match the Pairs

Draw a line connecting each item on the left to its match on the right.

Left columnRight column
1evaluate ATo test a solution the way its user would, then compare what it does with the requirements
2requirement: Show the score BRequirement: Add a name. Test: typed 'Mia' and it saved. Result: works well
3What works well: a requirement the solution meets when tested as a user CRequirement: Undo a mistake. Test: looked for an undo button. Result: missing
4What is missing: a requirement the solution does not meet when tested DThe evaluation did not compare the solution with the requirements. Personal opinion alone does not show what works or what is missing.
5Evaluation: I read the code and it looks fine, so it works. EA check to make when evaluating: does the solution do this? Tick it as 'works well' or note it as 'missing'
6Evaluation: The app has bright colours and I like it. Done! FThe solution was not tested as its user would. Reading it is not enough; you need to use it and try the tasks.

Definitions

evaluate

Fill in the Blanks

Complete each line of code by filling in the missing parts.

1.
________ app: test as user, compare
2.
IF app meets requirement ____ PRINT "What works well" ELSE PRINT "What is missing"
3.
IF app meets requirement THEN PRINT "Works well" ____ PRINT "Missing: needs a fix"
4.
requirement ← "Show the score" result ← "Score is not shown" IF ______ ≠ requirement THEN PRINT "Missing"
5.
requirement ← "Show the score" result ← "Score is shown" IF result _ requirement THEN PRINT "Works"

Spot the Error

Shade in the letter of the line that contains an error.

Question 1
A FOR each requirement
B Test it as the user would
C IF it meets the need THEN
D Add to missing list
E ELSE Add to missing list
Question 2
A Guess how the app works
B Compare it to the requirements
C List what works well
D List what is missing
Question 3
A requirement: Save a score
B Test: play and press Save
C Result: score is saved
D Judgement: missing
Question 4
A requirement: Show the time
B Test: read the code only
C Result: time is shown
D Judgement: works well
Question 5
A requirement: Sound on click
B Test: click the button
C Result: sound plays
D Judgement: missing

Answer Key

Evaluating an existing digital solution
Section A: Quick Questions
Q1
B — Use it the way a student would, then compare it with the requirements
Q2
B — This requirement works well
Q3
A — What is missing: borrowed status is not shown
Q4
A — The person who will use it
Q5
A — The requirements
Section B: Match the Pairs
Q1
evaluate → To test a solution the way its user would, then compare what it does with the requirements
Q2
requirement: Show the score → A check to make when evaluating: does the solution do this? Tick it as 'works well' or note it as 'missing'
Q3
What works well: a requirement the solution meets when tested as a user → Requirement: Add a name. Test: typed 'Mia' and it saved. Result: works well
Q4
What is missing: a requirement the solution does not meet when tested → Requirement: Undo a mistake. Test: looked for an undo button. Result: missing
Q5
Evaluation: I read the code and it looks fine, so it works. → The solution was not tested as its user would. Reading it is not enough; you need to use it and try the tasks.
Q6
Evaluation: The app has bright colours and I like it. Done! → The evaluation did not compare the solution with the requirements. Personal opinion alone does not show what works or what is missing.
Section C: Definitions
Q1
evaluate — To test a solution the way its user would, then compare what it does with the requirements to find what works well and what is missing.
Section D: Fill in the Blanks
Q1
evaluate app: test as user, compare
Q2
IF app meets requirement THEN PRINT "What works well" ELSE PRINT "What is missing"
Q3
IF app meets requirement THEN PRINT "Works well" ELSE PRINT "Missing: needs a fix"
Q4
requirement ← "Show the score" result ← "Score is not shown" IF result ≠ requirement THEN PRINT "Missing"
Q5
requirement ← "Show the score" result ← "Score is shown" IF result = requirement THEN PRINT "Works"
Section E: Spot the Error
Q1
D — When the solution meets the need, it belongs in the works well list. It should say 'Add to works well list', not 'Add to missing list'.
Q2
A — To evaluate a solution you must test it the way its user would, not guess. Line 1 should be 'Test the app as its user would'.
Q3
D — The score was saved, so the requirement is met. The judgement should be 'works well', not 'missing'.
Q4
B — An evaluation tests the solution as its user would, by opening and using the app. Reading only the code is not a user test. It should be 'Test: open the app, look'.
Q5
C — The judgement says the sound is missing, so the result must report that no sound plays. The result should be 'Result: no sound plays'.