Applying evaluation criteria to a data solution

Tip: Choose Save as PDF in the print dialog to download. Use A4 paper size.

Applying evaluation criteria to a data solution

Name:
Date:
Class:

Quick Questions

Shade in the A or B circle for each question.

1. A criterion says 'All totals must be correct'. What is the best way to apply it?
A Say the totals look fine without checking them
B Test the totals against hand-calculated answers and record the result
2. Which rating fits best? The dashboard loads in 3 seconds. The criterion says it must load in under 5 seconds.
A Met
B Not met
3. Which rating fits best? 8 of 10 charts have axis labels. The criterion says every chart must have axis labels.
A Met
B Partly met
4. Which rating fits best? The criterion says data must be validated on entry. The spreadsheet has no validation rules at all.
A Not met
B Partly met
5. Which justification is stronger?
A Partly met: 8 of 10 charts have axis labels, but the Sales and Costs charts do not
B Partly met: the charts are mostly okay

Match the Pairs

Draw a line connecting each item on the left to its match on the right.

Left columnRight column
1Criterion: Chart shows all 8 students | Result: Met AA rating of met, because the test showed the criterion was fully achieved.
2Result: Partly met | Evidence: 7 of 8 rows charted BA Not met rating has no evidence and no recommended improvement.
3Justify a rating by citing evidence from testing the solution. CRecommendation: Change =SUM(B2:B8) to =SUM(B2:B9) to include every row.
4If a criterion is not fully met, recommend an improvement. DThe rating is not justified with evidence. A vague comment like 'looks fine' does not show the solution was tested.
5Criterion: Totals are accurate | Result: Met (looks fine) ENot met: the total in F10 shows 412, but the source data adds to 436.
6Criterion: Chart is clear | Result: Not met | Evidence: none | Recommendation: none FA rating of partly met, justified with evidence from the test.

Definitions

apply a criterion

Fill in the Blanks

Complete each line of code by filling in the missing parts.

1.
=__(B2>=95,"Met","Not met")
2.
=IF(B2__95,"Met","Not met")
3.
=_______(C2:C9,"Met")
4.
IF errors = 0 THEN result ← "Met" ____ result ← "Not met"
5.
IF result = "Not met" THEN ______ "Add a range check"

Spot the Error

Shade in the letter of the line that contains an error.

Question 1
A Criterion: Loads in under 5 s
B Test: Timed 3 runs
C Result: Not met
D Evidence: Average was 3.2 s
Question 2
A Criterion: No blank IDs
B Test: Filtered ID for blanks
C Result: Met
D Evidence: 4 of 200 IDs blank
Question 3
A Criterion: Shows all 12 months
B Result: Not met
C Evidence: Looks fine to me
D Improve: Extend axis to Dec
Question 4
A Criterion: Totals are correct
B Test: Did not check anything
C Result: Met
D Evidence: All 5 matched
Question 5
A Criterion: Staff find it easy
B Test: Asked the developer
C Result: Partly met
D Evidence: 3 of 5 found it easy

Answer Key

Applying evaluation criteria to a data solution
Section A: Quick Questions
Q1
B — Test the totals against hand-calculated answers and record the result
Q2
A — Met
Q3
B — Partly met
Q4
A — Not met
Q5
A — Partly met: 8 of 10 charts have axis labels, but the Sales and Costs charts do not
Section B: Match the Pairs
Q1
Criterion: Chart shows all 8 students | Result: Met → A rating of met, because the test showed the criterion was fully achieved.
Q2
Result: Partly met | Evidence: 7 of 8 rows charted → A rating of partly met, justified with evidence from the test.
Q3
Justify a rating by citing evidence from testing the solution. → Not met: the total in F10 shows 412, but the source data adds to 436.
Q4
If a criterion is not fully met, recommend an improvement. → Recommendation: Change =SUM(B2:B8) to =SUM(B2:B9) to include every row.
Q5
Criterion: Totals are accurate | Result: Met (looks fine) → The rating is not justified with evidence. A vague comment like 'looks fine' does not show the solution was tested.
Q6
Criterion: Chart is clear | Result: Not met | Evidence: none | Recommendation: none → A Not met rating has no evidence and no recommended improvement.
Section C: Definitions
Q1
apply a criterion — Test the solution against a criterion, record the result (met, partly met or not met) and justify the rating with evidence. Recommend improvements if it is not fully met.
Section D: Fill in the Blanks
Q1
=IF(B2>=95,"Met","Not met")
Q2
=IF(B2>=95,"Met","Not met")
Q3
=COUNTIF(C2:C9,"Met")
Q4
IF errors = 0 THEN result ← "Met" ELSE result ← "Not met"
Q5
IF result = "Not met" THEN OUTPUT "Add a range check"
Section E: Spot the Error
Q1
C — The evidence shows an average of 3.2 s, which is under 5 s, so the criterion is met. The result should be 'Result: Met'.
Q2
C — 4 IDs are blank, so the criterion 'No blank IDs' is not fully achieved. Most IDs are filled, so the rating should be 'Result: Partly met'.
Q3
C — Evidence must be specific and checkable, not an opinion. It should state what was found, such as 'Evidence: Chart stops at Oct'.
Q4
B — Applying a criterion means actually testing the solution against it. The test should be something like a hand calculation of 5 rows, otherwise the rating has no basis.
Q5
B — The criterion is about staff finding it easy, so the test must involve the actual users. The developer is not a fair judge, so it should be 'Test: Survey of 5 staff'.