Applying evaluation criteria to a solution

Name:

Date:

Class:

Quick Questions

Shade in the A or B circle for each question.

1. A criterion says: 'The report loads in under 3 seconds.' The tester times it at 2.1 seconds. What is the judgement?

A Not met: 2.1 s is different from 3 s

B Met: the evidence (2.1 s) is within the 3 s target

2. Which step comes first when applying an evaluation criterion?

A Gather evidence, such as timings, test results or user feedback

B Decide the criterion is met before collecting any data

3. Criterion: 'The program produces the correct total for all 20 test cases.' Evidence: 17 of 20 test cases passed. What is the judgement?

A Not met: only 17 of 20 passed, so the target of all 20 was not reached

B Met: most of the test cases passed

4. Which criterion is judged using evidence about EFFICIENCY?

A The output matches the expected result for every test case

B The search finishes in under 2 seconds using less than 50 MB of memory

5. Which criterion is judged using evidence about EFFECTIVENESS?

A The program calculates the correct grade for every student in the test data

B The program uses less than 30 MB of memory when it runs

Match the Pairs

Draw a line connecting each item on the left to its match on the right.

Left column		Right column
1Criterion: Report generates in under 3 seconds. Evidence: timed 2.1 seconds. Judgement: Met		AAn efficiency criterion applied: the measured time is compared with the target and judged as met.
2Criterion: Output matches expected results for all test cases. Evidence: 18 of 20 passed. Judgement: Not met		Bjudgement = "Met" if elapsed <= 3 else "Not met"
3Step 1 of applying a criterion: gather evidence, such as a measured value, by running the solution		CAn effectiveness criterion applied: the evidence falls short of the target, so it is judged not met.
4Step 2 and 3: compare the evidence with the target, then judge whether the criterion is met or not met		DNo evidence was gathered. The judgement is based on opinion, not a measured value compared with the target.
5Criterion: Page loads in under 2 seconds. Judgement: Met (it feels fast enough)		Eelapsed = end_time - start_time
6Criterion: Users can save a record. Evidence: Save takes 0.5 seconds. Judgement: Met		FThe evidence is about speed (efficiency) but the criterion is about whether the task works (effectiveness), so it does not match the criterion.

Definitions

apply evaluation criteria

Fill in the Blanks

Complete each line of code by filling in the missing parts.

seconds = 1.8 target = 2.0 met = seconds __ target

evidence = 96 __ evidence >= 95: print("Met")

met = errors == 0 print("Met" if met ____ "Not met")

results = [True, True, False, True] passed = ___(results) met = passed == len(results)

passed = 18 total = 20 percent = passed _ total * 100

Spot the Error

Shade in the letter of the line that contains an error.

Question 1

A target = 2.0

B evidence = '1.4'

C if evidence <= target:

D print('Met')

E else:

F print('Not met')

Question 2

A times = [1.2, 0.8, 1.5]

B avg = sum(times) * len(times)

C target = 1.5

D print(avg <= target)

Question 3

A target = 90

B passed = 46

C rate = passed / 50

D print(rate >= target)

Question 4

A target = 80

B score = 74

C if score >= target:

D print('Not met')

E else:

F print('Not met')

Question 5

A target_ms == 200

B actual_ms = 340

C met = actual_ms <= target_ms

D print('Met:', met)

Answer Key

Applying evaluation criteria to a solution

Section A: Quick Questions

B — Met: the evidence (2.1 s) is within the 3 s target

A — Gather evidence, such as timings, test results or user feedback

A — Not met: only 17 of 20 passed, so the target of all 20 was not reached

B — The search finishes in under 2 seconds using less than 50 MB of memory

A — The program calculates the correct grade for every student in the test data

Section B: Match the Pairs

Criterion: Report generates in under 3 seconds. Evidence: timed 2.1 seconds. Judgement: Met → An efficiency criterion applied: the measured time is compared with the target and judged as met.

Criterion: Output matches expected results for all test cases. Evidence: 18 of 20 passed. Judgement: Not met → An effectiveness criterion applied: the evidence falls short of the target, so it is judged not met.

Step 1 of applying a criterion: gather evidence, such as a measured value, by running the solution → elapsed = end_time - start_time

Step 2 and 3: compare the evidence with the target, then judge whether the criterion is met or not met → judgement = "Met" if elapsed <= 3 else "Not met"

Criterion: Page loads in under 2 seconds. Judgement: Met (it feels fast enough) → No evidence was gathered. The judgement is based on opinion, not a measured value compared with the target.

Criterion: Users can save a record. Evidence: Save takes 0.5 seconds. Judgement: Met → The evidence is about speed (efficiency) but the criterion is about whether the task works (effectiveness), so it does not match the criterion.

Section C: Definitions

apply evaluation criteria — Gather evidence for each criterion, compare it with the target, then judge if it is met or not met, for both efficiency and effectiveness.

Section D: Fill in the Blanks

seconds = 1.8
target = 2.0
met = seconds <= target

evidence = 96
if evidence >= 95:
    print("Met")

met = errors == 0
print("Met" if met else "Not met")

results = [True, True, False, True]
passed = sum(results)
met = passed == len(results)

passed = 18
total = 20
percent = passed / total * 100

Section E: Spot the Error

B — The evidence is stored as a string, so comparing it with the number target raises a TypeError. It should be the number evidence = 1.4.

B — An average is the total divided by the count. The line must use / instead of *, or the evidence compared with the target is wrong.

C — The target is a percentage, so the rate must be multiplied by 100. Without * 100 the evidence (0.92) is compared with 90 and the judgement is wrong.

D — This branch runs when the evidence reaches the target, so it must report 'Met'. Printing 'Not met' here gives the wrong judgement.

A — == compares values, but this line needs to assign the target with a single =. Otherwise target_ms is never created and a NameError occurs later.