← VCE Software Development U4O1

Applying evaluation criteria to a solution

Gather evidence for each criterion, compare it with the target, then judge if it is met or not met, for both efficiency and effectiveness.

Part of: VCE Software Development - U4O1 - development and evaluation — Module 180, QCE Digital Solutions Unit 1 — Programmed Solutions — Module 115, QCE Digital Solutions Unit 3 — Innovative Digital Solutions — Module 87, QCE Digital Solutions Unit 4 — Prototype Digital Data Exchanges — Module 135, WA Computer Science ATAR Year 11 — Pseudocode and Algorithm Design — Module 95

Understanding Applying evaluation criteria to a solution in VCE Software Development U4O1

What it does: Calculating the elapsed time collects measurable evidence that can later be compared with an efficiency target. The target was all 20 test cases. Passing 17 falls short of the target, so the effectiveness criterion is not met. Efficiency is about how well resources such as time and memory are used. Correct output is about effectiveness. The evidence (2.1 s) is below the 3 second target, so the criterion is judged met. Each criterion must be applied using evidence, such as a timed result, before judging it met or not met.

Common mistakes: The evidence is stored as a string, so comparing it with the number target raises a TypeError. It should be the number evidence = 1.4. An average is the total divided by the count. The line must use / instead of *, or the evidence compared with the target is wrong.

Class: _____________________  ·  Name: _____________________  ·  Date: _________

Free printable worksheet with full answer key — or add this module to a class and your students practise it interactively.

🖨 Print worksheet + answer key Add Applying evaluation criteria to a solution to a class →

This module's key terms are also in a printable crossword (Modules 172–182) and word search (Modules 172–198).

Take this worksheet further — free with Cloodit

Each concept is reinforced from every angle — learned, then applied, then tested.

Learning
Duo
A criterion says: 'The report loads in under 3 seconds.' The tester times it at 2.1 seconds. What is the judgement?
Met: the evidence (2.1 s) is within the 3 s targetNot met: 2.1 s is different from 3 s
Matches
Criterion: Page loads in under 2 seconds. Judgement: Met (it feels fast enough)
↓
No evidence was gathered. The judgement is based on opinion, not a measured value compared with the target.
Applying
Meanings
Term
apply evaluation criteria
Meaning
Gather evidence for each criterion, compare it with the target, then judge if it is met or not met, for both efficiency and effectiveness.
Practice
target_secs = 2.0
Testing
Gaps
met = seconds target
Check Answer
Spots
1target = 2.0
2evidence = '1.4'

Cloodit turns curriculum-aligned coding content into journeys students work through one biome at a time.

The 'Chameleon' badge — Type Shifter, one of Cloodit's 106 collectible badges
Students earn collectable badges

Over 100 of them, across seven natural biomes.

Study Buddy
Students build a real study resource

Turns their work into revision material ready for Flash Cards and Exam study.

Diamond Dash — one of Cloodit's live, competitive Sprint games
Students lock in with Sprints

Live, competitive practice for the start of the lesson or a teacher-led lesson finisher.

A Cloodit certificate of achievement, ready to personalise and print
Custom printable certificates

Honour your top performers, or encourage a student who's trying hard — ready to print in seconds.

Add to class →

Quick Questions

1. A criterion says: 'The report loads in under 3 seconds.' The tester times it at 2.1 seconds. What is the judgement?
A. Not met: 2.1 s is different from 3 s
B. Met: the evidence (2.1 s) is within the 3 s target ✓
Compare the evidence with the target. 2.1 seconds is under 3 seconds, so the criterion is met.
2. Which step comes first when applying an evaluation criterion?
A. Gather evidence, such as timings, test results or user feedback ✓
B. Decide the criterion is met before collecting any data
A judgement must be based on evidence. You gather the evidence first, compare it with the target, then judge.
3. Criterion: 'The program produces the correct total for all 20 test cases.' Evidence: 17 of 20 test cases passed. What is the judgement?
A. Not met: only 17 of 20 passed, so the target of all 20 was not reached ✓
B. Met: most of the test cases passed
The target was all 20 test cases. Passing 17 falls short of the target, so the effectiveness criterion is not met.
4. Which criterion is judged using evidence about EFFICIENCY?
A. The output matches the expected result for every test case
B. The search finishes in under 2 seconds using less than 50 MB of memory ✓
Efficiency is about how well resources such as time and memory are used. Correct output is about effectiveness.
5. Which criterion is judged using evidence about EFFECTIVENESS?
A. The program calculates the correct grade for every student in the test data ✓
B. The program uses less than 30 MB of memory when it runs
Effectiveness is about whether the solution produces correct, complete and usable output that meets the needs. Memory use is efficiency.

Match the Pairs

Criterion: Report generates in under 3 seconds. Evidence: timed 2.1 seconds. Judgement: Met → An efficiency criterion applied: the measured time is compared with the target and judged as met.
Criterion: Output matches expected results for all test cases. Evidence: 18 of 20 passed. Judgement: Not met → An effectiveness criterion applied: the evidence falls short of the target, so it is judged not met.
Step 1 of applying a criterion: gather evidence, such as a measured value, by running the solution → elapsed = end_time - start_time
Step 2 and 3: compare the evidence with the target, then judge whether the criterion is met or not met → judgement = "Met" if elapsed <= 3 else "Not met"
Criterion: Page loads in under 2 seconds. Judgement: Met (it feels fast enough) → No evidence was gathered. The judgement is based on opinion, not a measured value compared with the target.
Criterion: Users can save a record. Evidence: Save takes 0.5 seconds. Judgement: Met → The evidence is about speed (efficiency) but the criterion is about whether the task works (effectiveness), so it does not match the criterion.

Key Term

apply evaluation criteria
Gather evidence for each criterion, compare it with the target, then judge if it is met or not met, for both efficiency and effectiveness.

Fill in the Blanks

1. seconds = 1.8 target = 2.0 met = seconds <= target
Hint: Type the comparison operator that checks the measured evidence is no more than the target.
2. evidence = 96 if evidence >= 95: print("Met")
Hint: Type the keyword that starts a decision comparing the evidence with the target.
3. met = errors == 0 print("Met" if met else "Not met")
Hint: Type the keyword that introduces the result used when the criterion is not met.
4. results = [True, True, False, True] passed = sum(results) met = passed == len(results)
Hint: Type the built-in function name that adds up the True results to count the evidence.
5. passed = 18 total = 20 percent = passed / total * 100
Hint: Type the arithmetic operator that divides passed tests by total tests to get a proportion of effectiveness evidence.

Spot the Error

Question 1
A target = 2.0
B evidence = '1.4'
C if evidence <= target:
D print('Met')
E else:
F print('Not met')
Line B — The evidence is stored as a string, so comparing it with the number target raises a TypeError. It should be the number evidence = 1.4.
Question 2
A times = [1.2, 0.8, 1.5]
B avg = sum(times) * len(times)
C target = 1.5
D print(avg <= target)
Line B — An average is the total divided by the count. The line must use / instead of *, or the evidence compared with the target is wrong.
Question 3
A target = 90
B passed = 46
C rate = passed / 50
D print(rate >= target)
Line C — The target is a percentage, so the rate must be multiplied by 100. Without * 100 the evidence (0.92) is compared with 90 and the judgement is wrong.
Question 4
A target = 80
B score = 74
C if score >= target:
D print('Not met')
E else:
F print('Not met')
Line D — This branch runs when the evidence reaches the target, so it must report 'Met'. Printing 'Not met' here gives the wrong judgement.
Question 5
A target_ms == 200
B actual_ms = 340
C met = actual_ms <= target_ms
D print('Met:', met)
Line A — == compares values, but this line needs to assign the target with a single =. Otherwise target_ms is never created and a NameError occurs later.

Student with a class code? Join your class →