Writing evaluation criteria for efficiency and effectiveness

Name:

Date:

Class:

Quick Questions

Shade in the A or B circle for each question.

1. Which is a well-written evaluation criterion for efficiency?

A The report page loads in under 3 seconds with 1000 records

B The report page should load quickly

2. Which is a well-written evaluation criterion for effectiveness?

A The program should be good at calculating GST

B The program calculates GST correctly for all 20 test cases

3. A criterion says 'The app uses less than 50 MB of memory'. What type of criterion is this?

A Efficiency criterion

B Effectiveness criterion

4. A criterion says 'The login form rejects 100% of empty usernames'. What type of criterion is this?

A Effectiveness criterion

B Efficiency criterion

5. What makes a statement a measurable target?

A It uses a descriptive word, such as 'fast' or 'smooth'

B It includes a number or clear pass/fail check, such as 'under 2 seconds'

Match the Pairs

Draw a line connecting each item on the left to its match on the right.

Left column		Right column
1The search results load in under 2 seconds on a standard school laptop.		AMemory use stays below 100 MB when 1000 records are loaded.
2At least 90% of testers can book a ticket without help.		BAn effectiveness criterion: it sets a measurable target for whether the solution does its job correctly and completely.
3A measurable target gives a number or limit so the result can be checked after development.		CNot measurable: 'fast' and 'well' have no number or limit, so it cannot be checked after development.
4An effectiveness criterion checks that the output is accurate and complete.		DWrong type: memory use is an efficiency measure, not effectiveness, and 'little' is not measurable.
5The program should be fast and run well.		EThe report totals match the manual totals for all 50 test records.
6The app should be effective: it uses little memory.		FAn efficiency criterion: it sets a measurable target for speed that can be timed after development.

Definitions

evaluation criterion

Fill in the Blanks

Complete each line of code by filling in the missing parts.

maxSeconds = 2 efficient = elapsed __ maxSeconds

correct = 48 total = 50 effective = correct / total __ 0.95

errors = 0 __ errors == 0: print("Criterion met")

# Criterion: uses at most 100 MB memoryMb = 48 meets = memoryMb <= ___

start = time.time() elapsed = time.time() - _____ print(elapsed < 2)

Spot the Error

Shade in the letter of the line that contains an error.

Question 1

A max_time = 2.0

B actual_time = 1.4

C if actual_time >= max_time:

D print('Efficiency: PASS')

E else:

F print('Efficiency: FAIL')

Question 2

A max_secs = 'fast'

B load_secs = 2.5

C met = load_secs <= max_secs

D print('Efficiency met:', met)

Question 3

A required = 95

B correct = 188

C total = 200

D accuracy = correct/total

E print(accuracy >= required)

Question 4

A criteria = {

B 'accuracy_pct': 150,

C 'max_search_secs': 2

D }

Question 5

A times = [1.2, 1.8, 2.4]

B limit = 2

C met = min(times) <= limit

D print('All met:', met)

Answer Key

Writing evaluation criteria for efficiency and effectiveness

Section A: Quick Questions

A — The report page loads in under 3 seconds with 1000 records

B — The program calculates GST correctly for all 20 test cases

A — Efficiency criterion

A — Effectiveness criterion

B — It includes a number or clear pass/fail check, such as 'under 2 seconds'

Section B: Match the Pairs

The search results load in under 2 seconds on a standard school laptop. → An efficiency criterion: it sets a measurable target for speed that can be timed after development.

At least 90% of testers can book a ticket without help. → An effectiveness criterion: it sets a measurable target for whether the solution does its job correctly and completely.

A measurable target gives a number or limit so the result can be checked after development. → Memory use stays below 100 MB when 1000 records are loaded.

An effectiveness criterion checks that the output is accurate and complete. → The report totals match the manual totals for all 50 test records.

The program should be fast and run well. → Not measurable: 'fast' and 'well' have no number or limit, so it cannot be checked after development.

The app should be effective: it uses little memory. → Wrong type: memory use is an efficiency measure, not effectiveness, and 'little' is not measurable.

Section C: Definitions

evaluation criterion — A measurable target for efficiency or effectiveness, such as 'search returns in under 2 seconds', that can be checked after development to judge whether the solution succeeded.

Section D: Fill in the Blanks

maxSeconds = 2
efficient = elapsed <= maxSeconds

correct = 48
total = 50
effective = correct / total >= 0.95

errors = 0
if errors == 0:
    print("Criterion met")

# Criterion: uses at most 100 MB
memoryMb = 48
meets = memoryMb <= 100

start = time.time()
elapsed = time.time() - start
print(elapsed < 2)

Section E: Spot the Error

C — An efficiency criterion with a time limit is met when the actual time is at or under the limit. The comparison should be <=, not >=, otherwise slower programs would pass.

A — A criterion needs a measurable target. 'fast' is vague and cannot be compared with a time. It should be a number such as max_secs = 3.

D — The effectiveness criterion is a percentage target (95). Without *100 the accuracy is 0.94, so it cannot be compared fairly with the target. It should be correct/total*100.

B — A measurable target must be achievable. An accuracy percentage cannot be over 100, so no solution could ever meet 150. It should be a realistic value such as 95.

C — The criterion must hold for every test, so check the slowest time with max(). Using min() only checks the fastest time and could hide failures.