← VCE Software Development U4O1

Evaluation strategy: data and methods

A plan listing the data to collect, the method used to collect it (such as a survey, test or observation) and which evaluation criterion each piece of data will help you judge.

Part of: VCE Software Development - U4O1 - development and evaluation — Module 179

Understanding Evaluation strategy: data and methods in VCE Software Development U4O1

What it does: The data (test results compared with expected output) is clearly tied to the effectiveness criterion about correct totals. The method (observation) explains how the data (time taken) will be collected, which is part of a complete strategy. Usability data comes from users. Observation and surveys collect data that shows how easy the interface is to use. A survey is a method used to collect data. A criterion is the standard you judge the data against.

Common mistakes: The criterion is about load speed, so the data is measured load time. A survey only gives opinions, not measured times. The method should be a timed test, such as method = "Timed test, 5 runs". An evaluation strategy must link the data to an evaluation criterion. The line should print criterion, not method, because the method is how the data is collected, not what the data is judged against.

Class: _____________________ · Name: _____________________ · Date: _________

Free printable worksheet with full answer key — or add this module to a class and your students practise it interactively.

🖨 Print worksheet + answer key Add Evaluation strategy: data and methods to a class →

This module's key terms are also in a printable crossword (Modules 172–182) and word search (Modules 172–198).

Take this worksheet further — free with Cloodit

Each concept is reinforced from every angle — learned, then applied, then tested.

Learning

Duo

Which item belongs in an evaluation strategy's data and methods section?

Data to collect, the method used, and the criterion it relates toOnly a list of bugs fixed during testing

Matches

Method: survey | Criterion: usability

↓

The data to be collected is missing, so we do not know what the survey will measure.

Applying

Meanings

Term

evaluation strategy

Meaning

A plan listing the data to collect, the method used to collect it (such as a survey, test or observation) and which evaluation criterion each piece of data will help you judge.

Practice

Criterion: Report loads in under 3 seconds

Testing

Gaps

"": "load time in seconds",

Check Answer

Spots

2data = "Load time in seconds"

3method = "Survey of 10 users"

Cloodit turns curriculum-aligned coding content into journeys students work through one biome at a time.

Students earn collectable badges

Over 100 of them, across seven natural biomes.

Study Buddy

Students build a real study resource

Turns their work into revision material ready for Flash Cards and Exam study.

Diamond Dash — one of Cloodit's live, competitive Sprint games

Students lock in with Sprints

Live, competitive practice for the start of the lesson or a teacher-led lesson finisher.

A Cloodit certificate of achievement, ready to personalise and print

Custom printable certificates

Honour your top performers, or encourage a student who's trying hard — ready to print in seconds.

Add to class →

Quick Questions

1. Which item belongs in an evaluation strategy's data and methods section?

A. Data to collect, the method used, and the criterion it relates to ✓

B. Only a list of bugs fixed during testing

An evaluation strategy lists the data to be collected, the method used to collect it and which criterion that data helps you judge.

2. A criterion says: 'The program processes 1000 records in under 2 seconds.' Which data and method links best?

A. Opinions gathered from a survey about how nice the colours are

B. Processing times recorded by running the program with timing code ✓

Efficiency criteria need measurable data such as time. A timed test collects it, so the data and method match the criterion.

3. A criterion says: 'Users find the interface easy to navigate.' Which method suits it?

A. Count the number of lines of code in the program

B. Observe users completing tasks and give them a survey ✓

Usability data comes from users. Observation and surveys collect data that shows how easy the interface is to use.

4. Which is a method of data collection?

A. Survey ✓

B. Criterion

A survey is a method used to collect data. A criterion is the standard you judge the data against.

5. Why should each piece of data be linked to a criterion?

A. So the data helps you judge whether that criterion was met ✓

B. So the data can be collected more cheaply

Data that is not linked to a criterion cannot be used to judge the solution, so it is wasted effort.

Match the Pairs

Data: average page load time | Method: timed test runs | Criterion: efficiency → An evaluation strategy entry that names the data to collect, the method used, and the criterion the data will judge.

Data: 20 user ratings out of 5 | Method: survey | Criterion: usability → Survey responses will be collected from users to judge how easy the solution is to use.

Each piece of data in the strategy is linked to the criterion it helps judge. → Criterion: The program must output correct totals | Data: test results vs expected output

The strategy states the method used to collect each type of data, such as observation. → Data: time taken to finish a task | Method: observe users completing the task

Method: survey | Criterion: usability → The data to be collected is missing, so we do not know what the survey will measure.

Data: number of crashes | Method: observation → The data is not linked to any evaluation criterion, so we cannot tell what it will help judge.

Key Term

evaluation strategy

A plan listing the data to collect, the method used to collect it (such as a survey, test or observation) and which evaluation criterion each piece of data will help you judge.

Fill in the Blanks

1. plan = {"criterion": "Fast loading", "data": "load time in seconds", "method": "timing test"}

Hint: Type the key that names the information collected to judge the criterion

2. plan = {"criterion": "Easy to use", "data": "ratings from users", "method": "survey"}

Hint: Type the key that names how the data is collected

3. plan = {"criterion": "Accurate results", "data": "actual vs expected output", "method": "test cases"}

Hint: Type the key that the collected data must be linked to

4. for plan in strategies: print(plan["criterion"]) print(plan["data"])

Hint: Type the keyword that repeats the code for every plan in the list

5. methods = ["survey", "interview", "test"] if "survey" in methods: print("Collects user ratings")

Hint: Type the operator that checks whether a data collection method is in the list

Spot the Error

Question 1

A criterion = "Loads in 2 sec"

B data = "Load time in seconds"

C method = "Survey of 10 users"

Line C — The criterion is about load speed, so the data is measured load time. A survey only gives opinions, not measured times. The method should be a timed test, such as method = "Timed test, 5 runs".

Question 2

A criterion = "Easy to learn"

B data = "Ratings from 1 to 5"

C method = "Survey of 20 users"

D print("Links to:", method)

Line D — An evaluation strategy must link the data to an evaluation criterion. The line should print criterion, not method, because the method is how the data is collected, not what the data is judged against.

Question 3

A criterion = "Data is accurate"

B data = "Time to finish a task"

C method = "Test cases"

Line B — The data must help you judge the criterion. Time to finish a task says nothing about accuracy. The data should be something like the number of wrong results found.

Question 4

A data = ["Time", "Clicks"

B method = "Observe 5 users"

C criterion = "Quick to finish"

Line A — The list is missing its closing square bracket, which causes a syntax error. It should be data = ["Time", "Clicks"].

Question 5

A plan = {}

B plan["data"] = "Error count"

C plan["method"] = Observation

D plan["crit"] = "Few errors"

Line C — The method is a piece of text, so it needs quotation marks. Without them Python looks for a variable called Observation and raises a NameError. It should be plan["method"] = "Observation".

Student with a class code? Join your class →