Writing a test report conclusion

Name:

Date:

Class:

Quick Questions

Shade in the A or B circle for each question.

1. Which conclusion is backed by evidence?

A The program works fine, so I think it is validated.

B All 12 tests passed after the fix, so the program is validated for the tested inputs.

2. A student ran 15 tests. 12 passed and 3 failed. Which summary counts the results correctly?

A 12 passed, 3 failed, 15 tests in total

B 12 passed, 3 failed, 18 tests in total

3. After fixing a bug that caused a failed test, what should the test report show?

A The fix was made and the test was run again, with the new result recorded.

B The fix was made, so the old FAIL result can simply be deleted.

4. Which conclusion is the most honest when only normal test data was used?

A All tests passed, so the program will never fail on any input.

B All tests passed, but abnormal data was not tested, so the program is only partly validated.

5. Which statement belongs in the conclusion of a test report?

A The program meets the requirements because every test now passes.

B Test 4 used the input 150 and the expected output was Invalid.

Match the Pairs

Draw a line connecting each item on the left to its match on the right.

Left column		Right column
1Tests run: 12, Passed: 10, Failed: 2		ACounts the passes and failures so the reader sees the overall result at a glance
2Fixed: age check changed from > to >=. Retested: all 12 passed.		BLimitation: Only whole numbers were tested, so decimal input is untested.
3A conclusion must be backed by evidence from the results, not just an opinion		CConclusion: The program is validated because all 12 tests passed after the fix.
4A report should state the limitations that remain after testing		DThe conclusion gives no evidence. It does not say how many tests passed or failed.
5Conclusion: The program works great and is fully validated.		ERecords what was fixed and shows that the tests were run again after the change
6Tests run: 12, Passed: 8, Failed: 4. Conclusion: The program is validated.		FThe conclusion contradicts the results, because 4 tests failed and nothing was fixed or retested.

Definitions

test report

Fill in the Blanks

Complete each line of code by filling in the missing parts.

passed = 8 failed = 2 total = passed _ failed

total = 10 passed = 9 rate = passed _ total * 100

if failed __ 0: print("Conclusion: program validated")

___ test in retests: run_test(test)

failed = ["T4", "T7"] print(___(failed), "tests still fail")

Spot the Error

Shade in the letter of the line that contains an error.

Question 1

A passed = 18

B failed = 2

C total = passed - failed

D print("Tests run:", total)

Question 2

A results = [True, True, False]

B passed = results.count(False)

C failed = results.count(False)

D print(passed, "passed")

Question 3

A total = 10

B passed = 17

C rate = passed / total * 100

D print("Pass rate:", rate)

Question 4

A failed = 3

B retested = 0

C retest_pass = 3

D print("Fixed and retested")

Question 5

A failed_now = 0

B passed_now = 20

C validated = failed_now == 0

D if validated = True:

E print("Program validated")

Answer Key

Writing a test report conclusion

Section A: Quick Questions

B — All 12 tests passed after the fix, so the program is validated for the tested inputs.

A — 12 passed, 3 failed, 15 tests in total

A — The fix was made and the test was run again, with the new result recorded.

B — All tests passed, but abnormal data was not tested, so the program is only partly validated.

A — The program meets the requirements because every test now passes.

Section B: Match the Pairs

Tests run: 12, Passed: 10, Failed: 2 → Counts the passes and failures so the reader sees the overall result at a glance

Fixed: age check changed from > to >=. Retested: all 12 passed. → Records what was fixed and shows that the tests were run again after the change

A conclusion must be backed by evidence from the results, not just an opinion → Conclusion: The program is validated because all 12 tests passed after the fix.

A report should state the limitations that remain after testing → Limitation: Only whole numbers were tested, so decimal input is untested.

Conclusion: The program works great and is fully validated. → The conclusion gives no evidence. It does not say how many tests passed or failed.

Tests run: 12, Passed: 8, Failed: 4. Conclusion: The program is validated. → The conclusion contradicts the results, because 4 tests failed and nothing was fixed or retested.

Section C: Definitions

test report — A summary of how many tests passed and failed, what was fixed and retested, and a conclusion on whether the program is validated, backed by the results and any limitations.

Section D: Fill in the Blanks

passed = 8
failed = 2
total = passed + failed

total = 10
passed = 9
rate = passed / total * 100

if failed == 0:
    print("Conclusion: program validated")

for test in retests:
    run_test(test)

failed = ["T4", "T7"]
print(len(failed), "tests still fail")

Section E: Spot the Error

C — The total number of tests is passes plus failures, so it should be total = passed + failed. Subtracting gives 16 instead of 20, which would make the report wrong.

B — Passes are the True results, so it should be results.count(True). Counting False here gives the number of failures and mislabels it as passes.

A — The total number of tests cannot be smaller than the number that passed. With total = 10 the pass rate would be 170%. It should be total = 20 so the count matches the evidence.

B — Every test that failed must be run again after the fix, so retested should equal failed (3). Setting it to 0 means no retests were done, so the fixes are unproven.

D — A single = assigns a value and is a syntax error inside an if condition. It should be if validated: (or if validated == True:).