Suite-health report
Evidence 15, part 2, for Band 5 quality assurance and above. One page. It shows whether your suite is healthy, using simple flow metrics: measure what is actually moving, not how busy people look.
Suite
| Field | Value |
|---|---|
| Suite | |
| Repository | |
| Period covered | from ______ to ______ (at least 2 weeks) |
| Number of tests | unit ___, API ___, browser ___ |
Metrics
| Metric | How to measure | Value | Trend |
|---|---|---|---|
| Defect to regression test | For each defect fixed in the period: days from the defect being reported to a regression test for it existing in the suite. Report the median. | days | |
| Quarantined or skipped tests | Count tests marked skip, fixme, or quarantined, at the end of the period. Each needs an owner and a deadline. |
||
| Suite run time | Median CI run time for the full suite. | minutes | |
| Failure causes | For every CI failure in the period: product defect, test defect, or environment problem (from your Module 13 triage records). | product ___ / test ___ / environment ___ | |
| Flaky rate | Tests that failed and then passed with no change, divided by all test runs. | % | |
| Manual regression time saved (optional) | From Evidence 7: manual minutes per release for cases now automated. | minutes per release |
Quarantine list
| Test | Quarantined on | Owner | Deadline | Cause |
|---|---|---|---|---|
What the numbers say
Three short points:
One action
The single change that would most improve this suite's health, with an owner and a date:
Why this matters
A growing pile of skipped, quarantined, or flaky tests is work in progress that is not moving. It is testing debt, and it is measurable. "Time from a defect report to a regression test" is a concrete cycle time: if it is long, the same defect can come back unnoticed.
Track notes
- Band 5 quality assurance (with support): cover your own tests from Evidence 11 and Evidence 12, with support.
- Band 6 quality assurance, Band 6 test engineering (independently): cover your area's suite.
- Band 7 test engineering, Band 7 test management (lead or coach): cover the team's suite, and propose which metrics the team should track every month. Band 7 test management brings this to Automation strategy and metrics.
View this document on GitHub materials/modules/module-15-quality-engineering/suite-health-report.md