6 Test Automation Reporting and Metrics

Part of the CTAL-TAE syllabus, explained.

Time in the syllabus: 150 minutes. Highest level: K4. Keywords to remember: measurement, metric, test log, test progress report, test step.

In plain words

What data to collect from the test automation and the system under test, how to analyse failures, and how to build and publish test progress reports for different stakeholders.

Learning objectives

• 6.1 Collection, Analysis and Reporting of Test Automation Data
  • 6.1.1 Apply Data Collection Methods from the Test Automation Solution and the System Under Test (K3)
  • 6.1.2 Analyze Data from the Test Automation Solution and the System Under Test to Better Understand Test Results (K4)
  • 6.1.3 Explain How a Test Progress Report is Constructed and Published (K2)

Previous: 5.1.3 Explain Test Automation Dependencies for an API Infrastructure · Contents · Next: 6.1 Collection, Analysis and Reporting of Test Automation Data

Based on the ISTQB Certified Tester Advanced Level Test Automation Engineering (CTAL-TAE) syllabus, version 2.0, section 6. The syllabus is © International Software Testing Qualifications Board (ISTQB®); ISTQB® is a registered trademark of the ISTQB. Copyright © 2024 the authors of the syllabus: Andrew Pollner (Chair), Péter Földházi, Patrick Quilter, Gergely Ágnecz, and László Szikszai. This page explains its concepts in our own words, for teaching, and is not an accredited course or a substitute for the syllabus.

View this document on GitHub materials/modules/module-5-istqb-certified-tester-advanced-level-test-automation-engineer/syllabus/6-test-automation-reporting-and-metrics.md