This page is outdated

The website of current conference can be found on

25 - 26 June 2015 in Prague

The website of last year conference can be found on

Agile Test Metrics (Updated)

Agile teams don’t need traditional metrics: we do everything so quickly that we only need to know our velocity and cycle time". Is this an extreme claim, or is it realistic? When it's possible to implement a completely pure and simple Agile methodology, and react to all feedback almost immediately, it might be true. It's certainly true that some of the metrics which work well in other types of project lifecycle aren't useful in an Agile one. But are test metrics irrelevant in a large Agile project, with multiple teams and a formal release mechanism? What happens when an Agile project has to comply with standards, or with regulatory requirements, to produce proof of product quality? And even if those things aren’t true, aren't there some things we can measure that will tell us how good our Agile testing is, and how it might get better?

Richard Taylor co-wrote an earlier version of this presentation, which Roman Jurkech gave to CzechTest 2013. Richard has now substantially updated and extended it. It will be helpful to anybody who is, or will be, testing in or managing an Agile project team. In it, Richard explains how to make some of his favourite test metrics useful in an Agile environment and why some others might better be avoided. Various types of coverage, effectiveness and weighted defect measures are explained and demonstrated. Richard shows how we can present both product and process metrics in a way that gives their message clearly to all interested people, including those from the business and from management who aren’t IT specialists.

Richard Taylor, STEST, Czech Republic

Richard TaylorRichard Taylor has been an IT practitioner for more than 40 years, during which he has done most ofthe jobs that it has to offer from programming and systems / business analysis through to project management. Since 1992 he has specialised in the conduct and management of software testing in a wide variety of environments. During six years as a Senior Consultant with one of the the world’s largest systems integration consultancies, he became the focal point for testing best practice within their UK Consulting & Systems Integration division. He has designed and implemented test process solutions aimed at BS5750, ISO9001 and CMM levels 2 and 3, and claims proudly that he has yet to fail a quality audit.

Richard has wide experience of applications delivery in the government, retail, logistics, insurance and transport sectors (including the management of airports). He is familiar with the issues of managing offshore testing and multi-national test teams, having worked extensively outside the UK.

He has worked in Agile as well as more traditional environments, for companies and on projects ranging from very small to very large, and has used a variety of project management methodologies including PRINCE2.

One of the early members of the software testing Subject Board in the British Computer Society’s Information Systems Examination Board (ISEB), Richard helped to develop the UK’s Foundation and Practitioner Certificates in Software Testing. Since then, he has contributed to its ISTQB replacement and to the Glossary of Software Testing Terms that accompanies it. He has contributed numerous improvements to accreditted training materials used for all of the ISTQB Advanced Level syllabi, and has written a complete training course for the ISTQB Foundation Level Agile Extension certificate.

A regular speaker at conferences and seminars in both continental Europe and the UK, he has written and presented papers on several aspects of testing and test management, including use of metrics for test management and for Agile testing (in which he has particular interest).

Richard was educated at an English private school and Cambridge University, which was followed by a short commission as an officer in the Royal Air Force. Now based in Prague, the capital of the Czech Republic, he continues to be an active software test management consultant as well as a popular trainer.