SciELO - Scientific Electronic Library Online

 
vol.12 issue3The past, present, and future of experimental software engineeringWhich documentation for software maintenance? author indexsubject indexarticles search
Home Pagealphabetic serial listing  

Journal of the Brazilian Computer Society

Print version ISSN 0104-6500

Abstract

GOKHALE, Swapna S.  and  MULLEN, Robert E.. The marginal value of increased testing: an empirical analysis using four code coverage measures. J. Braz. Comp. Soc. [online]. 2006, vol.12, n.3, pp. 13-30. ISSN 0104-6500.  http://dx.doi.org/10.1007/BF03194493.

This paper presents an empirical comparison of the growth characteristics of four code coverage measures, block, decision, c-use and p-use, as testing is increased. Due to the theoretical foundations underlying the lognormal software reliability growth model, we hypothesize that the growth for each coverage measure is lognormal. Further, since for a given program the breadth and the depth of the different coverage measures are similar, we expect that the parameters of the lognormal coverage growth model for each of the four coverage measures to be similar. We confirm these hypotheses using coverage data generated from extensive testing of an application which has 30 KLOC. We then discuss how the lognormal coverage growth function could be used to control the testing process and to guide decisions about when to stop testing, since it can provide an estimate of the marginal testing effort necessary to achieve a given level of improvement in the coverage. 

Keywords : lognormal; code coverage; data flow coverage; software reliability; software testing; testing criteria.

        · text in English     · pdf in English