Software Test Coverage and Reliability

Karcich@stortek.com

Technical Report CS-96-128

Y.MalaiyaandN.LiarepartlysupportedbyaBMDOfundedprojectmonitoredbyONR

J.Biemanissupported,inpart,bytheNASALangleyResearchCenter,theColoradoAdvancedSoftwareInstitute(CASI)andStorageTechnologyInc.CASIissupportedinpartbytheColoradoAdvancedTechnologyInstitute(CATI).CATIpromotesadvancedtechnologyteachingandresearchatuniversitiesinColoradoforthepurposeofeconomicdevelopment.

All-PathsAll-DU-PathsAll-UsesAll-C-UsesSome-P-UsesAll-P-UsesSome-C-UsesAll-DefsAll-P-UsesAll-BranchesAll-Blocks21.81.61.41.2at time t0at time t1at time t3p(x)10.80.60.40.2000.20.4Detectability0.60.810.90.8actualfitted0.70.6Fault Coverage0.50.40.30.20.100.451.20.50.550.60.650.7Branch Coverage0.750.80.851n-ftbk-ftbr-ftc-ftp-fty=xComputed Fault Coverage0.80.60.40.2000.20.40.60.81Actual Fault Coverage10.90.80.7Coverage0.60.50.4blockc-usep-usebranchfault0.30.20.1110Number of Tests100100010.8Actual defect coverageModel defect coverageRelative defect density85% branch coverage0.60.40.200.50.60.70.8Branch Coverage0.911Defect Coverageapproximately linear heremay not be observed insmall programs0.850.5Enumerable iTest Coverage11branchc-usep-use0.90.8Coverages (C2, C3, C4)0.70.60.50.40.30.550.60.650.70.750.80.850.90.951Block Coverage44real datafitted line4240Branch Coverage38363432307274767880Module Coverage828486MTTF00.20.4Test Coverage0.60.81