Reference Further Empirical Studies of Test Effectiveness,.pdf

MSc Software Testing and Maintenance MSc Prófun og viðhald hugbúnaðar Fyrirlestrar 37 38 An Experiment on Test Effectiveness Does your test suite catch the bug? 09/ 10/2006 Dr Andy Brooks 1 Case Study Dæmisaga Reference Further Empirical Studies of Test Effectiveness, Phyllis G Frankl and Oleg Iakounenko, SIGSOFT´98 © ACM, pp 153-162 09/ 10/2006 Dr Andy Brooks 2 1. Introduction • How effective are branch testing and all-uses data flow testing ? – structural (white-box) testing techniques • path selection techniques • This paper tries to answer this question by reporting an experiment with eight versions of a real-world C program, each containing a naturally occurring (and different) fault. – antenna configuration program developed for the European Space Agency – each version had over 10,000 lines of code 09/ 10/2006 Dr Andy Brooks 3 1. Introduction • In statement testing, a test set is considered adequate if it causes the execution of every statement. • In branch testing (decision coverage), a test set is considered adequate if it causes every edge in the control flow graph to be executed. 09/ 10/2006 Dr Andy Brooks 4 1. Introduction • In all-uses data flow testing, each test requirement is: – “a definition-use association (dua) i.e., a triple (d,u,v), where v is a variable, d is a program point where v is defined, and u is a program point where v is used” – “to cover such a requirement a test case must execute a path that goes from