An Adequacy Based Test Data Generation Technique Using Genetic Algorithms = An Adequacy Based Test Data Generation Technique Using Genetic Algorithms

다국어 초록 (Multilingual Abstract)

As the complexity of software is increasing, generating an effective test data has become a necessity. This necessity has increased the demand for techniques that can generate test data effectively. This paper proposes a test data generation technique based on adequacy based testing criteria. Adequacy based testing criteria uses the concept of mutation analysis to check the adequacy of test data. In general, mutation analysis is applied after the test data is generated. But, in this work, we propose a technique that applies mutation analysis at the time of test data generation only, rather than applying it after the test data has been generated. This saves significant amount of time (required to generate adequate test cases) as compared to the latter case as the total time in the latter case is the sum of the time to generate test data and the time to apply mutation analysis to the generated test data. We also use genetic algorithms that explore the complete domain of the program to provide near-global optimum solution. In this paper, we first define and explain the proposed technique. Then we validate the proposed technique using ten real time programs. The proposed technique is compared with path testing technique (that use reliability based testing criteria) for these ten programs. The results show that the adequacy based proposed technique is better than the reliability based path testing technique and there is a significant reduce in number of generated test cases and time taken to generate test cases.

참고문헌 (Reference)

1 S. Khor, "Using a Genetic Algorithm and Formal Concept Analysis to Generate Branch Coverage Test Data Automatically" 1068-3062, 2004

2 A.S. Ghiduk, "Using Genetic Algorithms to Aid Test-Data Generation for Data-Flow Coverage" IEEE 41-48, 2007

3 B. W. Kernighan, "The Elements of Programming Style" McGraw-Hill, Inc 1982

4 K. Dahal, "Test Data Generation from UML State Machine Diagrams using GAs" IEEE 834-840, 2007

5 K.K. Aggarwal, "Software Engineering" New Age International Publishers 2006

6 S. Rapps, "Selecting software test data using data flow information" 11 (11): 367-375, 1985

7 P. McMinn, "Search-based software test data generation: A survey" 14 (14): 105-156, 2004

8 M. Harman, "Search based testing (keynote)" 2005

9 D.E. Goldberg, "Genetic Algorithms: in Search, In Optimization & Machine Learning" Addison Wesley 1989

10 C.C. Michael, "Genetic Algorithms for Dynamic Test Data Generation"

11 C. Michael, "Generating software test data by evolution" 27 (27): 1085-1110, 2001

12 M. A. Ahmed, "GAbased multiple paths test data generator" 2007

13 J. Wegener, "Evolutionary Test Environment for Automatic Structural Testing" 43 : 841-854, 2001

14 J. W. Laski, "Data flow oriented program testing strategy" 9 (9): 347-354, 1983

15 N. Mansour, "Data Generation for Path Testing" Kluwer Academic Publishers 12 : 121-136, 2004

16 R. DeMillo, "Constraint-based automatic test data generation" 17 (17): 900-910, 1991

17 J. C. Lin, "Automatic test data generation for path testing using Gas" 131 : 47-64, 2001

18 B.F. Jones, "Automatic structural testing using genetic algorithms" 299-306, 1996

19 M. R Girgis, "Automatic Test Data Generation For Data Flow Testing Using A Genetic Algorithm" 11 (11): 898-915, 2005

20 Yong Chen, "Automatic Path-oriented Test Data Generation Using a Multi-Population Genetic Algorithm" IEEE 2008

21 X. Shen, "Automatic Generation of Test Case based on GATS Algorithm, 2007AA04Z148, supported by Nation 863 Project"

22 B. Korel, "Automated software test generation" 16 (16): 870-879, 1990

23 M. Harman, "Automated Test Data Generation using Search Based Software Engineering" IEEE 2007

24 A. Rauf, "Automated GUI Test Coverage Analysis using GA" IEEE 1057-1062, 2010

25 S. Xanthakis, "Application of genetic algorithm to software testing" 625-636, 1992

26 P.R. Srivastava, "Application of Genetic Algorithm in Software Testing" 3 (3): 87-96, 2009

27 J.W. Duran, "An evaluation of random testing" 10 (10): 438-443, 1984

28 A.S. Andreou, "An automatic software test-data generation scheme based on data flow criteria and genetic algorithms" IEEE 867-872, 2007

29 A. Bouchachia, "An Immune Genetic Algorithm for Software Test Data Generation" IEEE 84-89, 2007

30 Y. Jia, "An Analysis and Survey of the Development of Mutation Testing" IEEE 2010

31 L. Clarke, "A system to generate test data and symbolically execute programs" SE-2 (SE-2): 215-222, 1976