A Critical Review on Automated Test Case Generation for Conducting Combinatorial Testing Using Particle Swarm Optimization

  • Authors

    • Dr V. Chandra Prakash
    • Subhash Tatale
    • Vrushali Kondhalkar
    • Laxmi Bewoor
    2018-07-07
    https://doi.org/10.14419/ijet.v7i3.8.15212
  • Particle Swarm Optimization (PSO), Software Testing, Combinatorial Testing, Pair-wise Testing, Automated Test Case Generation

  • Abstract

    In software development life cycle, testing plays the significant role to verify requirement specification, analysis, design, coding and to estimate the reliability of software system. A test manager can write a set of test cases manually for the smaller software systems. However, for the extensive software system, normally the size of test suite is large, and the test suite is prone to an error committed like omissions of important test cases, duplication of some test cases and contradicting test cases etc. When test cases are generated automatically by a tool in an intelligent way, test errors can be eliminated. In addition, it is even possible to reduce the size of test suite and thereby to decrease the cost & time of software testing.

    It is a challenging job to reduce test suite size. When there are interacting inputs of Software under Test (SUT), combinatorial testing is highly essential to ensure higher reliability from 72 % to 91 % or even more than that. A meta-heuristic algorithm like Particle Swarm Optimization (PSO) solves optimization problem of automated combinatorial test case generation. Many authors have contributed in the field of combinatorial test case generation using PSO algorithms.

    We have reviewed some important research papers on automated test case generation for combinatorial testing using PSO. This paper provides a critical review of use of PSO and its variants for solving the classical optimization problem of automatic test case generation for conducting combinatorial testing.

     

     

     

  • References

    1. [1] Cohen, David M., Siddhartha R. Dalal, Michael L. Fredman, and Gardner C. Patton. "The AETG system: An approach to testing based on combinatorial design." IEEE Transactions on Software Engineering Vol.23, No. 7 (1997), pp. 437-444.

      [2] Poli, Riccardo, James Kennedy, and Tim Blackwell. "Particle swarm optimization." Swarm intelligence, Springer, Vol. 1, No. 1 (2007), pp. 33-57.

      [3] R. Kuhn, Yu Lei and Raghu Kacker, “Practical Combinatorial Testing: beyond Pair wiseâ€, IEEE Computer Society - IT Professional, Vol. 10, No. 3 (2008).

      [4] D. Richard Kuhn, Raghu N. Kacker and Yu Lei, “Practical combinatorial testingâ€, NIST Special Publication, (2010).

      [5] Chen, Xiang, Qing Gu, Jingxian Qi, and Daoxu Chen. "Applying particle swarm optimization to pairwise testing." Conference In Computer Software and Applications (COMPSAC), IEEE (2010), pp. 107-116.

      [6] Ahmed, Bestoun S., and Kamal Z. Zamli. "PSTG: a t-way strategy adopting particle swarm optimization." 4th Asia International Conference In Mathematical/Analytical Modelling and Computer Simulation (AMS), IEEE (2010), pp. 1-5.

      [7] Zha, Ri-Jun, De-Ping Zhang, Chang-Hai Nie, and Bao-Wen Xu. "Test data generation algorithms of combinatorial testing and comparison based on cross-entropy and particle swarm optimization method." Jisuanji Xuebao (Chinese Journal of Computers) Vol.33, No. 10 (2010), pp.1896-1908.

      [8] Ahmed, Bestoun S., and Kamal Z. Zamli. "T-way test data generation strategy based on particle swarm optimization." 2nd International Conference In Computer Research and Development, IEEE (2010), pp. 93-97.

      [9] Vudatha, Chandra Prakash, Sateesh Nalliboena, Sastry Kr Jammalamadaka, Bala Krishna Kamesh Duvvuri, and L. S. S. Reddy. "Automated generation of test cases from output domain of an embedded system using Genetic algorithms." 3rd International In Electronics Computer Technology (ICECT), IEEE (2011), vol. 5, pp. 216-220.

      [10] Pan, Xiaoying, and Hao Chen. "Using organizational evolutionary particle swarm techniques to generate test cases for combinatorial testing." 7th International Conference In Computational Intelligence and Security (CIS), IEEE (2011), pp. 1580-1583.

      [11] Ahmed, Bestoun S., and Kamal Z. Zamli. "A variable strength interaction test suites generation strategy using Particle Swarm Optimization." Journal of Systems and Software Vol.84, No. 12 (2011), pp. 2171-2185.

      [12] Ahmed, Bestoun S., Kamal Z. Zamli, and C. Lim. "The development of a particle swarm based optimization strategy for pairwise testing." Journal of Artificial Intelligence Vol.4, No. 2 (2011), pp. 156-165.

      [13] Ahmed, Bestoun S., Kamal Z. Zamli, and Chee Peng Lim. "Constructing a t-way interaction test suite using the particle swarm optimization approach." International Journal of Innovative Computing, Information and Control Vol.8, No. 1 (2012),pp. 431-452.

      [14] Ahmed, Bestoun S., Kamal Z. Zamli, and Chee Peng Lim. "Application of particle swarm optimization to uniform and variable strength covering array construction." Applied Soft Computing Vol. 12, No. 4 (2012), pp. 1330-1347.

      [15] Ahmed, Bestoun S., and Kamal Z. Zamli. "A greedy particle swarm optimization strategy for t-way software testing." Journal of Artificial Intelligence Vol.5, No. 2 (2012), pp. 85-90.

      [16] Chana, Inderveer, and Ajay Rana. "An Effective Approach to Build Optimal T-way Interaction Test Suites over Cloud Using Particle Swarm Optimization." In International Conference on Advances in Communication, Network, and Computing, Springer (2012), pp. 193-198.

      [17] Wang, Jianfeng, Chao Sun, and Shouda Jiang "Improved algorithm for combinatorial test data generation based on particle swarm optimization." Journal of Harbin Engineering University Vol.4 (2013).

      [18] Ahmed, Bestoun S., Mouayad A. Sahib, and Moayad Y. Potrus. "Generating combinatorial test cases using Simplified Swarm Optimization (SSO) algorithm for automated GUI functional testing." International Journal of Engineering Science and Technology, Vol. 17, No. 4 (2014), pp.218-226.

      [19] Wu, Huayao, Changhai Nie, Fei-Ching Kuo, Hareton Leung, and Charles J. Colbourn. "A discrete particle swarm optimization for covering array generation." IEEE Transactions on Evolutionary Computation Vol.19, No. 4 (2013), pp. 575-591.

      [20] Rabbi, Khandakar, Quazi Mamun, and MD Rafiqul Islam. "An efficient particle swarm intelligence based strategy to generate optimum test data in t-way testing." 10th Conference In Industrial Electronics and Applications (ICIEA), IEEE (2015), pp. 123-128.

      [21] Mahmoud, Thair, and Bestoun S. Ahmed. "An efficient strategy for covering array construction with fuzzy logic-based adaptive swarm optimization for software testing use." Expert Systems with Applications Vol.42, No. 22 (2015), pp. 8753-8765.

      [22] V.Chandra Prakash and Kadiyala Priyanka, 2016. “Test Case Generation for Pairwise + Testing.†Asian Journal of Information Technology. Vol. 15 No.23 (2016), pp.4800-4805.

      [23] Kalaee, Akram, and Vahid Rafe. "An Optimal Solution for Test Case Generation Using ROBDD Graph and PSO Algorithm." International Journal of Quality and Reliability Engineering Vol.32, No. 7 (2016), pp. 2263-2279

      [24] Sahin, Omur, and Bahriye Akay. "Comparisons of metaheuristic algorithms and fitness functions on software test data generation." Applied Soft Computing Vol. 49 (2016), pp. 1202-1214.

      [25] Bewoor, L., V. Chandra Prakash, and Sagar U. Sapkal. "Comparative analysis of metaheuristic approaches for m-machine no-wait flow shop scheduling for minimizing total flow time with stochastic input." International Journal of Engineering & Technology, Vol.8 (2016), pp. 3021-3026.

      [26] Ahmed, Bestoun S., Luca M. Gambardella, Wasif Afzal, and Kamal Z. Zamli. "Handling constraints in combinatorial interaction testing in the presence of multi objective particle swarm and multithreading." Journal of Information and Software Technology Vol.86 (2017), pp. 20-36

      [27] Sheng, Yunlong, Changan Wei, and Shouda Jiang. "Constraint Test Cases Generation Based on Particle Swarm Optimization." International Journal of Reliability, Quality and Safety Engineering Vol.24, No. 05 (2017).

      [28] Bewoor, Laxmi A., V. Chandra Prakash, and Sagar U. Sapkal. "Comparative Analysis of Metaheuristic Approaches for Makespan Minimization for No Wait Flow Shop Scheduling Problem." International Journal of Electrical and Computer Engineering Vol.7, No. 1 (2017), pp. 417.

      [29] Bewoor Laxmi A., V. Chandra Prakash, and Sagar U. Sapkal. "Evolutionary Hybrid Particle Swarm Optimization Algorithm for Solving NP-Hard No-Wait Flow Shop Scheduling Problems." Algorithms Vol.10, No. 4 (2017), pp. 121.

      [30] Vudatha Chandra Prakash, Sastry K R Jammalamadaka, and Bala Krishna Kamesh Duvvuri. "Automated generation of Test cases for testing critical regions of embedded systems through Adjacent Pair-wise Testing." International Journal of Mathematics and Computational Methods in Science & Technology Vol.2, No.2, (2012), pp. 10-15.

      [31] Dr. Chandra Prakash V, Dr. Sastry J K R, Sravani G, Manasa USL, Khyathi A, Harini A. "Testing Software Through Genetic Algorithms-A Survey" Journal of Advanced Research in Dynamical and Control Systems, Vol. 9 (2017).

  • Downloads

  • How to Cite

    V. Chandra Prakash, D., Tatale, S., Kondhalkar, V., & Bewoor, L. (2018). A Critical Review on Automated Test Case Generation for Conducting Combinatorial Testing Using Particle Swarm Optimization. International Journal of Engineering & Technology, 7(3.8), 22-28. https://doi.org/10.14419/ijet.v7i3.8.15212

    Received date: 2018-07-06

    Accepted date: 2018-07-06

    Published date: 2018-07-07