Regression Testing Systematic Literature Review – A Preliminary Analysis

  • Authors

    • Bakr Ba-Quttayyan
    • Haslina Mohd
    • Fauziah Baharom
    2018-11-27
    https://doi.org/10.14419/ijet.v7i4.19.23176
  • Regression testing, software maintenance, systematic review, software testing.

  • Abstract

    Software needs to be modified and frequently maintained by what is called regression testing. Regression testing is a costly but necessary maintenance activity in the software development lifecycle (SDLC), which can be performed to revalidate modified software to make sure that changes did not adversely affect software behavior. Several studies have been carried out regarding regression testing domain in the literature. However, these studies need to be classified, summarized and ordered in a systematic manner to spot on the current state of the art of regression testing field. Previously, a protocol for conducting systematic literature review for regression testing was carried out. Therefore, this paper will carry out a systematic literature review (SLR) to illustrate the current state-of-the-art of regression testing domain. In this SLR, a manual search has been conducted to obtain related studies from four various sources where those studies were classified under journal, conference proceeding, and book chapter categories within specific criteria. Consequently, the initial search resulted in 1261 unfiltered studies, which then decreased according to certain predefined criteria up to 246 selected relevant studies. For the next stage, primary and secondary studies were identified. As a result of this stage, major regression testing concepts such as: approaches, frameworks, models and tools were briefly presented, analyzed and discussed in related with selected studies. In the future, regression testing approaches, techniques and tools will be further discussed in more detail.

     

     

  • References

    1. [1] S. Eghbali and L. Tahvildari, “Test Case Prioritization Using Lexicographical Ordering,†IEEE Trans. Softw. Eng., vol. 42, no. 12, pp. 1178–1195, Dec. 2016.

      [2] Q. Yi, Z. Yang, J. Liu, C. Zhao, and C. Wang, “A synergistic analysis method for explaining failed regression tests,†Proc. - Int. Conf. Softw. Eng., vol. 1, pp. 257–267, 2015.

      [3] H. K. N. Leung and L. White, “Insights into regression testing,†in Proceedings. Conference on Software Maintenance - 1989, 1989, pp. 60–69.

      [4] N. Chauhan, Software Testing: Principles and Practices. Oxford University Press, 2010.

      [5] M. Kowalczewski, M. Krawczyk, E. Lewańska, and W. Abramowicz, “IFTT: Software Application Interfaces Regression Testing,†in International Conference on Business Information Systems, Springer, Cham, 2017, pp. 120–131.

      [6] R. Kazmi, D. N. A. Jawawi, R. Mohamad, and I. Ghani, “Effective Regression Test Case Selection: A Systematic Literature Review,†ACM Comput. Surv., vol. 50, no. 2, p. 29:1-29:32, Jun. 2017.

      [7] E. Engström and P. Runeson, “A Qualitative Survey of Regression Testing Practices,†2010, pp. 3–16.

      [8] M. Rava and W. M. N. Wan-Kadir, “A Review on Prioritization Techniques in Regression Testing,†Int. J. Softw. Eng. Its Appl., vol. 10, no. 1, pp. 221–232, Jan. 2016.

      [9] C. Tao, B. Li, X. Sun, and Y. Zhou, “A Hierarchical Model for Regression Test Selection and Cost Analysis of Java Programs,†in 2010 Asia Pacific Software Engineering Conference, 2010, pp. 290–299.

      [10] H. Do, “Chapter Tree - Recent Advances in Regression Testing Techniques,†in Advances in Computers, vol. 103, Elsevier, 2016, pp. 53–77.

      [11] S. Nayak, C. Kumar, and S. Tripathi, “Enhancing Efficiency of the Test Case Prioritization Technique by Improving the Rate of Fault Detection,†Arab. J. Sci. Eng., pp. 1–17, Jul. 2017.

      [12] M. J. Harrold, “Testing: A Roadmap,†in Proceedings of the conference on The future of Software engineering - ICSE ’00, 2000, no. May 2001, pp. 61–72.

      [13] I. S. C. IEEE Committee, “IEEE Standard Glossary of Software Engineering Terminology,†IEEE Std 610.12-1990, vol. 169, no. 1, pp. 1–94, 1990.

      [14] G. Rothermel and M. J. J. Harrold, “A framework for evaluating regression test selection techniques,†in Proceedings of 16th International Conference on Software Engineering, 1994, pp. 201–210.

      [15] T. . Yu, X. . Qu, M. . Acharya, and G. . c Rothermel, “Oracle-based regression test selection,†Proc. - IEEE 6th Int. Conf. Softw. Testing, Verif. Validation, ICST 2013, pp. 292–301, 2013.

      [16] A. Janes, “Test Case Generation and Prioritization: A Process-Mining Approach,†in 2017 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW), 2017, pp. 38–39.

      [17] K. Fischer, F. Raji, and A. Chruscicki, “A methodology for retesting modified software,†in Proceedings of the National Telecommunications Conference, 1981, pp. 1–6.

      [18] G. Rothermel and M. J. Harrold, “Experience With Regression Test Selection,†Empir. Softw. Eng., vol. 2, no. 2, pp. 178–188, 1997.

      [19] W. E. E. Wong, J. R. R. Horgan, S. London, and H. Agrawal, “A study of effective regression testing in practice,†in Proceedings The Eighth International Symposium on Software Reliability Engineering, 1997, pp. 264–274.

      [20] D. Hao, L. Zhang, and H. Mei, “Test-case prioritization: achievements and challenges,†Front. Comput. Sci., vol. 10, no. 5, pp. 769–777, Jul. 2016.

      [21] E. Engström, M. Skoglund, and P. Runeson, “Empirical evaluations of regression test selection techniques: a systematic review.,†Int. Symp. Empir. Softw. Eng. Meas., pp. 22–31, 2008.

      [22] E. Engström, P. Runeson, and M. Skoglund, “A systematic review on regression test selection techniques,†Inf. Softw. Technol., vol. 52, no. 1, pp. 14–30, 2010.

      [23] S. Keele, others, and S. E. Group, “Guidelines for performing systematic literature reviews in software engineering,†sn, 2007.

      [24] A. G. Malishevsky, G. Rothermel, and S. Elbaum, “Modeling the cost-benefits tradeoffs for regression testing techniques,†Softw. Maintenance, 2002. Proceedings. Int. Conf., pp. 204–213, 2002.

      [25] H. Do and G. Rothermel, “An Empirical Study of Regression Testing Techniques Incorporating Context and Lifetime Factors and Improved Cost-Benefit Models,†Sigsoft’06/Fse-, pp. 141–151, 2006.

      [26] H. Do and G. Rothermel, “Using sensitivity analysis to create simplified economic models for regression testing,†in Proceedings of the 2008 international symposium on Software testing and analysis - ISSTA ’08, 2008, p. 51.

      [27] H. K. N. Leung and L. White, “A cost model to compare regression test strategies,†in Proceedings. Conference on Software Maintenance 1991, 1991, pp. 201–208.

      [28] Von Mayrhauser, Mraz, and Walls, “Domain based regression testing,†in Proceedings International Conference on Software Maintenance ICSM-94, 1994, pp. 26–35.

      [29] J. Zheng, “In regression testing selection when source code is not available,†20th IEEEACM Int. Conf. Autom. Softw. Eng. ASE 2005, pp. 452–455, 2005.

      [30] S. Nachiyappan, A. Vimaladevi, C. B. Selvalakshmi, and S. CB, “An evolutionary algorithm for regression test suite reduction,†Proc. 2010 Int. Conf. Commun. Comput. Intell. (INCOCCI)., pp. 503–508, 2010.

      [31] K. K. Aggrawal, Y. Singh, and A. Kaur, “Code coverage based technique for prioritizing test cases for regression testing,†ACM SIGSOFT Softw. Eng. Notes, vol. 29, no. 5, p. 1, Sep. 2004.

      [32] A. K. Onoma, W.-T. Tsai, M. Poonawala, and H. Suganuma, “Regression testing in an industrial environment,†Commun. ACM, vol. 41, no. 5, pp. 81–86, May 1998.

      [33] A. Memon, A. Nagarajan, and Q. Xie, “Automating regression testing for evolving GUI software,†J. Softw. Maint. Evol. Res. Pract., vol. 17, no. 1, pp. 27–64, Jan. 2005.

      [34] F. Haftmann, D. Kossmann, and E. Lo, “A framework for efficient regression tests on database applications,†VLDB J., vol. 16, no. 1, pp. 145–164, 2007.

      [35] J. M. Kauffman and G. M. Kapfhammer, “A Framework to Support Research in and Encourage Industrial Adoption of Regression Testing Techniques,†in 2012 IEEE Fifth International Conference on Software Testing, Verification and Validation, 2012, pp. 907–908.

      [36] R. Salama, J. McGuire, and M. K. Rosenberg, “A methodology for managing database and code changes in a regression testing framework,†in Proceedings of the 3rd annual conference on Systems, programming, and applications: software for humanity - SPLASH ’12, 2012, p. 117.

      [37] Z. Liu, Q. Chen, and X. Jiang, “A maintainability spreadsheet-driven regression test automation framework,†Proc. - 16th IEEE Int. Conf. Comput. Sci. Eng. CSE 2013, pp. 1181–1184, 2013.

      [38] T. Yu, W. Srisa-an, and G. Rothermel, “SimRT: an automated framework to support regression testing for data races,†Proc. 36th Int. Conf. Softw. Eng. - ICSE 2014, pp. 48–59, 2014.

      [39] V. Terragni, S. C. Cheung, and C. Zhang, “RECONTEST: Effective regression testing of concurrent programs,†Proc. - Int. Conf. Softw. Eng., vol. 1, pp. 246–256, 2015.

      [40] R. C. Ruth M., “A privacy-aware, end-to-end, CFG-based regression test selection framework for web services using only local information,†4th Int. Conf. Appl. Digit. Inf. Web Technol. ICADIWT 2011, pp. 13–18, 2011.

      [41] S. Chen, Z. Chen, Z. Zhao, B. Xu, and Y. Feng, “Using semi-supervised clustering to improve regression test selection techniques,†2011 Fourth IEEE Int. Conf. Softw. Testing, Verif. Valid., pp. 1–10, 2011.

      [42] L. Yu, C. Liu, and Y. Zhang, “A multidimensional classification of safe regression test selection techniques,†2012 Int. Conf. Syst. Informatics, ICSAI 2012, no. Icsai, pp. 2516–2520, 2012.

      [43] A. Larprattanakul and T. Suwannasart, “An Approach for Regression Test Case Selection Using Object Dependency Graph,†2013 5th Int. Conf. Intell. Netw. Collab. Syst., pp. 617–621, 2013.

      [44] M. Nooraei Abadeh and S.-H. Mirian-Hosseinabadi, “Delta-based regression testing: a formal framework towards model-driven regression testing,†J. Softw. Evol. Process, vol. 27, no. 12, pp. 913–952, Dec. 2015.

      [45] Z. Zhang, J. Huang, B. Zhang, J. Lin, and X. Chen, “Regression Test Generation Approach Based on Tree-Structured Analysis,†2010 Int. Conf. Comput. Sci. Its Appl., pp. 244–249, 2010.

      [46] D. Marijan, “Multi-perspective Regression Test Prioritization for Time-Constrained Environments,†in 2015 IEEE International Conference on Software Quality, Reliability and Security, 2015, pp. 157–162.

      [47] N. J. Wahl, “An overview of regression testing,†ACM SIGSOFT Softw. Eng. Notes, vol. 24, no. 1, pp. 69–73, Jan. 1999.

      [48] M. Harman, “Making the Case for MORTO: Multi Objective Regression Test Optimization,†in 2011 IEEE Fourth International Conference on Software Testing, Verification and Validation Workshops, 2011, pp. 111–114.

      [49] S. Sampath, R. Bryce, and A. M. Memon, “A Uniform Representation of Hybrid Criteria for Regression Testing,†IEEE Trans. Softw. Eng., vol. 39, no. 10, pp. 1326–1344, Oct. 2013.

      [50] K. S. S. Prakash, S. U. M. D. Prasad, and D. G. Krishna, “Recommendation and Regression Test Suite Optimization Using Heuristic Algorithms,†in Proceedings of the 8th India Software Engineering Conference on XXX - ISEC ’15, 2015, pp. 202–203.

      [51] P. R. Cox, “Specification of a Regression Test for a Mini Computer Operating System,†SIGMETRICS Perform. Eval. Rev., vol. 10, no. 1, pp. 29–32, Apr. 1981.

      [52] A. von Mayrhauser and T. Jeon, “CASE tool architecture for knowledge-based regression testing,†in Proceedings of the conference on TRI-Ada ’93 - TRI-Ada ’93, 1993, pp. 368–378.

      [53] J. Zheng, L. Williams, and B. Robinson, “Pallino: Automation to support regression test selection for cots-based applications,†ASE’07 - 2007 ACM/IEEE Int. Conf. Autom. Softw. Eng., pp. 224–233, 2007.

      [54] S. Huang, J. Zhu, and Y. Ni, “ORTS: a tool for optimized regression testing selection,†Proceeding 24th ACM SIGPLAN Conf. companion Object oriented Program. Syst. Lang. Appl., pp. 803–804, 2009.

      [55] W. . Jin, A. . Orso, and T. . Xie, “BERT: A tool for behavioral regression testing,†Proc. ACM SIGSOFT Symp. Found. Softw. Eng., pp. 361–362, 2010.

      [56] S. Raina and A. P. Agarwal, “An Automated Tool for Regression Testing in Web Applications,†SIGSOFT Softw. Eng. Notes, vol. 38, no. 4, pp. 1–4, 2013.

      [57] X. Huang, H. Chen, and J. Qian, “Design and implementation of an automatic tool for software regression test based on STAF,†Proc. 2013 3rd Int. Conf. Comput. Sci. Netw. Technol. ICCSNT 2013, pp. 280–283, 2014.

      [58] G. Meszaros, “Agile regression testing using record & playback,†in Companion of the 18th annual ACM SIGPLAN conference on Object-oriented programming, systems, languages, and applications - OOPSLA ’03, 2003, p. 353.

      [59] J. Ziegler, J. M. Grasso, and L. G. Burgermeister, “An Ada based real-time closed-loop integration and regression test tool,†in Proceedings. Conference on Software Maintenance - 1989, 1989, pp. 81–90.

      [60] G. Fraser, B. K. Aichernig, and F. Wotawa, “Handling Model Changes: Regression Testing and Test-Suite Update with Model-Checkers,†Electron. Notes Theor. Comput. Sci., vol. 190, no. 2 SPEC. ISS., pp. 33–46, 2007.

      [61] Z. Fang and H. Sun, “A Software Regression Testing Strategy Based on Bayesian Network,†in 2010 International Conference on Computational Intelligence and Software Engineering, 2010, pp. 1–4.

      [62] M. Salehie, S. Li, L. Tahvildari, R. Dara, S. Li, and M. Moore, “Prioritizing requirements-based regression test cases: A goal-driven practice,†Proc. Eur. Conf. Softw. Maint. Reengineering, CSMR, pp. 329–332, 2011.

      [63] S. Huang, Z. J. Li, Y. Liu, and J. Zhu, “Regression Testing as a Service,†2011 Annu. SRII Glob. Conf., pp. 315–324, 2011.

      [64] H. Aman, M. Sasaki, K. Kureishi, and H. Ogasawara, “Application of the 0-1 Programming Model for Cost-Effective Regression Test,†in 2013 IEEE 37th Annual Computer Software and Applications Conference, 2013, pp. 720–721.

      [65] R. Lang and M. Spezio, “Mission assurance increased with regression testing,†in 2013 IEEE Aerospace Conference, 2013, pp. 1–8.

      [66] E. Rogstad and L. C. Briand, “Clustering Deviations for Black Box Regression Testing of Database Applications,†IEEE Trans. Reliab., vol. 65, no. 1, pp. 4–18, 2016.

      [67] M. Skoglund and S. Sciences, “A Case Study on Regression Test Suite Maintenance in System,†Softw. Maintenance, 2004., 2004.

      [68] E. Engström, P. Runeson, and A. Ljung, “Improving regression testing transparency and efficiency with history-based prioritization - An industrial case study,†Proc. - 4th IEEE Int. Conf. Softw. Testing, Verif. Validation, ICST 2011, pp. 367–376, 2011.

      [69] E. Juergens, B. Hummel, F. Deissenboeck, M. Feilkas, C. Schlögel, and A. Wübbeke, “Regression test selection of manual system tests in practice,†Proc. Eur. Conf. Softw. Maint. Reengineering, CSMR, pp. 309–312, 2011.

      [70] D. Di Nardo, N. Alshahwan, L. Briand, and Y. Labiche, “Coverage-based regression test case selection, minimization and prioritization: a case study on an industrial system,†Softw. Testing, Verif. Reliab., vol. 25, no. 4, pp. 371–396, Jun. 2015.

      [71] H. K. Leung, “Selective regression testing-assumptions and fault detecting ability,†Inf. Softw. Technol., vol. 37, no. 10, pp. 531–537, 1995.

      [72] D. S. Rosenblum and E. J. Weyuker, “Predicting the cost-effectiveness of regression testing strategies,†Proc. ACM SIGSOFT Symp. Found. Softw. Eng., no. New York, NY, United States, pp. 118–126, 1996.

      [73] S. Elbaum, P. Kallakuri, A. Malishevsky, G. Rothermel, and S. Kanduri, “Understanding the effects of changes on the cost-effectiveness of regression testing techniques,†Softw. Test. Verif. Reliab., vol. 13, no. 2, pp. 65–83, 2003.

      [74] D. Sundmark, A. Pettersson, and H. Thane, “Regression testing of multi-tasking real-time systems,†ACM SIGBED Rev., vol. 2, no. 2, pp. 31–34, Apr. 2005.

      [75] A. J. H. Simons, “A theory of regression testing for behaviourally compatible object types,†Softw. Testing, Verif. Reliab., vol. 16, no. 3, pp. 133–156, Sep. 2006.

      [76] R. Sukkerd, I. Beschastnikh, J. Wuttke, S. Zhang, and Y. Brun, “Understanding regression failures through test-passing and test-failing code changes,†in 2013 35th International Conference on Software Engineering (ICSE), 2013, pp. 1177–1180.

      [77] J. Y. Lee, J. Suh, K. D. Kim, and J. J. Jeong, “Development of a computer program to support an efficient non-regression test of a thermal-hydraulic system code,†Nucl. Eng. Technol., vol. 46, no. 5, pp. 719–724, Oct. 2014.

      [78] A. H. Patil, N. Goveas, and K. Rangarajan, “Re-architecture of Contiki and Cooja Regression Test Suites using Combinatorial Testing Approach,†ACM SIGSOFT Softw. Eng. Notes, vol. 40, no. 2, pp. 1–3, Apr. 2015.

      [79] D. Qiu, B. Li, S. Ji, and H. Leung, “Regression Testing of Web Service: A Systematic Mapping Study,†ACM Comput. Surv., vol. 47, no. 2, pp. 1–46, 2014.

      [80] S. Yoo and M. Harman, “Regression testing minimization, selection and prioritization: a survey,†Softw. Testing, Verif. Reliab., vol. 24, no. 8, p. n/a-n/a, 2010.

      [81] Z. Anwar and A. Ahsan, “Exploration and analysis of regression test suite optimization,†ACM SIGSOFT Softw. Eng. Notes, vol. 39, no. 1, pp. 1–5, Feb. 2014.

      [82] D. Binkley, “The application of program slicing to regression testing,†Inf. Softw. Technol., vol. 40, no. 11–12, pp. 583–594, 1998.

      [83] M. Böhme, A. Roychoudhury, and B. C. d. S. Oliveira, “Regression Testing of Evolving Programs,†in Advances in Computers, vol. 89, Elsevier Inc., 2013, pp. 53–88.

      [84] A. Mahdian, A. A. Andrews, and O. J. Pilskalns, “Regression testing with UML software designs: A survey,†J. Softw. Maint. Evol. Res. Pract., vol. 21, no. 4, pp. 253–286, Jul. 2009.

      [85] E. Engström, “Regression Test Selection and Product Line System Testing,†2010 Third Int. Conf. Softw. Testing, Verif. Valid., pp. 512–515, 2010.

      [86] P. Dhareula and A. Ganpati, “Prevalent criteria’s in regression test case selection techniques: An exploratory study,†in 2015 International Conference on Green Computing and Internet of Things (ICGCIoT), 2015, pp. 871–876.

      [87] G. Rothermel and M. J. Harrold, “Analyzing regression test selection techniques,†IEEE Trans. Softw. Eng., vol. 22, no. 8, pp. 529–551, 1996.

      [88] T. L. Graves, M. J. Harrold, J.-M. Kim, A. Porters, and G. Rothermel, “An empirical study of regression test selection techniques,†in Proceedings of the 20th International Conference on Software Engineering, 1998, vol. 10, no. 2, pp. 188–197.

      [89] G. Rothermel and M. J. Harrold, “Empirical studies of a safe regression test selection technique,†IEEE Trans. Softw. Eng., vol. 24, no. 6, pp. 401–419, 1998.

      [90] J.-M. Kim, A. Porter, and G. Rothermel, “An empirical study of regression test application frequency,†Proc. 22nd Int. Conf. Softw. Eng. - ICSE ’00, vol. 15, no. 4, pp. 257–279, Dec. 2000.

      [91] J. Bible, G. Rothermel, and D. S. Rosenblum, “A comparative study of coarse- and fine-grained safe regression test-selection techniques,†ACM Trans. Softw. Eng. Methodol., vol. 10, no. 2, pp. 149–183, 2001.

      [92] N. Mansour, R. Bahsoon, and G. Baradhi, “Empirical comparison of regression test selection algorithms,†J. Syst. Softw., vol. 57, no. 1, pp. 79–90, Apr. 2001.

      [93] M. J. Harrold, D. Rosenblum, G. Rothermel, and E. Weyuker, “Empirical studies of a prediction model for regression test selection,†IEEE Trans. Softw. Eng., vol. 27, no. 3, pp. 248–263, Mar. 2001.

      [94] N. Mansour and R. Bahsoon, “Reduction-based methods and metrics for selective regression testing,†vol. 44, 2002.

      [95] P. G. Frankl, G. Rothermel, K. Sayre, and F. I. Vokolos, “An empirical comparison of two safe regression test selection techniques,†2003 Int. Symp. Empir. Softw. Eng. 2003 ISESE 2003 Proc., pp. 195–204, 2003.

      [96] M. Skoglund and P. Runeson, “A case study of the class firewall regression test selection technique on a large scale distributed software system,†in 2005 International Symposium on Empirical Software Engineering, 2005., 2005, vol. 0, no. c, pp. 72–81.

      [97] E. Engström, P. Runeson, and G. Wikstrand, “An empirical evaluation of regression testing based on fix-cache recommendations,†ICST 2010 - 3rd Int. Conf. Softw. Testing, Verif. Valid., pp. 75–78, 2010.

      [98] A. Shi, T. Yung, A. Gyori, and D. Marinov, “Comparing and Combining Test-suite Reduction and Regression Test Selection,†Proc. 2015 10th Jt. Meet. Found. Softw. Eng., pp. 237–247, 2015.

      [99] R. Wang, B. Qu, and Y. Lu, “Empirical study of the effects of different profiles on regression test case reduction,†IET Softw., vol. 9, no. 2, pp. 29–38, Apr. 2015.

      [100] Z. Li, M. Harman, and R. M. Hierons, “Search Algorithms for Regression Test Case Prioritization,†IEEE Trans. Softw. Eng., vol. 33, no. 4, pp. 225–237, 2007.

      [101] H. Do, S. Mirarab, L. Tahvildari, and G. Rothermel, “An empirical study of the effect of time constraints on the cost-benefits of regression testing,†in Proceedings of the 16th ACM SIGSOFT International Symposium on Foundations of software engineering - SIGSOFT ’08/FSE-16, 2008, p. 71.

      [102] X. Qu, M. B. Cohen, and G. Rothermel, “Configuration-Aware Regression Testing : An Empirical Study of Sampling and Prioritization,†ISSTA ’08 Proc. 2008 Int. Symp. Softw. Test. Anal., pp. 75–85, 2008.

      [103] S. Li, N. Bian, Z. Chen, D. You, and Y. He, “A Simulation Study on Some Search Algorithms for Regression Test Case Prioritization,†2010 10th Int. Conf. Qual. Softw., pp. 72–81, 2010.

      [104] Y. Lu et al., “How does regression test prioritization perform in real-world software evolution?,†in Proceedings of the 38th International Conference on Software Engineering - ICSE ’16, 2016, pp. 535–546.

      [105] S. Elbaum, A. G. Malishevsky, and G. Rothermel, “Prioritizing test cases for regression testing,†in Proceedings of the International Symposium on Software Testing and Analysis - ISSTA ’00, 2000, vol. 27, no. 10, pp. 102–112.

      [106] M. G. Epitropakis, S. Yoo, M. Harman, and E. K. Burke, “Empirical evaluation of pareto efficient multi-objective regression test case prioritisation,†Proc. 2015 Int. Symp. Softw. Test. Anal. - ISSTA 2015, pp. 234–245, 2015.

      [107] M. Gittens, H. Lutfiyya, M. Bauer, D. Godwin, Y. W. Kim, and P. Gupta, “An empirical evaluation of system and regression testing,†Acta Inform., vol. 1, no. 3, p. 3, 2002.

      [108] A. Orso, T. Apiwattanapong, and M. J. Harrold, “Leveraging field data for impact analysis and regression testing,†in Proceedings of the 9th European software engineering conference held jointly with 10th ACM SIGSOFT international symposium on Foundations of software engineering - ESEC/FSE ’03, 2003, p. 128.

      [109] J. Chen, M. Lin, K. Yu, and B. Shao, “When a GUI regression test failed, what should be blamed?,†Proc. - IEEE 5th Int. Conf. Softw. Testing, Verif. Validation, ICST 2012, pp. 467–470, 2012.

      [110] N. Rachatasumrit and M. Kim, “An empirical investigation into the impact of refactoring on regression testing,†2012 28th IEEE Int. Conf. Softw. Maint., pp. 357–366, 2012.

  • Downloads

  • How to Cite

    Ba-Quttayyan, B., Mohd, H., & Baharom, F. (2018). Regression Testing Systematic Literature Review – A Preliminary Analysis. International Journal of Engineering & Technology, 7(4.19), 418-424. https://doi.org/10.14419/ijet.v7i4.19.23176

    Received date: 2018-12-05

    Accepted date: 2018-12-05

    Published date: 2018-11-27