Performance Analysis of Proprietary and Non-Proprietary Tools for Regression Testing Using Genetic Algorithm

Authors: K. Hema Shankari, R. Thirumalaiselvi, N. V. Balasubramanian

Abstract:

The present paper addresses to the research in the area of regression testing with emphasis on automated tools as well as prioritization of test cases. The uniqueness of regression testing and its cyclic nature is pointed out. The difference in approach between industry, with business model as basis, and academia, with focus on data mining, is highlighted. Test Metrics are discussed as a prelude to our formula for prioritization; a case study is further discussed to illustrate this methodology. An industrial case study is also described in the paper, where the number of test cases is so large that they have to be grouped as Test Suites. In such situations, a genetic algorithm proposed by us can be used to reconfigure these Test Suites in each cycle of regression testing. The comparison is made between a proprietary tool and an open source tool using the above-mentioned metrics. Our approach is clarified through several tables.

Keywords: APFD metric, genetic algorithm, regression testing, RFT tool, test case prioritization, selenium tool.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1130503

References:

[1] K Hema Shankari, R. Thirumalai Selvi, and N. V. Balasubramanian, "Industry Based Regression Testing Using IIGRTCP Algorithm and RFT Tool," Lecture Notes in Engineering and Computer Science: Proceedings of The International Multi Conference of Engineers and Computer Scientists 2016, 16-18 March, 2016, Hong Kong, pp473-478.
[2] G. Rothermel, R. Untch, C. Chu and M. Harrold, “Test case prioritization: An empirical study,” In Software Maintenance, 1999. (ICSM’ 99) proceedings. IEEE International conference, on pages 179-188 IEEE, 1999.
[3] A. Pravin and Dr. S. Srinivasan, “An Efficient Algorithm for Reducing the Test Cases which is Used for Performing Regression Testing,” 2nd International Conference on Computational Techniques and Artificial Intelligence (ICCTAI'2013) March 17-18, 2013.
[4] S. Elbaum, A. Malishevsky, and G. Rothermel, “Prioritizing test cases for regression testing,” Proc. The 2000 ACM SIGSOFT International Symposium on Software Testing and Analysis, Portland, Oregon, U.S.A., August 2000, 102–112.
[5] W. Wong, J. Horgan, S. London and H. Agrawal, “A study of effective regression testing in practice,” In Proc. of the Eighth Intl. Symp. On Softw Rel. Engr., pages 230–238, Nov. 1997.
[6] R. Beena, Dr. S. Sarala, “Code Coverage Based Test Case Selection And Prioritization,” International Journal of Software Engineering & Applications (IJSEA), Vol. 4, No.6, November 2013.
[7] R. Kavitha, N. Sureshkumar, “Test Case Prioritization for Regression Testing based on Severity of Fault,” College of Engineering and Technology Madurai, Tamilnadu, India (IJCSE) International Journal on Computer Science and Engineering 2010.
[8] Samaila Musa, Abu Bakar Md Sultan, Abdul Azim Bin Abd Ghani, Salmi Baharom, “A Regression Test Case Selection and Prioritization for Object-Oriented Programs using Dependency Graph and Genetic Algorithm” Research Inventry: International Journal of Engineering And Science Vol.4, Issue 7 (July 2014), PP 54-64 Issn (e):2278-4721, Issn (p):2319-6483.
[9] Sujatha, Mohit Kumar and Varun Kumar, (2010) "Requirements based Test Case Prioritization using Genetic Algorithm", International Journal of Computer Science and Technology, Vol.1, No, 2, pp.189-191.
[10] Q.-u.-a. Farooq, M. Z. Z. Iqbal, Z. I. Malik, and A. Nadeem. An approach for selective state machine based regression testing. In Proceedings of the 3rd International Workshop on Advances in Model-based Testing (A-MOST 2007), pages. 44–52, New York, NY, USA, 2007.ACM.
[11] G. Rothermel, R. Untch, C. Chu, and M. J. Harrold. “Test case prioritization: an empirical study” Testing European Journal of Scientific Research, ISSN 1450-216X Vol.55 No.2 (2011), pp.261-274.
[12] S. Elbaum, A. G. Malishevsky and G. Rothermel, (2001), “Incorporating varying test costs and fault severities into test case Prioritization”, 23rd International Conference.