Automated User Story Driven Approach for Web-Based Functional Testing

Authors: Mahawish Masud, Muhammad Iqbal, M. U. Khan, Farooque Azam

Abstract:

Manual writing of test cases from functional requirements is a time-consuming task. Such test cases are not only difficult to write but are also challenging to maintain. Test cases can be drawn from the functional requirements that are expressed in natural language. However, manual test case generation is inefficient and subject to errors.  In this paper, we have presented a systematic procedure that could automatically derive test cases from user stories. The user stories are specified in a restricted natural language using a well-defined template.  We have also presented a detailed methodology for writing our test ready user stories. Our tool “Test-o-Matic” automatically generates the test cases by processing the restricted user stories. The generated test cases are executed by using open source Selenium IDE.  We evaluate our approach on a case study, which is an open source web based application. Effectiveness of our approach is evaluated by seeding faults in the open source case study using known mutation operators.  Results show that the test case generation from restricted user stories is a viable approach for automated testing of web applications.

Keywords: Automated testing, natural language, user story modeling, software engineering, software testing, test case specification, transformation and automation, user story, web application testing.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1339932

References:

[1] Offutt, J., Quality attributes of web software applications. IEEE software, 2002. 19(2): p. 25.
[2] Hagel, J. and J.S. Brown, Your next IT strategy. Harvard business review, 2001. 79(9): p. 105-115.
[3] Kreger, H., Web services conceptual architecture (WSCA 1.0). IBM Software Group, 2001. 5: p. 6-7.
[4] Zo, H., D.L. Nazareth, and H.K. Jain. Measuring reliability of applications composed of web services. in System Sciences, 2007. HICSS 2007. 40th Annual Hawaii International Conference on. 2007. IEEE.
[5] Ricca, F. and P. Tonella. Analysis and testing of web applications. in Proceedings of the 23rd international conference on Software engineering. 2001. IEEE Computer Society.
[6] Wang, C., et al. Automatic generation of system test cases from use case specifications. in Proceedings of the 2015 International Symposium on Software Testing and Analysis. 2015. ACM.
[7] Zhang, M., et al. A systematic approach to automatically derive test cases from use cases specified in restricted natural languages. in International Conference on System Analysis and Modeling. 2014. Springer.
[8] Sinha, A., S.M. Sutton Jr, and A. Paradkar. Text2Test: Automated inspection of natural language use cases. in 2010 Third International Conference on Software Testing, Verification and Validation. 2010. IEEE.
[9] Sarmiento, E., J.C.S. do Prado Leite, and E. Almentero. C&L: Generating model based test cases from natural language requirements descriptions. in Requirements Engineering and Testing (RET), 2014 IEEE 1st International Workshop on. 2014. IEEE.
[10] Escalona, M., et al., An overview on test generation from functional requirements. Journal of Systems and Software, 2011. 84(8): p. 1379-1393.
[11] Hametner, R., D. Winkler, and A. Zoitl. Agile testing concepts based on keyword-driven testing for industrial automation systems. in IECON 2012-38th Annual Conference on IEEE Industrial Electronics Society. 2012. IEEE.
[12] Carvalho, G., et al. Test case generation from natural language requirements based on SCR specifications. in Proceedings of the 28th Annual ACM Symposium on Applied Computing. 2013. ACM.
[13] Lucassen, G., et al. Forging high-quality user stories: towards a discipline for agile requirements. in 2015 IEEE 23rd international requirements engineering conference (RE). 2015. IEEE.
[14] North, D., Introducing bdd. Better Software, March, 2006.
[15] North, D., What's in a story. 2007, February.
[16] Saravana. K.M, G.N.B., Rajkumar, Dr. A. Kovalan, “ Case Study On Agile User Stories Prioritization Using Imaginative Standard”. IJERA Vol. 2(no. 5): p. pp. 472-480.
[17] Cucumber, https://cucumber.io/. Retrieved June, 2015.
[18] JBehave, http://jbehave.org/. Retrieved July, 2015.
[19] Testing, C., http://www.jackkinsella.ie/2011/09/26/why-bother-with-cucumber-testing.html. Access Date, March 2016.
[20] Drawbacks, C., https://www.jimmycuadra.com/posts/please-don-t-use-cucumber/. Access Date, March 2016.
[21] Yue, T., L.C. Briand, and Y. Labiche. A use case modeling approach to facilitate the transition towards analysis models: Concepts and empirical evaluation. in International Conference on Model Driven Engineering Languages and Systems. 2009. Springer.
[22] Praphamontripong, U. and J. Offutt. Applying Mutation Testing to Web Applications. in ICST Workshops. 2010.
[23] Framework, P.M.t., A PHP 5.3+ Mutation Testing framework. https://github.com/padraic/mutagenesis, January 2016.