A Systematic Method for Performance Analysis of SOA Applications

Authors: Marzieh Asgarnezhad, Ramin Nasiri, Abdollah Shahidi

Abstract:

The successful implementation of Service-Oriented Architecture (SOA) is not confined to Information Technology systems and required changes of the whole enterprise. In order to adapt IT and business, the enterprise requires adequate and measurable methods. The adoption of SOA creates new problem with regard to measuring and analysis the performance. In fact the enterprise should investigate to what extent the development of services will increase the value of business. It is required for every business to measure the extent of SOA adaptation with the goals of enterprise. Moreover, precise performance metrics and their combination with the advanced evaluation methodologies as a solution should be defined. The aim of this paper is to present a systematic methodology for designing a measurement system at the technical and business levels, so that: (1) it will determine measurement metrics precisely (2) the results will be analysed by mapping identified metrics to the measurement tools.

Keywords: Service-oriented architecture, metrics, performance, evaluation.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1071146

References:

[1] Erl, T., Service-Oriented Architecture: Concepts, Technology, and Design, Prentice Hall, 2005.
[2] Newcomer, E. and Lomow, G., Understanding SOA with Web Services, Addison Wesley Professional, 2004.
[3] Hubbard, D. W., How to Measure Anything Finding the Value of "Intangibles" in Business, Wiley, 2007.
[4] Jain, R., the art of computer systems performance analysis: Techniques, for Experimental Design, measurement, Simulation, and Modeling, Wiley, 1984.
[5] Her, J. S., Choi, S. W., Oh, S. H., and Kim, S. D., A Framework for Measuring Performance in Service-Oriented Architecture, Proceedings of the NWeSP 2007, pp. 55-60, 2007.
[6] Song, M. and van der Aalst, W. M. P., Towards Comprehensive Support for Organizational Mining, Decision Support Systems, v.46 n.1,pp.300- 317, 2008.
[7] DiMare, J., Service oriented architecture: A practical guide to measuring return on investment, http://www.935.ibm.com/services/de/bcs/pdf/2007/soa_practical_guide.pdf, 2006.
[8] Barnes, M., Applied SOA: Measuring Business Value, http://www.gartner.com/teleconferences/attributes/attr_150040_115.pdf, 2006.
[9] Johnson, P., et al., Extended Influence Diagrams for Enterprise Architecture Analysis, in the Proceedings of the EDOC 2006, pp.3-12, 2006.
[10] Vasconcelos, A., et al.: An information system architectural framework for enterprise application integration, in the Proceedings of the HICSS 2004, pp. 225-233, 2004.
[11] Khaddaj, S., Horgan, G., The Evaluation of Software Quality Factors in Very Large Information Systems, Electronic Journal of Information Systems Evaluation, pp. 43-48, 2004.
[12] Aier, S., Ahrens, M., Stutz, M., Bub, U., Deriving SOA Evaluation Metrics in an Enterprise Architecture Context, in the Proceedings of the ICSOC 2007, pp. 224 - 233, 2009.
[13] Smith, J., 10 Measures for Successful SOA Implementations, http://soa.sys-con.com/node/631831, 2008.
[14] McKendrick, J., Justifying SOA: 12 key metrics to keep tabs on, http://blogs.zdnet.com/service-oriented/?p=1950, 2009.
[15] http://www.processmining.org/
[16] A.K. Alves de Medeiros and C.W. Gunther, Process Mining: Using CPN Tools to Create Test Logs for Mining Algorithms, www.daimi.au.dk/CPnets/workshop05/cpn/.../AnaKarlaAlvesdeMedeiro s.pdf, 2005.
[17] Medeiros, A. K. Alves de, and Weijters, A. J. M. M., ProM Framework Tutorial, http://prom.win.tue.nl/research/wiki/_media/tutorial/promtutorialv2.pdf? id=tutorials&cache=cache, 2008.
[18] G├╝nther, C. W., van der Aalst, W. M. P., A Generic Import Framework For Process Event Logs, Proceedings of the Business Process Management Workshops Workshop on Business Process Intelligence (BPI 2006), volume 4103, pp. 81-92, Springer LNCS, 2006.
[19] Van der Aalst, W. M. P., Stein, S., Zoeller, S. and et. al, Semantics Utilized for Process management within and between Enterprises, www.ip-super.org/res/Deliverables/M12/D2.2.pdf, 2007.
[20] Kannan, V., van der Aalst, W.M.P. and Voorhoeve, M., Formal Modeling and Analysis by Simulation of Data Paths in Digital Document Printers, http://is.tm.tue.nl/staff/wvdaalst/publications/p538.pdf, 2008.