An Agent Oriented Approach to Operational Profile Management

Authors: Sunitha Ramanujam, Hany El Yamany, Miriam A. M. Capretz

Abstract:

Software reliability, defined as the probability of a software system or application functioning without failure or errors over a defined period of time, has been an important area of research for over three decades. Several research efforts aimed at developing models to improve reliability are currently underway. One of the most popular approaches to software reliability adopted by some of these research efforts involves the use of operational profiles to predict how software applications will be used. Operational profiles are a quantification of usage patterns for a software application. The research presented in this paper investigates an innovative multiagent framework for automatic creation and management of operational profiles for generic distributed systems after their release into the market. The architecture of the proposed Operational Profile MAS (Multi-Agent System) is presented along with detailed descriptions of the various models arrived at following the analysis and design phases of the proposed system. The operational profile in this paper is extended to comprise seven different profiles. Further, the criticality of operations is defined using a new composed metrics in order to organize the testing process as well as to decrease the time and cost involved in this process. A prototype implementation of the proposed MAS is included as proof-of-concept and the framework is considered as a step towards making distributed systems intelligent and self-managing.

Keywords: Software reliability, Software testing, Metrics, Distributed systems, Multi-agent systems

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1061282

References:

[1] J. Musa, Software Reliability Engineering: More Reliable Software Faster and Cheaper, McGraw-Hill. 2004.
[2] I. Sommerville, Software Engineering, Addison-Wesley, 7th Edition, Chapter 24, 2004.
[3] J. Musa, "Operational Profile in Software Reliability Engineering," IEEE Software, Vol. 10, No. 2, Mar. 1993, pp. 14-32.
[4] R. V. Binder, "Automated Testing with an Operational Profile", The Software Tech News, Vol. 8, No. 1. Dec. 2004, pp. 7-10.
[5] J. A. Whittaker and J. Voas, "Toward a more reliable theory of software reliability", IEEE Computer, Vol. 33, No. 12, Dec. 2000, pp. 36-42.
[6] J. Voas, "Will the real operational profile please stand up", IEEE Software, Vol. 17, No. 2, Mar./Apr. 2000, pp. 87-89.
[7] D. M. Woit, "Specifying operational profile for modules". In Proceedings of the ACM International Symposium on Software Testing and Analysis, ACM, 1993.
[8] D. M. Woit, "Operational profile specification, test case generation, and reliability estimation for modules", Technical report, Queen-s University, Kingston, Ontario Canada, 1994
[9] M. Gittens, H. Lutfiyya, and M. Bauer, "An Extended Operational Profile Model", In the proceedings of the Fifteenth International Symposium on Software Reliability Engineering, Nov. 2004.
[10] N. R. Jennings, K. Sycara, M. Wooldridge, "A Roadmap of Agent Research and Development," Journal of Autonomous Agents and Multi- Agent Systems, Vol. 1, No. 1, 1998, pp. 5-38.
[11] J. Lind, "Patterns in agent-oriented software engineering," in Proceedings of AOSE Workshop, 2002, pp. 47-58.
[12] M. Wooldridge, "Agent-based software engineering," IEE Proceedings Software Engineering, Vol. 144, 1997, pp. 26-37.
[13] Mitchell, B.; Zeil, S. J.: A Reliability Model Combining Representative and Directed Testing, Technical Report TR 95-18, Old Dominon University, 1995.
[14] M. Grottke and K.D-Zieger, "Systematic vs. Operational Testing: The Necessity for Different Failure Models," in Proc. of the 5th Conference on Quality Engineering in Software Technology, 2001, pp. 59 - 68.
[15] Critical Software Practices for Performance-Based Management: Available: http://www.spmn.com/16CSP.html (URL).
[16] V. R. Basili, and W. L. Melo, "A Validation of Object Oriented Design Metrics as Quality Indicators", IEEE Transactions on Software Engineering, Vol. 22, No. 10, Oct. 1996, pp. 751-761.
[17] M. Wooldridge, N. R. Jennings and D. Kinny, The Gaia Methodology for Agent-Oriented Analysis and Design in Journal of Autonomous Agents and Multi-Agent Systems, Vol. 3, No.3, 2000, pp. 285-312.