An Empirical Analysis of the Influence of Application Experience on Working Methods of Process Modelers

Authors: A. Nielen, S. Mütze-Niewöhner, C. M. Schlick

Abstract:

In view of growing competition in the service sector, services are as much in need of modeling, analysis and improvement as business or working processes. Graphical process models are important means to capture process-related know-how for an effective management of the service process. In this contribution, a human performance analysis of process model development paying special attention to model development time and the working method was conducted. It was found that modelers with higher application experience need significantly less time for mental activities than modelers with lower application experience, spend more time on labeling graphical elements, and achieved higher process model quality in terms of activity label quality.

Keywords: Model quality, predetermined motion time system, process modeling, working method.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1083285

References:

[1] M. Weske, Business Process Management. Berlin: Springer, 2007.
[2] C. Houy, P. Fettke, P. Loos, "Empirical research in business process management - analysis of an emerging field of research", Business Process Management Journal, vol. 16, no. 4, pp. 619-661, 2010.
[3] J. Becker, D. Kahn, "Der Prozess im Fokus," in Prozessmanagement, J. Becker, M. Kugeler, M. Rosemann, Eds. Berlin: Springer, 2008.
[4] H. A. Reijers, J. Recker, S. G. van de Wouw, "An Integrative Framework of the Factors Affecting Process Model Understanding: A Learning Perspective," in Proc. 16th Americas Conference on Information Systems, Lima, 2010, pp. 1-10.
[5] J. Mendling, J. Recker, "Extending the Discussion of Model Quality: Why Clarity and Completeness may not be enough," in CAiSE 2007 Workshop Proc. Vol. 1 - 11th international Workshop on Exploring Modeling Methods in Systems Analysis and Design (EMMSAD), Trondheim, 2007, pp. 109-121.
[6] K. Y. Wong, "Critical success factors for implementing knowledge management in small and medium enterprises," Industrial Management & Data Systems, vol. 105, pp. 261-279, 2005.
[7] M. Indulska, P. Green, J. Recker, M. Rosemann, " Business Process Modeling: Perceived Benefits," in Conceptual Modeling - ER 2009, S. Castano, U. Dayal, A. H. F. Laender, Eds. Gramado: Springer, 2009, pp. 458-471.
[8] W. M. P. van der Aalst, A. H. M. ter Hofstede, M. Weske, ÔÇ×Business Process Management: A Survey," in Proc. Intl. Conf. on Business process Management (BPM), Eindhoven, 2003.
[9] T. H. Davenport, J. E. Short, "The New Industrial Engineering Information Technology and Business Process Redesign," Sloan Management Review, vol. 31, no. 4, pp. 11-27, 1990.
[10] N. P. Dalal, M. Kamath. W. J. Kolarik, E. Sivaramann, "Toward an Integrated Framework for Modeling Enterprise Processes," Communications of the ACM, vol. 47, no.3, pp. 83-87, March 2004.
[11] D. L. Moody, G. Sindre, T. Brasethvik, A. Solvberg, "Evaluating the Quality of Process Models: Empirical Testing of a Quality Framework," in ER 2002, LNCS 2503, S. Spaccapietra, S. T. March, Y. Kambayashi, Eds. Berlin: Springer, 2002, pp. 380-396.
[12] D. L. Moody, "Theoretical and practical issues in evaluating the quality of conceptual models: current state and future directions," Data & Knowledge Engineering, vol. 55, pp. 243-276, 2005.
[13] A. Maes, G. Poels, "Evaluating quality of conceptual modeling scripts based on user perceptions," Data Knowledge & Engineering, vol. 63, pp. 701-724, 2007.
[14] J. R. Evans, W. M. Lindsay, Managing for Quality and Performance Excellence. Mason, OH: Thomson South-Western, 2007.
[15] R. Schmitt, T. Pfeifer, Qualitätsmanagement: Strategien, Methoden, Techniken. München: Carl-Hanser Verlag, 2010.
[16] R. Schuette, T. Rotthowe, ÔÇ×The Guidelines of Modeling - an approach to enhance the quality in information models," in ER 1998, LNCS 1507, T. W. Ling, S. Ram, M. L. Lee, Eds. Berlin: Springer, 1998, pp. 240- 254.
[17] O. I. Lindland, G. Sindre, A. Solvberg, ÔÇ×Understanding Quality in Conceptual Modeling," IEEE Software, pp. 42-49, March 1994.
[18] J. Mendling, H. A. Reijers, W. M. P., ÔÇ×Seven Process Modeling Guidelines (7PMG)", Information and Software Technology (IST), vol. 52, pp. 127-136, 2010.
[19] J. Mendling, J. Recker, H. A. Reijers, ÔÇ×Process modeling quality: a framework and research agenda," BPM center reports, pp. 18-36, 2009.
[20] D. Z├ñhringer, P. Schneider, ÔÇ×Analyse der Modellierungsfunktion" in Business Process Management Tools 2011, D. Spath, A. Weisbecker, D. Kopperger, R. N├ñgele, Eds. Stuttgart: Fraunhofer IAO, 2011, pp. 37-60.
[21] P. Fettke, ÔÇ×How Conceptual Modeling Is Used," Communications oft he Association for Information Systems, vol. 25, pp. 571-592, Dec. 2009.
[22] S. West, R. A. Brown, J. Recker, ÔÇ×Collaborative business process modeling using 3D virtual environments," in 16th Americas Conference in Information Systems: Sustainable IT Collaboration around the Globe, Lima, 2010.
[23] M. Weidlich, A. Barros, J. Mendling, M. Weske, ÔÇ×Vertical Alignment of Process Models- How Can We Get There?," in EMMSAD 2009, LNBIP 29, T. Haipin et al., Eds. Berlin: Springer, 2009, pp.71-84.
[24] M. Rosemann, ÔÇ×Potential pitfalls of process modeling: part A," Business Process Management, vol. 12. no. 2, pp.249-254, 2006.
[25] J. Recker, A. Dreiling, ÔÇ× Does It Matter Which Process Modelling Language We Teach or Use? An Experimental Study on Understanding Process Modelling Languages without Formal Education," in 18th Australasian Conference on Information Systems, Toowoomba, 2007.
[26] S. Smirnow, M. Weidlich, J. Mendling, M. Weske, ÔÇ×Action Patterns in Business Process Models," in ICSOS-ServiceWave 2009, LNCS 5900, L. Baresi, C. H. Chi, J. Suzuki, Eds. Berlin: Springer, 2009, pp.115-129.
[27] R. Laue, A. Gadatsch, ÔÇ×Measuring the Understandability of Business Process Models - Are We Asking the Right Questions?," in 6th International Workshop on Business Process Design (BPD), Hoboken, 2011.
[28] J. Mendling, H. A. Reijers, J. Cardoso, ÔÇ×What Makes Process Models Understandable?," in BPM 2007, LNCS 4714, G. Alonso, P. Dadam, M. Rosemann, Eds. Berlin: Springer, 2007, pp. 48-63.
[29] H. A. Reijers, J. Mendling, ÔÇ×Modularity in Process Models," in BPM 2008, LNCS 5240, M. Dumas, M. Reichert, M. C. Shan, Eds. Berlin: Springer, 2008, pp. 20-35.
[30] I. Vanderfeesten, J. Cardoso, J. Mendling, H. A. Reijers, W. van der Allst, ÔÇ×Quality Metrics for Business Process Models," in 2007 BPM and workflow handbook, L. Fisher, Ed., Lighthouse-Point, 2008.
[31] H. A. Reijers, J. Mendling, ÔÇ×A Study Into the Factors That Influence the Understandability of Business Process Models," IEEE Transactions on Systems, Man, And Cibernetics - Part A: Systems and Humans, vol. 41, no. 3, pp. 449-462, May 2011.
[32] J. Erickson, K. Siau, ÔÇ×Theoretical and Practical Complexity of Modeling Methods," Communications of the ACM, vol. 50, no. 8, pp. 46-51, 2007.
[33] J. Recker, M. zur Muehlen, K. Siau, J. Erickson, M. Indulska, ÔÇ×Measrung method complexity: UML versus BPMN," in 15th Americas Conference in Information Systems, San Francisco, 2009.
[34] M. La Rosa, A. H. M. ter Hofstede, P. Wohed, H. A. Reijers, J. Mendling, W. M. P. van der Aalst, ÔÇ×Managing process model complexity via concrete syntax modifications," IEEE Transactions on Industrial Informatics, vol. 7, no. 2, pp. 1-11, 2011.
[35] D. Birkmeier, S. Klöckner, S. Overhage, ÔÇ×An Empirical Comparison of the Usability of BPMN and UML Activity Diagrams for Business Users," in 18th European Conference on Information Systems, 2010.
[36] J. Recker, M. Rosemann, ÔÇ×Teaching Business Process Modelling: Experiences and Recommendations," Communications of the Association for Information Systems, vol. 25, pp. 379-394, Oct. 2009.
[37] M. zur Muehlen, J. Recker, ÔÇ×How Much Language Is Enough? Theoretical and Practical Use of the Business Process Modeling Notation," in CAiSE 2008, LNCS 5074, Z. Bellahsene, M. Leonard, Eds. Berlin: Springer, 2008, pp. 465-479.
[38] J. Recker, ÔÇ×Opportunities and constraints: the current struggle with BPMN," Business Process Management Journal, vol. 16, no. 1, pp.181- 201, 2010.
[39] Deutsche MTM Vereinigung e. V., MTM - Grundverfahren Lehrgangsunterlage Teil 1. Hamburg, 2003.
[40] J. H. Quick, J. H. Duncan, J. A. Malcolm, Work-Factor Time Standards. New York: The maple press company, 1962.
[41] K. B. Zandin, MOST Work Measurement Systems, 3 ed., New York: Marcel Dekker.
[42] R. Papenfuß, K. -D. Theis, ÔÇ×Die WORK-FACTOR-Verfahren" Angewandte Arbeitswissenschaft, pp. 3-18, 1988.
[43] C. Schlick, R- Bruder, H. Luczak, Arbeitswissenschaft. Berlin: Springer, 2010.
[44] J. H. Quick, J. H. Duncan, J. A. Malcolm, Jr., Das Work-Factor-Buch. M├╝nchen: Carl-Hanser Verlag, 1965.
[45] H. Luczak, ÔÇ×Task Analysis," in Handbook of Human Factors and Ergonomics - 2nd Edition, G. Salvendy, Ed. New York: Wiley- Interscience, 1997, pp. 340-416.
[46] C. Wohlin, P. Runeson, M. Höst, M. C. Ohlsson, B. Regnell, A. Wesslen, ÔÇ×Experimentation in Software Engineering - An Introduction," in The Kluwer International Series in Software Engineering, V. R. Basili, Ed. Boston: Kluwer Academic Publishers, 2000.
[47] A. Nielen, D. Költer, S. M├╝tze-Niewöhner, J. Karla, C. M. Schlick, ÔÇ×An Empirical Analysis of Human Performance and Error in Process Model Development," in ER 2011 Proc. of the 30th International Conference on Conceptual Modeling, Brussels, 2011A, pp. 514-523.
[48] T. D. Cook, D. T. Campbell, Quasi-Experimentation - Design and Analysis Issues for Field Settings.Boston: Houghton Mifflin Harcourt, 1979.
[49] A. Nielen, S. M├╝tze-Niewöhner, C.M. Schlick, ÔÇ×Identification and Classification of Humand Error in Process Model Development," in Industrial Engineering and Engineering Management (IEEM), Singapore, 2011B.
[50] H. Luczak, Arbeitswissenschaft. Berlin: Springer, 1998.
[51] L. Schmidt, H. Luczak, ÔÇ×Model-based Design of Mobile Work Systems," in Mobile Virtual Work - A New Paradigm?, J. H. E. Andriessen, M. Vartiainen, Eds. Berlin: Springer, 2003, pp. 154-176.