Usability and Functionality: A Comparison of Key Project Personnel's and Potential Users' Evaluations

Authors: F. Calisir, C. A. Gumussoy, A. E. Bayraktaroglu, E. Saygivar

Abstract:

Meeting users- requirements is one of predictors of project success. There should be a match between the expectations of the users and the perception of key project personnel with respect to usability and functionality. The aim of this study is to make a comparison of key project personnel-s and potential users- (customer representatives) evaluations of the relative importance of usability and functionality factors in a software design project. Analytical Network Process (ANP) was used to analyze the relative importance of the factors. The results show that navigation and interaction are the most significant factors,andsatisfaction and efficiency are the least important factors for both groups. Further, it can be concluded that having similar orders and scores of usability and functionality factors for both groups shows that key project personnel have captured the expectations and requirements of potential users accurately.

Keywords: Functionality, software design, usability.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1334678

References:

[1] M. Lu and W. Yeung, "A framework for effective commercial web application development," Internet Research: Electronic Networking Applications and Policy, vol.8, no. 2, pp. 166-173, 1998.
[2] J.C. Bertot, J.T. Snead, P.T. Jaeger, and C.R. McClure, "Functionality, usability and accessibility," Performance Measurement and Metrics, vol. 7, no. 1, pp. 17-28, 2006.
[3] J. Nielsen, "Usability 101: Introduction to usability," Useit.com Alertbox: Current Issues in Web Usability, August, 2003, available at: www.useit.com/alertbox/20030825.html(accessed on 7 September 2008).
[4] C.S. Porter, J.M. Porter, and S. Chhibber, "Realpeople; capturing the emotions of product users," in Meeting Diversity in Ergonomics, Ed. Pikaar, Koningsveld, and Settels, NJ: Elsevier, 2007, ch. 12, pp. 187- 208.
[5] T.A. Yeung and R. Law, "Extending the modified heuristic usability evaluation technique to chain and independent hotel websites," International Journal of Hospitality Management, vol. 23, pp. 307-313, 2004.
[6] A. Seffah, T. Mohamed, H. Habieb-Mammar, and A. Abran, "Reconciling usability and interactive system architecture using patterns," Journal of Systems and Software, vol. 81, pp. 1845-1852, 2008.
[7] L. Bass and B.E. John, "Linking usability to software architecture patterns through general scenarios," Journal of Systems and Software, vol. 66, pp. 187-197, 2003.
[8] S. Furnell, "Why users can not use security," Computers and Security, vol. 24, pp. 274-279, 2005.
[9] C.D. Kavadias, S. Rupp, S.L. Tombros, and D.D., Vergados, "A P2P technology middleware architecture enabling user-centric services deployment on low-cost embedded networked devices," Computer Communications, vol. 30, pp. 527-537, 2007.
[10] D.J.M. Saarloos, T.A. Arentze, A.W.J. Borgers, and H.J.P. Timmermans, "A multi-agent paradigm as structuring principle for planning support systems," Computers, Environment and Urban Systems, vol. 32, pp. 29-40, 2008.
[11] R.B. Klein and A. Seffah, "Evaluation of integrated software development environments: Challenges and results from three empirical studies," International Journal of Human-Computer Studies, vol. 63, pp. 607-627, 2005.
[12] S. Petter, "Managing user expectations on software projects: lessons from the trenches," International Journal of Project Management, vol. 26, pp. 700-712, 2008.
[13] J.D. Procaccino and J.M. Verner, "Software project managers and project success: An exploratory study," Journal of Systems and Software, vol. 79, pp. 1541-1551, 2006.
[14] D. White and J. Fortune, "Current practice in project management - an empirical study," International Journal of Project Management, vol. 20, pp. 1-11, 2002.
[15] R. Schmidt, K. Lyytinen, M. Keil, and P. Cule, "Identifying software project risks: An international Delphi study," Journal of Management Information Systems, vol. 17, no. 4, pp. 5-36, 2001.
[16] J.W. Palmer, "Web site usability, design, and performance metrics," Information Systems Research, vol. 13, no. 2, pp. 151-167, 2002.
[17] M.C. Roy, O. Dewit, and B.A. Aubert, "The impact of interface usability on trust in web retailers," Internet Research: Electronic Networking Applications and Policy, vol. 11, no. 5, pp. 388-398, 2001.
[18] G. Chakraborty, P. Srivastava, and D.L. Warren, "Understanding B2B corporate web sites- effectiveness from North American and European perspective," Industrial Marketing Management, vol. 34, pp. 420-429, 2005.
[19] C. Calero, J. Ruiz, and M. Piattini, "Classifying web metrics using the web quality model," Online Information Review, vol. 29, no. 3, pp. 227- 248, 2005.
[20] J. Nielsen, "End of web design," Useit.com Alertbox: Current Issues in Web Usability, July, 2000. available at: www.useit.com/alertbox/20000723.html (accessed on 7 September 2008).
[21] J.M. Pearson, A. Pearson, and D. Green, "Determining the importance of key criteria in web usability," Management Research News, vol. 30, no. 11, pp. 816-828, 2007.
[22] E.F. Reilly, T.J. Leibrandt, A.J. Zonno, M.J. Simpson, and J.B. Morris, "General surgery residency program websites: usefulness and usability for resident applicants," Current Surgery, vol. 61, no. 2, pp. 236-240, 2003.
[23] S.M. Ferreira and D.N. Pithan, "Usability of digital libraries," OCLC Systems and Services, vol. 21, no. 4, pp. 311-323, 2005.
[24] A. Stefani, B. Vassiliadis, and M. Xenos, "On the quality assessment of advanced e-learning services," Interactive Technology and Smart Education, vol. 3, pp. 237-250, 2006.
[25] K. Kapoor and O.P. Goyal, "Web-based OPACs in Indian academic libraries: a functional comparison," Program: Electronic Library and Information Systems, vol. 41, no. 3, pp. 291-309, 2007.
[26] K. Waite and T. Harrison, "Internet archaeology: uncovering pension sector web site evolution," Internet Research, vol. 17, no. 2, pp. 180- 195, 2007.
[27] T. Liang, H. Lai, and Y. Ku, "Personalized content recommendation and user satisfaction: theoretical synthesis and empirical findings," Journal of Management Information Systems, vol. 23, no. 3, pp. 45-70, 2007.
[28] T.L. Saaty, Decision-making with dependence and feedback: The Analytic Network Process. Pittsburg, NJ: RWS Publishing, 1996.
[29] T.L. Saaty, Multicriteria decision-making: The analytic hierarchy process. Pittsburg, NJ: RWS Publishing, 1980.
[30] R.W. Saaty, Decision making in complex environments. Pittsburgh: Creative Decisions Foundation, 2003.
[31] A.A. Salo and R.P. Hamalainen, "On the measurement of preferences in the analytic hierarchy process," Journal of Multi-Criteria Decision Analysis, vol. 6, pp. 309-319, 1997.
[32] S. Jharkharia and R. Shankar, "Selection of logistics service provider: An analytic network process (ANP) approach," Omega, vol. 35, pp. 274 - 289, 2007.
[33] H. Shyur and H. Shih, "A hybrid MCDM model for strategic vendor selection," Mathematical and Computer Modeling, vol. 44, pp. 749-761, 2006.
[34] F. Calisir, A.E. Bayraktaroglu, C.A. Gumussoy, Y.I. Topcu, and T. Mutlu, "The relative importance of usability and functionality factors for online auction and shopping web sites," Online Information Review, vol. 34(3), pp.420-439, 2010.