Comparative Usability Study of the Websites of Top Universities in Three Continents: A Case Study of the University of Cape Town, Oxford University, and Harvard University

Authors: Stephen Akuma, Racheal Aluma, Abraham Undu

Abstract:

Academic websites play an important role in promoting education for all. They allow universities to provide users with digital academic services to save time and resources. A university website is not only a cost-effective and timely way to communicate with a variety of stakeholders, such as students, faculty, and visitors, but it is also a vehicle for the university to shape its image. The quality of a website is a major factor that universities consider in cyberspace. Potential students can easily apply to universities where the website provides useful and clear information. This has made the usability of websites an important area in meeting the needs and expectations of website users. In this paper, a comparative usability study of the University of Cape Town, Oxford University, and Harvard University academic websites (http://www.uct.ac.za/, https://www.ox.ac.uk/, and https://www.harvard.edu/) was carried out. The proactive user feedback technique was adopted for the comparative usability assessment of the aforementioned universities. The method was used by the researchers to collect and log records from the participants in real time. The result shows that the average dwell time on the websites of Harvard University, Oxford University, and Cape Town University in seconds for the three tasks are 51.58, 33.28, and 54.82 respectively. The System Usability Scale (SUS) scores for Harvard, Oxford, and the University of Cape Town are 49.81, 69.43, and 54.14 respectively. The result of the Analysis of Variance on the dwell time data shows a significant difference (p = .009) on the three websites. Our findings show that Oxford University has the most suitable website in terms of usability factors and other metrics than the other websites investigated. Practical implications are highlighted, and recommendations for improved website usability are suggested.

Keywords: Usability factors, user feedback, university websites, University of Cape Town, Harvard University, Oxford University.

References:

[1] F. M. Adedeji et al, "A Systematic Review on Usability Evaluation for University Websites," International Journal of Computer Applications Technology and Research, vol. 11, (2), pp. 22-23, 2022.
[2] C. Pinho, M. Franco and L. Mendes, "Web portals as tools to support information management in higher education institutions," A Systematic Literature Review.International Journal of Information Management, pp. 80-92, 2018.
[3] F. B. Deedam, E. Thomas and O. E. Taylor, "Accessibility and Usability Evaluation of State-Owned Universities Website in Nigeria," International Journal of Engineering Trends and Technology, vol. 56, (1), pp. 31-36, 2018.
[4] Stephen Akuma, "Investigating the Effect of Implicit Browsing Behaviour on Students’ Performance in a Task Specific Context," I.J. Information Technology and Computer Science, vol. 5, pp. 11-17, 2014.
[5] S. Iqbal et al, "Maximizing coverage, reducing time: a usability evaluation method for web-based library systems," Sci. Rep., vol. 12, (1), 2022.
[6] G. Loren, International Trends in Higher Education 2016–17. Oxford, UK: University of Oxford, 2017.
[7] A. Saverimoutou, B. Mathieu and S. Vaton, "Web View: A Measurement Platform for Depicting Web Browsing Performance and Delivery," IEEE Commun Mag, vol. 58, (3), pp. 33-39, 2020.
[8] K. Davis and D. Douglas, "Translating usability test data into client-ready findings and recommendations," Proc Hum Factors Ergon Soc, pp. 1764-1768, 2015.
[9] C. Z. Acemyan et al, "Summative Usability Assessments of STAR-Vote: A Cryptographically Secure e2e Voting System That Has Been Empirically Proven to Be Easy to Use," Hum. Factors, vol. 64, (5), pp. 866-889, 2022.
[10] Ergonomics requirements for office work with visual display terminals. Available: https://www.iso.org/standard/16883.html.
[11] ISO 9241-11:2018(en): Ergonomics of human-system interaction — Part 11: Usability: Definitions and concepts. Available: https://www.iso.org/obp/ui/#iso:std:iso:9241:-11:ed-2:v1:en.
[12] F. Veríssimo et al, "A Checklist Proposal to Evaluate the Quality of University Websites," Springer. Ser. Des. Innov., vol. 19, pp. 134-145, 2022.
[13] S. Akuma and R. Iqbal, "Development of relevance feedback system using regression predictive model and tf-idf algorithm (J)," International Journal of Education and Management Engineering, IJEME, vol. 8, (4), pp. 31-49, 2018.
[14] A. Undu and S. Akuma, "Investigating the Usability of a University Website from the Users’ Perspective: An Empirical Study of Benue State University Website," International Journal of Computer and Information Engineering, vol. 12(10), pp. 922-929, 2018.
[15] J. Nielsen, Usability Engineering. Boston: Academic Press, 1993.
[16] K. H. Ramanayaka, X. Chen and B. Shi, "UNSCALE: A Fuzzy-based Multi-criteria Usability Evaluation Framework for Measuring and Evaluating Library Websites," IETE Tech. Rev., vol. 36, (2), pp. 1-20, 2018.
[17] H. Şerefoğlu Henkoğlu, "Web Accessibility Evaluation of University Library Websites in Turkey in Terms of Web Content Accessibility Guidelines," Bilgi Dunyasi, vol. 22, (2), pp. 251-288, 2021.
[18] M. S. Ahmet and A. H. Turan, "Assessing the usability of university websites: An empirical study on Namik Kemal University," Turk.Online J.Educ.Tech, vol. 11, pp. 61-69, 2012.
[19] H. Layla, "Heuristic evaluation of three Jordanian university websites," Inf.Educ.Int.J., vol. 12, pp. 231-251, 2013.
[20] A. Ansar, N. Q. Noorulhassan and A. H. Muhammad, "Evaluating Usability of Academic Websites through Fuzzy Analytical Hierarchical Process," pp. 4, 2021.
[21] B. Fatemeh, "The Effectiveness of Website Design in Higher Education Recruitment", 2016.
[22] A. Arshad and K. Fyiaz, "Heuristic Evaluation to Enhance the Usability: A Proposal," Paper Presented at the Meeting of IMDC 2016, Gujrat, Pakistan, 2016.
[23] A. Marzie and M. Elhindi, "An Empirical Study of University Websites," Issues in Information Systems, vol. 9(2), pp. 460, 2008.
[24] M. Rahman S. and S. Ahmed Z., "Exploring the factors influencing the usability of academic websites: A case study in a university setting," Business Information Review, vol. 30(1), pp. 40-47, 2013.
[25] E. Koulocheri et al, "Usability inspection through heuristic evaluation in E-learning environments: The LAMS case," in VII International Conference on ICT in Education, Challenges, University of Minho, Braga, Portugal, 2011, pp. 617-630.
[26] F. Yani, O. D. Nurhayati and A. P. Widodo, "Heuristic evaluation and analytical network process for analyzing the role of websites in higher education," J. Phys. Conf. Ser., vol. 1943 (1), (1), 2021.
[27] L. Chamba-Eras et al, "Analysis of usability of universities Web portals using the Prometheus tool – SIRIUS," ICEDEG 2017 - 4th International Conference on eDemocracy & eGovernment. DOI: 10.1109/ICEDEG.2017.7962533. Quito, 2017.
[28] K. Sarga and A. Saha, "The effect of user variables on academic websites usability: An empirical study," 2019.
[29] J. Valacich and J. Georgem, Modern System Analysis & Design. 9th Edition Pearson, 2020.
[30] E. Hopkins et al, "Developing a Criteria-Based Evaluation Tool for User Experience Design that Balances Standardization and Creativity," IEEE Syst. Inf. Eng. Des. Symp., SIEDS, 2021.
[31] M. Jabar, U. Usman and A. Awal, "Assessing the usability of University websites from users’ perspective," Australian Journal of Basic and Applied Sciences, vol. 7(10), pp. 98-111, 2013.
[32] B. Fortune D., T. Enefa and E. Onate T., "Accessibility and Usability Evaluation of State-Owned Universities Website in Nigeria," International Journal of Engineering Trends and Technology (IJETT), vol. 56(1), 2018.
[33] E. Caglar and S. Mentes A., "The usability of university websites–a study on European University of Lefke," International Journal of Business Information Systems, vol. 11(1), pp. 22-40.
[34] S. Adepoju A. and I. Shehu S., "Usability Evaluation of Academic Websites Using Automated Tools," 3rd International Conference on User Science and Engineering (i-USEr). UiTM Shah Alam Malaysia., 2014.
[35] S. Mustafa H. and L. Al-Zoua’bi F., "Usability of the Academic Websites of Jordan's Universities an Evaluation Study," Paper Presented at the Meeting of the 9th International Arab Conference for Information Technology (ACIT'2008), Tunisia., 2008.
[36] M. Benaida and A. Namoun, "An Exploratory Study of the Factors Affecting the Perceived Usability of Algerian Educational Websites," Turk. Online J.Educ.Technol, vol. 17, pp. 1-12, 2018.
[37] T. Wahyuningrum, N. Rokhman and A. Musdholifah, "Algorithm comparison performance in assessing the quality of university websites," in In Proceedings of the 4th International Conference on New Media Studies, Hotel Santika Premier, Indonesia, 2017, pp. 19–24.
[38] H. Zainab and M. A. Hania, "Usability Evaluation of Educational Websites: A case Study of University of Basrah Website," Solid State Technol., vol. 63, 2020.
[39] Measuring and Interpreting System Usability Scale (SUS). Available: https://uiuxtrend.com/measuring-system-usability-scale-sus/.
[40] Center for World University Rankings, "World University Rankings 2019-20," 2019.