Augmented Reality in Schools: Preliminary Evaluation Results from a Summer School

Authors: Alexandru Balog, Costin Pribeanu, Dragos Iordache

Abstract:

Formative usability evaluation aims at finding usability problems during the development process. The earlier these problems are identified, the less expensive to fix they are. This paper presents some preliminary results from a formative usability testing of the 1st prototype developed for the ARiSE (Augmented Reality in School Environments) project.

Keywords: AR-based educational systems, formative evaluation, usability evaluation, user testing.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1331525

References:

[1] S. Amershi, N. Arksey, G. Carenini, C. Conati, A. Mackworth, H. Maclaren, D. Poole. (2005) "Designing CIspace: Pedagogy and Usability in a Learning Environment for AI". Proceedings of ITCSE 2005. ACM Press, New York. 178 - 182
[2] Ardito, C., M. F. Costabile, A. De Angeli, R. Lanzilotti "Systematic Evaluation of e-learning Systems: An Experimental Validation". Proceedings of NordiCHI 2006, 14-18 October 2006. ACM Press. 195- 202.
[3] Ardito, C., Costabile, M.F., Marsico, M. de, Lanzilotti, R., Levialdi, S., Roselli, T., Rossano, V. "An approach to usability evaluation of elearning applications." Universal Access in the Information Society, 4 (2006): 270-283. Springer
[4] Augmented Reality in School Environments - FP6 027039 http://www.arise-project.org/
[5] Azuma, R. A Survey of Augmented Reality. PRESENCE: Teleoperators and Virtual Environments, Vol. 6, No. 4, pp. 355-385, 1997.
[6] Barajas, M. and Owen, M., Implementing virtual learning environments: looking for holistic approach. Educational Technology and Society, 3, 2000.
[7] Bogen, M., Wind, J. and Giuliano, A.: "ARiSE - Augmented Reality in School Environments." Nejdl, W. & TochTermann, K. (Eds.): Proceedings of EC-TEL 2006. LNCS 4227, Springer 2006. pp. 709-714
[8] Hix, D., Gabbard, J., Swan, E., Livingston, M., Herer, T., Julier, S., Baillot, Y. & Brown, D.: A Cost-Effective Usability Evaluation Progression for Novel Interactive Systems, In Proceedings of the Hawaii International Conference on Systems Sciences, January 5-8, 2004, Big Island, Hawaii.
[9] Kukulska-Hulme, A. & Lesley Shield (2004), The keys to usability in elearning websites, Networked Learning Conference 2004, Lancaster.
[10] Liarokapis, F., Mourkoussis, N., White, M., Darcy, J., Sifniotis, M., Petridis, P., Basu, A. & Lister, P.: Web3D and augmented reality to support engineering education in World Transactions on Engineering and Technology Education Vol.3, No.1, 2004.
[11] Nielsen, J. Usability Engineering. Academic Press. 1993.
[12] Nokelainen, P. ÔÇ×An empirical assesment of pedagogical usability criteia for digital learning material with elementary school students". Educational Technology & Society, 9 (2), 2006. 178-197.
[13] Silius, K. & Tervakari, A-M. "The usefulness of web-based learning environments. The Evaluation Tool into the Portal of Finnish Virtual University." International Conference on Network Universities and elearning. 8-9 May 2003. Valencia. Spain.