An Overview of Evaluations Using Augmented Reality for Assembly Training Tasks

Authors: S. Werrlich, E. Eichstetter, K. Nitsche, G. Notni

Abstract:

Augmented Reality (AR) is a strong growing research topic in different training domains such as medicine, sports, military, education and industrial use cases like assembly and maintenance tasks. AR claims to improve the efficiency and skill-transfer of training tasks. This paper gives a comprehensive overview of evaluations using AR for assembly and maintenance training tasks published between 1992 and 2017. We search in a structured way in four different online databases and get 862 results. We select 17 relevant articles focusing on evaluating AR-based training applications for assembly and maintenance tasks. This paper also indicates design guidelines which are necessary for creating a successful application for an AR-based training. We also present five scientific limitations in the field of AR-based training for assembly tasks. Finally, we show our approach to solve current research problems using Design Science Research (DSR).

Keywords: Assembly, augmented reality, survey, training.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1132315

References:

[1] Dünser, Andreas; Grasset, Raphaël; Billinghurst, Mark (2008): A survey of evaluation techniques used in augmented reality studies. In: Human Interface Technology Laboratory New Zealand, S. 1–27. DOI: 10.1145/1508044.1508049.
[2] Wang, X.; Ong, S. K.; Nee, A. Y. C. (2016): A comprehensive survey of augmented reality assembly research. In: Advances in Manufacturing, S. 1–22. DOI: 10.1007/s40436-015-0131-4.
[3] Rolland, J.; Meyer, C.; Davis, L.; Hamza-Lup, F.; Norfleet, J.; Imielinska, C.; Kerner, K. F. (2002): Merging augmented reality and anatomically correct 3D models in the development of a training tool for endotracheal intubation. In: Biomedical Imaging, 2002. Proceedings. 2002 IEEE International Symposium on, S. 895–898. DOI: 10.1109/ISBI.2002.1029405.
[4] Daiber, Florian; Kosmalla, Felix; Krüger, Antonio (2013): BouldAR – Using AugmentedReality to Support CollaborativeBoulder Training. In: CHI 2013: Changing Perspectives, Paris, France, S. 949–954. DOI: 10.1145/2468356.2468526.
[5] Stevens, Jon (2014): Augmented Reality Technology in U.S. Army Training (WIP).
[6] Langley, A.; Lawson, G.; Hermawati, S.; D'Cruz, M.; Apold, J.; Arlt, F.; Mura, K. (2016): Establishing the Usability of a Virtual Training System for Assembly Operations within the Automotive Industry. In: Human Factors and Ergonomics in Manufacturing & Service Industries, S. 667–679. DOI: 10.1002/hfm.20406.
[7] Gorecky, Dominic; Worgan, Simon F.; Meixner, Gerrit (2011): COGNITO - A Cognitive Assistance and TrainingSystem for Manual Tasks in Industry. In: Proceedings of ECCE 2011 Conference, S. 53–56. DOI: 10.1145/2074712.2074723.
[8] Webel, Sabine; Bockholt, Uli; Engelke, Timo; Gavish, Nirit; Olbrich, Manuel; Preusche, Carsten (2013): An augmented reality training platform for assembly and maintenance skills. In: Robotics and Autonomous Systems, S. 398–403. DOI: 10.1016/j.robot.2012.09.013.
[9] Loch, Frieder; Quint, Fabian; Brishtel, Iuliia (2016): Comparing Video and Augmented Reality Assistance in Manual Assembly. In: 2016 12th International Conference, S. 147–150. DOI: 10.1109/IE.2016.31.
[10] Rios, Horacio; González, Eduardo; Rodriguez, Ciro; Siller, Hector R.; Contero, Manuel (2013): A Mobile Solution to Enhance Training and Execution of Troubleshooting Techniques of the Engine Air Bleed System on Boeing 737. In: Procedia Computer Science, S. 161–170. DOI: 10.1016/j.procs.2013.11.020.
[11] Hou, Lei; Wang, Xiangyu (2013): A study on the benefits of augmented reality in retaining working memory in assembly tasks: A focus on differences in gender. In: Automation in Construction, S. 38–45. DOI: 10.1016/j.autcon.2012.12.007.
[12] Hořejší, Petr (2015): Augmented Reality System for Virtual Training of Parts Assembly. In: Procedia Engineering, S. 699–706. DOI: 10.1016/j.proeng.2015.01.422.
[13] Boud, A. C.; Haniff, D. J.; Baber, C.; Steiner, S. J. (1999): Virtual reality and augmented reality as a training tool for assembly tasks. In: Information Visualization, 1999. Proceedings. 1999 IEEE International Conference on, S. 32–36. DOI: 10.1109/IV.1999.781532.
[14] Valimont, R. B.; Vincenzi, D. A.; Gangadharan, S. N.; Majoros, A. E. (2002): The effectiveness of augmented reality as a facilitator of information acquisition. In: Digital Avionics Systems Conference, 2002. Proceedings. The 21st, S. 7C5-1-7C5-9. DOI: 10.1109/DASC.2002.1052926.
[15] Pathomaree, Nattapol; Charoenseang, Siam (2005): Augmented reality for skill transfer in assembly task. In: Robot and Human Interactive Communication, 2005. ROMAN 2005. IEEE International Workshop on, S. 500–504. DOI: 10.1109/ROMAN.2005.1513829.
[16] Macchiarella, N. D.; Vincenzi, D. A. (2004): Augmented reality in a learning paradigm for flight aerospace maintenance training. In: Digital Avionics Systems Conference, 2004. DASC 04. The 23rd, S. 5.D.1-5.1-9. DOI: 10.1109/DASC.2004.1391342.
[17] Gavish, Nirit; Gutiérrez, Teresa; Webel, Sabine; Rodríguez, Jorge; Peveri, Matteo; Bockholt, Uli; Tecchia, Franco (2013): Evaluating virtual reality and augmented reality training for industrial maintenance and assembly tasks. In: Interactive Learning Environments, S. 778–798. DOI: 10.1080/10494820.2013.815221.
[18] Gonzalez-Franco, Mar; Pizarro, Rodrigo; Cermeron, Julio; Li, Katie; Thorn, Jacob; Hutabarat, Windo; Tiwari, Ashutosh; Bermell-Garcia, Pablo (2017): Immersive Mixed Reality for Manufacturing Training. In: Frontiers in Robotics and AI, S. 1. DOI: 10.3389/frobt.2017.00003.
[19] Hou, Lei; Wang, Xiangyu; Bernold, Leonhard; Love, Peter E. D. (2013): Using Animated Augmented Reality to Cognitively Guide Assembly. In: Journal of Computing in Civil Engineering, S. 439–451. DOI: 10.1061/(ASCE)CP.1943-5487.0000184.
[20] Suárez-Warden, Fernando; Mendívil, Eduardo González; Rodríguez, Ciro A.; Garcia-Lumbreras, Salvador (2015): Assembly Operations Aided by Augmented Reality: An Endeavour toward a Comparative Analysis. In: Procedia Computer Science, S. 281–290. DOI: 10.1016/j.procs.2015.12.249.
[21] Peniche, A; Treffetz, H; Diaz, C et al (2012): Combining virtual and augmented reality to improve the mechanical assembly training process in manufacturing. In: Proceedings of the 2012 American conference on applied mathematics, S. 292–297.
[22] Rios, Horacio; Hincapié, Mauricio; Caponio, Andrea; Mercado, Emilio; González Mendívil, Eduardo (2004): Augmented Reality: An Advantageous Option for Complex Training and Maintenance Operations in Aeronautic Related Processes. In: Hutchison, Kanade et al. (Hg.) 2011 – Virtual and Mixed Reality, S. 87–96. DOI: 10.1007/978-3-642-22021-0_11.
[23] Westerfield, Giles; Mitrovic, Antonija; Billinghurst, Mark (2015): Intelligent Augmented Reality Training for Motherboard Assembly. In: International Journal of Artificial Intelligence in Education, S. 157–172. DOI: 10.1007/s40593-014-0032-x.
[24] Vincenzi, Dennis A.; Valimont, Brian; Macchiarella, Nickolas; Opalenik, Christopher; Gangadharan, Sathya N. (2003): The Effectiveness of Cognitive Elaboration Using Augmented Reality as a Training and Learning Paradigm. In: Proceedings of the Human Factors and Ergonomics Society 47th Annual Meeting, S. 2054–2058.
[25] Haritos, T.; Macchiarella, N. D. (2005): A Mobile Application of Augmented Reality for Aerospace Maintenance Training. In: 24th Digital Avionics Systems Conference 30-03 Oct. 2005, S. 5.B.3-1-5.B.3-9. DOI: 10.1109/DASC.2005.1563376.
[26] DIN EN ISO 9241-110:2008-09: Ergonomie der Mensch-System-Interaktion-Teil 110: Grundsätze der Dialoggestaltung (ISO 9241-110:2006).
[27] Nielsen, J.; Molich, R. (1990): Improving a human-computer dialogue. In: Communications of the ACM 33, 3 (March), S. 338–348.
[28] Shneiderman, Ben; Plaisant, Catherine; Cohen, Maxine S.; Jacobs, Steven M.; Elmqvist, Niklas (2016): Designing the user interface: Strategies for effective human-computer interaction. In: CEC Faculty Books and Book Chapters.
[29] Webel, Sabine; Bockholt, Ulrich; Engelke, Timo; Gavish, Nirit; Tecchia, Franco (2011): Design Recommendations for Augmented Reality based Training of Maintenance Skills. In: Alem L, Huang WD (eds) Recent trends of mobile collaborative augmented reality systems, S. 69–82. DOI: 10.1007/978-1-4419-9845-3_5.
[30] Regenbrecht, H.; Baratoff, G.; Wilke, W. (2005): Augmented Reality Projects in the Automotive and Aerospace Industries. In: IEEE Computer Graphics and Applications, S. 48–56. DOI: 10.1109/MCG.2005.124.
[31] Yim, Ho Bin; Seong, Poong Hyun (2010): Heuristic guidelines and experimental evaluation of effective augmented-reality based instructions for maintenance in nuclear power plants. In: Nuclear Engineering and Design, S. 4096–4102. DOI: 10.1016/j.nucengdes.2010.08.023.
[32] Webel, Sabine; Bockholt, Ulrich; Keil, Jens (2011): Design Criteria for AR-Based Training of Maintenance and Assembly Tasks. In: Proceedings of the 2011 international conference on virtual and mixed reality: new trends - volume part 1, S. 123–132. DOI: 10.1007/978-3-642-22021-0_15.
[33] Fitts, P.M.; Posner, M.I. (1967): Human performance. In: Oxford, England: Brooks/Cole.
[34] Taatgen, Niels A.; Huss, David; Dickison, Daniel; Anderson, John R. (2008): The acquisition of robust and flexible cognitive skills. In: Journal of experimental psychology. General, S. 548–565.
[35] Werrlich, Stefan; Nitsche, Kai; Notni, Gunther (): Demand Analysis for an Augmented Reality based Assembly Training. In: PETRA- The 10th International Conference, S. 416–422. DOI: 10.1145/3056540.3076190.
[36] Alan R. Hevner; Salvatore T. March; Jinsoo Park; Sudha Ram (2004): Design Science in Information Systems Research. In: MIS Quarterly Vol. 28 No. 1, S. 75–105.