Mobile Augmented Reality for Collaboration in Operation

Authors: Chong-Yang Qiao

Abstract:

Mobile augmented reality (MAR) tracking targets from the surroundings and aids operators for interactive data and procedures visualization, potential equipment and system understandably. Operators remotely communicate and coordinate with each other for the continuous tasks, information and data exchange between control room and work-site. In the routine work, distributed control system (DCS) monitoring and work-site manipulation require operators interact in real-time manners. The critical question is the improvement of user experience in cooperative works through applying Augmented Reality in the traditional industrial field. The purpose of this exploratory study is to find the cognitive model for the multiple task performance by MAR. In particular, the focus will be on the comparison between different tasks and environment factors which influence information processing. Three experiments use interface and interaction design, the content of start-up, maintenance and stop embedded in the mobile application. With the evaluation criteria of time demands and human errors, and analysis of the mental process and the behavior action during the multiple tasks, heuristic evaluation was used to find the operators performance with different situation factors, and record the information processing in recognition, interpretation, judgment and reasoning. The research will find the functional properties of MAR and constrain the development of the cognitive model. Conclusions can be drawn that suggest MAR is easy to use and useful for operators in the remote collaborative works.

Keywords: Mobile augmented reality, remote collaboration, user experience, cognitive model.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1126551

References:

[1] Billinghurst M, Kato H, Poupyrev I. MagicBook: transitioning between reality and virtuality. In: CHI’ 01 Extended Abstracts on Human Factors in Computing Systems. New York: ACM, 2001. 25–26.
[2] Diotasoft, Augmenting Industries, 2016, Augmented Reality for the Industry (Online), Available: http://www.diota.com (July 02, 2016).
[3] Colley, A., Häkkilä, J., Rantakari, J., 2014, “Augmenting the Home to Remember – Initial User Perceptions”, UBICOMP '14 ADJUNCT, Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication, September 13 - 17, 2014, Seattle, WA, USA, pp. 1369-1372
[4] Mekni, M., Lemieux, A., 2014, “Augmented reality: Applications, challenges and future trends”, In Proceedings of the 13th International Conference on Applied Computer and Applied Computational Science (ACA-COS ‘14), volume 20 of Recent Advances in Computer Engineering Series, April 23-25, 2014, Kuala Lumpur, Malaysia, pp. 205-215.
[5] S.K. Ong, J. Zhang, Y. Shen, A.Y. Nee. Augmented reality in product development and manufacturing. In Handbook of Augmented Reality (2011), pp. 651–669 Springer New York.
[6] P. Fite-Georgel, “Is there a reality in Industrial Augmented Reality?” In 2011 10th IEEE International Symposium on Mixed and Augmented Reality, 2011, pp. 201–210.
[7] Tractica, Augmented Reality for Mobile Devices, 2015, Installed Base of Mobile Augmented Reality Apps to Reach 2.2 Billion by 2019 (Online), Available: https://www.tractica.com/research/augmented-reality-for-mobile-devices/ (June 18, 2015).
[8] U. Neumann and A. Majoros, "Cognitive, Performance, and Systems Issues for Augmented Reality Applications in Manufacturing and Maintenance," Proc. IEEE Virtual Reality Ann. Int'l Symp.(VRAIS 98), IEEE CS Press, Los Alamitos, Calif., 1998, pp. 4-11.
[9] Reitmayr., G, Schmalstieg., D, 2001, “Mobile Collaborative Augmented Reality,” In Proc. ISAR’01 (Int. Symposium On Augmented Reality), 2001, New York, NY, USA, pp. 114-123.
[10] Wang, J. Feng, Y. Zeng, C. Li, S. (2014). An augmented reality based system for remote collaborative maintenance instruction of complex products. In IEEE International conference on automation science and engineering (CASE), Taipei, Taiwan. pp. 309-314.
[11] Lin, T., Liu, C., Tsai, M., and Kang, S., 2015, “Using Augmented Reality in a Multiscreen Environment for Construction Discussion”, Journal of Computing in Civil Engineering, 2015, 29(6): 04014088.
[12] B, L, Chui. L, Kunho. (2015). LG`s G3 GUI: A slick smartphone GUI rides the new wave of digital modernism. In magazine of interactions, volume 22 issue 1, January and February, New York, NY, USA. pp. 12-15.