A Holographic Infotainment System for Connected and Driverless Cars: An Exploratory Study of Gesture Based Interaction

Authors: Nicholas Lambert, Seungyeon Ryu, Mehmet Mulla, Albert Kim

Abstract:

In this paper, an interactive in-car interface called HoloDash is presented. It is intended to provide information and infotainment in both autonomous vehicles and ‘connected cars’, vehicles equipped with Internet access via cellular services. The research focuses on the development of interactive avatars for this system and its gesture-based control system. This is a case study for the development of a possible human-centred means of presenting a connected or autonomous vehicle’s On-Board Diagnostics through a projected ‘holographic’ infotainment system. This system is termed a Holographic Human Vehicle Interface (HHIV), as it utilises a dashboard projection unit and gesture detection. The research also examines the suitability for gestures in an automotive environment, given that it might be used in both driver-controlled and driverless vehicles. Using Human Centred Design methods, questions were posed to test subjects and preferences discovered in terms of the gesture interface and the user experience for passengers within the vehicle. These affirm the benefits of this mode of visual communication for both connected and driverless cars.

Keywords: Holographic interface, human-computer interaction, user-centered design, Gesture.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1474994

References:

[1] Market Forecast for Connected and Autonomous Vehicles (7th September 2017): Centre for Connected and Autonomous Vehicles; https://www.gov.uk/government/publications/connected-and-autonomous-vehicles-market-forcecast accessed 22nd December 2017.
[2] J. M. Anderson, N. Kalra, K. D. Stanley, P. Sorensen, C. Samaras, O. A. Oluwatola, Autonomous Vehicle Technology: A Guide for Policymakers (RAND Corporation, Santa Monica Calif. 2016), pviii.
[3] “F 015: Luxury in Motion”, Ars Electronica 2015, https://www.aec.at/postcity/en/f-015-luxury-in-motion/ .Accessed 22nd Dec 2017.
[4] J. Rousseau and B. Crane, “The Human Transition To Autonomous Vehicles", The Artefact Group, October 27th 2015, accessed Friday 22nd December - https://www.artefactgroup.com/articles/the-human-transition-to-autonomous-vehicles/ Accessed 22nd Dec 2017.
[5] C. P. Janssen and L. Kenemans, "Multitasking in Autonomous Vehicles: Ready to Go?"; proceedings of AutomotiveUI'15 September 1-3, 2015, Nottingham, UK ACM 978-1-4503-3736-6, p3.
[6] O. Tsimhoni , H. Yoo, P. Green, "Effects of Visual Demand and In-Vehicle Task Complexity on Driving and Task Performance as Assessed by Visual Occlusion", Technical Report UMTRI-99-37 December, 1999, http://www.umich.edu/~driving/publications/UMTRI-99-37.pdf, accessed December 22nd 2017.
[7] P. Hock et al, “CarVR: Enabling In-Car Virtual Reality Entertainment”: CHI 2017, May 06 - 11, 2017, Denver, CO, USA.
[8] J. Nielsen "10 Usability Heuristics for User Interface Design", January 1, 1995 https://www.nngroup.com/articles/ten-usability-heuristics/, accessed 16th Dec 2017.
[9] C. Smith et al, D5.3 WEKIT Workplace Integration, Wearable Experience for Knowledge Intensive Training, http://wekit.eu/wp-content/uploads/2017/08/WEKIT_D5.3.pdf.
[10] Y. Zhang, O. Meruvia-Pastor (2017) Operating Virtual Panels with Hand Gestures in Immersive VR Games. In: De Paolis L., Bourdot P., Mongelli A. (eds) Augmented Reality, Virtual Reality, and Computer Graphics. AVR 2017. Lecture Notes in Computer Science, vol 10324. Springer, Cham.
[11] Y. Du, S. Liu, L. Feng, M. Chen, J. Wu, Hand Gesture Recognition with Leap Motion, arXiv:1711.04293 (12th November 2017) https://arxiv.org/abs/1711.04293.
[12] R. McCartney; J. Yuan; and H-P Bischof, "Gesture Recognition with the Leap Motion Controller" (2015). Accessed from http://scholarworks.rit.edu/other/857.
[13] I. A. Grout, Hand Motion and Gesture Control of Laboratory Test Equipment Using the Leap Motion Controller, International Science Index, Electronics and Communication Engineering Vol:11, No:11, 2017 waset.org/Publication/10008085.
[14] K. de Greef, E. van der Spek, T. Bekker (2013) Designing Kinect games to train motor skills for mixed ability players. In: Schouten B., Fedtke S., Bekker T., Schijven M., Gekker A. (eds) Games for Health. Springer Vieweg, Wiesbaden.