Hand Controlled Mobile Robot Applied in Virtual Environment

Authors: Jozsef Katona, Attila Kovari, Tibor Ujbanyi, Gergely Sziladi

Abstract:

By the development of IT systems, human-computer interaction is also developing even faster and newer communication methods become available in human-machine interaction. In this article, the application of a hand gesture controlled human-computer interface is being introduced through the example of a mobile robot. The control of the mobile robot is implemented in a realistic virtual environment that is advantageous regarding the aspect of different tests, parallel examinations, so the purchase of expensive equipment is unnecessary. The usability of the implemented hand gesture control has been evaluated by test subjects. According to the opinion of the testing subjects, the system can be well used, and its application would be recommended on other application fields too.

Keywords: Human-machine interface, hand control, mobile robot, virtual environment.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1131766

References:

[1] Y. Lin and W. Zhang, "A function-behavior-state approach to designing human-machine interface for nuclear power plant operators", IEEE Transactions on Nuclear Science, vol. 52, no. 1, pp. 430-439, 2005.
[2] Seong Soo Choi, Jin Kyun Park, Jin Hyuk Hong, Han Gon Kim, Soon Heung Chang and Ki Sig Kang, "Development strategies of an intelligent human-machine interface for next generation nuclear power plants", IEEE Transactions on Nuclear Science, vol. 43, no. 3, pp. 2096-2114, 1996.
[3] P. Lagari, A. Nasiakou and M. Alamaniotis, "Evaluation of Human Machine Interface (HMI) on a Digital and Analog Control Room in Nuclear Power Plants Using a Fuzzy Logic Approach", International Journal of Monitoring and Surveillance Technologies Research, vol. 4, no. 2, pp. 50-68, 2016.
[4] I. Rezazadeh, M. Firoozabadi, H. Hu and S. Golpayegani, "Co-Adaptive and Affective Human-Machine Interface for Improving Training Performances of Virtual Myoelectric Forearm Prosthesis", IEEE Transactions on Affective Computing, vol. 3, no. 3, pp. 285-297, 2012.
[5] M. Bosnak and I. Skrjanc, "Embedded Control System for Smart Walking Assistance Device", IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 25, no. 3, pp. 205-214, 2017.
[6] C. Cipriani, J. Segil, J. Birdwell and R. Weir, "Dexterous Control of a Prosthetic Hand Using Fine-Wire Intramuscular Electrodes in Targeted Extrinsic Muscles", IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 22, no. 4, pp. 828-836, 2014.
[7] B. Ravani, M. Gabibulayev and T. Lasky, "Improvement of a Human-Machine Interface (HMI) for Driver Assistance Using an Event-Driven Prompting Display", IEEE Transactions on Control Systems Technology, vol. 19, no. 3, pp. 622-627, 2011.
[8] P. Alvarado Mendoza, A. Lindgren and A. Angelelli, "Ecological interface design inspired human machine interface for advanced driver assistance systems", IET Intelligent Transport Systems, vol. 5, no. 1, pp. 53-59, 2011.
[9] C. Pickering, "The search for a safer driver interface: a review of gesture recognition human machine interface", Computing and Control Engineering, vol. 16, no. 1, pp. 34-40, 2005.
[10] S. Park and T. Sheridan, "Enhanced Human–Machine Interface in Braking", IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, vol. 34, no. 5, pp. 615-629, 2004.
[11] D. Santana, C. da Silva Santos and H. Hernandez Figueroa, "Human-Computer Interface Techniques to Design and Evaluate an Electromagnetic Simulator", IEEE Latin America Transactions, vol. 12, no. 4, pp. 725-732, 2014.
[12] H. Saini and R. Daruwala, "Human Machine Interface in Internet Of Things system", 2016 International Conference on Computing Communication Control and automation (ICCUBEA), 2016.
[13] M. Gertz, D. Stewart and P. Khosla, "A human machine interface for distributed virtual laboratories", IEEE Robotics & Automation Magazine, vol. 1, no. 4, pp. 5-13, 1994.
[14] Jiang, Y. C., “Menacing motion-sensing technology, different leap motion.” PC. Fan 11, pp. 32-33, 2013.
[15] Gy. Molnár and Z. Szűts, Visual Learning - Picture and Memory in Virtual Worlds, In: András Benedek, Kristóf Nyíri (ed.) Beyond Words: Pictures, Parables, Paradoxes. 260 p. Frankfurt: Peter Lang Verlag, 2015. pp. 153-161. (ISBN:978-3-631-66385-1)
[16] Gy. Molnár, Challenges and Opportunities in Virtual and Electronic Learning Environments, In: Szakál Anikó (ed.) SISY 2013: IEEE 11th International Symposium on Intelligent Systems and Informatics: proceedings. Budapest: IEEE Hungary Section, 2013. pp. 397-401. (ISBN:978-1-4799-0303-0)
[17] I. Horváth, Innovative engineering education in the cooperative VR environment, 7th IEEE Conference on Cognitive Infocommunications CogInfoCom 2016, 16-18 October 2016, Wroclaw, Poland, pp. 000359 - 000364, doi: 10.1109/CogInfoCom.2016.7804576
[18] I. Horváth, The education of disruptive technologies in the innovative engineering training, Australian Journal of Intelligent Information Processing System, Vol.14, No.4. 2016.
[19] Dr Molnár Gy., The role of electronic and virtual learning support systems in the learning process, In: Szakál Anikó (ed.) IEEE 8th International Symposium on Applied Computational Intelligence and Informatics: SACI 2013. (IEEE) New York: IEEE, 2013. pp. 51-54. (ISBN:978-1-4673-6397-6)