Vision Based Hand Gesture Recognition

Authors: Pragati Garg, Naveen Aggarwal, Sanjeev Sofat

Abstract:

With the development of ubiquitous computing, current user interaction approaches with keyboard, mouse and pen are not sufficient. Due to the limitation of these devices the useable command set is also limited. Direct use of hands as an input device is an attractive method for providing natural Human Computer Interaction which has evolved from text-based interfaces through 2D graphical-based interfaces, multimedia-supported interfaces, to fully fledged multi-participant Virtual Environment (VE) systems. Imagine the human-computer interaction of the future: A 3Dapplication where you can move and rotate objects simply by moving and rotating your hand - all without touching any input device. In this paper a review of vision based hand gesture recognition is presented. The existing approaches are categorized into 3D model based approaches and appearance based approaches, highlighting their advantages and shortcomings and identifying the open issues.

Keywords: Computer Vision, Hand Gesture, Hand Posture, Human Computer Interface.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1074855

References:

[1] A. Mulder, "Hand gestures for HCI", Technical Report 96-1, vol. Simon Fraster University, 1996
[2] F. Quek, "Towards a Vision Based Hand Gesture Interface", pp. 17-31, in Proceedings of Virtual Reality Software and Technology, Singapore, 1994.
[3] Ying Wu, Thomas S Huang, " Vision based Gesture Recognition : A Review", Lecture Notes In Computer Science; Vol. 1739 , Proceedings of the International Gesture Workshop on Gesture-Based Communication in Human-Computer Interaction, 1999
[4] K G Derpains, "A review of Vision-based Hand Gestures", Internal Report, Department of Computer Science. York University, February 2004
[5] Richard Watson, "A Survey of Gesture Recognition Techniques", Technical Report TCD-CS-93-11, Department of Computer Science, Trinity College Dublin, 1993.
[6] Y. Wu and T.S. Huang, "Hand modeling analysis and recognition for vision-based human computer interaction", IEEE Signal Processing Mag. - Special issue on Immersive Interactive Technology, vol.18, no.3, pp. 51-60, May 2001
[7] H. Zhou, T.S. Huang, "Tracking articulated hand motion with Eigen dynamics analysis", In Proc. Of International Conference on Computer Vision, Vol 2, pp. 1102-1109, 2003 .
[8] JM Rehg, T Kanade, "Visual tracking of high DOF articulated structures: An application to human hand tracking" ,In Proc. European Conference on Computer Vision, 1994
[9] A. J. Heap and D. C. Hogg, "Towards 3-D hand tracking using a deformable model", In 2nd International Face and Gesture Recognition Conference, pages 140-145, Killington, USA,Oct. 1996.
[10] Y. Wu, L. J. Y., and T. S. Huang. "Capturing natural hand Articulation". In Proc. 8th Int. Conf. on Computer Vision, volume II, pages 426-432, Vancouver, Canada, July 2001.
[11] B. Stenger P. R. S. Mendonc┬©a R. Cipolla, "Model-Based 3D Tracking of an Articulated Hand" , In proc. British Machine Vision Conference, volume I, Pages 63-72, Manchester, UK, September 2001
[12]
[Online] Available from:
[11.09.2008]
[13] B. Stenger, A. Thayananthan, P.H.S. Torr, R. Cipolla , "Model-based hand tracking using a hierarchical Bayesian filter" , IEEE transactions on pattern analysis and machine intelligence, September 2006
[14] Elena Sánchez-Nielsen, Luis Antón-Canalís, Mario Hernández-Tejera, "Hand Getsure recognition for Human Machine Intercation", In Proc. 12th International Conference on Computer Graphics, Visualization and Computer Vision : WSCG, 2004
[15] B. Stenger, "Template based Hand Pose recognition using multiple cues", In Proc. 7th Asian Conference on Computer Vision : ACCV 2006
[16] Lars Bretzner, Ivan Laptev and Tony Lindeberg, "Hand gesture recognition using multiscale color features, hieracrchichal models and particle filtering", in Proceedings of Int. Conf. on Automatic face and Gesture recognition, Washington D.C., May 2002
[17] M. Black, & Jepson, " Eigen tracking: Robust matching and tracking of articulated objects using a view-based representation", In European Conference on Computer Vision, 1996.
[18] C C Wang, K C Wang, "Hand Posture recognition using Adaboost with SIFT for human robot interaction", Springer Berlin, ISSN 0170-8643, Volume 370/2008
[19] R. Lienhart and J. Maydt, "An extended set of Haar-like features for rapid object detection," in Proc. IEEE Int. Conf. Image Process., 2002, vol. 1, pp. 900-903.
[20] Andre L. C. Barczak, Farhad Dadgostar, "Real-time hand tracking using a set of co-operative classifiers based on Haar-like features", Res. Lett. Inf. Math. Sci., 2005, Vol. 7, pp 29-42
[21] Qing Chen , N.D. Georganas, E.M Petriu, "Real-time Vision based Hand Gesture Recognition Using Haar-like features", IEEE Transactions on Instrumentation and Measurement -2007
[22] P. Viola and M. Jones, "Robust real-time object detection," Cambridge Res. Lab., Cambridge, MA, pp. 1-24, Tech. Rep. CRL2001/01, 2001.
[23] Ju, S., Black, M., Minneman, S., Kimber, D, "Analysis of Gesture and Action in Technical Talks for Video Indexing", IEEE Conf. on Computer Vision and Pattern Recognition, CVPR 97 ,1997
[24] Berry,G.: Small-wall, "A Multimodal Human Computer Intelligent Interaction Test Bed with Applications", Dept. of ECE, University of Illinois at Urbana-Champaign, MS thesis (1998)
[25] Zeller, M., et al, " A Visual Computing Environment for Very Large Scale Biomolecular Modeling", Proc. IEEE Int. Conf. on Applicationspecific Systems, Architectures and Processors (ASAP), Zurich, pp. 3- 12, 1997
[26] Thad Starner and Alex Pentland, "Real time American Sign Language Recognition from Video using Hidden Markov Models", Technical Report 375, MIT Media Lab,1995
[27] A Malima, E Ozgur, M Cetin, "A fast algorithm for Vision based hand gesture recognition for robot control", 14th IEEE conference on Signal Processing and Communications Applications, April 2006
[28] Hongmo Je Jiman Kim Daijin , "Hand Gesture Recognition to Understand Musical Conducting Action" 16th IEEE International Symposium on Robot and Human interactive Communication, 2007, ROMAN, 2007, pg 163-168
[29] Dong Guo Yonghua, " Vision-Based Hand Gesture Recognition for Human-Vehicle Interaction", International Conference on Control, Automation and Computer Vision, 1998
[30] Pickering, Carl A. Burnham, Keith J. Richardson, Michael J. Jaguar , "A research Study of Hand Gesture Recognition Technologies and Applications for Human Vehicle Interaction", 3rd Conference on Automotive Electronics, 2007
[31] Juan P. Wachs , Helman I. Stern, Yael Edan, Michael Gillam, Jon Handler, Craig Feied, Mark Smith, "A Gesture-based Tool for Sterile Browsing of Radiology Images", Journal of the American Medical Informatics Association (2008; 15:321-323, DOI 10.1197/jamia.M24)
[32]
[Online] Available from:
[11.09.2008]