Multi-Scale Gabor Feature Based Eye Localization

Authors: Sanghoon Kim, Sun-Tae Chung, Souhwan Jung, Dusik Oh, Jaemin Kim, Seongwon Cho

Abstract:

Eye localization is necessary for face recognition and related application areas. Most of eye localization algorithms reported so far still need to be improved about precision and computational time for successful applications. In this paper, we propose an eye location method based on multi-scale Gabor feature vectors, which is more robust with respect to initial points. The eye localization based on Gabor feature vectors first needs to constructs an Eye Model Bunch for each eye (left or right eye) which consists of n Gabor jets and average eye coordinates of each eyes obtained from n model face images, and then tries to localize eyes in an incoming face image by utilizing the fact that the true eye coordinates is most likely to be very close to the position where the Gabor jet will have the best Gabor jet similarity matching with a Gabor jet in the Eye Model Bunch. Similar ideas have been already proposed in such as EBGM (Elastic Bunch Graph Matching). However, the method used in EBGM is known to be not robust with respect to initial values and may need extensive search range for achieving the required performance, but extensive search ranges will cause much more computational burden. In this paper, we propose a multi-scale approach with a little increased computational burden where one first tries to localize eyes based on Gabor feature vectors in a coarse face image obtained from down sampling of the original face image, and then localize eyes based on Gabor feature vectors in the original resolution face image by using the eye coordinates localized in the coarse scaled image as initial points. Several experiments and comparisons with other eye localization methods reported in the other papers show the efficiency of our proposed method.

Keywords: Eye Localization, Gabor features, Multi-scale, Gabor wavelets.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1058765

References:

[1] S.Z. Li and A. K. Jain, Handbook of Face Recognition, Springer, 2004.
[2] P. Wang, M.B. Green, Q. Ji, J. Wayman, "Automatic Eye Detection and Its Validation," Computer Vision and Pattern Recognition, 2005 IEEE Computer Society Conference, Vol. 3, pp. 164 - 172 , June 2005.
[3] T. Kawaguchi, D. Hidaka and M. Rizon, "Robust Extraction of Eyes from Face," 15th Int-l Conf. on Pattern Recognition, Vol. 1. pp. 1109 - 1114, Sept. 2000.
[4] O. Jesorsky, K. Kirchberg and R. Frischholz, "Robust Face Detection Using the Hausdorff Distance," In: J. Bigun, F. Smeraldi Eds. Lecture Notes in Computer Science 2091, Berlin: Springer, pp.90-95, 2001.
[5] H. Zhou, X. Geng. "Projection Functions for Eye Detection," Pattern Recognition, No. 5, pp. 1049-1056, May 2004.
[6] Y. Ma, X. Ding, Z. Wang, N. Wang, "Robust Precise Eye Location under Probabilistic Framework," Proc. 6th IEEE Int-l Conf. on Automatic face and Gesture Recognition (FGR-04), PP. 339-344, May 2004.
[7] P. Campadelli, R. Lanzarotti, G. Lipori, "Precise eye localization through a general-to-specific model definition," Proc. 17th conference organised by the British Machine Vision (BMVC 2006).
[8] Z. Niu, S. Shan, S. Yan, X. Chen and W. Gao, "2D Cascaded Adaboost for Eye Localization," 18th Int-l Conf. on Pattern Recognition, Vol. 2, pp. 1216-1219, Aug. 2006.
[9] L. Wiskott, J.-M. Fellous, N. Kuiger, and C. von der Malsburg, "Face Recognition by Elastic Bunch Graph Matching," Pattern Analysis and Machine Intelligence, IEEE Transactions on Vol. 19, pp. 775 - 779, July 1997.
[10] J.-K. Kamarainen, and V. Kyrki, "Invariance Properties of Gabor Filter-Based Features - Overview and Applicaions," IEEE Trans. Omage Processing, Vol. 15, No. 5, pp. 1088-1099, May 2006. 1996.
[11] Rainer Lienhart and Jochen Maydt, "An Extended Set of Haar-like Features for Rapid Object Detection," IEEE ICIP 2002, Vol. 1, pp. 900-903, Sep. 2002.
[12] IMM face database, http://www2.imm.dtu.dk/~aam/
[13] FERET face database, http://www.itl.nist.gov/iad/humanid/feret /feret_master.html
[14] BioID Face Database, http://www.bioid.com/downloads/facedb /index.php
[15] The JAFFE database, http://www.mis.atr.co.jp/~mlyons/jaffe.htm