Assessment of Time-Lapse in Visible and Thermal Face Recognition

Authors: Sajad Farokhi, Siti Mariyam Shamsuddin, Jan Flusser, Usman Ullah Sheikh

Abstract:

Although face recognition seems as an easy task for human, automatic face recognition is a much more challenging task due to variations in time, illumination and pose. In this paper, the influence of time-lapse on visible and thermal images is examined. Orthogonal moment invariants are used as a feature extractor to analyze the effect of time-lapse on thermal and visible images and the results are compared with conventional Principal Component Analysis (PCA). A new triangle square ratio criterion is employed instead of Euclidean distance to enhance the performance of nearest neighbor classifier. The results of this study indicate that the ideal feature vectors can be represented with high discrimination power due to the global characteristic of orthogonal moment invariants. Moreover, the effect of time-lapse has been decreasing and enhancing the accuracy of face recognition considerably in comparison with PCA. Furthermore, our experimental results based on moment invariant and triangle square ratio criterion show that the proposed approach achieves on average 13.6% higher in recognition rate than PCA.

Keywords: Infrared Face recognition, Time-lapse, Zernike moment invariants

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1071093

References:

[1] Socolinsky, Selinger and Neuheisel, Face recognition with visible and thermal infrared imagery. Computer Vision and Image Understanding, 2003. 91(1-2): p. 72-114.
[2] Störring, Andersen and Granum, Physics-based modelling of human skin colour under mixed illuminants. Robotics and Autonomous Systems, 2001. 35(3-4): p. 131-142.
[3] Kong, Heo, Abidi, Paik, and Abidi, Recent advances in visual and infrared face recognition--a review. Computer Vision and Image Understanding, 2005. 97(1): p. 103-135.
[4] Xin Chen , Patrick J. Flynn and Bowyer. Visible-light and Infrared Face Recognition. in The proceedings of Workshop on Multimodal User Authentication. 2003. Santa Barbara, CA USA.
[5] Buddharaju, Pavlidis, Tsiamyrtzis, and Bazakos, Physiology-Based Face Recognition in the Thermal Infrared Spectrum. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2007. 29(4): p. 613-626.
[6] Chen, Flynn and Bowyer, IR and visible light face recognition. Computer Vision and Image Understanding, 2005. 99(3): p. 332-358.
[7] Joseph Wilder, P. Jonathon Phillips, Cunhong Jiang, and Wiener. Comparison of visible and infra-red imagery for face recognition. in Proceedings of the Second International Conference on Automatic Face and Gesture Recognition. 1996.
[8] Xin Chen, Patrick J. Flynn and Bowyer. PCA-based face recognition in infrared imagery: baseline and comparative studies. in IEEE International Workshop on Analysis and Modeling of Faces and Gestures. 2003.
[9] Yu, Zhihua, Zhijun, Jucheng, Shiqian, and Feng. Time-Lapse Data Oriented Infrared Face Recognition Method Using Block-PCA. in 2010 International Conference on Multimedia Technology (ICMT). 2010.
[10] Jan Flusser, Moment Invariants in Image Analysis. Proceedings of World Academy of Science, Engineering and Technology, 2006. 1307- 6884: p. 196-201.
[11] Jian, Zhang, Frangi, and Jing-yu, Two-dimensional PCA: a new approach to appearance-based face representation and recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2004. 26(1): p. 131-137.
[12] M. Turk and Pentland, Eigenfaces for Recognition. Journal of Cognitive Neuroscience, 1991. 3,No 1: p. 71-86.
[13] Jan Flusser, Tomas Suk and Zitova, Moments and Moment Invariants in Pattern Recognition. First ed. 2009, chichester: wiley. 291.
[14] Zahran, Abbas, Dessouky, Ashour, and Sharshar. High performance face recognition using PCA and ZM on fused LWIR and VISIBLE images on the wavelet domain. in International Conference on Computer Engineering & Systems. 2009.
[15] Lajevardi seyed mehdi and Hussain, Higher order orthogonal moments for invariant facial expression recognition. Digital Signal Processing, 2010. 20(6): p. 1771-1779.
[16] Nabatchian, Makaremi, Abdel-Raheem, and Ahmadi. Pseudo-Zernike Moment Invariants for Recognition of Faces Using Different Classifiers in FERET Database. in Third International Conference on Convergence and Hybrid Information Technology. 2008.
[17] Zhi and Ruan. A Comparative Study on Region-Based Moments for Facial Expression Recognition. in Congress on Image and Signal Processing. 2008.
[18] Ali Broumandnia and Shanbehzadeh, Fast Zernike wavelet moments for Farsi character recognition. Image and Vision Computing, 2007. 25(5): p. 717-726.
[19] Shen and Ip, Discriminative wavelet shape descriptors for recognition of 2-D patterns. Pattern Recognition, 1999. 32(2): p. 151-165.
[20] A. Marcano-Cedeño, J. Quintanilla-Domínguez, Cortina-Januchs, and Andina. Feature selection using Sequential Forward Selection and classification applying Artificial Metaplasticity Neural Network. in 36th IEEE Annual Conference on Industrial Electronics Society. 2010.
[21] Durga Prasad Muni, Nikhil R. Pal and Das, Genetic programming for simultaneous feature selection and classifier design. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 2006. 36(1): p. 106-117.
[22] Gutierrez-Osuna, a lecture on sequential feature selection. 2008, A&M University: Texas. p. 1-15.
[23] Nor'aini, Raveendran and Selvanathan. Human Face Recognition using Zernike moments and Nearest Neighbor classifier. in 4th Student Conference on Research and Development. 2006.
[24] Chao-Chun Liu, Dao-Qing Dai and Yan, Local discriminant wavelet packet coordinates for face recognition. Journal of Machine Learning Research, May 2007. Vol. 8: p. 1165-1195.
[25] Flynn, Bowyer and Phillips, Assessment of Time Dependency in Face Recognition: An Initial Study Audio- and Video-Based Biometric Person Authentication, J. Kittler and M. Nixon, Editors. 2003, Springer Berlin / Heidelberg. p. 1057-1057.
[26] Viola and Jones. Rapid Object Detection Using a Boosted Cascade of Simple Features. in Computer Vision and Pattern Recognition. 2001.
[27] Hrkać, Kalafatić and Krapac, Infrared-Visual Image Registration Based on Corners and Hausdorff Distance Image Analysis, B. Ersb├©ll and K. Pedersen, Editors. 2007, Springer Berlin / Heidelberg. p. 383-392.
[28] Socolinsky and Selinger. Thermal face recognition over time. in Proceedings of the 17th International Conference on Pattern Recognition. 2004.
[29] Sang-ki Kim, Hyobin Lee, Sunjin Yu, and Lee. Robust Face Recognition by Fusion of Visual and Infrared Cues. in 1ST IEEE Conference on Industrial Electronics and Applications. 2006.
[30] Buddharaju and Pavlidis, Multispectral Face Recognition: Fusion of Visual Imagery with Physiological Information, in Face Biometrics for Personal Identification, R. Hammoud, B. Abidi, and M. Abidi, Editors. 2007, Springer Berlin Heidelberg. p. 91-108.