Quantitative Analysis of PCA, ICA, LDA and SVM in Face Recognition

Authors: Liton Jude Rozario, Mohammad Reduanul Haque, Md. Ziarul Islam, Mohammad Shorif Uddin

Abstract:

Face recognition is a technique to automatically identify or verify individuals. It receives great attention in identification, authentication, security and many more applications. Diverse methods had been proposed for this purpose and also a lot of comparative studies were performed. However, researchers could not reach unified conclusion. In this paper, we are reporting an extensive quantitative accuracy analysis of four most widely used face recognition algorithms: Principal Component Analysis (PCA), Independent Component Analysis (ICA), Linear Discriminant Analysis (LDA) and Support Vector Machine (SVM) using AT&T, Sheffield and Bangladeshi people face databases under diverse situations such as illumination, alignment and pose variations.

Keywords: PCA, ICA, LDA, SVM, face recognition, noise.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1096107

References:

[1] ToygarOnsen and AcanAdnan (2003): Face recognition using PCA, LDA and ICA approaches on colored images, Journal of electrical and Electronics Engineering vol. 3, No. 1, 735 – 743. J. Clerk Maxwell, A Treatise on Electricity and Magnetism, 3rd ed., vol. 2. Oxford: Clarendon, 1892, pp. 68-73.
[2] Belhumeur P. N., Hespanha J. P. and Kriegman D. J (1997): Eigenfaces vs.Fisherfaces: Recognition Using Class Specific Linear Projection," in IEEE TPAMI. vol. 19, pp. 711-720.K.
[3] Becker B.C. and Ortiz E.G. (2008): Evaluation of Face Recognition Techniques for Application Facebook, in Proceedings of the 8th IEEE International Automatic Face and Gesture, 14 (2008), Carnegie Mellon Univ., Pittsburgh, PA, pp. 1-6.
[4] Delac K., Grgic M., Grgic S. (2002): Independent Comparative Study of PCA, ICA, and LDA on the FERET Data Set, International Journal of Imaging.
[5] Martinez A.M., Kak A.C. (2001): PCA versus LDA, IEEE Trans. Patt. Anal. Mach. Intell. 23 (2) 228–233.6. Mazanec Jan and et al. (2008): Support Vector Machines, PCA and LDA in face recognition, Journal of Electrical engineering, vol. 59, No. 4, pp. 203–209.
[6] Mazanec Jan and et al. (2008): Support Vector Machines, PCA and LDA in face recognition, Journal of Electrical engineering , vol. 59, No. 4, pp. 203–209.
[7] Turk M. A. and Pentland A. P. (1991): Face Recognition Using Eigenfaces, IEEE CVPR 1991, pp. 586-591.
[8] Turk M., Pentland A. (1991): Eigenfaces for Recognition, Journal of Cognitive Neuroscience, Vol. 3, No. 1, 1991, pp. 71-86.
[9] Bartlett M.S., Movellan J.R., and Sejnowski T.J. (2002): Face Recognition by Independent Component Analysis, IEEE Trans. on Neural Networks, Vol. 13, pp. 1450-1464.
[10] Liu C. and Wechsler H. (1999): Comparative Assessment of Independent Component Analysis (ICA) for Face Recognition, Second International Conference on Audio and Videobased Biometric Person Authentication, AVBPA’99,Washington D. C., USA, March 22-24.
[11] Baek K., Draper B., Beveridge J.R. and She K. (2002): PCA vs. ICA: A Comparison on the FERET Data Set, Proc. of the Fourth International Conference on Computer Vision, Pattern Recognition and Image Processing, pp. 824-827.
[12] Moghaddam B. (2002): Principal Manifolds and Probabilistic Subspaces for Visual Recognition, IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 24, pp. 780-788,.
[13] Beveridge J.R., She K., Draper B., and Givens G.H. (2001): A Nonparametric Statistical Comparison of PrincipalComponent and Linear Discriminant Subspaces for Face Recognition, Proceeding of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 535- 542.
[14] Martinez A.M. and Kak A.C (2001): PCA versus LDA, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 23, pp. 228-233.
[15] Belhumeur V., Hespanha J., and Kriegman D. (1997): Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 19, pp. 711-720.
[16] Navarrete P. and Ruiz-del-Solar J. (2002): Analysis and Comparison of Eigenspace-Based Face Recognition Approaches, International Journal of Pattern Recognition and Artificial Intelligence, Vol. 16, pp. 817-830.
[17] Belhumeur P., Hespanha J., Kriegman D. (1996): Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection, Proc. of the Fourth European Conference on Computer Vision, Vol. 1, 14-18 April 1996, Cambridge, UK, pp. 45-58.
[18] Zhao W., Chellappa R., Krishnaswamy A. (1998): Discriminant Analysis of Principal Components for Face Recognition, Proc. of the 3rd IEEE International Conference on Automatic Face and Gesture Recognition, 14-16 April 1998, Nara, Japan, pp. 336-341.
[19] Cortes C. and Vapnik V. (1995): Support-vector networks, Machine Learning, Vol.20, No. 3, pp. 273.
[20] Sheffield Face Database,available online: http://www.sheffield.ac.uk/eee/research/iel/research/face
[21] AT&T Face Database,available online: http://www.cl.cam.ac.uk/Research/DTG/attarchive:pub/data/att_faces.zp