Curvelet Features with Mouth and Face Edge Ratios for Facial Expression Identification

Authors: S. Kherchaoui, A. Houacine

Abstract:

This paper presents a facial expression recognition system. It performs identification and classification of the seven basic expressions; happy, surprise, fear, disgust, sadness, anger, and neutral states. It consists of three main parts. The first one is the detection of a face and the corresponding facial features to extract the most expressive portion of the face, followed by a normalization of the region of interest. Then calculus of curvelet coefficients is performed with dimensionality reduction through principal component analysis. The resulting coefficients are combined with two ratios; mouth ratio and face edge ratio to constitute the whole feature vector. The third step is the classification of the emotional state using the SVM method in the feature space.

Keywords: Facial expression identification, curvelet coefficients, support vector machine (SVM).

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1337245

References:

[1] H. Rowley, S. Baluja, and T. Kanade, "Human face detection in visual scenes”, Technical Report CMU-CS-95-158R, School of Computer Science, Carnegie Mellon University, Nov. 1995.
[2] K.-K. Sung and T. Poggio, "Example-based learning for view-based human face detection”, Technical Report A.I. Memo 1521, CBCL Paper 112, MIT, Dec. 1994.
[3] M. Pantic and L. J. M. Rothkrantz, "Expert Ststem For Automatic Analysis Of Facilal Expressions”, Image And Vision Computing 18, pp.881-905, 2000.
[4] P.Viola, M.Jones, "Robust Real Time Object Detection”, Second International Workshop on Statistical and Computational Theories of Vision Modelling, Learning, Computing and Sampling, Vancouver, Canada, July 13, 2001.
[5] http://www.kasrl.org/jaffe.html
[6] Xianxing Wu, Jieyu Zhao, "Curvelet Feature Extraction for Face Recognition andFacial Expression Recognition”, Sixth International Conference on Natural Computation, 2010.
[7] T. F. Cootes, G. J. Edwards and C. J. Taylor. "Active Appearance Models”, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 23, N° 6, 2001.
[8] D. Arumugan, S. Purushothaman, "Emotion Classification Using Facial Expression”, International Journal of Advanced Computer Science and Application, Vol. 2, N°7, 2011.
[9] M. S. Bartlett, Joseph C. Hager, P. Ekman, and T. J. Sejnowski, "Measuring facial expressions by computer image analysis”, Psychophysiology, Cambridge University, USA 36, pp.253–263, 1999.
[10] Zheng You, "Feature-Based Facial Expression Recognition: Sensitivity Analysis and Experiments with a Multi-Layer Perceptron”, International Journal of pattern Recognition and artificial Intelligence, 13(6), pp.893-911, 1999.
[11] P. Ekman, W.V. Friesen, "Facial action coding system: investigator’s guide”, Consulting Psychologists Press, Palo Alto, CA, 1978.
[12] P.Ekman. Strong evidence of universals in facial expressions: A reply to Russell’s mistaken critique. Psychological Bulletin, pp. 268-287, 1994.
[13] AshirbaniSaha, Q.M. Jonathan Wu, "Facial expression recognition using curvelet based local binary patterns”, ICASSP, 2010.
[14] www.curvelet.org.
[15] D. L. Donoho and M. R. Duncan, "Digital curvelet Transform: Strategy, Implementation, Experiments”, Technical Report, Stanford University, 1999.
[16] E. Candés, L. Demanet, D. Donoho and L. Ying, "Fast Discrete Curvelet Transforms”, Applied and Computational Mathematics, Caltech, Pasadena, 2006.