A Survey on Facial Feature Points Detection Techniques and Approaches

Authors: Rachid Ahdid, Khaddouj Taifi, Said Safi, Bouzid Manaut

Abstract:

Automatic detection of facial feature points plays an important role in applications such as facial feature tracking, human-machine interaction and face recognition. The majority of facial feature points detection methods using two-dimensional or three-dimensional data are covered in existing survey papers. In this article chosen approaches to the facial features detection have been gathered and described. This overview focuses on the class of researches exploiting facial feature points detection to represent facial surface for two-dimensional or three-dimensional face. In the conclusion, we discusses advantages and disadvantages of the presented algorithms.

Keywords: Facial feature points, face recognition, facial feature tracking, two-dimensional data, three-dimensional data.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1127498

References:

[1] S. Fazli, R. Afrouzian, and H. Seyedarabi. Fiducial facial points tracking using particle lter and geometric features. In International Congress on Ultra Modern Telecom-munications and Control Systems and Workshops(ICUMT), 2010, pages 396-400; 2010.
[2] S. Nagamalla and B.C. Dhara. A novel face recognition method using facial landmarks. In Seventh International Conference on Advances in Pattern Recognition 2009(ICAPR ’09), pages 445-448, Feburary 2009.
[3] M.F. Valstar, B. Martinez, X. Binefa, and M. Pantic. Facial point detection using Boosted Regression and Graph Models. In IEEE Int’l Conf. Computer Vision and Pattern Recognition, pages 2729-2736, San Francisco, USA, June 2010.
[4] M.P. Segundo, L. Silva, O.R.P. Bellon, and C.C. Queirolo. Automatic face segmentation and facial landmark detection in range images. In IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, volume 40, pages 1319-1330, September 2010.
[5] W.S. Lee and N. Magnenat-Thalmann. Fast head modeling for animation. Image and Vision Computing, 18(4):355-364, March 2000.
[6] C. Hu, R. Feris, and M. Turk. Real-time view-based face alignment using active wavelet networksn. In Proc. IEEE Intl Workshop Analysis and Modeling of Faces and Gestures, pages 215-221. IEEE, 2003.
[7] R. Stiefelhagen, U. Meier, and J. Yang. Real-time lip-tracking for lipreading. In Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2001.
[8] E. Holden and R. Owens. Automatic facial point detection. In Proc. Asian Conf. Computer Vision, pages 731-736, 2002.
[9] B. Yip, W.Y. Sui, and J.S. Jin. Pose determination of human head using one feature point based on head movement. In IEEE International Conference on Multimedia and Expo, 2004(ICME ’04), pages 1183-1186, June 2004.
[10] M. Pantic and L.J.M. Rothkrantz. Facial action recognition for facial expression analysis from static face images. In IEEE Transactions on Systems, Man and Cy- bernetics, Part B: Cybernetics, volume 34, No.3, pages 1449-1461. IEEE, 2004.
[11] K. Grauman, M. Betke, J. Gips, and G.R. Bradski. Communication via eye blinks-detection and duration analysis in real time. In Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2001, volume 1, pages 1010-1017. IEEE, 2001.
[12] M.J.T. Reinders, et al., Locating Facial Features in Image Sequences using Neural Networks, Proc. IEEE Intl Conf. Face and Gesture Recognition, pp. 230-235, 1996.
[13] E. Holden, R. Owens, Automatic Facial Point Detection, Proc. Asian Conf. Computer Vision, 2002.
[14] R.S. Feris, et al., Hierarchical Wavelet Networks for Facial Feature Localization, Proc. IEEE Intl Conf. Face and Gesture Recognition, pp. 118-123, 2002.
[15] C. Hu, et al., Real-time view-based face alignment using active wavelet networks, Proc. IEEE Intl Workshop Analysis and Modeling of Faces and Gestures, pp. 215- 221, 2003.
[16] S. Yan, et al., Face Alignment using View-Based Direct Appearance Models, Intl J. Imaging Systems and Technology, vol. 13, no. 1, pp. 106-112, 2003.
[17] L. Wiskott, et al., Face recognition by elastic bunch graph matching. IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 775779, 1997.
[18] D. Cristinacce, T. Cootes, Facial Feature Detection Using AdaBoost With Shape Constrains, British Machine Vision Conference, 2003.
[19] L. Chen, et al., 3D Shape Constraint for Facial Feature Localization using Probabilistic-like Output, Proc. IEEE Intl Workshop Analysis and Modeling of Faces and Gestures, pp. 302-307, 2004.
[20] T. Cootes, G. Edwards, and C. Taylor. Active appearance models. Pattern Analysis and Machine Intelligence,IEEE Transactions on, 23(6):681685, June 2001.
[21] D. Cristinacce and T. Cootes. A comparison of shape constrained facial feature detectors. Automatic Face and Gesture Recognition, 2004. Proceedings. Sixth IEEE International Conference on, pages 375380, 17-19 May 2004.
[22] A. Salah and L. Akarun. 3d facial feature localization for registration. Multimedia Content Representation, Classification and Security, pages 338345, 2006.
[23] X. Lu and A. K. Jain. ”Multimodal facial feature extraction for automatic 3D face recognition,” Technical Report MSU-CSE-05-22, Department of Computer Science, Michigan State University, East Lansing, Michigan, August 2005.
[24] M. Yu and B. P. Tiddeman: ”Facial Feature Detection and Tracking with a 3D Constrained Local Model”, WSCG 2010 conference proceedings, Copyright UNION Agency Science Press, pp: 181-188, WSCG 2010.
[25] D. Vukadinovic and M. Pantic ; Fully Automatic Facial Feature Point Detection Using Gabor Feature Based Boosted Classifiers; 2005 IEEE International Conference on Systems, Man and Cybernetics Waikoloa, Hawaii October 10-12, 2005.
[26] V. Bevilacqua, A. Ciccimarra, I. Leone and G. Mastronardi: ”Automatic Facial Feature Points Detection”, Conference Paper September 2008 DOI: 10.1007/978-3-540-85984-0–137 Source: DBLP, pp:11421149 , 2008.
[27] M. R. Quiones, D. Masip and J. Vitria: ”Automatic Detection of Facial Feature Points via HOGs and Geometric Prior Models”, Conference Paper-June 2011, DOI: 10.1007/978-3-642-21257-4–46, Source: DBLP Conference: Pattern Recognition and Image Analysis-5th Iberian Conference, IbPRIA 2011.
[28] A. S. Md. Sohail and P. Bhattacharya:”Detection of Facial Feature Points Using Anthropometric Face Model”, Signal Processing for Image Enhancement and Multimedia Processing Volume 31 of the series Multimedia Systems and Applications Series,DOI 10.1007/978-0-387-72500-0–17 pp: 189-200, 2008.
[29] H. WU, J. INADA, T. SHIOYAMA, Q. CHEN and T. SIMADA: ” Automatic facial feature points detection with susan operator”. In Proceedings of the Scandinavian Conference on Image Analysis, pp: 257-263, 2001.
[30] S. Jahanbin, A. C. Bovik, and H. Choi:” Automated facial feature detection from portrait and range images”. In Image analysis and interpretation, 2008. SSIAI 2008. IEEE southwest symposium on (pp. 25-28). IEEE. 2008.
[31] M. Yu, and B. Tiddeman: ”Face Feature Detection with 3D Models”, 2011.
[32] B. Tiddeman:”Facial feature detection with 3D convex local models”. In Automatic Face and Gesture Recognition and Workshops (FG 2011), 2011 IEEE International Conference on (pp. 400-405). IEEE 2011.
[33] D. Colbry, G. Stockman, and A. Jain:”Detection of Anchor Points for 3D Face Verification”, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05) - Workshops, pp:25-25, June 2005.
[34] X. Lu, and A. K. Jain. :”Multimodal facial feature extraction for automatic 3D face recognition”2. Department of Computer Science, Michigan State University, East Lansing, Michigan, Tech. Rep. MSU-CSE-05-22. 2005.