Adaptive Gaussian Mixture Model for Skin Color Segmentation

Authors: Reza Hassanpour, Asadollah Shahbahrami, Stephan Wong

Abstract:

Skin color based tracking techniques often assume a static skin color model obtained either from an offline set of library images or the first few frames of a video stream. These models can show a weak performance in presence of changing lighting or imaging conditions. We propose an adaptive skin color model based on the Gaussian mixture model to handle the changing conditions. Initial estimation of the number and weights of skin color clusters are obtained using a modified form of the general Expectation maximization algorithm, The model adapts to changes in imaging conditions and refines the model parameters dynamically using spatial and temporal constraints. Experimental results show that the method can be used in effectively tracking of hand and face regions.

Keywords: Face detection, Segmentation, Tracking, Gaussian Mixture Model, Adaptation.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1331379

References:

[1] A. A. Argyros and M. I. A. Lourakis. Real-Time Tracking of Multiple Skin-Colored Objects with a Possibly Moving Camera. In Proc. European Conference on Computer Vision (ECCV), pages 368-379, 2004.
[2] A. A. Argyros and M. I. A. Lourakis. Three-Dimensional Tracking of Multiple Skin-Colored Regions by Moving Stereoscopic System. Applied Optics, 43(2), January 2004.
[3] S. Birchfield. Elliptical Head Tracking Using Intensity Gradients and Color Histograms. In Proc. on Computer Vision and Pattern Recognition, pages 232-237, 1998.
[4] J. Brand and J. Mason. A Comparative Assessment of Three Approaches to Pixel Level Human Skin Detection. In Proc. IEEE Int. Conf. on on Pattern Recognition, pages 1056-1059, 2000.
[5] D. Chai and A. Bouzerdoum. A Bayesian Approach to Skin Color Classification in YCbCr Color Space. In Proc. 10th IEEE Conf. on Region, pages 421-424, 2000.
[6] B. S. Everitt and D. J. Hand. Finite Mixture Distribution, Monographs on Applied Probability and Statistics. Chapman and Hall, 1981.
[7] R. L. Hsu, M. Abdel-Mottaleb, and A. K. Jain. Face detection in color images. IEEE Transaction on Pattern Analysis and Machine Intelligence, 24(5):696-706, May 2002.
[8] M. Jones and J. M. Rehg. Statistical Color Models with Application to Skin Detection. In Proc. IEEE Int. Conf. on Computer Vision and Pattern Recognition, pages 274-280, 1999.
[9] J. Lee and S. Yoo. An Elliptical Boundary Model for Skin Color Detection. In Proc. Int. Conf. on Imaging Science, System and Technology, 2002.
[10] C. Liu. A bayesian discriminating features method for face detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(6):725-740, June 2003.
[11] S. J. McKenna, S. Gong, and Y. Raja. Modelling Facial Colour and Identity with Gaussian Mixtures. In Proc. on Pattern Recognition, pages 1883-1892, 1998.
[12] K. Nigam, A. McCallum, S. Thrun, and T. Mitchell. Text Classification from Labeled and Unlabeled Documents Using EM. Machine Learning Special Issue on Information Retrieval, 39(2):103-134, May-June 2000.
[13] N. Oliver, A. Pentland, and F. Berard. Lafter: Lips and Face Real Time Tracker. In Proc. Computer Vision and Pattern Recognition, pages 123- 129, 1997.
[14] P. Perez, C. Hue, J. Vermaak, and M. Cangnet. Color-Based Probabilistic Tracking. In Proc. European Conference on Computer Vision (ECCV), pages 661-675, 2002.
[15] M. Sadeghi, J.V. Kittler, A. Kostin, and K. Messer. A Comparative Study of Automatic Face Verification Algorithms on the BANCA Database. In Proc. Int. Conf. on Audio and Video Based Person Anthentication, pages 35-43, 2003.
[16] L. Sigal, S. Sclaroff, and V. Athitsos. Estimation and Prediction of Evolving Color Distributions for Skin Segmentation Under Varying Illumination. In Proc. IEEE Conf. on Computer Vision and Pattern Recognition, pages 1883-1892, 2000.
[17] J. Terrillion, M. Shirazi, H. Fukamachi, and S. Akamatsu. Comparative Performance of Different Skin Chrominance Models and Chrominance Spaces for the Automatic Detection of Human Faces in Color Images. In Proc. Int. Conf. on Face and Gesture Recognition, pages 54-61, 2000.
[18] H. Yang, D. Kriegman, and N. Ahuja. Detecting Faces in Images: A Survey. IEEE Transaction on Pattern Analysis and Machine Intelligence, 24(1):34-58, 2002.
[19] D. Zarit, B. J. Super, and F. Queck. Comparison of Five Color Models in Skin Pixel Classification. In Proc. Workshop on Recognition, Analysis and Tracking of Faces and Gestures in Real-Time Systems, pages 58-63, 1999.