Moment Invariants in Image Analysis

Authors: Jan Flusser

Abstract:

This paper aims to present a survey of object recognition/classification methods based on image moments. We review various types of moments (geometric moments, complex moments) and moment-based invariants with respect to various image degradations and distortions (rotation, scaling, affine transform, image blurring, etc.) which can be used as shape descriptors for classification. We explain a general theory how to construct these invariants and show also a few of them in explicit forms. We review efficient numerical algorithms that can be used for moment computation and demonstrate practical examples of using moment invariants in real applications.

Keywords: Object recognition, degraded images, moments, moment invariants, geometric invariants, invariants to convolution, moment computation.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1071752

References:

[1] D. Hilbert, Theory of Algebraic Invariants. Cambridge University Press, 1993.
[2] G. B. Gurevich, Foundations of the Theory of Algebraic Invariants. Groningen, The Netherlands: Nordhoff, 1964.
[3] I. Schur, Vorlesungen uber Invariantentheorie. Berlin: Springer, 1968.
[4] M. K. Hu, "Visual pattern recognition by moment invariants," IRE Trans. Information Theory, vol. 8, pp. 179-187, 1962.
[5] S. A. Dudani, K. J. Breeding, and R. B. McGhee, "Aircraft identification by moment invariants," IEEE Trans. Computers, vol. 26, pp. 39-45, 1977.
[6] S. O. Belkasim, M. Shridhar, and M. Ahmadi, "Pattern recognition with moment invariants: a comparative study and new results," Pattern Recognition, vol. 24, pp. 1117-1138, 1991.
[7] R. Y. Wong and E. L. Hall, "Scene matching with invariant moments," Computer Graphics and Image Processing, vol. 8, pp. 16-24, 1978.
[8] A. Goshtasby, "Template matching in rotated images," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 7, pp. 338-344, 1985.
[9] J. Flusser and T. Suk, "A moment-based approach to registration of images with affine geometric distortion," IEEE Trans. Geoscience and Remote Sensing, vol. 32, pp. 382-387, 1994.
[10] J. Flusser and T. Suk, "Affine moment invariants: A new tool for character recognition," Pattern Recognition Letters, vol. 15, pp. 433- 436, 1994.
[11] S. Maitra, "Moment invariants," Proc. of the IEEE, vol. 67, pp. 697-699, 1979.
[12] T. M. Hupkens and J. de Clippeleir, "Noise and intensity invariant moments," Pattern Recognition, vol. 16, pp. 371-376, 1995.
[13] L. Wang and G. Healey, "Using Zernike moments for the illumination and geometry invariant classification of multispectral texture," IEEE Trans. Image Processing, vol. 7, pp. 196-203, 1998.
[14] Y. Li, "Reforming the theory of invariant moments for pattern recognition," Pattern Recognition, vol. 25, pp. 723-730, 1992.
[15] W. H. Wong, W. C. Siu, and K. M. Lam, "Generation of moment invariants and their uses for character recognition," Pattern Recognition Letters, vol. 16, pp. 115-123, 1995.
[16] J. Flusser, "On the independence of rotation moment invariants," Pattern Recognition, vol. 33, pp. 1405-1410, 2000.
[17] J. Flusser, "On the inverse problem of rotation moment invariants," Pattern Recognition, vol. 35, pp. 3015-3017, 2002.
[18] M. R. Teague, "Image analysis via the general theory of moments," J. Optical Soc. of America, vol. 70, pp. 920-930, 1980.
[19] A. Wallin and O. Kubler, "Complete sets of complex Zernike moment invariants and the role of the pseudoinvariants," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, pp. 1106-1110, 1995.
[20] J. Flusser and T. Suk, "Pattern recognition by affine moment invariants," Pattern Recognition, vol. 26, pp. 167-174, 1993.
[21] T. H. Reiss, "The revised fundamental theorem of moment invariants," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, pp. 830-834, 1991.
[22] R. J. Prokop and A. P. Reeves, "A survey of moment-based techniques for unoccluded object representation and recognition," CVGIP: Graphical Models and Image Processing, vol. 54, pp. 438-460, 1992.
[23] C. H. Teh and R. T. Chin, "On image analysis by the method of moments," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 10, pp. 496-513, 1988.
[24] Y. S. Abu-Mostafa and D. Psaltis, "Recognitive aspects of moment invariants," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 6, pp. 698-706, 1984.
[25] S. X. Liao and M. Pawlak, "On image analysis by moments," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, pp. 254-266, 1996.
[26] M. Pawlak, "On the reconstruction aspects of moment descriptors," IEEE Trans. Information Theory, vol. 38, pp. 1698-1708, 1992.
[27] R. R. Bailey and M. Srinath, "Orthogonal moment features for use with parametric and non-parametric classifiers," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, pp. 389-398, 1996.
[28] Y. S. Abu-Mostafa and D. Psaltis, "Image normalization by complex moments," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 7, pp. 46-55, 1985.
[29] M. Gruber and K. Y. Hsu, "Moment-based image mormalization with high noise-tolerance," Pattern Recognition, vol. 19, pp. 136-139, 1997.
[30] L. Yang and F. Albregtsen, "Fast and exact computation of cartesian geometric moments using discrete Green-s theorem," Pattern Recognition, vol. 29, pp. 1061-1073, 1996.
[31] L. van Gool, T. Moons, and D. Ungureanu, "Affine/photometric invariants for planar intensity patterns," in Proc. 4th ECCV-96, vol. LNCS 1064, pp. 642-651, Springer, 1996.
[32] F. Mindru, T. Moons, and L. van Gool, "Recognizing color patterns irrespective of viewpoint and illumination," in Proc. IEEE Conf. Computer Vision Pattern Recognition CVPR-99, vol. 1, pp. 368-373, 1999.
[33] J. Flusser and T. Suk, "Degraded image analysis: An invariant approach," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 6, pp. 590-603, 1998.
[34] J. Flusser, T. Suk, and S. Saic, "Recognition of blurred images by the method of moments," IEEE Trans. Image Processing, vol. 5, pp. 533- 538, 1996.
[35] Y. Zhang, C. Wen, and Y. Zhang, "Estimation of motion parameters from blurred images," Pattern Recognition Letters, vol. 21, pp. 425- 433, 2000.
[36] Y. Zhang, C. Wen, Y. Zhang, and Y. Soh, "Determination of blur and affine combined invariants by normalization," Pattern Recognition, vol. 35, pp. 211-221, 2002.
[37] J. Lu and Y. Yoshida, "Blurred image recognition based on phase invariants," IEICE Trans. Fundamentals of El. Comm. and Comp. Sci., vol. E82A, pp. 1450-1455, 1999.
[38] Y. Bentoutou, N. Taleb, M. Mezouar, M. Taleb, and L. Jetto, "An invariant approach for image registration in digital subtraction angiography," Pattern Recognition, vol. 35, pp. 2853-2865, 2002.
[39] Y. Zhang, Y. Zhang, and C. Wen, "A new focus measure method using moments," Image and Vision Computing, vol. 18, pp. 959-965, 2000.
[40] J. Flusser, T. Suk, and S. Saic, "Image features invariant with respect to blur," Pattern Recognition, vol. 28, pp. 1723-1732, 1995.
[41] J. Flusser, T. Suk, and S. Saic, "Recognition of images degraded by linear motion blur without restoration," Computing Suppl., vol. 11, pp. 37-51, 1996.
[42] A. Stern, I. Kruchakov, E. Yoavi, and S. Kopeika, "Recognition of motion-blured images by use of the method of moments," Applied Optics, vol. 41, pp. 2164-2172, 2002.
[43] J. Flusser and B. Zitov'a, "Combined invariants to linear filtering and rotation," Int-l. Journal of Pattern Recognition and Artificial Intelligence, vol. 13, no. 8, pp. 1123-1136, 1999.
[44] T. Suk and J. Flusser, "Combined blur and affine moment invariants and their use in pattern recognition," Pattern Recognition, vol. 36, pp. 2895-2907, 2003.
[45] J. Flusser, B. Zitov'a, and T. Suk, "Invariant-based registration of rotated and blurred images," in IEEE 1999 International Geoscience and Remote Sensing Symposium. Proceedings (I. S. Tammy, ed.), (Los Alamitos), pp. 1262-1264, IEEE Computer Society, June 1999.
[46] B. Zitov'a and J. Flusser, "Estimation of camera planar motion from defocused images," in Proc. IEEE Int-l. Conf. Image Proc ICIP-02, vol. II, pp. 329-332, Rochester, NY, September 2002.
[47] J. Flusser, J. Boldyˇs, and B. Zitov'a, "Moment forms invariant to rotation and blur in arbitrary number of dimensions," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, no. 2, pp. 234-246, 2003.
[48] J. Flusser and T. Suk, "Pattern Recognition by Means of Affine Moment Invariants," Tech. Rep. 1726, U' TIA AV Cˇ R, Praha, 1991.
[49] L. Van Gool, T. Moons, E. Pauwels, and A. Oosterlinck, "Vision and Lie-s approach to invariance," Image and Vision Computing vol. 13 pp. 259-277, 1995.
[50] T. Suk and J. Flusser, " Projective Moment Invariants," IEEE Trans. Pattern Anal. Mach. Intell., submitted in 2003.
[51] T. Suk and J. Flusser, "Graph method for generating affine moment invariants," Int-l. Conf. Pattern Recognition ICPR-04, Cambridge, U.K., August 2004 (submitted).
[52] M. I. Sezan and A. M. Tekalp, "Survey of recent developments in digital image restoration," Optical Engineering, vol. 29, pp. 393-404, 1990.
[53] D. Kundur and D. Hatzinakos, "Blind image deconvolution," IEEE Signal Processing Magazine, vol. 13, no. 3, pp. 43-64, 1996.
[54] B. Zitov'a and J. Flusser, "Image registration methods: A survey," Image and Vision Computing, vol. 21, pp. 977-1000, 2003.