Objects Extraction by Cooperating Optical Flow, Edge Detection and Region Growing Procedures

Authors: C. Lodato, S. Lopes

Abstract:

The image segmentation method described in this paper has been developed as a pre-processing stage to be used in methodologies and tools for video/image indexing and retrieval by content. This method solves the problem of whole objects extraction from background and it produces images of single complete objects from videos or photos. The extracted images are used for calculating the object visual features necessary for both indexing and retrieval processes. The segmentation algorithm is based on the cooperation among an optical flow evaluation method, edge detection and region growing procedures. The optical flow estimator belongs to the class of differential methods. It permits to detect motions ranging from a fraction of a pixel to a few pixels per frame, achieving good results in presence of noise without the need of a filtering pre-processing stage and includes a specialised model for moving object detection. The first task of the presented method exploits the cues from motion analysis for moving areas detection. Objects and background are then refined using respectively edge detection and seeded region growing procedures. All the tasks are iteratively performed until objects and background are completely resolved. The method has been applied to a variety of indoor and outdoor scenes where objects of different type and shape are represented on variously textured background.

Keywords: Image Segmentation, Motion Detection, Object Extraction, Optical Flow

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1084932

References:

[1] R. Pohle and K. Toennies, "Segmentation of medical images using adaptive region growing", Proc. SPIE Medical Imaging 2001, San Diego, CA, 2001, 1337-1346.
[2] G. A. Ruza, and P. A. Estéveza, "Image segmentation using fuzzy minmax neural networks for wood defect detection", Proc. IPROMS 2005, online web-based conference, July 2005, to be published by Elsevier.
[3] A. K. Jain and M. P. Dubuisson, "Segmentation of x-ray and c-scan images of fiber reinforced composite materials", Pattern Recognition, 25, pp. 257-269, 1992.
[4] P. F. Felzenszwalb and D. P. Huttenlocher, "Efficient graph based image segmentation", International Journal of Computer Vision 59(2), 167- 181, 2004.
[5] J. Malik, S. Belongie, T. Leung and J. Shi, "Contour and texture analysis for image segmentation", International Journal of Computer Vision 43(1), 7-27, 2001
[6] U. Montanari, "On the optimal detection of curves in noisy pictures", Comm. of the ACM, vol.14:335-345, 1971.
[7] P. Parent and S. Zucker, "Trace inference, curvature, consistency, and curve detection", IEEE Transactions on Pattern Analysis and Machine Intelligence Volume 11 , Issue 8, Pages: 823 - 839, August 1989.
[8] A. Sha-ashua and S. Ullman, "Structural saliency: the detection of globally salient structures using a locally connected network", in Proc. 2nd Int. Conf. Computer Vision, Tampa, FL, USA, 1988, pp 321-327.
[9] L. Williams and D. Jacobs, "Stochastic completion fields: a neural model of illusory contour shape and salience", in Proc. 5th Int. Conf. Computer Vision, Cambridge, MA, 1995, pp. 408-415.
[10] L. A. Vese and T. F. Chan, "A multiphase level set framework for image segmentation using the Mumford and Shah model", International Journal of Computer Vision 50(3), 271-293, 2002.
[11] N. Paragios, "A variational approach for the segmentation of the left ventricle in cardiac image analysis", International Journal of Computer Vision 50(3), 345-362, 2002.
[12] X. Wang, L. He and W. Wee, "Deformable contour method: a constrained optimization approach", International Journal of Computer Vision 59(1), 87-108, 2004.
[13] B. Appleton and H. Talbot, "Globally optimal geodesic active contours", Journal of Mathematical Imaging and Vision 23:67-86, 2005
[14] T. Amiaz and N. Kiryati, "Dense discontinuous optical flow via contourbased segmentation", in Proc. ICIP 2005, Genova, Italy, September 2005, Vol. III, pp. 1264-1267.
[15] C. L. Zitnick, N. Jojic and S. B. Kang, "Consistent segmentation for optical flow estimation", in Proc. ICCV 2005, Beijing, China, October 2005.
[16] F. Ranchin and F. Dibos, "Moving objects segmentation using optical flow estimation", in Proc. Workshop on Mathematics and Image Analysis, Paris, September 2004.
[17] R. Vidal and S. Sastry, "Segmentation of dynamic scenes from image intensities", in Proc. IEEE Workshop on Vision and Motion Computing, Orlando FL, December 2002, pp. 44-49.
[18] D. Cremers, "A variational framework for image segmentation combining motion estimation and shape regularization", in Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Madison, Wisconsin, June 2003.
[19] A. G. Bors and I. Pitas, "Optical flow estimation and moving object segmentation based on median radial basis function network", IEEE Trans. Image Process., vol. 7, no. 5, pp. 693--702, May 1998.
[20] J. L. Barron, D. J. Fleet, and S. S. Beauchemin, "Performance of optical flow techniques", International Journal of Computer Vision 12(1), pp. 43-77, 1994.
[21] E. Francomano, C. Lodato, S. Lopes and A. Tortorici, "An algorithm for optical flow computation based on a quasi-interpolant operator", Journal of Computational Methods in Science and Engineering (JCMSE) to be published.
[22] B. K. Horn and B. G. Schunck, "Determining optical flow", Artificial Intelligence. August 1981.
[23] W.H.Press, B.P.Flannery, S.A.Teukolsky and W.T.Vetterling. "Numerical Recipes in C: The Art of Scientific Computing," 23, Cambridge Univ. Press, 2nd ed. (1992).
[24] M. Sezgin and B. Sankur, "Survey over image thresholding techniques and quantitative performance evaluation", Journal of Electronic Imaging 13(1), 146-165, January 2004.
[25] A. Abutaleb, "Automatic thresholding of gray-level pictures using twodimensional entropy", Computer Vision, Graphics, and Image Processing, Volume 47, Issue 1, Pages 22-32, July 1989.
[26] M. Roggero. "Object segmentation with region growing and principal component analysis", in Proc. ISPRS Commission III, Symposium 2002, Graz, Austria, September 2002, pp. A-289-294.
[27] J. Fan, D. K. Y. Yau, A. K. Elmagarmid and W. G. Aref, "Automatic image segmentation by integrating color-edge extraction and seeded region growing", IEEE Trans. Image Process., vol.10, no.10, pp.1454- 1466, Oct. 2001.
[28] R. Adams and L. Bischof, "Seeded region growing", IEEE Trans. Pattern Anal. Mach. Intell., vol.16, no.6, pp.641-647, June 1994.
[29] S. A. Hojjatoleslami and J. Kittler, "Region growing: A new approach", IEEE Trans. Image Process., vol.7, no.7, pp.1079-1084, July 1998.
[30] Y. L. Chang and X. Li, "Adaptive image region-growing", IEEE Trans. Image Process., vol.3, no.6, pp.868-872, Nov. 1994.