Rotation Invariant Fusion of Partial Image Parts in Vista Creation using Missing View Regeneration

Authors: H. B. Kekre, Sudeep D. Thepade

Abstract:

The automatic construction of large, high-resolution image vistas (mosaics) is an active area of research in the fields of photogrammetry [1,2], computer vision [1,4], medical image processing [4], computer graphics [3] and biometrics [8]. Image stitching is one of the possible options to get image mosaics. Vista Creation in image processing is used to construct an image with a large field of view than that could be obtained with a single photograph. It refers to transforming and stitching multiple images into a new aggregate image without any visible seam or distortion in the overlapping areas. Vista creation process aligns two partial images over each other and blends them together. Image mosaics allow one to compensate for differences in viewing geometry. Thus they can be used to simplify tasks by simulating the condition in which the scene is viewed from a fixed position with single camera. While obtaining partial images the geometric anomalies like rotation, scaling are bound to happen. To nullify effect of rotation of partial images on process of vista creation, we are proposing rotation invariant vista creation algorithm in this paper. Rotation of partial image parts in the proposed method of vista creation may introduce some missing region in the vista. To correct this error, that is to fill the missing region further we have used image inpainting method on the created vista. This missing view regeneration method also overcomes the problem of missing view [31] in vista due to cropping, irregular boundaries of partial image parts and errors in digitization [35]. The method of missing view regeneration generates the missing view of vista using the information present in vista itself.

Keywords: Vista, Overlap Estimation, Rotation Invariance, Missing View Regeneration.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1079826

References:

[1] Bo Hu, Christopher Brown and Andrew Choi, "Acquiring an Environment Map Through Image Mosaicking", Technical Report 786, November 2001, Computer Science Department, University of Rochester.
[2] P.R. Wolf, "Elements of Photogrammetry", McGraw-Hill, Second edition, 1983
[3] Heung-Yeung, Shum Richard Szeliski, "Panoramic Image Mosaics", Technical Report MSR-TR-97-23, Microsoft Cooperation, 1997.
[4] M.Traka, G.Tziritas, "Panoramic view construction", Signal Processing and Image Communication, volume 18, 2003 pages 465-481, www.elsevier.com/locate/image.
[5] Richard Szeliski (2005), "Image Alignment and Stitching A Tutorial", Technical Report SR-TR-2004-92, Microsoft Cooperation, January 2005.
[6] Richard Szeliski and Heung-Yeung Shum, "Creating Full View Panoramic Image Mosaics and Environment Maps", Proc. of SIGGRAPH-97, May 1997.
[7] Matthew Uyttendaele, Heung-Yeung Shum Richard Szeliski, "Seamless Stitching using Multi-Perspective Sweep", Technical Report MSR-TR- 2004-48, Microsoft Cooperation, June 2004.
[8] A.K. Jain and Arun Ross, "Fingerprint Mosaicking", Proc. of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Orlando, Florida, May 13-17, 2002.
[9] A. Criminisi, P. Perez, and K. Toyama, "Object removal by exemplarbased inpainting", Proc. Conf. Comp. Vision Pattern Rec., Madison, WI, Jun 2003.
[10] A. Criminisi, P. Perez, and K. Toyama, "Object removal by exemplarbased inpainting", IEEE transaction on image processing, Vol. 13, No. 9, Sep 2004.
[11] M.Bertalmio, A.L.Bertozziand G.Sapiro."Navier-Stokes,Fluid Dynamics, and Image and Video Inpainting," in Proc.Int conf. Computer Vision Pattern Reg,pp1:355-362,Dec. 2001.
[12] Reddy, B.S., and B.N. Chatterji, "An FFT-based technique for translation, rotation, and scale-invariant image registration," IEEE Trans. On Image Processing, vol. 5, no. 8, pp 1266-1270, August 1996.
[13] Dr. H.B.Kekre, Sudeep D. Thepade, "Vista creation using Picture Parts", In Proc. of International Conference ICEATES 2008, Saurashtra University, Rajkot.
[14] Dr. H.B.Kekre, Sudeep D. Thepade, "Approaches of Overlap Estimation in photo parts for Panorama making", In Proc. of IEEE sponsored International Conference ACVIT 2007, Dr. B.A.M. University, Aurangabad, INDIA.
[15] Dr. H.B.Kekre, Sudeep D. Thepade, "Region Filling and object removal by Exemplar-based Image Inpainting", In Proc. of National Conference NCSPA 2007, DYPIET, Pune.
[16] Dr. H.B.Kekre, Sudeep D. Thepade, "Creating Vista using Picture Parts", In Proc. of NCCSP 2007, TSEC, Bandra(w), Mumbai.
[17] Dr. H.B.Kekre, Sudeep D. Thepade, "New Methods of Image Stitching", In Proc. of National Conference NCDSP 2007, FCRCE, Bnadstand, Bandra(w), Mumbai.
[18] Dr. H.B.Kekre, Sudeep D. Thepade, "Panorama Making Using Fractional Images", In Proc. of Electro-Info-Com 2007, 04-06 Jan 2007, SFIT, Borivali, Mumbai.
[19] Dr.H.B.Kekre, Sudeep D. Thepade, "Panoramic View Construction using Partial Images", In Proc. of IEEE sponsored International Conference SSPCCIN 2008, VIT, Pune.
[20] Dr.H.B.Kekre, Sudeep D. Thepade, "Scaling Invariant Fusion of Image Pieces in Panorama Making and Novel Image Blending Technique", International Journal of Imaging (IJI), Issue 1, Volume 1, 2008.
[21] M. Ashikhmin, "Synthesizing natural textures", In Proc. ACM Symposium on Interactive 3D Graphics, pages 217-226, Research Triangle Park, NC, March 2001.
[22] C. Ballester, V. Caselles, J. Verdera, M. Bertalmio, and G. Sapiro, "A variational model for filling-in gray level and color images", In Proc. Int. Conf. Computer Vision, pages I: 10-16, Vancouver, Canada, June 2001.
[23] M. Bertalmio, G. Sapiro, V. Caselles, and C. Ballester, "Image inpainting", In Proc. ACM Conf. Comp. Graphics (SIGGRAPH), pages 417-424, New Orleans, LU, July 2000. http://mountains.ece.umn.edu/»guille/inpainting.htm.
[24] M. Bertalmio, L. Vese, G. Sapiro, and S. Osher, "Simultaneous structure and texture image inpainting", In Proc. Conf. Comp. Vision Pattern Rec., Madison, WI, 2003. http://mountains.ece.umn.edu/»guille/inpainting.htm.
[25] R. Bornard, E. Lecan, L. Laborelli, and J-H. Chenot, "Missing data correction in still images and image sequences", In ACM Multimedia, France, December 2002.
[26] T. F. Chan and J. Shen, "Non-texture inpainting by curvature-driven diffusions(CDD)", J. Visual Comm. Image Rep., 4(12):436-449, 2001.
[27] J.S. de Bonet, "Multiresolution sampling procedure for analysis and synthesis of texture images" In Proc. ACM Conf. Comp. Graphics (SIGGRAPH), volume 31, pages 361-368, 1997.
[28] I. Drori, D. Cohen-Or, and H. Yeshurun, "Fragment-based image completion", In ACM Trans. on Graphics (SIGGRAPH 2003 issue), 22(3), volume 22, pages 303-312, San Diego, US, 2003.
[29] A. Efros and W.T. Freeman, "Image quilting for texture synthesis and transfer", In Proc. ACM Conf. Comp. Graphics (SIGGRAPH), pages 341-346, Eugene Fiume, August 2001.
[30] A. Efros and T. Leung, "Texture synthesis by non-parametric sampling", In Proc. Int. Conf. Computer Vision, pages 1033-1038, Kerkyra, Greece, September 1999.
[31] W.T. Freeman, E.C. Pasztor, and O.T. Carmichael, "Learning low-level vision", Int. J. Computer Vision, 40(1):25-47, 2000.
[32] D. Garber, "Computational Models for Texture Analysis and Texture Synthesis", PhD thesis, University of Southern California, USA, 1981.
[33] P. Harrison, "A non-hierarchical procedure for re-synthesis of complex texture", In Proc. Int. Conf. Central Europe Comp. Graphics, Visua. And Comp. Vision, Plzen, Czech Republic, February 2001.
[34] D.J. Heeger and J.R. Bergen, "Pyramid-based texture analysis/synthesis", In Proc. ACM Conf. Comp. Graphics (SIGGRAPH), volume 29, pages 229-233, Los Angeles, CA, 1995.
[35] A. Hertzmann, C. Jacobs, N. Oliver, B. Curless, and D. Salesin, "Image analogies", In Proc. ACM Conf. Comp. Graphics (SIGGRAPH), Eugene Fiume, August 2001.
[36] H. Igehy and L. Pereira, "Image replacement through texture synthesis", In Proc. Int. Conf. Image Processing, pages III:186-190, 1997.
[37] J. Jia and C.-K. Tang, "Image repairing: Robust image synthesis by adaptive end tensor voting", In Proc. Conf. Comp. Vision Pattern Rec., Madison, WI, 2003.
[38] G. Kanizsa, "Organization in Vision", Praeger, New York, 1979.
[39] J. M. Kasson and W. Plouffe, "An analysis of selected computer interchange color spaces", In ACM Transactions on Graphics, volume 11, pages 373-405, October 1992.
[40] L. Liang, C. Liu, Y.-Q. Xu, B. Guo, and H.-Y. Shum, "Real-time texture synthesis by patch-based sampling", ACM Transactions on Graphics, 2001.
[41] S Masnou and J.-M. Morel, "Level lines based disocclusion", In Int. Conf. Image Processing, Chicago, 1998.
[42] S. Rane, G. Sapiro, and M. Bertalmio, "Structure and texture filling-in of missing image blocks in wireless transmission and compression applications", In IEEE. Trans. Image Processing, 2002.
[43] L.-W. Wey and M. Levoy, "Fast texture synthesis using tree-structured vector quantization", In Proc. ACM Conf. Comp. Graphics (SIGGRAPH), 2000.
[44] A. Zalesny, V. Ferrari, G. Caenen, and L. van Gool, "Parallel composite texture synthesis", In Texture 2002 workshop - ECCV, Copenhagen, Denmark, June 2002.
[45] Jiaya Jia, Chi-Keung Tang, "Image Stitching Using Structure Deformation", In IEEE Trans. Pattern Analysis And Machine Intelligence, Vol. 30, No. 4, April 2008.