Creating the Color Panoramic View using Medley of Grayscale and Color Partial Images

Authors: Dr. H. B. Kekre, Sudeep D. Thepade

Abstract:

Panoramic view generation has always offered novel and distinct challenges in the field of image processing. Panoramic view generation is nothing but construction of bigger view mosaic image from set of partial images of the desired view. The paper presents a solution to one of the problems of image seascape formation where some of the partial images are color and others are grayscale. The simplest solution could be to convert all image parts into grayscale images and fusing them to get grayscale image panorama. But in the multihued world, obtaining the colored seascape will always be preferred. This could be achieved by picking colors from the color parts and squirting them in grayscale parts of the seascape. So firstly the grayscale image parts should be colored with help of color image parts and then these parts should be fused to construct the seascape image. The problem of coloring grayscale images has no exact solution. In the proposed technique of panoramic view generation, the job of transferring color traits from reference color image to grayscale image is done by palette based method. In this technique, the color palette is prepared using pixel windows of some degrees taken from color image parts. Then the grayscale image part is divided into pixel windows with same degrees. For every window of grayscale image part the palette is searched and equivalent color values are found, which could be used to color grayscale window. For palette preparation we have used RGB color space and Kekre-s LUV color space. Kekre-s LUV color space gives better quality of coloring. The searching time through color palette is improved over the exhaustive search using Kekre-s fast search technique. After coloring the grayscale image pieces the next job is fusion of all these pieces to obtain panoramic view. For similarity estimation between partial images correlation coefficient is used.

Keywords: Panoramic View, Similarity Estimate, Color Transfer, Color Palette, Kekre's Fast Search, Kekre's LUV

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1330983

References:

[1] T. Welsh, M. Ashikhmin, and K. Mueller, Transferring color to grayscale images," ACM TOG, vol. 20, no. 3, pp. 277-280, 2002.
[2] E. Reinhard, M. Ashikhmin, B. Gooch, and P. Shirley, "Color transfer between images," IEEE Computer grahics and applications, vol. 21, no. 5, pp. 34-41, September/October 2001.
[3] D. L. Ruderman, T. W. Cronin, and C. C. Chiao, "Statistics of coneresponses to natural images: implications for visual coding,", J. Optical Soc. Of America, vol. 15, no. 8, pp. 2036-2045, 1998.
[4] A. A. Efros and T. K. Leung, "Texture synthesis by nonparametric sampling", In International Conference on Computer Vision, pages 1033-1038, Corfu, Greece, September 1999.
[5] Rafael C. Gonzalez & Paul Wintz, "Digital Image Processing", Addison-Wesley Publications, May, 1987.
[6] A. Hertzmann, C. E. Jacobs, N. Oliver, B. Curless, and D.H. Salesin, "Image analogies", In Proceedings of ACM SIGGRAPH, pp. 341- 346, 2002.
[7] SILBERG, J., Cinesite Press Article, 1998. http://www.cinesite.com/core/press/articles/1998/10_00_98- team.html
[8] Pratt, W. K. "Digital Image Processing", John Wiley & Sons, 1991.
[9] Dr.H.B.Kekre, Sudeep D. Thepade, "Image Blending in Vista Creation using Kekre-s LUV Color Space", In SPIT-IEEE Colloquium, SPIT Mumbai, INDIA, Feb 4-5,2008.
[10] Anat Levin, Dani Lischinski, Yair Weiss, "Colorization using optimization", ACM Transaction on. Graphics, 23(3):689-694, 2004.
[11] G. R. Greenfield, D. H. House, "A Palette-Driven Approach to Image Color Transfer", Computational Aesthetics in Graphics, Visualization and Imaging ,2005.
[12] Tongbo Chen, Yan Wang Volker Schillings, Christoph Meinel, "Grayscale Image Matting And Colorization", In Proceedings of ACCV- 2004, Jan 27-30, 2004, Korea.
[13] Y. Y. Chuang, A. Agarwala, B. Curless, D. Salesin, and R. Szeliski, "Video matting of complex scenes," ACM Transaction on Graphics, vol. 11, no. 4, 2002.
[14] A. R. Smith and J. F. Blinn, "Blue screen matting," in Proceedings of ACM SIGGRAPH, 1996, pp. 259-268.
[15] Karl Rasche, Robert Geist, James Westall, "Re-coloring Images for Gamuts of Lower Dimension", EUROGRAPHICS , Volume 24 , Number ,2005.
[16] Stone M. C., Cowan W. B., Beatty J. C., "Color gamut mapping and the printing of digital color images", ACM Transactions on Graphics, Vol.7- No.4 Oct.1988.
[17] Luiz Filipe M. Vieira, Rafael D. Vilela, Erickson R. do Nascimento, "Automatically choosing source color images for coloring grayscale images", In Proceedings of the XVI Brazilian Symposium on Computer Graphics and Image Processing (SIBGRAPI-03), 2003.
[18] P.R. Wolf, "Elements of Photogrammetry", McGraw-Hill, Second edition, 1983.
[19] Dr.H.B.Kekre, Sudeep D. Thepade, "Approaches of Overlap Estimation in photo parts for Panorama making",In Proc. of IEEE International Conference on Advances in Computer Vision and Information Technology (ACVIT-07), 28 -30 Nov. 2007., Held at Dr. Babasaheb Ambedkar Marathwada University, Aurangabad. MS-INDIA.
[20] Dr.H.B.Kekre, Sudeep D. Thepade, "New Methods of Image Stitching", National Conference on Applications Digital Signal Processing (NCDSP - 2007), 19-20 Jan 2007, held at FCRCE, Bandra (W), Mumbai.
[21] Dr. H.B.Kekre, Sudeep D. Thepade, "Rotation Invariant Fusion of Partial Image Parts in Vista Creation using Missing View Regeneration", WASET International Journal of Electrical, Computer, and Systems Engineering (IJECSE),Vol. 2, No.2, Spring 2008,www.waset.org/ijecse.
[22] Dr.H.B.Kekre, Sudeep D. Thepade, "The Algorithm for Fusion of Color and GrayscalePartial Imagesin Seascape Formation", National Conference on Algorithms (NCA - 2008), held at FCRCE, Bandra (W), Mumbai.
[23] Dr.H.B.Kekre, Sudeep D. Thepade, « Color Traits Transfer to Grayscale Images », IEEE International Conference on Emerging Trends in Engineering and Technology (ICETET-2008), held at G. H. Raisoni College of Engineering,, Nagpur, INDIA.
[24] Dr. H.B.Kekre, Sudeep D. Thepade, "Boosting Block Truncation Coding with Kekre-s LUV Color Space for Image Retrival", WASET International Journal of Electrical, Computer, and Systems Engineering (IJECSE),Vol. 2, No.3, Summer 2008,www.waset.org/ijecse.
[25] Dr. H.B.Kekre, Sudeep D. Thepade, "New Methods of Image Stitching", In Proc. of National Conference NCDSP 2007, FCRCE, Bnadstand, Bandra(w), Mumbai.
[26] Dr.H.B.Kekre, Sudeep D. Thepade, "Scaling Invariant Fusion of Image Pieces in Panorama Making and Novel Image Blending Technique", International Journal of Imaging (IJI), Issue 1, Volume 1, 2008.
[27] Dr.H.B.Kekre, Tanuja K. Srode, Sudeep D. Thepade, "Grid Based Image Scaling Technique", International Journal of Computer Science and Applications(IJCSA), Issue 1, Volume 1, 2008.
[28] F. Nielsen, "Randomized Adaptive Algorithms for Mosaicing Systems", IEICE Trans. of Inf. & Syst., Vol.E83-D, No.7, July 2000.
[29] H. Y. Shum and R. Szeliski, "Panoramic Image Mosaics", Technical Report, Microsoft Research, 1998
[30] M. Massey and W. Bender, "Salient Stills: Process and Practice", IBM Systems Journal, Vol.35, No.3&4, 1996.
[31] M. Irani, P. Anandan, J. Bergen, R. Kumar, and S. Hsu, "Mosaic Representations of Video Sequences and Their Applications", Signal Processing: Image Communication, Special Issue on Image and Video Semantics: Processing, Analysis, and Applications, Vol.8, No.4, 1996.
[32] J. Assfalg, A. Del Bimbo, and M. Hirakawa, "A Mosaic-based Query Language for Video Databases",Proc., IEEE Symposium on Visual Languages, 2000.
[33] M. Petrou and P. Bosdogianni, "Image Processing The Fundamental", John Wiley & Sons, 1999.
[34] Yang Linhong, Masahito Hirakawa,"A Stitching Algorithm of Still Pictures with Camera Translation", In Proc.of the First International Symposium on Cyber Worlds (CW.02),2002.