Mean Shift-based Preprocessing Methodology for Improved 3D Buildings Reconstruction

Authors: Nikolaos Vassilas, Theocharis Tsenoglou, Djamchid Ghazanfarpour

Abstract:

In this work, we explore the capability of the mean shift algorithm as a powerful preprocessing tool for improving the quality of spatial data, acquired from airborne scanners, from densely built urban areas. On one hand, high resolution image data corrupted by noise caused by lossy compression techniques are appropriately smoothed while at the same time preserving the optical edges and, on the other, low resolution LiDAR data in the form of normalized Digital Surface Map (nDSM) is upsampled through the joint mean shift algorithm. Experiments on both the edge-preserving smoothing and upsampling capabilities using synthetic RGB-z data show that the mean shift algorithm is superior to bilateral filtering as well as to other classical smoothing and upsampling algorithms. Application of the proposed methodology for 3D reconstruction of buildings of a pilot region of Athens, Greece results in a significant visual improvement of the 3D building block model.

Keywords: 3D buildings reconstruction, data fusion, data upsampling, mean shift.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1106273

References:

[1] C. Tomasi, and R. Manduchi, “Bilateral filtering for gray and color images,” in Proc. 6th International Conference on Computer Vision (ICCV ’98), pp. 839-846, Bombay, India, Jan. 1998.
[2] D. Comaniciu, and P. Meer, “Mean shift: A robust approach toward feature space analysis,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 5, pp. 603–619, 2002.
[3] S. Paris, P. Kornprobst, J. Tumblin, and F. Durand, “Bilateral filtering: Theory and applications,” Computer Graphics and Vision, vol. 1, pp. 1- 73, 2008.
[4] D. Barash, and D. Comaniciu, “A common framework for nonlinear diffusion, adaptive smoothing, bilateral filtering and mean shift,” Image and Vision Computing, vol. 22, no. 1, pp. 73-81, 2004.
[5] J. Kopf, M.F. Cohen, D. Lischinski, and M. Uyttendaele, “Joint bilateral upsampling,” ACM Transactions on Graphics (Proc. SIGGRAPH), vol. 26, pp. 673-678, San Diego, Aug. 2007.
[6] E. Eisemann, and F. Durand, “Flash Photography Enhancement via Intrinsic Relighting, ACM Transactions on Graphics (Proc. SIGGRAPH), vol. 23, pp. 673-678, Los Angeles, Aug. 2004.
[7] G. Petschnigg, M. Agrawala, H. Hoppe, R. Szeliski, M. Cohen, and K. Toyama, “Digital Photography with Flash and No-Flash Image Pairs,” ACM Transactions on Graphics (Proc. SIGGRAPH), vol. 23, pp. 664- 672, Los Angeles, Aug. 2004.
[8] J. Solomon, K. Crane, A. Butscher, and C. Wojtan, “A general framework for bilateral and mean shift filtering,” CoRR, 2014.
[9] K. Fukunaga, and L. Hostetler, “The estimation of the gradient of a density function, with applications in pattern recognition,” IEEE Transactions on InformationTheory, vol. 21, no. 1, pp. 32–40, 1975.
[10] Y. Cheng, “Mean shift, mode seeking, and clustering,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 17, no. 8, pp. 790–799, 1995.
[11] J. van de Weijer, and R. van den Boomgaard, “Local Mode Filtering,” in Proc. Computer Vision and Pattern Recognition (CVPR 2001), Vol. II, pp. 428-433, Hawaii, USA, Dec. 2001.