On Phase Based Stereo Matching and Its Related Issues

Authors: Andr´as R¨ovid, Takeshi Hashimoto

Abstract:

The paper focuses on the problem of the point correspondence matching in stereo images. The proposed matching algorithm is based on the combination of simpler methods such as normalized sum of squared differences (NSSD) and a more complex phase correlation based approach, by considering the noise and other factors, as well. The speed of NSSD and the preciseness of the phase correlation together yield an efficient approach to find the best candidate point with sub-pixel accuracy in stereo image pairs. The task of the NSSD in this case is to approach the candidate pixel roughly. Afterwards the location of the candidate is refined by an enhanced phase correlation based method which in contrast to the NSSD has to run only once for each selected pixel.

Keywords: Stereo matching, Sub-pixel accuracy, phase correlation, SVD, NSSD.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1092568

References:

[1] M. Young, E. Beeson, J. Davis, S. Rusinkiewicz and R. Ramamoorthi, ”Viewpoint-Coded Structured Light”, IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pages 18, June 2007
[2] E. Lilienblum, B. Michaelis, ”Optical 3D Surface Reconstruction by a Multi-Period Phase Shift Method, Journal of Computers, Vol. 2, No. 2, pp. 73-83, 2007
[3] Yan Cui, Schuon, S., Chan, D., Thrun, S., Theobalt, C., ”3D Shape Scanning with a Time-of-Flight Camera,” 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1173-1180, 13-18 June 2010
[4] N. Karpinsky, S. Zhang, ”High-Resolution, Real-Time 3D Imaging with Fringe Analysis,” Journal of Real-Time Image Processing, Springer-Verlag, Vol. 7, Issue 1, pp. 55-66, 2010
[5] Raj Kumar Gupta, Siu-Yeung Cho, ”Window-Based Approach for Fast Stereo Correspondence,” IET Computer Vision, Vol. 7, Issue 2, ISSN 1751-9632, pp. 123-134, April 2013.
[6] Adhyapak Satyajit Anil, Kehtarnavaz Nasser, Nadin Mihai, ”Stereo matching via selective multiple windows,” Journal of Electronic Imaging Vol. 16, No. 1, pp. 013012-1–013012-14, 2007.
[7] Boykov, Y.; Veksler, O.; Zabih, R., ”Fast approximate energy minimization via graph cuts,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 23, No. 11, pp. 1222–1239, Nov. 2001.
[8] M. Bleyer, M. Gelautz, ”Graph-Cut-Based Stereo Matching Using Image Segmentation with Symmetrical Treatment of Occlusions, Signal Processing: Image Communication, Vol. 22, Issue 2, ISSN 0923-5965, pp. 127–143, Feb. 2007.
[9] Liu, Yonghuai, ”A Mean Field Annealing Approach to Accurate Free Form Shape Matching,” Journal of Pattern Recognition, Vol. 40, Issue 9, ISSN: 0031-3203, pp. 2418-2436, 2007.
[10] Jian Sun; Nan-Ning Zheng; Heung-Yeung Shum, ”Stereo matching using belief propagation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 25, No. 7, pp. 787–800, July 2003.
[11] Sawires, E.F.; Hamdy, A.M.; Amer, F.Z.; Bakr, E. M., ”Disparity map using suboptimal cost with dynamic programming,” IEEE International Symposium on Signal Processing and Information Technology, pp. 209–214, 15-18 Dec. 2010.
[12] Kachouane, M.; Sahki, S.; Lakrouf, M.; Ouadah, N., ”HOG based fast human detection,” 24th International Conference on Microelectronics (ICM), pp. 1–4, 16–20 Dec. 2012.
[13] Hoge, W.S., ”A Subspace Identification Extension to the Phase Correlation Method
[MRI application],” IEEE Transactions on Medical Imaging, Vol. 22, No. 2, pp. 277–280, Feb. 2003.
[14] Muquit, M. A., Shibahara, T., Aoki, T., ”A High-Accuracy Passive 3D Measurement System Using Phase-Based Image Matching,” IEICE Transactions, Vol. E89, No. 3, pp. 686–697, 2006.
[15] Z. Zhang, ”A Flexible New Technique for Camera Calibration,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(11):1330–1334, 2000.