A Developmental Survey of Local Stereo Matching Algorithms

Authors: André Smith, Amr Abdel-Dayem

Abstract:

This paper presents an overview of the history and development of stereo matching algorithms. Details from its inception, up to relatively recent techniques are described, noting challenges that have been surmounted across these past decades. Different components of these are explored, though focus is directed towards the local matching techniques. While global approaches have existed for some time, and demonstrated greater accuracy than their counterparts, they are generally quite slow. Many strides have been made more recently, allowing local methods to catch up in terms of accuracy, without sacrificing the overall performance.

Keywords: Developmental survey, local stereo matching, stereo correspondence.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1125937

References:

[1] C. C. Pham, J. W. Jeon, "Domain transformation-based efficient cost aggregation for local stereo matching." Circuits and Systems for Video Technology, IEEE Transactions on 23.7 (2013): 1119-1130.
[2] D. Scharstein, H. Hirschmüller, Y. Kitajima, G. Krathwohl, N. Nešić, X. Wang, P. Westling, "High-resolution stereo datasets with subpixel-accurate ground truth." Pattern Recognition (2014): 31-42.
[3] Q. Yang, R. Yang, J. Davis, D. Nister, "Spatial-depth super resolution for range images." Computer Vision and Pattern Recognition, 2007. CVPR'07. IEEE Conference on. IEEE, 2007.
[4] Q. Yang, "A non-local cost aggregation method for stereo matching." Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on. IEEE, 2012.
[5] U. R. Dhond, and J. K. Aggarwal, "Structure from stereo-a review." IEEE transactions on systems, man, and cybernetics 19.6 (1989): 1489-1510.
[6] D. Marr, and T. Poggio. "A computational theory of human stereo vision." Proceedings of the Royal Society of London B: Biological Sciences 204.1156 (1979): 301-328.
[7] D Scharstein, R Szeliski, "A taxonomy and evaluation of dense two-frame stereo correspondence algorithms." International journal of computer vision 47.1-3 (2002): 7-42.
[8] A. Fusiello, E. Trucco, A. Verri, "Rectification with unconstrained stereo geometry." BMVC. 1997.
[9] X. Sun, X. Mei, S. Jiao, M. Zhou, Z. Liu, H. Wang, "Real-time local stereo via edge-aware disparity propagation." Pattern Recognition Letters 49 (2014): 201-206.
[10] S. Birchfield, C. Tomasi. "Depth discontinuities by pixel-to-pixel stereo." International Journal of Computer Vision 35.3 (1999): 269-293.
[11] H. Hirschmuller, "Stereo processing by semiglobal matching and mutual information." Pattern Analysis and Machine Intelligence, IEEE Transactions on 30.2 (2008): 328-341.
[12] http://vision.middlebury.edu/stereo/data
[13] Zitnick, C. Lawrence, and Takeo Kanade. "A cooperative algorithm for stereo matching and occlusion detection." Pattern Analysis and Machine Intelligence, IEEE Transactions on 22.7 (2000): 675-684.
[14] Hirschmüller, Heiko, and Daniel Scharstein. "Evaluation of cost functions for stereo matching." Computer Vision and Pattern Recognition, 2007. CVPR'07. IEEE Conference on. IEEE, 2007.
[15] Grinberg, Victor S., Gregg W. Podnar, and Mel Siegel. "Geometry of binocular imaging." IS&T/SPIE 1994 International Symposium on Electronic Imaging: Science and Technology. International Society for Optics and Photonics, 1994.
[16] Szeliski, Richard, and Polina Golland. "Stereo matching with transparency and matting." Computer Vision, 1998. Sixth International Conference on. IEEE, 1998.
[17] Kim, Junhwan, Vladimir Kolmogorov, and Ramin Zabih. "Visual correspondence using energy minimization and mutual information." Computer Vision, 2003. Proceedings. Ninth IEEE International Conference on. IEEE, 2003.
[18] Kanade, Takeo, and Masatoshi Okutomi. "A stereo matching algorithm with an adaptive window: Theory and experiment." Robotics and Automation, 1991. Proceedings., 1991 IEEE International Conference on. IEEE, 1991.
[19] Veksler, Olga. "Fast variable window for stereo correspondence using integral images." Computer Vision and Pattern Recognition, 2003. Proceedings. 2003 IEEE Computer Society Conference on. Vol. 1. IEEE, 2003.
[20] Fusiello, Andrea, Emanuele Trucco, and Alessandro Verri. "A compact algorithm for rectification of stereo pairs." Machine Vision and Applications 12.1 (2000): 16-22.
[21] Gao, Xinting, Richard Kleihorst, and Ben Schueler. "Implementation of auto-rectification and depth estimation of stereo video in a real-time smart camera system." Computer Vision and Pattern Recognition Workshops, 2008. CVPRW'08. IEEE Computer Society Conference on. IEEE, 2008.
[22] Zhang, Zhengyou. "Determining the epipolar geometry and its uncertainty: A review." International journal of computer vision 27.2 (1998): 161-195.
[23] http://vision.middlebury.edu/stereo/eval, Middlebury Stereo Evaluation, Version 2, 2015. http://vision.middlebury.edu/stereo/eval3, Middlebury Stereo Evaluation, Version 3, 2015.
[24] Žbontar, Jure, and Yann LeCun. "Stereo Matching by Training a Convolutional Neural Network to Compare Image Patches." arXiv preprint arXiv:1510.05970 (2015).
[25] http://www.cvlibs.net/datasets/kitti/eval_scene_flow.php?benchmark=stereo, The KITTI Vision Benchmark Suite, Stereo Evaluation, 2015.