Stereo Motion Tracking

Authors: Yudhajit Datta, Jonathan Bandi, Ankit Sethia, Hamsi Iyer

Abstract:

Motion Tracking and Stereo Vision are complicated, albeit well-understood problems in computer vision. Existing softwares that combine the two approaches to perform stereo motion tracking typically employ complicated and computationally expensive procedures. The purpose of this study is to create a simple and effective solution capable of combining the two approaches. The study aims to explore a strategy to combine the two techniques of two-dimensional motion tracking using Kalman Filter; and depth detection of object using Stereo Vision. In conventional approaches objects in the scene of interest are observed using a single camera. However for Stereo Motion Tracking; the scene of interest is observed using video feeds from two calibrated cameras. Using two simultaneous measurements from the two cameras a calculation for the depth of the object from the plane containing the cameras is made. The approach attempts to capture the entire three-dimensional spatial information of each object at the scene and represent it through a software estimator object. In discrete intervals, the estimator tracks object motion in the plane parallel to plane containing cameras and updates the perpendicular distance value of the object from the plane containing the cameras as depth. The ability to efficiently track the motion of objects in three-dimensional space using a simplified approach could prove to be an indispensable tool in a variety of surveillance scenarios. The approach may find application from high security surveillance scenes such as premises of bank vaults, prisons or other detention facilities; to low cost applications in supermarkets and car parking lots.

Keywords: Kalman Filter, Stereo Vision, Motion Tracking, Matlab, Object Tracking, Camera Calibration, Computer Vision System Toolbox.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1099112

References:

[1] Benjamin C. Kuo, Automatic Control Systems, 3rd edition, New Jersey: Prentice Hall, Inc., 2007, pp. 588-594.
[2] Simon S. Haykin, Neural Networks: A Comprehensive Foundation, 3rd ed., Pearson Education Asia, 1999, pp. 762-765.
[3] R. C. Gonzalez, R. E. Woods, S. L Eddins, Digital image Processing using Matlab: Pearson Education, 2004, (Chap 10)pp. 379 407, (Chap 12) pp. 484 498.
[4] R. Jain, R. Kasturi, B. G. Schunck, Machine Vision, Singapore: McGraw-Hill Book Co., 1995, (Chap -15) pp. 459 481, (Chap -11) pp. 289 305, (Chap -12) pp. 309 357.
[5] www.vision.caltech.edu/bouguetj/calib doc/htmls/parameters.html (as of 21-07-13).
[6] stemkoski.github.io/Three.js/ (as of 21-07-13).
[7] www.mathworks.in/help/vision/ref/assigndetectionstotracks.html (as of 21-07-13).
[8] www.mathworks.in/help/matlab/ref/avifile.html (as of 21-07-13).
[9] www.mathworks.in/help/imaq/controlling-logging-parameters.html (as of 21-07-13).
[10] www.mathworks.in/help/vision/ref/epipolarline.html (as of 21-07-13).
[11] G. Welch, G. Bishop, An Introduction to the Kalman Filter, University of North Carolina at Chapel Hill, ACM :1995.