Identifying Blind Spots in a Stereo View for Early Decisions in SI for Fusion based DMVC

Authors: H. Ali, K. Hameed, N. Khan

Abstract:

In DMVC, we have more than one options of sources available for construction of side information. The newer techniques make use of both the techniques simultaneously by constructing a bitmask that determines the source of every block or pixel of the side information. A lot of computation is done to determine each bit in the bitmask. In this paper, we have tried to define areas that can only be well predicted by temporal interpolation and not by multiview interpolation or synthesis. We predict that all such areas that are not covered by two cameras cannot be appropriately predicted by multiview synthesis and if we can identify such areas in the first place, we don-t need to go through the script of computations for all the pixels that lie in those areas. Moreover, this paper also defines a technique based on KLT to mark the above mentioned areas before any other processing is done on the side view.

Keywords: Side Information, Distributed Multiview Video Coding, Fusion, Early Decision.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1056579

References:

[1] Girod, B.; Aaron, A.M.; Rane, S.; Rebollo-Monedero, D., "Distributed Video Coding," Proceedings of the IEEE , vol.93, no.1, pp.71-83, Jan. 2005
[2] Guol, X.; Lu, Y.; Wu, X.; Gao, W.; and Li, S. "Distributed Multi-View Video Coding," Proc. SPIE, Jan. 2006, Vol. 6077, 60770T (2006); DOI:10.1117/12.642989
[3] Ouaret, M.; Dufaux, F.; Ebrahimi, R., "Fusion-based multiview distributed video coding," Proceedings of the 4th ACM international workshop on Video surveillance and sensor networks, October, 2006, Santa Barbara, California, USA DOI:10.1145/1178782.1178803, 2006
[4] http://en.wikipedia.org/wiki/Epipolar_geometry, "Epipolar geometry," Wikipedia.
[5] Dufaux, F. and Konrad, J. "Efficient, Robust, and Fast Global Motion Estimation for Video Coding," IEEE transactions on image processing, vol. 9, no.3, March 2000.
[6] Jianbo Shi; Tomasi, C., "Good features to track," Computer Vision and Pattern Recognition, 1994. Proceedings CVPR '94., 1994 IEEE Computer Society Conference on , vol., no., pp.593-600, 21-23 Jun 1994
[7] Tommasini, T.; Fusiello, A.; Trucco, E.; Roberto, V., "Making good features track better," Computer Vision and Pattern Recognition, 1998. Proceedings. 1998 IEEE Computer Society Conference on , vol., no., pp.178-183, 23-25 Jun 1998
[8] Singh, M.; Mandal, M.; Basu, A., "Robust KLT tracking with Gaussian and Laplacian of Gaussian weighting functions," Pattern Recognition, 2004. ICPR 2004. Proceedings of the 17th International Conference on , vol.4, no., pp. 661-664 Vol.4, 23-26 Aug. 2004
[9] K. Wojciechowski, B. Smolka, H. Palus, R.S. Kozera, W. Skarbek and L. Noakes, "A voting strategy for high speed stereo matching." Computer Vision and Graphics International Conference, ICCVG 2004, Warsaw, Poland, September 2004, Proceedings, 10.1007/1-4020-4179-9_27, 2004
[10] Kolmogorov, V.; Zabih, R., "Computing visual correspondence with occlusions using graph cuts ," Computer Vision, 2001. ICCV 2001. Proceedings. Eighth IEEE International Conference on , vol.2, no., pp.508-515 vol.2, 2001
[11] Ikeuchi, K., "Constructing A Depth Map from Images," Massachusetts Institute of Technology, A. I. Memo No. 744. 1983
[12] Torr, P.H.S, Murray, D.W., "The development and comparison of robust methods for estimating the fundamental matrix," International Journal of Computer Vision 24(3), 271-300, 1997
[13] Shungang Hua; Jing Zhang; Zongying Ou, "Novel view generation from two reference images based on the same optical axis," Computer and Information Technology, 2004. CIT '04. The Fourth International Conference, pp. 801-806, 14-16 Sept. 2004.