Effective Image and Video Error Concealment using RST-Invariant Partial Patch Matching Model and Exemplar-based Inpainting

Authors: Shiraz Ahmad, Zhe-Ming Lu

Abstract:

An effective visual error concealment method has been presented by employing a robust rotation, scale, and translation (RST) invariant partial patch matching model (RSTI-PPMM) and exemplar-based inpainting. While the proposed robust and inherently feature-enhanced texture synthesis approach ensures the generation of excellent and perceptually plausible visual error concealment results, the outlier pruning property guarantees the significant quality improvements, both quantitatively and qualitatively. No intermediate user-interaction is required for the pre-segmented media and the presented method follows a bootstrapping approach for an automatic visual loss recovery and the image and video error concealment.

Keywords: Exemplar-based image and video inpainting, outlierpruning, RST-invariant partial patch matching model (RSTI-PPMM), visual error concealment.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1079044

References:

[1] S. Lin, D. J. Costello, and M. J. Miller, "Automatic repeat request error control schemes," IEEE Communication Magazine, vol. 22, no. 12, pp. 5-17, 1984.
[2] B. Girod and N. Farber, "Feedback-based error control for mobile video transmission," Proc. IEEE, vol. 87, no. 10, pp. 1707-1717, 1999.
[3] J. Hagenauer and T. Stockhammer, "Channel coding and transmission aspects for wireless multimedia," Proc. IEEE, vol. 87, no. 10, pp. 1764- 1777, 1999.
[4] S. B. Wicker, Error control systems for digital communication and storage, Upper Saddle River, NJ: Prentice-Hall, 1995, ch. 15.
[5] V. K. Goyal, "Multiple description coding: compression meets the network," IEEE Signal Processing Magazine, vol. 18, no. 5, pp.74-93, Sept.2001.
[6] B.W. Wah, X. Su, and D. Lin, "A survey of error-concealment schemes for real-time audio and video transmission over the internet," in Proc. IEEE Int. Symp. Microelectronic Systems Education, Taipei, Taiwan, 2000, pp. 17-24.
[7] P. Cuenca, L. Orozco-Barbosa, A. Garrido, F. Quiles, and T. Olivares, "A survey of error concealment schemes for MPEG-2 video communications over ATM Network," in Proc. IEEE Canadian Conf. Electrical and Computer Engineering, St John-s, NF, Canada, 1997, vol. 1, pp. 118-121.
[8] M. Bystrom, V. Parthasarathy, and J. W. Modestino, "Hybrid error concealment schemes for broadcast video transmission over ATM networks," IEEE Trans. Circuits, Syst. and Video Tech., vol. 9, no. 6, pp. 868-881, Sept. 1999.
[9] A. A. Efros and T. K. Leung, "Texture synthesis by non-parametric sampling," in Proc. 7th Int. Conf. Computer Vision, Kerkyra, Corfu, Greece, 1999, pp. 1033-1038.
[10] A. Criminisi, P. Perez, and K. Toyama, "Region filling and object removal by exemplar-based inpainting," IEEE Trans. Image Processing, vol. 13, no. 9, pp. 1200-1212, Sept. 2004.
[11] OV: The open video project - a shared digital video collection. Available: http://www.open-video.org