Adaptive Kernel Filtering Used in Video Processing

Authors: Rasmus Engholm, Eva B. Vedel Jensen, Henrik Karstoft

Abstract:

In this paper we present a noise reduction filter for video processing. It is based on the recently proposed two dimensional steering kernel, extended to three dimensions and further augmented to suit the spatial-temporal domain of video processing. Two alternative filters are proposed - the time symmetric kernel and the time asymmetric kernel. The first reduces the noise on single sequences, but to handle the problems at scene shift the asymmetric kernel is introduced. The performance of both are tested on simulated data and on a real video sequence together with the existing steering kernel. The proposed kernels improves the Rooted Mean Squared Error (RMSE) compared to the original steering kernel method on video material.

Keywords: Adaptive image filtering, noise reduction, kernel methods, video processing.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1071007

References:

[1] H. Takeda, S. Farsiu, and P. Milanfar, "Kernel regression for image processing and reconstruction," IEEE Transactions on Image Processing, vol. 16, no. 2, pp. 349-366, 2007.
[2] C. Tomasi and R. Manduchi, "Bilateral filtering for gray and color images," Proc. 6th Int. Conf. Computer Vision, New Delhi, India, pp. 839-846, 1998.
[3] M. Elad, "On the origin of the bilateral filter and ways to improve it," Image Processing, IEEE Transactions on, vol. 11, no. 10, pp. 1141-1151, 2002.
[4] D. Barash, "Fundamental relationship between bilateral filtering, adaptivesmoothing, and the nonlinear diffusion equation," PAMI, IEEE Transactions on, vol. 24, no. 6, pp. 844-847, 2002.
[5] D. Barash and D. Comaniciu, "A common framework for nonlinear diffusion, adaptive smoothing, bilateral filtering and mean shift," Image and Vision Computing, vol. 22, no. 1, pp. 73-81, 2004.
[6] T. Pham and L. van Vliet, "Separable Bilateral Filtering for Fast Video Preprocessing," Multimedia and Expo, 2005. ICME 2005. IEEE International Conference on, pp. 454-457, 2005.
[7] F. Durand and J. Dorsey, "Fast bilateral filtering for the display of highdynamic- range images," Proceedings of the 29th annual conference on Computer graphics and interactive techniques, pp. 257-266, 2002.
[8] S. Paris and F. Durand, "A fast approximation of the bilateral filter using a signal processing approach," Proc. of Eur. Conf. on Comp. Vision, 2006.
[9] S. Fleishman, I. Drori, and D. Cohen-Or, "Bilateral mesh denoising," Int. Conf. on Comp. Graphics and Interactive Techniques, pp. 950-953, 2003.