A New H.264-Based Rate Control Algorithm for Stereoscopic Video Coding

Authors: Yi Liao, Wencheng Yang, Gangyi Jiang

Abstract:

According to investigating impact of complexity of stereoscopic frame pairs on stereoscopic video coding and transmission, a new rate control algorithm is presented. The proposed rate control algorithm is performed on three levels: stereoscopic group of pictures (SGOP) level, stereoscopic frame (SFrame) level and frame level. A temporal-spatial frame complexity model is firstly established, in the bits allocation stage, the frame complexity, position significance and reference property between the left and right frames are taken into account. Meanwhile, the target buffer is set according to the frame complexity. Experimental results show that the proposed method can efficiently control the bitrates, and it outperforms the fixed quantization parameter method from the rate distortion perspective, and average PSNR gain between rate-distortion curves (BDPSNR) is 0.21dB.

Keywords: Stereoscopic video coding, rate control, stereoscopic group of pictures, complexity of stereoscopic frame pairs.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1087073

References:

[1] P. Surman, “Stereoscopic and Autostereoscopic Displays,” 3D-TV system with depth-image-based rendering, Springer New York, pp.375-411, 2013.
[2] A. Aggoun, E. Tsekleves, D. Zarpalas, A.Dimou, P. Daras, P. Nunes, and L. Soares, “Immersive 3D holoscopic video system,” IEEE Trans. MultiMedia, vol.20, no.1, pp.28-37, 2013.
[3] Z. Zhu, F. Liang, G. Jiang, and Q. Zhang, “Bit allocation and rate control for stereoscopic video coding,” in Proc. of 3DTV Conf., Kos, Island, 2007, pp.1-4.
[4] S. Lu, J. Sun, and J. Wang, “Multiview video rate control scheme based on human stereo visual feature,” Journal of Image and Graphics, vol.14, no.11, pp. 2396-2400, 2009.
[5] F. Shao, G. Jiang, X. Wang, M. Yu, and K. Chen, “Stereoscopic video coding with asymmetric luminance and chrominance qualities,” IEEE Trans. Consumer Electronics, vol.54, no.6, pp.2460-2468, 2010.
[6] F. Shao, G. Jiang, M. Yu, Q. Zheng, and K. Chen, “A novel rate control technique for asymmetric-quality stereoscopic video,” IEEE Trans. Consumer Electronics, vol.57, no.4, pp.1823-1829, 2011.
[7] Y. Liu, G. Peng, Y. Hu, S. Ci, and H. Tang, “A multi-pass VBR rate control method for video plus depth based mobile 3D video coding,” Advances in Multimedia Information Proc.-PCM 2010, Springer Berlin Heidelberg, pp.156-166, 2011.
[8] Q. Wang, L. Zhuo, J. Zhang, and X. Li, “Frame layer rate control method for stereoscopic video coding based on a novel rate-distortion model,” The Era of Interactive Media, Springer New York, pp. 205-216, 2013.
[9] S. Park and D. Sim, “An efficient rate control algorithm for multi-view video coding,” The 13th IEEE International Sym. Consumer Electronics (ISCE), kyoto, Janpan, 2009, pp.115-118.
[10] Y. Liu, Q. Huang, S. Ma, D. Zhao, and W. Gao, “A novel rate control technique for multi-view video plus depth based 3D video coding,” IEEE Trans. on Broadcasting, vol. no. 2, pp. 562-571, 2011.
[11] Q. Zheng, M. Yu, G. Jiang, F. Shao, and Z. Peng, “Rate control for multi-View video coding based on statistical analysis and frame complexity estimation,” International Conf. Computer, Informatics, Cybernetics and Applications, Hangzhou, China, 2011, pp.1089-1097.
[12] S. Li, M .Yu, G. Jiang, T. Choi, Y. Kim, and Y. Deak, “Approaches to H.264-Based stereoscopic video coding,” 2004 IEEE First Sym. Multi-Agent Security and Survivability, Hongkong, 2004, pp.365-368.
[13] ISO/IEC JTC1/SC29/WG11 and ITU-T SG16/Q.6, “Adaptive basic unit layer rate control for JVT,” Doc. JVT-G012r1, Pattaya, Thailand, 2003, pp.23-27.
[14] G. Bjontegard, “Calculation of average PSNR differences between RD-curves,” VCEG-M33, the 13th VCEG Meeting, Austin, Texas, USA, 2001.