Hybrid Error Concealment Method Based on H.264 Standard for Wireless Transmission

Hybrid error concealment method based on H.264 standard for wireless transmission

Project proposal for EE 5359 Multimedia processing, Fall 2010.

Dr. K.R. Rao

SadafAhamed,ID 1000694336,

Objective:

The objective is to implement spatial and temporal error concealment techniques on H.264 [2] using JM 17.2 and also to compare them on the basis of computational complexity and image quality.The aim is also to implement hybrid error concealment and to obtain the output with remarkably improved subjective quality of the reconstructed video. Hence quality of reconstruction, typically peak signal to noise ratio (PSNR), mean square error (MSE) and structural similarity index metric (SSIM) are used and evaluated.

Problem:

Transmission of hybrid-coded video over error-prone channels such as wireless networks and the Internet mayresult in the packet losses or errors at the decoder. Decoding errors caused by macro blocks will propagate in both thetemporal and spatial domains and will substantially degradethe video quality.[1]

Error Concealment:

Spatial Error Concealment:

The spatial-domain concealment algorithms interpolatethe missing blocks using decoded information from spatially surrounding image data i.e, interpolating the pixels of the defected part of the video image from the pixels within thesurrounding area.

Temporal Error Concealment:

The damaged image is replaced with the macroblock in the reference frame specified by the motion vector of the damaged macroblock.i.e, the pixels of the missing parts of the image can be copied from thepreviously decoded neighboring frames.

Hybrid Error Concealment:

Finally, hybrid error concealment method for H.264[2]compressed video is presented in this paroject. Themethod can adequately exploit the spatial and temporal relativities of video sequence to adaptivelyselect the spatial concealment or temporal concealment according to the boundary matchcriterion. [2]

Project Plan:

Sept 28-Oct 8 : JM software implementation.

Oct 11-Oct 15: Analysis on the types of spatial and temporal error concealment techniques.

Oct 18-Oct 28: Implementation of temporal error concealment.

Nov 1-Nov 8: Implementation of spatial error concealment.

Nov 9-Nov 20: Implementation of hybrid error concealment.

Nov 21-Nov 25: Comparison of the above.

References:

[1] H.Zhi-hua and Y.Ben-shun, “A new temporal error concealment algorithm for H.264 using motion strength of neighboring area”, Conference on Education Technology and Computer Science, Vol. 1,pp. 569-572, Mar 2009.

[2] I.Richardson, ”The H.464 advanced video compression standard”, Wiley publications,2010.

[3] X.Xiu., L.Zhuo and L.Shen, “A hybrid error concealment method based on H.264 standard”, International conference on signal processing, Vol 2,Apr 2007.

[4] S. K. Bandyopadhyay, Z. Wu, P. Pandit and J. M. Boyce, “An error concealment scheme for entire frame losses for H.264/AVC”, Proc. IEEE Sarnoff Symposium, Mar. 2006.

[5] L. Liu, S. Zhang, X. Ye and Y. Zhang, “Error resilience schemes of H.264/AVC for 3G conversational video”, Proc. IEEE CIT, pp. 657- 661, Sept. 2005.

[6] S.Kumar, L.Xu , M. K. Mandal, and S. Panchanathan, ” Error resiliency schemes in H.264/AVC standard,” J. Visual Communication and Image Representation, vol. 17, pp. 425-450, April 2006.

[7] S. Wenger, “H.264/AVC over IP” IEEE Trans. Circuits and Systems for Video Technology, vol. 13, pp. 645-656, July 2003, (under review).

[8] J.Panyavarapom and S.Aramvith, “An error resilient framework using one-pass explicit FMO map generation and error concealment for H.264/AVC wireless video communication”, Journal of electronic imaging.

[9] T. Wiegand, et al, “Overview of the H.264/AVC Video Coding Standard” IEEE Trans.

Circuits and Systems for Video Technology, vol. 13, pp. 560-576, June 2003.

[10] R. Schafer, T. Wiegand, and H. Schwarz,”The emerging H.264/AVC standard,” EBUTechnical Review, Special Issue on Best of 2003, Dec. 2003.

[11] M. M. Ghandi and M. Ghanbari, “Layered H.264 video transmission with hierarchical

QAM” Electronic Systems Engineering Department, University of Essex, UK available in:

http://privatewww.essex.ac.uk/.