用户名: 密码: 验证码:
基于数据嵌入的时域误码掩盖算法
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
随着技术的发展,多媒体通信正逐步成为通信网络的主要业务。多媒体通信,如会议电视、可视电话、图像和视频检索等,其中主要的是图像和视频媒体。视频通信的数据往往是压缩编码以后的数据。当编码视频流在Internet上传输时,很容易受到信道错误的影响而丢失数据,并且误码在接收端解码时会引起扩散,使重建图像的质量在不同程度上受到该误码的影响。这主要是由于压缩编码去掉了视频图像内大量的空间和时间相关性,从而造成压缩后的图像对信道误码十分敏感,即易受到信道误码的影响。
     为了减少由于信道误码引起的图像失真,人们正进行着种种努力。其中,基于解码的或者和编码相结合的多种误码掩盖方法近年来引起了人们的注意。这种方法是对已发生错误的一种弥补,因而是一类比较独立的、对改进误码图像的观赏质量有很大作用的、简单易行的方法。
     本文提出了一种基于数据嵌入的误码掩盖方法。该方法在新一代视频编码标准—H.264上结合编码端和解码端对受损图像进行数据恢复,即在编码端中提取出一些比较重要的数据,对其进行嵌入传输。在解码端处将其提取出来,根据嵌入的信息,对搜索到的丢失宏块进行弥补,恢复图像的视觉效果。
     该方法与H.264的参考软件所应用的时域误码掩盖方法进行性能比较,实验结果表明,使用该嵌入方法,通过对PSNR的比较,达到了预期目的。
As the emerging of 3-G mobile communication system and booming of IP-based network, video communication wins great importance and prosperous future in multimedia services network today. Some successful applications have been very popular, such as multimedia email, interactive multimedia and e-commerce etc. At the same time, the error will come into being in the wireless channel or IP channel. Because of the limit in bandwidth of channel, data of video communication is always the one which has be compressed and coded, based on that, the data is so tender that the quality of picture will be worsen in error environment. In one word, reduction of raw video data rates is one of the key problems in wireless and grouping video communication.
     For effective video communication, there are two ways to avoid or recover the transmitting error. One is use of the error control and data recover in traditional data communication, such as FEC, ARQ and so on; its intention is to transmit data with no error. The other is that errors recover, such as signal reconstruction and error concealment, whose aim is to recover corrupted picture vividly.
     Because of the characters of human eyes, people can abide some distortion of picture or video. Based on that, corrupted picture can be recovered appropriately when video bit stream have the error, Toward the recover, it is not recovered accurately, but only conceals the picture, which will look like a whole picture. So it has the applicability in practice. For the reasons, error concealment has become to the main method in the domain of video communication. For decreasing the picture distortion owing to channel error, people attempt the whole bag of tricks. Nowadays, the technique based on encode, decode or combining of encode and decode has attracted people's attention.
     This paper describes the necessity and the challenges of error control for video communications, and provides an overview of various approaches that have been developed for in the current international video coding standard H.264. We emphasize the advanced coding features presented in H.264, such as multi-shape motion compensation block size, multiple reference frame prediction, fractional pixel motion compensation accuracy and context based entropy coding methods.
     To cope with the problem of packet loss probability and visual degradation, H.264 introduces slice-structured coding, which provides spatially-distinct resynchronization points within the video data for a single frame. A more advanced and generalized concept is provided by Flexible macroblocks ordering, which has been introduced to have the possibility to transmit macroblocks in non-scan order. This flexibility allows the definition of different patterns including slice interleaving without interrupting the inter macroblocks prediction for motion vector prediction and entropy concealment. A third error resilience concept included in H.264 is data partitioning, which can also reduce visual artifacts resulting from packet losses, especially if prioritization or unequal error protection is provided by the network. All these error resilience features in H.264 video coding standard can greatly provide more robust error resilient capabilities and keep compliance with original standard syntax.
     After a general analysis of the current situation of error resilience techniques in video coding, more words focus on the error concealments in the decoder. Generally speaking, the paper describes two aspects, one is the conventional error concealment, including spatial-domain, temporal-domain, frequency-domain; and the other is the up to date one. Nowadays, a lot of new technology turns up, this can be used in the video domain excellently, such as watermark. Based on that, people are thinking of error concealment making use of encoder and decoder.
     Based on the research above, this paper proposes an algorithm to enhance the robustness of constructed video in error prone channel. The algorithm is the error concealment based on data embedding, which, based on the new video standard-H.264, by the methods, the decrease between the same macroblocks of frames near by will be embedded in transform coefficients. Then in the decoder, when the program has searched the lost macroblocks, the embedded data is extracted from video, we use the information to find out the best block for concealing corrupted picture.
     The paper suggests two embedding methods, the one is embedded by the odd-even embedding; the other is embedded by fixed points embedding. The result shows that, compared with the algorithm in test model JM72, the two methods have the more cost in transmitting channel, and the PSNR also reduces in encoder. But compared with odd-even method with the least 0.10 dB, the other makes the less decrease: the least is only 0.01 dB, for the reasons, we ignore the PSNR reducing. Towards the PSNR in the decoder, two methods have the same results more or less, but the second method makes the less embedding cost. In one word, the method of embedded by fixed points embedding has the better effect.
     In conclusion, the proposed temporal error concealment algorithm has the effective improvement on error concealment. Besides, the performance is even superior using proposed algorithm as the QP or acuity-motion is increasing.
引文
[1]H.Gharavi,et al,"Multipriority video transmission for third generation wireless communication systems,"Proc.IEEE.1999,87:1751-1763.
    [2]"Draft ITU-T recommendation and final draft international standard of joint video specification(ITU-T Rec.H.264/ISO/IEC 14 496-10 AVC," in Joint Video Team(JVT)of ISO/IEC MPEG and ITU-T VCEG,JVTG050,2003.
    [3]T.Wiegand,H.Schwarz,A.Joch,F.Kossentini,and G.J.Sullivan,"Rate-constrained coder control and comparison of video coding standards," IEEE Trans.Circuits Syst.Video Technol,vol.13,pp.688-703,July 2003.
    [4]"Video Coding for Low Bitrate Communication,Version 1," ITU-T,ITU-T Recommendation H.263,1995.
    [5]K.Stuhlmuller,et al,"Analysis of video transmission over lossy channels,IEEE Jorunal on Selected Areas in Communications,"2000(6):996-1011.
    [6]J.Feng,K.T.Lo,H.Mehrpour,and A.E.Karbowiak,"Cell loss concealment method for MPEG video in ATM networks," in Proc IEEE Global Telecommunications Conference,vol.3,pp.1925-1929,Nov.1995.
    [7]S.Tsekeridou and I.Pitas,"MPEG-2 error concealment based on block searching principles," IEEE Trans.Circuits and Syst.Video technology,vol.10,no.4,pp.646-658,Jun.2000.
    [8]W.M.Lam,A.R.Reibman,and B.Liu,"Recovery of lost or erroneously received motion vectors," in Proc.ICASSP'93,pp.V417-V420,Apr.1993.
    [9]楼剑等.“H.264标准的特点及其改进研究,”电视技术 2003.6,13-15.
    [10]王嵩等.“H.264视频编码新标准及性能分析,”电视技术 2003.6,25-27.
    [11]Geneva,"Joint Video Team(JVT)of ISO/IEC MPEG and ITU-T VCEG.Working Draft Number 2,Revision 2(WD-2)," January 29-February 1,2002.
    [12]ITU-T Rec,H.264 ISO/TEC 14496-10 AVC.Draft Text of Final Draft International Standard(FDIS)of Joint Video Specification.Pattaya Meeting of the JVT,Match,2003
    [13]张志伟,向健勇,朱学涛.“视频压缩新标准H.264的新特点,”电子科技 2004.8,49-51.
    [14]周祥平,王嵩.“新标准H.264的核心技术与应用前景,”中国有线电视 2004.15,55-61.
    [15]成运,戴葵,王志英.“H.2641帧间多种块模式的编码性能分析与研究,”计算机工程与应用 2005.5,33-36.
    [16]T.Wiegand(editor),"Joint Final Committee Draft(JFCD)of Joint Video Specification (ITU-T Rec.H.264 |ISO/IEC 14496-10 AVC)," Joint Video Team(JVT)of ISO/IEC MPEG and ITU-T VCEG,July 2002.
    [17]J.Ribas-Corbera and S.Lei,"Rate control in DCT video coding for low delay communications," IEEE Trans.Circuits Syst.Video Technol.,vol.9,no.1,pp.172-185,Feb.1999.
    [18]W-MLam,A Reibman."An error concealment algorithm for images subject to channel errors,"[J].IEEE Trans.Image Processing,1995:533-542.
    [19]G.S.Yu,M.M.K.Liu,and M.W.Marcellin,"POCS-based error concealment for packet video using multiframe overlap information,"IEEE Trans.Circuits Syst.Video Technol.,vol.10,no.4,Jun.2000.
    [20]Y.Wang and Q.F.Zhu,"Error control and concealment for video communication:A review," International Conference on Image Processing,Vol.2,pp.974—997,May 1998.
    [21]J.W.Park,J.W.Kim and S.U.Lee,"DCT coefficients recovery-based error concealment technique and its application to MPEG-2 Bit stream error," IEEE Transactions on Circuits and Systems for Video Technology,Vol.7,pp.845—854,December 1997.
    [22]Y.Wang,Q.F.Zhu and L.Shaw,"Maximally smooth image recovery in transform coding," IEEE Tractions on Communications,Vol.41,pp.1544—1551,October 1993.
    [23]S.Tsekeridou and I.Pitas,"MPEG-2 error concealment based on block-matching principles," IEEE Transactions on Circuits and Systems for Video Technology,Vol.10,pp.646—58,June 2000.
    [24]S.Shirani,F.Kossentini,and R.Ward,"A concealment method for video communications in an error-prone environment," IEEE Journal on Selected Areas in Communication,Vol.18,pp.1122—1128,June 2000.
    [25]Yanling Xu and Yuanhua Zhou,"Refined Video Error Concealment over Wireless IP Network,"
    [26]D.S.Turaga and T.Chert,"Model-based error concealment for wireless video," IEEE Transactions on Circuits and Systems for Video Technology,Vol.12,pp.483—496,June 2002.
    [27]宋彬,常义林,“一种新颖实用的交互式视频抗误码方法[J]1,”电子学报,2003,31(4):80283.
    [28]宋彬,常义林,“基于主观质量控制的数字视频综合抗误码技术[J]1,”电子学报.2001.29(7):9522959.
    [29]Lehtoranta,O,Hamalainen,T.D,"Complexity analysis of spatially scalable MPEG-4encoder," System-on-Chip,2003.Proceeding.International Symposium on,19-21 Nov.2003,Page:57-60
    [30]Bo Yah,and Kam Wing Ng,"A Novel Selective Motion Vector Matching Algorithm for Error Concealment in MPEG-4 Video Transmission over Error-Prone Channels," IEEE Transactions on Consumer Electronics,Vol.49,No.4,NOVEMBER 2003,pp.1416-1423.
    [31]F.Zhu,"Device and method of signal loss recovery for real-time and/or interactive communications," US Patent 5550847.1996.8.
    [32]Jae-Young Pyun,Jun-Suk Lee,Jin-Woo Jeong,Jae-Hwan Jeong,and Sung-Jea Ko,"Robust error concealment for visual communications in burst-packet-loss networks,"IEEE Transactions on Consumer Electronics,Vol.49,No.4,NOVEMBER 2003,pp.1013-1019.
    [33]Jae-Young Pyun,Jun-Suk Lee,Jin-Woo Jeong,Jae-Hwan Jeong,and Sung-Jea Ko,"A Burst Error Concealment Technique for Visual Communications in a Mobile Environment," Consumer Electronics,2003.ICCE.2003 IEEE International Conference on,17-19 June 2003,pp.18-19.
    [34]Y.Wang and Q.F.Zhu,"Error control and concealment for video communication:a review," in Proc.IEEE,vol.86,pp.974-997,May.1998.
    [35]Y.Wang,Q.F.Zhu,and L.Shaw,"Maximally smooth image recovery n transform coding," IEEE Trans.Communications,vol.41,no.10,pp.544-1551,Oct.1993.
    [36]H.Sun and W.Kwok,"Concealment of damaged block transform coded mages using projections onto convex sets," IEEE Trans.Image rocessing,vol.4,pp.470-477,Apr.1995.
    [37]S.Valente,C.Dufour,F.Groliere,and D.Snook,"An efficient errorconcealment implementation for MPEG-4 video streams," IEEE Trans.Consumer Electron.,vol.47,no.3,pp.568-578,Aug.2001.
    [38]A.Vetro,H.Sun,Y.Chen,and S.Kung,"True Motion Vectors for robust Video Transmission," in Proc.of SPIE Visual Communications and Image Processing,pp.230-240,Jan.1999.
    [39]ITU-T/SG-15 Video Coding Experts Group,Video codec test model,TMN8,1997.
    [40]W.M.Lain,A.R.Reibman,and B.Liu,"Recovery of lost or erroneously received motion vectors," in Proc.ICASSP'93,pp.V417-V420,Apr.1993.
    [41]Jinghong Zheng,Lap-Pui Chau,"A temporal error concealment algorithm for H.264using Lagrange interpolation," ISCAS2004.
    [42]安维嵘,张旭东,“一种适用于H.264的时域误码掩盖改进算法[J].”中国图像图形学报,2004,9(9)
    [43]周睿,崔慧娟,唐昆.“高效的H.264时域误码掩盖方法[J].”清华大学学报,2005,45(7).
    [44]Jinghong Zheng,Lap-Pui Chau."A temporal error concealment algorithm for H.264based on plane estimation," ICICS-PCM 2003.
    [45]Shahram Shirani,et al."A concealment method for video communications in an error-prone environment[J]." IEEE Journal on Swlected Areas in Communications,2000,18(6):1122-1128.
    [46]Paul Salama,Ness B Shroff,Edward J Delp."Error concealment in MPEG video streams over ATMnetworks[J]." IEEE Journal on Selected Areas in communications,2000,18(6):1129-1144.
    [47]杨开祥,石教英.“数字图像加密与水印技术研究.”2001(7).
    [48]杨成,张鸿宾.“基于数字水印的图像认证技术研究.”2002(7).
    [49]孙燕征,丰举富,石青云.“基于模式的图像数字水印算法”.2002(5).
    [50]杨付正,常义林,王新岱,王静.“基于水印的视频误码掩盖方法[J].”西安电子科技大学学报,2005,32(1).
    [51]Chowdary B.Adsumilli,Mylene C.Q.Farias,Sanjit K.Mitra."A robust error concealment technique using data hiding for image and video transmission over lossy channels," IEEE Trans.Circuits Syst.Video Technol.,vol.15,no.11,Nov.2005.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700