视频后处理算法研究
|
摘要
随着社会的发展和科技的进步,人类对各类信息的需求越来越多,要求也越来越高。集视频、图像、音频、语音、文字数据等多种媒体为一身的多媒体业务,已经成为人类获取信息的主要方式。在多媒体业务中,视频和图像占据着主导地位。视频后处理模块作为解码器与显示设备的衔接模块,能在实现格式转换的同时方便的实现各种图像处理算法,在改善画面、提升图像观赏质量和视觉效果方面起着重要作用,使得信息能更好的表现给最终接收者。
帧率上转换技术作为一种将视频从一个较低帧率上变换到一个较高帧率的技术,可以在解码端恢复编码端为了降低码率而跳过的视频帧,减小视觉上的停滞感和跳跃感,提供更好的视觉质量。对通过差错信道传输的视频内容,错误掩盖技术在解码端实现了对传输中丢失信息的预测和替代,大大改善最终显示图像的质量。三维电视是近年来兴起的一种能够增强视频观赏体验的新型媒体介质,为视频后处理技术应用研究提供了新的领域。
本文首先介绍了视频编码的主要原理和相关国际标准,然后结合视频后处理主要内容和应用背景,提出了基于H.264标准的解码-后处理的联合模型。在该模型中,解码端为后处理模块提供编码信息。通过对这些编码信息进行分析,从中提取出图像的局部特征,最后利用该局部特征进一步改善后处理性能。本文研究重点是该联合模型下各种后处理算法以及其在三维视频系统中的新应用,主要内容和创新如下:
研究帧率上转换算法,分析帧率上转换技术中的解码器运动矢量的判定和校正以及中间帧运动矢量的估计等问题,提出了一种时空域结合的基于解码运动矢量的帧率上转换算法。该算法在利用运动矢量相关性的基础上,综合考虑前后两帧中对应块的相似性和所插中间帧的空间连续性,减少了块效应和鬼影效应,对物体边缘实现了较好的保持。
研究错误掩盖算法,分析传统时域错误掩盖算法的不足,提出一种基于多模型的时域错误掩盖算法。该算法根据编码信息自适应的将改进的时域相关性模型与匀速运动模型相结合,表征错误区域的运动。在考虑丢失区域周围邻域的时域相关性的同时,保持相邻帧之间的运动的一致性,从而有效的减少了错误传递,提高了错误掩盖的效果。
针对视频传输中整帧丢失的情况,分析帧恢复技术中运动矢量场估计和丢失帧重建等问题,提出一种基于运动矢量校正的自适应帧恢复算法。该算法通过对参考帧的运动矢量进行修正,从而更好的估计丢失帧的运动矢量场;采用的自适应的重叠块运动补偿算法更好的重建丢失帧。
研究基于深度图像的三维视频系统中,视频后处理算法的应用。针对三维视频的特点,提出了一种基于图像修复的多视点图像产生算法。与传统的关注于深度图像处理的多视点图像的产生算法不同,采用图像修复的技术对映射后的视点图像中空白区域进行填充。
提出了一种三维视频系统中基于深度图像的时域错误掩盖算法。通过利用丢失宏块的深度信息,估计丢失宏块的内部结构,将错误块邻域分割成前景和背景两个邻域,并基于相关邻域对错误块进行时域错误掩盖。
为验证本文所提算法的性能,进行了大量的模拟实验。实验结果表明:利用本文算法处理后的视频图像在视觉效果和峰值信噪比两方面均优于同类算法。
With the development of the society and advancement of technology, the demand of all kinds’information is growing rapidly. The multimedia content which contains different formats, such as video, still image, audio, speech and text are becoming the main medium of information. Among all the formats, video and still image take the dominant role. The module of video post-processing, which acts as an interface between the decoder and display device, is responsible for converting the video format and performing image processing. It plays an important role in improving the image quality and enhancing the viewing experience of the final receiver.
Frame rate up-conversion is a kind of technique that is used to convert the video frame rate from a lower number into a higher one. It can be used in the decoder side to recover the video frames skipped in the encoder for meeting the low bit-rate bandwidth requirement. The converted video is much fluent and provides better visual quality. Error concealment techniques are always implemented at the decoder side in video applications. It can estimate and recover the lost information of the video which is caused by transmission over erroneous channel. The decoded video quality is greatly improved. Meanwhile, three dimension television (3D-TV) as a newly developed medium which can provide an enhancement of the viewing experience is becoming the new research area of video post-processing.
In this dissertation, the main theory and the international standards for video coding is briefly reviewed first. After that, the decoder and post-processor co-architecture based on H.264 standard is proposed, in which the decoder feeds coding information to the post-processor. Based on the coding information, the features of the local image are estimated and can be used to improve the performance of the post-processor. The main research topics of this dissertation are some algorithms under this co-architecture and some new applications in the 3D video system. It can be summarized as follows:
A novel frame rate up-conversion based on spatial and temporal correlation integrated, by using the motion vector from the decoder is proposed. The coding-type information, the spatial correlation in the motion vector field and the temporal correlation in the before and after frames,the spatial correlation in the interpolated frame, and the constant motion velocity model are used together to estimate the motion vectors of the interpolated frame. The algorithm takes the similarity of the related blocks in the before and after frames and the spatial correlation in the interpolated frames into consideration, which greatly decreases the blocking artifacts and ghost effects, and keeps the edge of the object clearly.
A multi-model based temporal error concealment algorithm is proposed. Improved temporal correlation model and constant motion velocity model are adaptively combined according to the coding information of the neighboring area. Then it is used to interpret the motion of the lost area for recovering the motion vector. After that, the lost pixels are concealed by using multiple-hypothesis motion compensation. The temporal correlation of the neighboring area around the lost block and the coherence of the motion in adjacent frames are considered together. It helps to reduce the error propagation and improve the quality of the recovered video.
A motion vector correction based frame recovery algorithm is proposed. The spatial correlation among motion vectors and the pixels’information in the reference frames are used to correct the motion vectors in the reference frame. After that they are used to estimates the motion vector field of the lost frame. Finally, adaptive overlapped block motion compensation is used to reconstruct the lost frame.
An inpainting based multi-view image generation algorithm for 3D video system is proposed. Different from conventional algorithms which focus on the dealing with the depth image, the inpainting is proposed to fill the blank area after the projection.
A depth image based temporal error concealment algorithm for 3D video system is proposed. By considering the depth information of the lost marcoblock, the inner structure of the lost marcoblock is estimated. The foreground area and background area will be separated and concealed respectively.
In order to evaluate the performances of those proposed algorithms, many experiments are done with all sorts of sequences. Experimental results show that the proposed algorithms outperform other techniques in both objective and subjective visual quality.
帧率上转换技术作为一种将视频从一个较低帧率上变换到一个较高帧率的技术,可以在解码端恢复编码端为了降低码率而跳过的视频帧,减小视觉上的停滞感和跳跃感,提供更好的视觉质量。对通过差错信道传输的视频内容,错误掩盖技术在解码端实现了对传输中丢失信息的预测和替代,大大改善最终显示图像的质量。三维电视是近年来兴起的一种能够增强视频观赏体验的新型媒体介质,为视频后处理技术应用研究提供了新的领域。
本文首先介绍了视频编码的主要原理和相关国际标准,然后结合视频后处理主要内容和应用背景,提出了基于H.264标准的解码-后处理的联合模型。在该模型中,解码端为后处理模块提供编码信息。通过对这些编码信息进行分析,从中提取出图像的局部特征,最后利用该局部特征进一步改善后处理性能。本文研究重点是该联合模型下各种后处理算法以及其在三维视频系统中的新应用,主要内容和创新如下:
研究帧率上转换算法,分析帧率上转换技术中的解码器运动矢量的判定和校正以及中间帧运动矢量的估计等问题,提出了一种时空域结合的基于解码运动矢量的帧率上转换算法。该算法在利用运动矢量相关性的基础上,综合考虑前后两帧中对应块的相似性和所插中间帧的空间连续性,减少了块效应和鬼影效应,对物体边缘实现了较好的保持。
研究错误掩盖算法,分析传统时域错误掩盖算法的不足,提出一种基于多模型的时域错误掩盖算法。该算法根据编码信息自适应的将改进的时域相关性模型与匀速运动模型相结合,表征错误区域的运动。在考虑丢失区域周围邻域的时域相关性的同时,保持相邻帧之间的运动的一致性,从而有效的减少了错误传递,提高了错误掩盖的效果。
针对视频传输中整帧丢失的情况,分析帧恢复技术中运动矢量场估计和丢失帧重建等问题,提出一种基于运动矢量校正的自适应帧恢复算法。该算法通过对参考帧的运动矢量进行修正,从而更好的估计丢失帧的运动矢量场;采用的自适应的重叠块运动补偿算法更好的重建丢失帧。
研究基于深度图像的三维视频系统中,视频后处理算法的应用。针对三维视频的特点,提出了一种基于图像修复的多视点图像产生算法。与传统的关注于深度图像处理的多视点图像的产生算法不同,采用图像修复的技术对映射后的视点图像中空白区域进行填充。
提出了一种三维视频系统中基于深度图像的时域错误掩盖算法。通过利用丢失宏块的深度信息,估计丢失宏块的内部结构,将错误块邻域分割成前景和背景两个邻域,并基于相关邻域对错误块进行时域错误掩盖。
为验证本文所提算法的性能,进行了大量的模拟实验。实验结果表明:利用本文算法处理后的视频图像在视觉效果和峰值信噪比两方面均优于同类算法。
With the development of the society and advancement of technology, the demand of all kinds’information is growing rapidly. The multimedia content which contains different formats, such as video, still image, audio, speech and text are becoming the main medium of information. Among all the formats, video and still image take the dominant role. The module of video post-processing, which acts as an interface between the decoder and display device, is responsible for converting the video format and performing image processing. It plays an important role in improving the image quality and enhancing the viewing experience of the final receiver.
Frame rate up-conversion is a kind of technique that is used to convert the video frame rate from a lower number into a higher one. It can be used in the decoder side to recover the video frames skipped in the encoder for meeting the low bit-rate bandwidth requirement. The converted video is much fluent and provides better visual quality. Error concealment techniques are always implemented at the decoder side in video applications. It can estimate and recover the lost information of the video which is caused by transmission over erroneous channel. The decoded video quality is greatly improved. Meanwhile, three dimension television (3D-TV) as a newly developed medium which can provide an enhancement of the viewing experience is becoming the new research area of video post-processing.
In this dissertation, the main theory and the international standards for video coding is briefly reviewed first. After that, the decoder and post-processor co-architecture based on H.264 standard is proposed, in which the decoder feeds coding information to the post-processor. Based on the coding information, the features of the local image are estimated and can be used to improve the performance of the post-processor. The main research topics of this dissertation are some algorithms under this co-architecture and some new applications in the 3D video system. It can be summarized as follows:
A novel frame rate up-conversion based on spatial and temporal correlation integrated, by using the motion vector from the decoder is proposed. The coding-type information, the spatial correlation in the motion vector field and the temporal correlation in the before and after frames,the spatial correlation in the interpolated frame, and the constant motion velocity model are used together to estimate the motion vectors of the interpolated frame. The algorithm takes the similarity of the related blocks in the before and after frames and the spatial correlation in the interpolated frames into consideration, which greatly decreases the blocking artifacts and ghost effects, and keeps the edge of the object clearly.
A multi-model based temporal error concealment algorithm is proposed. Improved temporal correlation model and constant motion velocity model are adaptively combined according to the coding information of the neighboring area. Then it is used to interpret the motion of the lost area for recovering the motion vector. After that, the lost pixels are concealed by using multiple-hypothesis motion compensation. The temporal correlation of the neighboring area around the lost block and the coherence of the motion in adjacent frames are considered together. It helps to reduce the error propagation and improve the quality of the recovered video.
A motion vector correction based frame recovery algorithm is proposed. The spatial correlation among motion vectors and the pixels’information in the reference frames are used to correct the motion vectors in the reference frame. After that they are used to estimates the motion vector field of the lost frame. Finally, adaptive overlapped block motion compensation is used to reconstruct the lost frame.
An inpainting based multi-view image generation algorithm for 3D video system is proposed. Different from conventional algorithms which focus on the dealing with the depth image, the inpainting is proposed to fill the blank area after the projection.
A depth image based temporal error concealment algorithm for 3D video system is proposed. By considering the depth information of the lost marcoblock, the inner structure of the lost marcoblock is estimated. The foreground area and background area will be separated and concealed respectively.
In order to evaluate the performances of those proposed algorithms, many experiments are done with all sorts of sequences. Experimental results show that the proposed algorithms outperform other techniques in both objective and subjective visual quality.
引文
[1] ISO/IEC JTC1/SC29/WG11, MPEG ISO CD 11172-1991 Coding of Moving Pictures an Associated Audio for Digital Storage Media at up to about 1.5Mbit/s. November 1991.
[2] ISO/IEC JTC1/SC29/WG11/13818,Generic coding of moving pictures and associated audio information (MPEG-2), Geneva, Nov. 1994.
[3] ISO/IEC JTC1/SC29/WG11, MPEG-4 Video Verification Model Version 10.0, MPEG98/N1992, San Jose, February 1998.
[4] ISO/IEC JTC1/SC 29/WG11, 14496-2:Information technology– Generic coding of audio-visual objects–Part 2: Visual. MPEG99/N 2688, Seoul, March 1999.
[5] ITU-T, Video codec for audiovisual services at 64 kbits. International Telecommunications Union, Geneva, Switzerland, ITU-T Recommendation H.261, 1993
[6] ITU-T, Draft Recommendation H.263 Video Coding for Narrow Telecommunication Channels at below 64kbit/s. March 1995
[7] ITU Recomdentation H.263, Draft Text of Recommendation H.263 Version 2 (“H.263+”) for Decision, Sep. 1997.
[8] ITU-T Recommendation H.263++ (Video Coding for Low Bitrate Communication), Geneva, Switzerland, 2000.
[9] JVT of ISO/IEC MPEG and ITU-T VCEG,“Draft ITU-T Recommendation and Final Draft International Standard of Joint Video Specification (ITU-T Rec. H.264 | ISO/IEC 14496-10 AVC),”JVT-G050, March 2003.
[10]余松煜,张文军,孙军.现代图像信息压缩技术.北京:科学出版社,1998.11.
[11]余松煜,周源华,吴时光.数字图像处理.北京:电子工业出版社, 1989.
[12] C.E.Shannon. Coding theorems for discrete source with a fidelity criterion. IRE Nat Conv. Record Pt. 4, 1959, 142-164.
[13] A. M. Tekalp,“Digital video processing,”清华大学出版社, 1998.
[14] T. Ebrahimi and A. M. Kunt,“Visual data compression for multimedia applications,”Proc. IEEE, vol. 86, pp. 1109-1125, June 1998.
[15] D. Taubman,“High performance scalable image compression with EBCOT,”IEEE Trans. Image Processing, Vol. 9, pp. 1158–1170, July 2000.
[16] W. A. Pearlman, A. Islam, N. Nagaraj, and A. Said,“Efficient, low-complexity image coding with a set-partitioning embedded block coder,”IEEE Trans. Circuits Syst. Video Technol., vol. 14, pp. 1219–1235, Nov. 2004.
[17] J.-R. Ohm,“Advances in Scalable Video Coding,”Proc. IEEE, vol. 93, pp. 42– 56, Jan. 2005.
[18] S. Knauer,“Real-time video compression algorithm for Hadamard transform processing,”IEEE Transactions on Electromagnetic Compatibility, vol. 18 pp. 28-36, 1976.
[19] J. R. Ohm,“Three-dimensional subband coding with motion compensation,”IEEE Trans. Image Processing, vol. 3, pp. 559–571, Sept. 1994.
[20] ISO/IEC MPEG,“Scalable Video Model 3.0,”Jan 2005.
[21] P. Salembier, L. Torres, F. Meyer, and C. Gu,“Region-based video coding using mathematical morphology,”Proc. IEEE, vol. 83, no. 6, pp. 843–857, Jun. 1995.
[22] J. Ostermann, E. S. Jang, J. S. Shin, and T. Chen,“Coding the arbitrarily shaped video objects in MPEG-4,”in IEEE Int. Conf. Image Processing, Santa Barbara, CA, 1997, pp. 496–499.
[23] M. Karczewicz, J. Niewglowski, and P. Havisto,“Video coding using motion compensation with polynomial motion vector fields,”Signal Process. Image Communication. vol. 10, no. 1–3, pp. 63–91, 1997.
[24] P. Eisert, T. Wiegand, and B. Girod,“Model-aided coding: A new approach to incorporate facial animation into motion-compensated video coding,”IEEE Trans. Circuits Syst. Video Technol., vol. 10, no. 3, pp. 344–358, Apr. 2000.
[25] H. Li and R. Forchheimer,“Two-view facial movement estimation,”IEEE Trans. Circuits Syst. Video Technol., vol. 4, no. 3, pp. 276–287, Jun. 1994.
[26] MPEG-7: Context, Objectives and Technical Roadmap, V.12. , MPEG99/N2861, Vancouver, July 1999.
[27] ISO/IEC JTC1/SC29/WG11/N5231. MPEG-21 Overview v.5, Shanghai, October 2002.
[28] ITU-T SG16,“DRAFT Call for proposals for H.26L video coding,”Feb. 1998.
[29] ISO/IEC,“Requirements for AVC Codec,”ISO/IEC JTC1/SC29/WG11/N4672, Jeju, Korea, March 2002
[30] Gray J.Sullivan and T. Wiegand,“Video Compression-From Concepts to the H.264/AVC Standard,”Proc. IEEE, vol. 93, no. 1, January 2005.
[31] R.Dugad,“A fast scheme for image size change in the compressed domain”, IEEE Trans. Circuits Syst. Video Technol., vol. 11, no. 4, pp. 461–474, Apr. 2001.
[32] G.D.Haan, E.B. Bellers,“Deinterlacing– an Overview”, Proc. Of IEEE, Sep.1998, 86(9): 1839-1857
[33] Choi, B.-D,Han, J.-W, etc.,“Motion-Compensated Frame Interpolation Using Bilateral Motion Estimation and Adaptive Overlapped Block Motion Compensation,”IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 4 pp. 407–416, Apr. 2007.
[34] C.Fehn, P.Kauff, etc,“An Evolutionary and Optimized Approach on 3D-TV,”Proceedings of International Broadcast Conference’02, Amsterdam, The Netherlands, pp. 357-375, 2002.
[35] W. R. Mark, Post-Rendering 3D Image Warping: Visibility, Reconstruction and Performance for Depth-Image Warping, PHD thesis, University of North Carolina at Chapel Hill, 1999.
[36] L. McMillan, An Image-Based Approach on Three Dimensional Computer Graphics, PHD thesis, University of North Carolina at Chapel Hill, 1997.
[37] ITU. ITU-T recommendation P.910--subjective video quality assessment methods for multimedia applications, 1999.
[38]蔡皖东.多媒体通信技术.陕西:西安电子科技大学出版社,2000,10.
[1] A. M. Tekalp,“Digital video processing,”清华大学出版社, 1998.
[2] A. N. Netravali and J. D. Robbins,“Motion adaptive interpolation of television frames,”Proc. Of Picture Coding Symposium, June 1981.
[3] P. Haavisto, J. Juhola, and Y. Neuvo,“Fractional frame rate up-conversion using weighted median filters,”IEEE Trans. Consum. Electron., vol. 35, no. 3, pp. 272–278, Aug. 1989.
[4] R. Castagno, P. Haavisto, and G. Ramponi,“A method for motion adaptive frame rate up-conversion,”IEEE Trans. Circuits Syst. Video Technol., vol. 6, no. 5, pp. 436–446, Oct. 1996.
[5] S.-H. Lee, Y.-C. Shin, S.-J. Yang, H.-H. Moon, and R.-H. Park,“Adaptive MC interpolation for frame rate up-conversion,”IEEE Trans. Consum. Electron., vol. 48, no. 3, pp. 444–450, Aug. 2002.
[6] Y.-K. Chen and S. Y. Kung,“Rate optimization by true motion estimation,”in Proc. IEEE Workshop Multimedia Signal Process., Jun. 1997, pp. 187–194.
[7] C.-C. Cheng, W.-L. Hwang, Z. Shen, and T. Xia,“Advanced motion compensation techniques for blocking artifacts reduction in 3-D video coding systems,”in Proc. ICIP, Sep. 2005, vol. 3, pp. 89–92.
[8] G. de Haan, P. W. Biezen, H. Huijgen, and O. A. Ojo,“True-motion estimationwith 3-D recursive search block matching,”IEEE Trans. Circuits Syst. Video Technol., vol. 3, no. 5, pp. 368–379, Oct. 1993.
[9] R. J. Schutten and G. D. Haan,“Real-time 2–3 pull-down elimination applying motion estimation/compensation in a programmable device,”IEEE Trans. Consum.Electron., vol. 44, no. 3, pp. 501–504, Aug. 1998.
[10] B.-W. Jeon, G.-I. Lee, S.-H. Lee, and R.-H. Park,“Coarse-to-fine frame interpolation for frame rate up-conversion using pyramid structure,”IEEE Trans. Consum. Electron., vol. 49, no. 3, pp. 499–508, Aug. 2003.
[11] T. Ha, S. Lee, and J. Kim,“Motion compensated frame interpolation by new block-based motion estimation algorithm,”IEEE Trans. on Consumer Electronics, vol.50, No. 2, pp. 752-759, May. 2004.
[12] B.D.Choi, J.W.Han, etc.“Motion Compensated Frame Interpolation Using Bilateral Motion Estimation and Adaptive Overlapped Block Motion Compensation,”IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 4, pp. 407–416, Apr. 2007.
[13] T.Y. Kuo and C.-C.J.Kuo,“Motion-compensated interpolation for low-bit-rate video quality enhancement,”Proc. SPIE Vis. Commun. Image Process, vol. 3460, pp. 277-288, Jul. 1998
[14] Y.-K. Chen, A. Vetro, H. Sun, and S. Y. Kung,“Frame-rate up-conversion using transmitted true motion vectors,”in Proc. IEEE Workshop Multimedia Signal Process., Dec. 1998, vol. 2, pp. 622–627.
[15] K. Hilman, H.-W. Park, and Y.-M. Kim,“Using motion compensated frame-rate conversion for the correction of 3:2 pulldown artifacts in video sequences,”IEEE Trans. Circuits Syst. Video Technol., vol. 10, no. 6, pp. 896–877, Sep. 2000.
[16] S. Liu, J.W. Kim, and C.-C. Jay Kuo,“MCI-embedded motion compensated prediction for quality enhancement of frame interpolation,”Proc. of SPIE International Symposium on Voice, Video, and Data Communications, Multimedia Systems and Applications III, Boston, MA, Nov. 2000.
[17] S. Liu, J.W.Kim, and C.-C. Jay Kuo,“Non-linear motion-compensated interpolation for low bit rate video”, Proc. Of SPIE International Symposium on Optical Science, Engineering, and Instrumentation, Applications of Digital Image Processing XXIII, San Diego, CA, July, 2000.
[18] S. Liu, J.W. Kim, and C.-C. Jay Kuo,“Hybrid global/local motion-compensated frame interpolation with segmentation for low bit-rate video”, Journal of Visual Commun. and Image Representation, vol. 14, No. 1, pp. 61-79, March 2003.
[19] Tieyan Liu, Kwok-Tung Lo, Jian Feng and Xudong Zhang,“Frame interpolationscheme using inertia motion interpolation”, Proc. of Signal Processing:Image Communication, vol.18, pp221-229, March 2003.
[20] G. Dane and T. Q. Nguyen,“Motion vector processing for frame rate up conversion,”Proc. of IEEE International Conference on Acoustics, Speech, & Signal Processing, vol. 3, pp. 309-312, May. 2004
[21] H. Sasai, S. Kondo, and S. Kadono,“Frame-rate up-conversion using reliable analysis of transmitted motion information,”Proc. of IEEE International Conference on Acoustics, Speech, & Signal Processing, May 2004.
[22] J.N. Zhang, L.F. Sun, etc.“Position prediction motion-compensated interpolation for frame rate up-conversion using temporal modeling,”Proc. ICIP, vol. 1, pp. 11-14, Sep. 2005,
[23] J.F. Zhai, K. Yu, J. L and S.P. Li,“A low complexity motion compensated frame interpolation method,”Proc. ISCAS, May 23-26, 2005: 4927-4930,
[24] G. Dane and T. Q. Nguyen,“Optimal temporal interpolation filter for motion-compensated frame rate up conversion,”IEEE Trans. on Image Processing, vol5, No. 4, pp. 978-991, May. 2004.
[25] Ai-Mei Huang and T. Nguyen,“Motion vector processing based on residual energy information for motion compensated frame interpolation,”Proc. ICIP, vol. 8, pp. 2721-2724, Oct. 2006
[26] Ai-Mei Huang and T. Nguyen,“A Novel Multi-Stage Motion Vector Processing Method for Motion Compensated Frame Interpolation,”Proc. ICIP, vol. 5, pp. 389-392, Oct. 2007
[27] G. Dane, K.EI-Maieh, and L.Yen-chi,”Encoder-assisted adaptive video frame interpolation,”Proc ICASSP05, vol.2, pp.349-352, Mar.2005
[28] Ya-Ting Yang; Yi-Shin Tung and Ja-Ling Wu,“Quality Enhancement of Frame Rate Up-Converted Video by Adaptive Frame Skip and Reliable Motion Extraction,”IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 12, pp. 1700–1713, Dec. 2000.
[29] M. T. Orchard and G. J. Sullivan,“Overlapped block motion compensation: An estimation-theoretic approach,”IEEE Trans. Image Process., vol. 3, no. 5, pp. 693–699, Sep. 1994.
[30] JVT of ISO/IEC MPEG and ITU-T VCEG,“Draft ITU-T Recommendation and Final Draft International Standard of Joint Video Specification (ITU-T Rec. H.264 | ISO/IEC 14496-10 AVC),”JVT-G050, March 2003.
[1] S.Kaiser, K.Fazel.“Comparison of error concealment techniques for an MPEG-2 video decoder in terrestrial TV-broadcasting,”Signal Processing: Image Communication, 1999, 14, 655-676.
[2] S.Shirani, F.Kossentini, R.Ward.“Error concealment methods, a comparative study”. In Procedings of IEEE Conference on Electrical and Computer Engineering, 1999, 5, 835-840.
[3] Y.Wang, Q.F.Zhu.“Error control and concealment for video communication: a review”. In Procedings of IEEE Multimedia Signal Processing, 1998, 5, 974-997.
[4] E.Asbun, P.Salama, E.J.Delp.“Real-time error concealment in digital video streams using digital signal processors,”IEEE Transactions on Consumer Electronics, 2001, 47(4), 904-909.
[5] D. Agrafiotis, D. R. Bull, and C. N. Canagarajah,“Enhanced error concealment with mode selection”, IEEE Trans. Circuits Syst. Video Technol, vol., 16, no. 8, August 2006.
[6] M.Ghanbari, V.Seferidis.“Cell-loss concealment techniques for all-digital high-definition television system,”IEEE Trans. Circuits Syst. Video Technol, 1993, 3(3), 238-247.
[7] S.Aign, K.Fazel.“Temporal and spatial error concealment techniques for hierarchical MPEG-2 video codec,”In Procedings of IEEE International Conference on Communication, Seattle, 1995, 3, 1778-1783.
[8] M.Y.Cheng, H.Y.Huang, A.W.Su.“A NURBs-based error concealment technique for corrupted images from packet loss,”In Proceedings on International Conference on Image Processing, 2002, 2, 705 -708.
[9] Y.Wang, Q.F.Zhu, L.Shaw.“Maximally smooth image recovery in transform coding,”IEEE Transactions on Communication, 1993, 41 (10), 1544–1551.
[10] W.Kwok, H.Sun.“Multi-directional interpolation for spatial error concealment,”IEEE Transactions on Consumer Electronics, 1993, 39(3), 455-460.
[11] H.Jiang, C.Moloney.“Error concealment using a diffusion based method,”In Proceedings of International Conference on Image Processing, 2002, 1, 832-835.
[12] S.C.Hsia.“An edge-oriented spatial interpolation for consecutive block error concealment,”IEEE Signal Processing Letters, 2004, 11(6), 577-580.
[13] X.Li, M.Orchard.“Novel sequential error-concealment techniques using orientation adaptive interpolation,”IEEE Transactions on Circuits and Systemsfor Video Technolgy, 2002, 12(10), 857- 864.
[14] Sirikham, A. Kumwilaisak, W.“Image Error Concealment Using Optimized Local Pixel Matching and Directional Interpolation,”in the 9th Conference on Advanced Communication Technology, vol.2, pp. 939-944, Feb. 2007.
[15] H.Sun, W.Kwok.“Concealment of damaged block transform coded images using projections onto convex sets,”IEEE Transactions on Image Processing. 1995, 4(4), 470-477.
[16] S.Shirani, F.Kossentini, R.Ward.“A concealment method for video communications in an error-prone environment,”IEEE Jounal on Selected Areas in Communications. 2000, 18(6), 1122-1128.
[17] S.Belfiore, M.Grangetto, E.Magli. IEEE Workshop on Multimedia Signal Processing, 2002, 121-124.
[18] L.T.Chia, D.J.Parish, J.W.R.Griths.“On the treatment of video cell loss in the transmission of JPEG images,”Computers andGraphics 1994, 18(1), 11-19.
[19] L.T.Chia, D.J.Parish, J.W.R.Griths etc.“On the use of transform domain information for concealment of errors in JPEG images,”EUSIPCO 1994, 1, 616-619.
[20] F.G.Natale, C.Perra, G.Vernazza.“DCT information recovery of erroneous image blocks by a neural predictor,”IEEE Journal on Selected Areas in Communications, 2000, 18(6), 1111-1121.
[21] J.S.Lee, Y.A Lee, W.S.Park etc.“A burst error concealment technique for visual communications in a mobile environment,”In IEEE International Conference on Consumer Electronics, 2003, 18-19.
[22] S.Belfiore, M.Grangetto, E.Magli etc.“An error concealment algorithm for streaming video,”In International Conference on Image Processing, 2003, (3) 649-652.
[23] M.A.Mualla, N.Canagarajah, D.R.Bull.“Motion field interpolation for temporal error concealment,”IEE Processing Visual Image Signal Processing, 2000, 147(5), 445-453.
[24] W.M.Lam, A.R.Reibmant, B.D.Liu.“Recovery of lost or erroneously received motion vectors,”In Processing IEEE ICASSP, 1993, 5, 417-420.
[25] Y. Xu and Y. Zhou,“H.264 video communication based refined error concealment schemes,”IEEE Trans. on Consumer Electronics, Nov. 2004, 50(4), 1135-1141.
[26] J. Zhang, J. F. Arnold, and M. R. Frater,“A cell-loss concealment technique for MPEG-2 coded video,”IEEE Trans. Circuits Syst. Video Technol., Jun. 2000, 10(6), 659–665.
[27] B. Yan and K. W. Ng,“A novel selective motion vector matching algorithm for error concealment in MPEG-4 video transmission over error-prone channels,”IEEE Trans. Consumer Electronics, vol. 49, no. 4, pp. 1416–1423, Nov. 2003.
[28] L.-W. Kang and J.-J. Leou,“A hybrid error concealment scheme for MPEG-2 video transmission based on best neighborhood matching algorithm,”J. Vis. Commun. Image Represent., vol. 16, no. 3, pp. 288–310, Jun. 2005.
[29] C.-T. Hsu, M.-J. Chen, W.-W. Liao and S.-Y. Lo,“High-performance spatial and temporal error-concealment algorithms for block-based video coding techniques,”ETRI J., vol. 27, no. 1, pp. 53–63, 2005.
[30] J.W.Suh, Y.S.Ho.“Error concealment techniques for digital TV,”IEEE Transactions on Broadcasting, 2002, 48(4), 299-306.
[31] J.-Y. Pyun, J.-S. Lee, J.-W. Jeong, J.-H. Jeong and S.-J. Ko,“Robust error concealment for visual communications in burst-packet-loss networks,”IEEE Trans. Consum. Electron., vol. 49, no. 4, pp. 1013–1019, Nov. 2003.
[32] T. Chen,“Refined boundary matching algorithm for temporal error concealment,”in Proc. of Packet Video, 2002.
[33] J. Zheng and L.-P. Chau,“Error-concealment algorithm for H.26L using first-order plane estimation,”IEEE Trans. on Multimedia, Dec. 2004, 6(6), 801-805.
[34] C. Chen, M. Chen, C. Huang, and S. Sun,“Motion vector based error concealment algorithms,”In Proc. of the Third IEEE Pacific Rim Conference on Multimedia, Lecture Notes In Computer Science, 2002, 2532, 425-433.
[35] J. Zheng and L.-P. Chau,“A Motion vector recovery algorithm for digital video using Lagrange interpolation,”IEEE Trans. on Broadcasting, Dec. 2003, 49(4), 383-389.
[36] Y. Kuo and S.-C. Tsao,“Error concealment based on overlapping,”In Proc. of VCIP, Jan. 2002, 4671(1), 146-153.
[37] M.-J. Chen, L.-G. Chen and R.-M. Weng,“Error concealment of lost motion vectors with overlapped motion compensation,”IEEE Trans. On Circuits and Systems for Video Technology, 1997, 7(3), 560-563.
[38] Y.-C. Lee, Y. Altunbasak, R. Mersereau,“Multiframe error concealment for MPEG-coded video delivery over error-prone networks,”IEEE Trans. on Image Processing, 2002, 11(11), 1314-1331.
[39] Y. O Park, C.-S. Kim, S.-U. Lee,“Multi-hypothesis error concealment algorithm for H.26L video,”Int. Conference on Image Processing (ICIP), Sept. 2003, 3, 465-8.
[40] S. Tsekeridou and I. Pitas,“MPEG-2 error concealment based on block-matchingprinciples,”IEEE Trans. Circuits Syst. Video Technol., vol. 10, no. 4, pp. 646–658, Jun. 2000.
[41] H. Sun, J. W. Zdepski, W. Kwok, and D. Raychaudhuri,“Error concealment algorithms for robust decoding of MPEG compressed video,”Signal Process.: Image Commun., vol. 10, pp. 249–268, 1997.
[42] M.-H. Jo and W.-J. Song,“Error concealment for mpeg-2 video decoders with enhanced coding mode estimation,”IEEE Trans. Consum. Electron., vol. 46, no. 4, pp. 962–969, Apr. 2000.
[43] ISO/IEC JTC1/SC29/WG11, MPEG-4 Video Verification Model Version 10.0, MPEG98/N1992, San Jose, February 1998.
[44] JVT of ISO/IEC MPEG and ITU-T VCEG,“Draft ITU-T Recommendation and Final Draft International Standard of Joint Video Specification (ITU-T Rec. H.264 | ISO/IEC 14496-10 AVC),”JVT-G050, March 2003.
[1] Y.Wang, Q.F.Zhu.“Error control and concealment for video communication: a review”. In Procedings of IEEE Multimedia Signal Processing, 1998,5,974-997.
[2] ITU-T, Draft Recommendation H.263 Video Coding for Narrow Telecommunication Channels at below 64kbit/s, Mar. 1995;
[3] JVT of ISO/IEC MPEG and ITU-T VCEG,“Draft ITU-T Recommendation and Final Draft International Standard of Joint Video Specification (ITU-T Rec. H.264 | ISO/IEC 14496-10 AVC),”JVT-G050, March 2003.
[4] Q. Peng, T.W. Yang and C.Q. Zhu,“Block-based temporal error concealment for video packet using motion vector extrapolation,”IEEE Communications, Circuits and Systems and West Sino Expositions, July 2002, I 10-14;
[5] Y. Chen, K. Yu, J. Li and S.P. Li,“An error concealment algorithm for entire frame loss in video transmission,”In Proceedings of Picture Coding Symposium, Dec. 2004, I.15-17;
[6] Z. Wu and J. M. Boyce,“An error concealment scheme for entire frame losses based on H.264/AVC,”in Proc. ISCAS’06, pp. 4463-4466, 2006
[7] K. Song, T. Chung, Y. Kim, Y. Oh and C.S. Kim,“Error concealment of H.264/AVC video frames for mobile video broadcasting,”IEEE Trans. Consumer Electronics, vol. 53, no. 2, May 2007
[8] B. K. P. Horn and B. G. Schunck,“Determining optical flow,”Artif. Intell., 1984, 23, 309–354;
[9] S. Belfiore, M. Grangetto, E. Magli, and G. Olmo,“An error concealment algorithm for streaming video”, In Proc. IEEE Int. Conf. Image Processing, 2003;
[10] S. Belfiore, M. Grangetto, E. Magli, and G. Olmo,“Concealment of Whole-Frame Losses for Wireless Low Bit-Rate Video Based on Multiframe Optical Flow Estimation,”IEEE Trans. Multimedia, vol. 7, no. 2, pp. 316-329, Apr. 2005
[11] P. Baccichet, A. Chimienti,“A low complexity concealment algorithm for the whole frame loss in H.264/AVC,”IEEE workshop on Multimedia Signal Processing, pp.279-282, 2004
[12] P. Baccichet, D. Bagni, A. Chimienti, L. Pezzoni, and F. Rovati,“Frame concealment for H.264/AVC decoders,”IEEE Trans. Consum. Electron., vol. 51, no. 1, pp 227-233, Feb. 2005.
[13] M. T. Orchard and G. J. Sullivan,“Overlapped block motion compensation: An estimation-theoretic approach,”IEEE Trans. Image Process., vol. 3, no. 5, pp.693–699, Sep. 1994.
[14] G. J. Sullivan and R. L. Baker,“Motion compensation for video compression using control grid interpolation,”in Proc. 1991 IEEE Int. Conf. Acoustic, Speech, Signal Processing, May 1991, vol. 4, pp. 2713-2716.
[1] A. Redert, M. Op de Beeck, C. Fehn, W. IJsselsteijn, M. Pollefeys, L. Van Gool, E. Ofek, I. Sexton, and P. Surman,“ATTEST—advanced three-dimensional television system techniques,”in Proc. 3DPVT’02, Padova, Italy, Jun. 2002, pp. 313–319.
[2] J. Flack, P. Harman, and S. Fox,“Low bandwidth stereoscopic image encoding and transmission,”in Proc.SPIE Conference on Stereoscopic Displays and Virtual Reality Systems X, vol. 5006, CA, U.S.A., Jan. 2003, pp. 206–214.
[3] H. Mitsumine, H. Noguchi, K. Enami, Y. Ninomiya, Y. Yamanoue, S. Yano, A. Hanazato, and M. Okui,“Virtual Museum-3-D fine art appreciation system,”IEEE Trans. Broadcast., vol. 42, no. 3, pp. 200–207, Sept. 1996.
[4] Lydia M. J. Meesters, Wijnand A. IJsselsteijn and Pieter J. H. Seunti?ns,“A Survey of Perceptual Evaluations and Requirements of Three-Dimensional TV,”IEEE Trans. Circuits System Video Technol., Mar. 2004, 14(3), 381-391.
[5] A. Woods, T. Docherty and R. Koch,“Image distortions in stereoscopic video systems,”In Proc. SPIE, 1993, 1915, 36–48.
[6] R. Spottiswoode, N. Spottiswoode and C. Smith,“3-D photography–Basic principles of the three-dimensional film,”J. SMPTE, 1952, 59, 249–286.
[7] M. Ziegler, L. Falkenhagen, R. Horst, and D. Kalivas,“Evolution of stereoscopic and three-dimensional video,”Signal Processing: Image Communication, vol. 14, pp. 173–194, 1998.
[8] Y. Luo, Z. Zhang, and P. An,“Stereo video coding based on frame estimation and interpolation,”IEEE Trans. Broadcast., vol. 49, no. 1, pp. 14–21, 2003.
[9] C. Fehn,“A 3D-TV Approach Using Depth-Image-Based Rendering,”In Proceedings of Picture Coding Symposium, Dec 2004.
[10] C. Fehn,“Depth-image-based rendering (DIBR), compression and transmission for a new approach on 3D-TV,”in Proc. SPIE Conf. Stereoscopic Displays and Virtual Reality Systems XI, vol. 5291, CA, U.S.A., Jan. 2004, pp. 93–104.
[11] C. Fehn, K. Hopf and B. Quante,“Key technologies for an advanced 3D-TV System,”In Proceedings of SPIE Three-Dimensional TV, Video and Display III, Oct. 2004, 66-80.
[12] Jongeun Cha, Sung-Yeol Kim, Yo-Sung Ho and Jeha Ryu,“3D Video Player System with Haptic Interaction based on Depth Image-Based Representation,”IEEE Transactions on Consumer Electronics, May.2006, 52(2), 477-484.
[13] P. Belhumeur and D. Mumford,“A Bayesian treatment of the stereo correspondence problem using half-occluded regions,”in Proc. CVPR’92, 1992, pp. 506–512.
[14] T. Kanade and M. Okutomi,“A stereo matching algorithm with an adaptive window: theory and experiment,”IEEE Trans. Pattern Recog. Mach. Intell., vol. 16, no. 9, pp. 920–932, 1994.
[15] L. Zhang, D. Wang, and A. Vincent,“Reliability measurement of disparity estimates for intermediate view reconstruction,”in Proc. IEEE Conf. Image Processing, vol. 3, Rochester, NY, USA, Sep. 2002, pp. 837–840.
[16] P.V. Harman, S.R. Fox, M.R. Dowley and J.C. Flack,“Image conversion and encoding techniques,”Dynamic Digital Depth Research, Ltd., Patent application WO200213141A1, 2002.
[17] M.C. Kaye,“Image processing system and method for converting two-dimensional images into three-dimensional images,”In-Three, Inc., Patent application gUS6686926B1, 2004.
[18] J. Yin and J. R. Cooperstock,“Improving depth maps by nonlinear diffusion,”in Proc. 12th International Conf. Computer Graphics, Visualization and Computer Vision, Plzen, Czech Republic, Feb. 2004.
[19] M. Kawakita, K. Lizuka, T. Aida, H. Kikuchi, H. Fujikake, J. Yonai, and K. Takizawa, AXI-vision camera (Real-time distance-mapping camera), Applied. Optics, 2000, 39, 3931–3939.
[20] G. Iddan and G. Yahav,“3D imaging in the studio (and elsewhere…),“In Proc. SPIE, 2001, 4298, 48–55.
[21] J. Shade, S. Gortler, L. He, and R. Szeliski,“Layered depth image,”in Proc. SIGGRAPH’98, Jul. 1998, pp. 231–242.
[22] G. Alain, W. J. Tam, and L. Zhang,“Improving Stereoscopic Image Quality of Pictures Generated From Depth Maps,”Communications Research Centre Canada, Ottawa, Internal CRC report, Apr. 2003.
[23] W. J. Tam, G. Alain, L. Zhang, T. Martin, and R. Renaud,“Smoothing depth maps for improved stereoscopic image quality,”in Proc. SPIE Conf. Three-Dimensional TV, Video, and Display III, vol. 5599, Philadelphia, U.S.A., Oct. 2004, pp. 162–172.
[24] L. Zhang, J. Tam, and D. Wang,“Stereoscopic image generation based on depth images,”in Proc. IEEE Conf. Image Processing, Singapore, Oct. 2004, pp. 2993–2996.
[25] L. Zhang, and J. Tam,“Stereoscopic image generation based on depth images for 3D TV,”in IEEE Trans. Broadcast., vol. 51, no. 2, pp. 191–199, 2005.
[26] M.Bertalmio, G.Sapiro, V.Caselles and C.Ballester,“Image inpainting,”In Computer Graphics Proceedings, Annual Conference Series, ACM SIGGRAPH, New Orleans, 2000. pp. 417-424.
[27] T.Chan Command J.Shen,“Non-texture inpainting by curvature-driven diffusions (CDD),”J. Visual Comm. Image Rep. 4(12):436-449, 2001.
[28] G.Sapiro,“Geometric Partial Differential Equations and Image Analysis,”USA: Cambridge University Press, 2001.
[29] S.D.Rane,GSapiro and M.Bertalmio,“Structure and Texture Filling-In of Missing Image Blocks in Wireless Transmission and Compression Applications,”Image Processing, IEEE Transactions on Volume 12, Issue 3, March 2003 pp.296-303.
[30] A.A.Efros and T.K.Leung,“Texture synthesis by non-parametric sampling,”In Proc. Int. Conf. Computer Vision, pp. 1033-1038, Kerkyra, Greece, September 1999.
[31] A.A.Efros and W.T. Freeman,“Image quilting for texture synthesis and transfer,”In Proc. ACM Conf. Comp. Graphics (SIGGRAPH), pp.341-346, Eugene Fiume, August 2001.
[32] L.Y Wei and M.Levoy,“Fast texture synthesis using tree-structured vector quantization,”Proceedings of SIGGRAPH 2000, July 2000, pp.479-488.
[33] M. Bertalmio, L. Vese, G. Sapiro, S. Osher,“Simultaneous Structure and Texture Image Inpainting,”IEEE Transactions on Image Processing, vol. 12, no. 8, pp. 882 -889, 2003.
[34] S.D. Rane, G. Sapiro and M. Bertalmio, "Structure and Texture Filling-In of Missing Image Blocks in Wireless Transmission and Compression,”in International Conference on Image Processing (ICIP'02), 2002, pp. 317-320.
[35] H. Yamauchi, J. Haber, and H.P. Seidel.“Image restoration using multi-resolution texture synthesis and image inpainting.”In Proc. Computer Graphics International, pp.120–125, 2003.
[36] S.Kaiser, K.Fazel.“Comparison of error concealment techniques for an MPEG-2video decoder in terrestrial TV-broadcasting,”Signal Processing: Image Communication, 1999, 14, 655-676.
[37] S.Shirani, F.Kossentini, R.Ward.“Error concealment methods, a comparative study”. In Procedings of IEEE Conference on Electrical and Computer Engineering, 1999, 5, 835-840.
[38] Y.Wang, Q.F.Zhu.“Error control and concealment for video communication: a review”. In Procedings of IEEE Multimedia Signal Processing, 1998, 5, 974-997.
[39] E.Asbun, P.Salama, E.J.Delp.“Real-time error concealment in digital video streams using digital signal processors,”IEEE Transactions on Consumer Electronics, 2001, 47(4), 904-909.
[40] D. Agrafiotis et al.,“Enhanced error concealment with mode selection”, IEEE Trans. Circuits Syst. Video Technol, vol., 16, no. 8, August 2006.
[41] J. Zhang, J. F. Arnold, and M. R. Frater,“A cell-loss concealment technique for MPEG-2 coded video,”IEEE Trans. Circuits Syst. Video Technol., Jun. 2000, 10(6), 659–665
[42] N. Otsu,“A Threshold Selection Method From Gray Level Histograms,”IEEE Transactions on Systems, Man, and Cybernetics, SMC-9, 1979, 62-66.
[43] J N Kapur, P K Sahoo, A K C. Wong,“A new method for gray-level picture thresholding using the entropy of the histogram,”Computer Graphics, Vision and Image Processing, 1985, 273-285.
[44] Soo-Chang Pei, Jing-Ming Guo,“3-Step Bi-Level Images for Multiscaling and Lossless Compression,”IEEE Information Communications and Signal Processing, Dec. 2005, 886-889.
[45] W.M.Lam, A.R.Reibmant, B.D.Liu.“Recovery of lost or erroneously received motion vectors,”In Processing IEEE ICASSP, 1993, 5, 417-420.
[2] ISO/IEC JTC1/SC29/WG11/13818,Generic coding of moving pictures and associated audio information (MPEG-2), Geneva, Nov. 1994.
[3] ISO/IEC JTC1/SC29/WG11, MPEG-4 Video Verification Model Version 10.0, MPEG98/N1992, San Jose, February 1998.
[4] ISO/IEC JTC1/SC 29/WG11, 14496-2:Information technology– Generic coding of audio-visual objects–Part 2: Visual. MPEG99/N 2688, Seoul, March 1999.
[5] ITU-T, Video codec for audiovisual services at 64 kbits. International Telecommunications Union, Geneva, Switzerland, ITU-T Recommendation H.261, 1993
[6] ITU-T, Draft Recommendation H.263 Video Coding for Narrow Telecommunication Channels at below 64kbit/s. March 1995
[7] ITU Recomdentation H.263, Draft Text of Recommendation H.263 Version 2 (“H.263+”) for Decision, Sep. 1997.
[8] ITU-T Recommendation H.263++ (Video Coding for Low Bitrate Communication), Geneva, Switzerland, 2000.
[9] JVT of ISO/IEC MPEG and ITU-T VCEG,“Draft ITU-T Recommendation and Final Draft International Standard of Joint Video Specification (ITU-T Rec. H.264 | ISO/IEC 14496-10 AVC),”JVT-G050, March 2003.
[10]余松煜,张文军,孙军.现代图像信息压缩技术.北京:科学出版社,1998.11.
[11]余松煜,周源华,吴时光.数字图像处理.北京:电子工业出版社, 1989.
[12] C.E.Shannon. Coding theorems for discrete source with a fidelity criterion. IRE Nat Conv. Record Pt. 4, 1959, 142-164.
[13] A. M. Tekalp,“Digital video processing,”清华大学出版社, 1998.
[14] T. Ebrahimi and A. M. Kunt,“Visual data compression for multimedia applications,”Proc. IEEE, vol. 86, pp. 1109-1125, June 1998.
[15] D. Taubman,“High performance scalable image compression with EBCOT,”IEEE Trans. Image Processing, Vol. 9, pp. 1158–1170, July 2000.
[16] W. A. Pearlman, A. Islam, N. Nagaraj, and A. Said,“Efficient, low-complexity image coding with a set-partitioning embedded block coder,”IEEE Trans. Circuits Syst. Video Technol., vol. 14, pp. 1219–1235, Nov. 2004.
[17] J.-R. Ohm,“Advances in Scalable Video Coding,”Proc. IEEE, vol. 93, pp. 42– 56, Jan. 2005.
[18] S. Knauer,“Real-time video compression algorithm for Hadamard transform processing,”IEEE Transactions on Electromagnetic Compatibility, vol. 18 pp. 28-36, 1976.
[19] J. R. Ohm,“Three-dimensional subband coding with motion compensation,”IEEE Trans. Image Processing, vol. 3, pp. 559–571, Sept. 1994.
[20] ISO/IEC MPEG,“Scalable Video Model 3.0,”Jan 2005.
[21] P. Salembier, L. Torres, F. Meyer, and C. Gu,“Region-based video coding using mathematical morphology,”Proc. IEEE, vol. 83, no. 6, pp. 843–857, Jun. 1995.
[22] J. Ostermann, E. S. Jang, J. S. Shin, and T. Chen,“Coding the arbitrarily shaped video objects in MPEG-4,”in IEEE Int. Conf. Image Processing, Santa Barbara, CA, 1997, pp. 496–499.
[23] M. Karczewicz, J. Niewglowski, and P. Havisto,“Video coding using motion compensation with polynomial motion vector fields,”Signal Process. Image Communication. vol. 10, no. 1–3, pp. 63–91, 1997.
[24] P. Eisert, T. Wiegand, and B. Girod,“Model-aided coding: A new approach to incorporate facial animation into motion-compensated video coding,”IEEE Trans. Circuits Syst. Video Technol., vol. 10, no. 3, pp. 344–358, Apr. 2000.
[25] H. Li and R. Forchheimer,“Two-view facial movement estimation,”IEEE Trans. Circuits Syst. Video Technol., vol. 4, no. 3, pp. 276–287, Jun. 1994.
[26] MPEG-7: Context, Objectives and Technical Roadmap, V.12. , MPEG99/N2861, Vancouver, July 1999.
[27] ISO/IEC JTC1/SC29/WG11/N5231. MPEG-21 Overview v.5, Shanghai, October 2002.
[28] ITU-T SG16,“DRAFT Call for proposals for H.26L video coding,”Feb. 1998.
[29] ISO/IEC,“Requirements for AVC Codec,”ISO/IEC JTC1/SC29/WG11/N4672, Jeju, Korea, March 2002
[30] Gray J.Sullivan and T. Wiegand,“Video Compression-From Concepts to the H.264/AVC Standard,”Proc. IEEE, vol. 93, no. 1, January 2005.
[31] R.Dugad,“A fast scheme for image size change in the compressed domain”, IEEE Trans. Circuits Syst. Video Technol., vol. 11, no. 4, pp. 461–474, Apr. 2001.
[32] G.D.Haan, E.B. Bellers,“Deinterlacing– an Overview”, Proc. Of IEEE, Sep.1998, 86(9): 1839-1857
[33] Choi, B.-D,Han, J.-W, etc.,“Motion-Compensated Frame Interpolation Using Bilateral Motion Estimation and Adaptive Overlapped Block Motion Compensation,”IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 4 pp. 407–416, Apr. 2007.
[34] C.Fehn, P.Kauff, etc,“An Evolutionary and Optimized Approach on 3D-TV,”Proceedings of International Broadcast Conference’02, Amsterdam, The Netherlands, pp. 357-375, 2002.
[35] W. R. Mark, Post-Rendering 3D Image Warping: Visibility, Reconstruction and Performance for Depth-Image Warping, PHD thesis, University of North Carolina at Chapel Hill, 1999.
[36] L. McMillan, An Image-Based Approach on Three Dimensional Computer Graphics, PHD thesis, University of North Carolina at Chapel Hill, 1997.
[37] ITU. ITU-T recommendation P.910--subjective video quality assessment methods for multimedia applications, 1999.
[38]蔡皖东.多媒体通信技术.陕西:西安电子科技大学出版社,2000,10.
[1] A. M. Tekalp,“Digital video processing,”清华大学出版社, 1998.
[2] A. N. Netravali and J. D. Robbins,“Motion adaptive interpolation of television frames,”Proc. Of Picture Coding Symposium, June 1981.
[3] P. Haavisto, J. Juhola, and Y. Neuvo,“Fractional frame rate up-conversion using weighted median filters,”IEEE Trans. Consum. Electron., vol. 35, no. 3, pp. 272–278, Aug. 1989.
[4] R. Castagno, P. Haavisto, and G. Ramponi,“A method for motion adaptive frame rate up-conversion,”IEEE Trans. Circuits Syst. Video Technol., vol. 6, no. 5, pp. 436–446, Oct. 1996.
[5] S.-H. Lee, Y.-C. Shin, S.-J. Yang, H.-H. Moon, and R.-H. Park,“Adaptive MC interpolation for frame rate up-conversion,”IEEE Trans. Consum. Electron., vol. 48, no. 3, pp. 444–450, Aug. 2002.
[6] Y.-K. Chen and S. Y. Kung,“Rate optimization by true motion estimation,”in Proc. IEEE Workshop Multimedia Signal Process., Jun. 1997, pp. 187–194.
[7] C.-C. Cheng, W.-L. Hwang, Z. Shen, and T. Xia,“Advanced motion compensation techniques for blocking artifacts reduction in 3-D video coding systems,”in Proc. ICIP, Sep. 2005, vol. 3, pp. 89–92.
[8] G. de Haan, P. W. Biezen, H. Huijgen, and O. A. Ojo,“True-motion estimationwith 3-D recursive search block matching,”IEEE Trans. Circuits Syst. Video Technol., vol. 3, no. 5, pp. 368–379, Oct. 1993.
[9] R. J. Schutten and G. D. Haan,“Real-time 2–3 pull-down elimination applying motion estimation/compensation in a programmable device,”IEEE Trans. Consum.Electron., vol. 44, no. 3, pp. 501–504, Aug. 1998.
[10] B.-W. Jeon, G.-I. Lee, S.-H. Lee, and R.-H. Park,“Coarse-to-fine frame interpolation for frame rate up-conversion using pyramid structure,”IEEE Trans. Consum. Electron., vol. 49, no. 3, pp. 499–508, Aug. 2003.
[11] T. Ha, S. Lee, and J. Kim,“Motion compensated frame interpolation by new block-based motion estimation algorithm,”IEEE Trans. on Consumer Electronics, vol.50, No. 2, pp. 752-759, May. 2004.
[12] B.D.Choi, J.W.Han, etc.“Motion Compensated Frame Interpolation Using Bilateral Motion Estimation and Adaptive Overlapped Block Motion Compensation,”IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 4, pp. 407–416, Apr. 2007.
[13] T.Y. Kuo and C.-C.J.Kuo,“Motion-compensated interpolation for low-bit-rate video quality enhancement,”Proc. SPIE Vis. Commun. Image Process, vol. 3460, pp. 277-288, Jul. 1998
[14] Y.-K. Chen, A. Vetro, H. Sun, and S. Y. Kung,“Frame-rate up-conversion using transmitted true motion vectors,”in Proc. IEEE Workshop Multimedia Signal Process., Dec. 1998, vol. 2, pp. 622–627.
[15] K. Hilman, H.-W. Park, and Y.-M. Kim,“Using motion compensated frame-rate conversion for the correction of 3:2 pulldown artifacts in video sequences,”IEEE Trans. Circuits Syst. Video Technol., vol. 10, no. 6, pp. 896–877, Sep. 2000.
[16] S. Liu, J.W. Kim, and C.-C. Jay Kuo,“MCI-embedded motion compensated prediction for quality enhancement of frame interpolation,”Proc. of SPIE International Symposium on Voice, Video, and Data Communications, Multimedia Systems and Applications III, Boston, MA, Nov. 2000.
[17] S. Liu, J.W.Kim, and C.-C. Jay Kuo,“Non-linear motion-compensated interpolation for low bit rate video”, Proc. Of SPIE International Symposium on Optical Science, Engineering, and Instrumentation, Applications of Digital Image Processing XXIII, San Diego, CA, July, 2000.
[18] S. Liu, J.W. Kim, and C.-C. Jay Kuo,“Hybrid global/local motion-compensated frame interpolation with segmentation for low bit-rate video”, Journal of Visual Commun. and Image Representation, vol. 14, No. 1, pp. 61-79, March 2003.
[19] Tieyan Liu, Kwok-Tung Lo, Jian Feng and Xudong Zhang,“Frame interpolationscheme using inertia motion interpolation”, Proc. of Signal Processing:Image Communication, vol.18, pp221-229, March 2003.
[20] G. Dane and T. Q. Nguyen,“Motion vector processing for frame rate up conversion,”Proc. of IEEE International Conference on Acoustics, Speech, & Signal Processing, vol. 3, pp. 309-312, May. 2004
[21] H. Sasai, S. Kondo, and S. Kadono,“Frame-rate up-conversion using reliable analysis of transmitted motion information,”Proc. of IEEE International Conference on Acoustics, Speech, & Signal Processing, May 2004.
[22] J.N. Zhang, L.F. Sun, etc.“Position prediction motion-compensated interpolation for frame rate up-conversion using temporal modeling,”Proc. ICIP, vol. 1, pp. 11-14, Sep. 2005,
[23] J.F. Zhai, K. Yu, J. L and S.P. Li,“A low complexity motion compensated frame interpolation method,”Proc. ISCAS, May 23-26, 2005: 4927-4930,
[24] G. Dane and T. Q. Nguyen,“Optimal temporal interpolation filter for motion-compensated frame rate up conversion,”IEEE Trans. on Image Processing, vol5, No. 4, pp. 978-991, May. 2004.
[25] Ai-Mei Huang and T. Nguyen,“Motion vector processing based on residual energy information for motion compensated frame interpolation,”Proc. ICIP, vol. 8, pp. 2721-2724, Oct. 2006
[26] Ai-Mei Huang and T. Nguyen,“A Novel Multi-Stage Motion Vector Processing Method for Motion Compensated Frame Interpolation,”Proc. ICIP, vol. 5, pp. 389-392, Oct. 2007
[27] G. Dane, K.EI-Maieh, and L.Yen-chi,”Encoder-assisted adaptive video frame interpolation,”Proc ICASSP05, vol.2, pp.349-352, Mar.2005
[28] Ya-Ting Yang; Yi-Shin Tung and Ja-Ling Wu,“Quality Enhancement of Frame Rate Up-Converted Video by Adaptive Frame Skip and Reliable Motion Extraction,”IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 12, pp. 1700–1713, Dec. 2000.
[29] M. T. Orchard and G. J. Sullivan,“Overlapped block motion compensation: An estimation-theoretic approach,”IEEE Trans. Image Process., vol. 3, no. 5, pp. 693–699, Sep. 1994.
[30] JVT of ISO/IEC MPEG and ITU-T VCEG,“Draft ITU-T Recommendation and Final Draft International Standard of Joint Video Specification (ITU-T Rec. H.264 | ISO/IEC 14496-10 AVC),”JVT-G050, March 2003.
[1] S.Kaiser, K.Fazel.“Comparison of error concealment techniques for an MPEG-2 video decoder in terrestrial TV-broadcasting,”Signal Processing: Image Communication, 1999, 14, 655-676.
[2] S.Shirani, F.Kossentini, R.Ward.“Error concealment methods, a comparative study”. In Procedings of IEEE Conference on Electrical and Computer Engineering, 1999, 5, 835-840.
[3] Y.Wang, Q.F.Zhu.“Error control and concealment for video communication: a review”. In Procedings of IEEE Multimedia Signal Processing, 1998, 5, 974-997.
[4] E.Asbun, P.Salama, E.J.Delp.“Real-time error concealment in digital video streams using digital signal processors,”IEEE Transactions on Consumer Electronics, 2001, 47(4), 904-909.
[5] D. Agrafiotis, D. R. Bull, and C. N. Canagarajah,“Enhanced error concealment with mode selection”, IEEE Trans. Circuits Syst. Video Technol, vol., 16, no. 8, August 2006.
[6] M.Ghanbari, V.Seferidis.“Cell-loss concealment techniques for all-digital high-definition television system,”IEEE Trans. Circuits Syst. Video Technol, 1993, 3(3), 238-247.
[7] S.Aign, K.Fazel.“Temporal and spatial error concealment techniques for hierarchical MPEG-2 video codec,”In Procedings of IEEE International Conference on Communication, Seattle, 1995, 3, 1778-1783.
[8] M.Y.Cheng, H.Y.Huang, A.W.Su.“A NURBs-based error concealment technique for corrupted images from packet loss,”In Proceedings on International Conference on Image Processing, 2002, 2, 705 -708.
[9] Y.Wang, Q.F.Zhu, L.Shaw.“Maximally smooth image recovery in transform coding,”IEEE Transactions on Communication, 1993, 41 (10), 1544–1551.
[10] W.Kwok, H.Sun.“Multi-directional interpolation for spatial error concealment,”IEEE Transactions on Consumer Electronics, 1993, 39(3), 455-460.
[11] H.Jiang, C.Moloney.“Error concealment using a diffusion based method,”In Proceedings of International Conference on Image Processing, 2002, 1, 832-835.
[12] S.C.Hsia.“An edge-oriented spatial interpolation for consecutive block error concealment,”IEEE Signal Processing Letters, 2004, 11(6), 577-580.
[13] X.Li, M.Orchard.“Novel sequential error-concealment techniques using orientation adaptive interpolation,”IEEE Transactions on Circuits and Systemsfor Video Technolgy, 2002, 12(10), 857- 864.
[14] Sirikham, A. Kumwilaisak, W.“Image Error Concealment Using Optimized Local Pixel Matching and Directional Interpolation,”in the 9th Conference on Advanced Communication Technology, vol.2, pp. 939-944, Feb. 2007.
[15] H.Sun, W.Kwok.“Concealment of damaged block transform coded images using projections onto convex sets,”IEEE Transactions on Image Processing. 1995, 4(4), 470-477.
[16] S.Shirani, F.Kossentini, R.Ward.“A concealment method for video communications in an error-prone environment,”IEEE Jounal on Selected Areas in Communications. 2000, 18(6), 1122-1128.
[17] S.Belfiore, M.Grangetto, E.Magli. IEEE Workshop on Multimedia Signal Processing, 2002, 121-124.
[18] L.T.Chia, D.J.Parish, J.W.R.Griths.“On the treatment of video cell loss in the transmission of JPEG images,”Computers andGraphics 1994, 18(1), 11-19.
[19] L.T.Chia, D.J.Parish, J.W.R.Griths etc.“On the use of transform domain information for concealment of errors in JPEG images,”EUSIPCO 1994, 1, 616-619.
[20] F.G.Natale, C.Perra, G.Vernazza.“DCT information recovery of erroneous image blocks by a neural predictor,”IEEE Journal on Selected Areas in Communications, 2000, 18(6), 1111-1121.
[21] J.S.Lee, Y.A Lee, W.S.Park etc.“A burst error concealment technique for visual communications in a mobile environment,”In IEEE International Conference on Consumer Electronics, 2003, 18-19.
[22] S.Belfiore, M.Grangetto, E.Magli etc.“An error concealment algorithm for streaming video,”In International Conference on Image Processing, 2003, (3) 649-652.
[23] M.A.Mualla, N.Canagarajah, D.R.Bull.“Motion field interpolation for temporal error concealment,”IEE Processing Visual Image Signal Processing, 2000, 147(5), 445-453.
[24] W.M.Lam, A.R.Reibmant, B.D.Liu.“Recovery of lost or erroneously received motion vectors,”In Processing IEEE ICASSP, 1993, 5, 417-420.
[25] Y. Xu and Y. Zhou,“H.264 video communication based refined error concealment schemes,”IEEE Trans. on Consumer Electronics, Nov. 2004, 50(4), 1135-1141.
[26] J. Zhang, J. F. Arnold, and M. R. Frater,“A cell-loss concealment technique for MPEG-2 coded video,”IEEE Trans. Circuits Syst. Video Technol., Jun. 2000, 10(6), 659–665.
[27] B. Yan and K. W. Ng,“A novel selective motion vector matching algorithm for error concealment in MPEG-4 video transmission over error-prone channels,”IEEE Trans. Consumer Electronics, vol. 49, no. 4, pp. 1416–1423, Nov. 2003.
[28] L.-W. Kang and J.-J. Leou,“A hybrid error concealment scheme for MPEG-2 video transmission based on best neighborhood matching algorithm,”J. Vis. Commun. Image Represent., vol. 16, no. 3, pp. 288–310, Jun. 2005.
[29] C.-T. Hsu, M.-J. Chen, W.-W. Liao and S.-Y. Lo,“High-performance spatial and temporal error-concealment algorithms for block-based video coding techniques,”ETRI J., vol. 27, no. 1, pp. 53–63, 2005.
[30] J.W.Suh, Y.S.Ho.“Error concealment techniques for digital TV,”IEEE Transactions on Broadcasting, 2002, 48(4), 299-306.
[31] J.-Y. Pyun, J.-S. Lee, J.-W. Jeong, J.-H. Jeong and S.-J. Ko,“Robust error concealment for visual communications in burst-packet-loss networks,”IEEE Trans. Consum. Electron., vol. 49, no. 4, pp. 1013–1019, Nov. 2003.
[32] T. Chen,“Refined boundary matching algorithm for temporal error concealment,”in Proc. of Packet Video, 2002.
[33] J. Zheng and L.-P. Chau,“Error-concealment algorithm for H.26L using first-order plane estimation,”IEEE Trans. on Multimedia, Dec. 2004, 6(6), 801-805.
[34] C. Chen, M. Chen, C. Huang, and S. Sun,“Motion vector based error concealment algorithms,”In Proc. of the Third IEEE Pacific Rim Conference on Multimedia, Lecture Notes In Computer Science, 2002, 2532, 425-433.
[35] J. Zheng and L.-P. Chau,“A Motion vector recovery algorithm for digital video using Lagrange interpolation,”IEEE Trans. on Broadcasting, Dec. 2003, 49(4), 383-389.
[36] Y. Kuo and S.-C. Tsao,“Error concealment based on overlapping,”In Proc. of VCIP, Jan. 2002, 4671(1), 146-153.
[37] M.-J. Chen, L.-G. Chen and R.-M. Weng,“Error concealment of lost motion vectors with overlapped motion compensation,”IEEE Trans. On Circuits and Systems for Video Technology, 1997, 7(3), 560-563.
[38] Y.-C. Lee, Y. Altunbasak, R. Mersereau,“Multiframe error concealment for MPEG-coded video delivery over error-prone networks,”IEEE Trans. on Image Processing, 2002, 11(11), 1314-1331.
[39] Y. O Park, C.-S. Kim, S.-U. Lee,“Multi-hypothesis error concealment algorithm for H.26L video,”Int. Conference on Image Processing (ICIP), Sept. 2003, 3, 465-8.
[40] S. Tsekeridou and I. Pitas,“MPEG-2 error concealment based on block-matchingprinciples,”IEEE Trans. Circuits Syst. Video Technol., vol. 10, no. 4, pp. 646–658, Jun. 2000.
[41] H. Sun, J. W. Zdepski, W. Kwok, and D. Raychaudhuri,“Error concealment algorithms for robust decoding of MPEG compressed video,”Signal Process.: Image Commun., vol. 10, pp. 249–268, 1997.
[42] M.-H. Jo and W.-J. Song,“Error concealment for mpeg-2 video decoders with enhanced coding mode estimation,”IEEE Trans. Consum. Electron., vol. 46, no. 4, pp. 962–969, Apr. 2000.
[43] ISO/IEC JTC1/SC29/WG11, MPEG-4 Video Verification Model Version 10.0, MPEG98/N1992, San Jose, February 1998.
[44] JVT of ISO/IEC MPEG and ITU-T VCEG,“Draft ITU-T Recommendation and Final Draft International Standard of Joint Video Specification (ITU-T Rec. H.264 | ISO/IEC 14496-10 AVC),”JVT-G050, March 2003.
[1] Y.Wang, Q.F.Zhu.“Error control and concealment for video communication: a review”. In Procedings of IEEE Multimedia Signal Processing, 1998,5,974-997.
[2] ITU-T, Draft Recommendation H.263 Video Coding for Narrow Telecommunication Channels at below 64kbit/s, Mar. 1995;
[3] JVT of ISO/IEC MPEG and ITU-T VCEG,“Draft ITU-T Recommendation and Final Draft International Standard of Joint Video Specification (ITU-T Rec. H.264 | ISO/IEC 14496-10 AVC),”JVT-G050, March 2003.
[4] Q. Peng, T.W. Yang and C.Q. Zhu,“Block-based temporal error concealment for video packet using motion vector extrapolation,”IEEE Communications, Circuits and Systems and West Sino Expositions, July 2002, I 10-14;
[5] Y. Chen, K. Yu, J. Li and S.P. Li,“An error concealment algorithm for entire frame loss in video transmission,”In Proceedings of Picture Coding Symposium, Dec. 2004, I.15-17;
[6] Z. Wu and J. M. Boyce,“An error concealment scheme for entire frame losses based on H.264/AVC,”in Proc. ISCAS’06, pp. 4463-4466, 2006
[7] K. Song, T. Chung, Y. Kim, Y. Oh and C.S. Kim,“Error concealment of H.264/AVC video frames for mobile video broadcasting,”IEEE Trans. Consumer Electronics, vol. 53, no. 2, May 2007
[8] B. K. P. Horn and B. G. Schunck,“Determining optical flow,”Artif. Intell., 1984, 23, 309–354;
[9] S. Belfiore, M. Grangetto, E. Magli, and G. Olmo,“An error concealment algorithm for streaming video”, In Proc. IEEE Int. Conf. Image Processing, 2003;
[10] S. Belfiore, M. Grangetto, E. Magli, and G. Olmo,“Concealment of Whole-Frame Losses for Wireless Low Bit-Rate Video Based on Multiframe Optical Flow Estimation,”IEEE Trans. Multimedia, vol. 7, no. 2, pp. 316-329, Apr. 2005
[11] P. Baccichet, A. Chimienti,“A low complexity concealment algorithm for the whole frame loss in H.264/AVC,”IEEE workshop on Multimedia Signal Processing, pp.279-282, 2004
[12] P. Baccichet, D. Bagni, A. Chimienti, L. Pezzoni, and F. Rovati,“Frame concealment for H.264/AVC decoders,”IEEE Trans. Consum. Electron., vol. 51, no. 1, pp 227-233, Feb. 2005.
[13] M. T. Orchard and G. J. Sullivan,“Overlapped block motion compensation: An estimation-theoretic approach,”IEEE Trans. Image Process., vol. 3, no. 5, pp.693–699, Sep. 1994.
[14] G. J. Sullivan and R. L. Baker,“Motion compensation for video compression using control grid interpolation,”in Proc. 1991 IEEE Int. Conf. Acoustic, Speech, Signal Processing, May 1991, vol. 4, pp. 2713-2716.
[1] A. Redert, M. Op de Beeck, C. Fehn, W. IJsselsteijn, M. Pollefeys, L. Van Gool, E. Ofek, I. Sexton, and P. Surman,“ATTEST—advanced three-dimensional television system techniques,”in Proc. 3DPVT’02, Padova, Italy, Jun. 2002, pp. 313–319.
[2] J. Flack, P. Harman, and S. Fox,“Low bandwidth stereoscopic image encoding and transmission,”in Proc.SPIE Conference on Stereoscopic Displays and Virtual Reality Systems X, vol. 5006, CA, U.S.A., Jan. 2003, pp. 206–214.
[3] H. Mitsumine, H. Noguchi, K. Enami, Y. Ninomiya, Y. Yamanoue, S. Yano, A. Hanazato, and M. Okui,“Virtual Museum-3-D fine art appreciation system,”IEEE Trans. Broadcast., vol. 42, no. 3, pp. 200–207, Sept. 1996.
[4] Lydia M. J. Meesters, Wijnand A. IJsselsteijn and Pieter J. H. Seunti?ns,“A Survey of Perceptual Evaluations and Requirements of Three-Dimensional TV,”IEEE Trans. Circuits System Video Technol., Mar. 2004, 14(3), 381-391.
[5] A. Woods, T. Docherty and R. Koch,“Image distortions in stereoscopic video systems,”In Proc. SPIE, 1993, 1915, 36–48.
[6] R. Spottiswoode, N. Spottiswoode and C. Smith,“3-D photography–Basic principles of the three-dimensional film,”J. SMPTE, 1952, 59, 249–286.
[7] M. Ziegler, L. Falkenhagen, R. Horst, and D. Kalivas,“Evolution of stereoscopic and three-dimensional video,”Signal Processing: Image Communication, vol. 14, pp. 173–194, 1998.
[8] Y. Luo, Z. Zhang, and P. An,“Stereo video coding based on frame estimation and interpolation,”IEEE Trans. Broadcast., vol. 49, no. 1, pp. 14–21, 2003.
[9] C. Fehn,“A 3D-TV Approach Using Depth-Image-Based Rendering,”In Proceedings of Picture Coding Symposium, Dec 2004.
[10] C. Fehn,“Depth-image-based rendering (DIBR), compression and transmission for a new approach on 3D-TV,”in Proc. SPIE Conf. Stereoscopic Displays and Virtual Reality Systems XI, vol. 5291, CA, U.S.A., Jan. 2004, pp. 93–104.
[11] C. Fehn, K. Hopf and B. Quante,“Key technologies for an advanced 3D-TV System,”In Proceedings of SPIE Three-Dimensional TV, Video and Display III, Oct. 2004, 66-80.
[12] Jongeun Cha, Sung-Yeol Kim, Yo-Sung Ho and Jeha Ryu,“3D Video Player System with Haptic Interaction based on Depth Image-Based Representation,”IEEE Transactions on Consumer Electronics, May.2006, 52(2), 477-484.
[13] P. Belhumeur and D. Mumford,“A Bayesian treatment of the stereo correspondence problem using half-occluded regions,”in Proc. CVPR’92, 1992, pp. 506–512.
[14] T. Kanade and M. Okutomi,“A stereo matching algorithm with an adaptive window: theory and experiment,”IEEE Trans. Pattern Recog. Mach. Intell., vol. 16, no. 9, pp. 920–932, 1994.
[15] L. Zhang, D. Wang, and A. Vincent,“Reliability measurement of disparity estimates for intermediate view reconstruction,”in Proc. IEEE Conf. Image Processing, vol. 3, Rochester, NY, USA, Sep. 2002, pp. 837–840.
[16] P.V. Harman, S.R. Fox, M.R. Dowley and J.C. Flack,“Image conversion and encoding techniques,”Dynamic Digital Depth Research, Ltd., Patent application WO200213141A1, 2002.
[17] M.C. Kaye,“Image processing system and method for converting two-dimensional images into three-dimensional images,”In-Three, Inc., Patent application gUS6686926B1, 2004.
[18] J. Yin and J. R. Cooperstock,“Improving depth maps by nonlinear diffusion,”in Proc. 12th International Conf. Computer Graphics, Visualization and Computer Vision, Plzen, Czech Republic, Feb. 2004.
[19] M. Kawakita, K. Lizuka, T. Aida, H. Kikuchi, H. Fujikake, J. Yonai, and K. Takizawa, AXI-vision camera (Real-time distance-mapping camera), Applied. Optics, 2000, 39, 3931–3939.
[20] G. Iddan and G. Yahav,“3D imaging in the studio (and elsewhere…),“In Proc. SPIE, 2001, 4298, 48–55.
[21] J. Shade, S. Gortler, L. He, and R. Szeliski,“Layered depth image,”in Proc. SIGGRAPH’98, Jul. 1998, pp. 231–242.
[22] G. Alain, W. J. Tam, and L. Zhang,“Improving Stereoscopic Image Quality of Pictures Generated From Depth Maps,”Communications Research Centre Canada, Ottawa, Internal CRC report, Apr. 2003.
[23] W. J. Tam, G. Alain, L. Zhang, T. Martin, and R. Renaud,“Smoothing depth maps for improved stereoscopic image quality,”in Proc. SPIE Conf. Three-Dimensional TV, Video, and Display III, vol. 5599, Philadelphia, U.S.A., Oct. 2004, pp. 162–172.
[24] L. Zhang, J. Tam, and D. Wang,“Stereoscopic image generation based on depth images,”in Proc. IEEE Conf. Image Processing, Singapore, Oct. 2004, pp. 2993–2996.
[25] L. Zhang, and J. Tam,“Stereoscopic image generation based on depth images for 3D TV,”in IEEE Trans. Broadcast., vol. 51, no. 2, pp. 191–199, 2005.
[26] M.Bertalmio, G.Sapiro, V.Caselles and C.Ballester,“Image inpainting,”In Computer Graphics Proceedings, Annual Conference Series, ACM SIGGRAPH, New Orleans, 2000. pp. 417-424.
[27] T.Chan Command J.Shen,“Non-texture inpainting by curvature-driven diffusions (CDD),”J. Visual Comm. Image Rep. 4(12):436-449, 2001.
[28] G.Sapiro,“Geometric Partial Differential Equations and Image Analysis,”USA: Cambridge University Press, 2001.
[29] S.D.Rane,GSapiro and M.Bertalmio,“Structure and Texture Filling-In of Missing Image Blocks in Wireless Transmission and Compression Applications,”Image Processing, IEEE Transactions on Volume 12, Issue 3, March 2003 pp.296-303.
[30] A.A.Efros and T.K.Leung,“Texture synthesis by non-parametric sampling,”In Proc. Int. Conf. Computer Vision, pp. 1033-1038, Kerkyra, Greece, September 1999.
[31] A.A.Efros and W.T. Freeman,“Image quilting for texture synthesis and transfer,”In Proc. ACM Conf. Comp. Graphics (SIGGRAPH), pp.341-346, Eugene Fiume, August 2001.
[32] L.Y Wei and M.Levoy,“Fast texture synthesis using tree-structured vector quantization,”Proceedings of SIGGRAPH 2000, July 2000, pp.479-488.
[33] M. Bertalmio, L. Vese, G. Sapiro, S. Osher,“Simultaneous Structure and Texture Image Inpainting,”IEEE Transactions on Image Processing, vol. 12, no. 8, pp. 882 -889, 2003.
[34] S.D. Rane, G. Sapiro and M. Bertalmio, "Structure and Texture Filling-In of Missing Image Blocks in Wireless Transmission and Compression,”in International Conference on Image Processing (ICIP'02), 2002, pp. 317-320.
[35] H. Yamauchi, J. Haber, and H.P. Seidel.“Image restoration using multi-resolution texture synthesis and image inpainting.”In Proc. Computer Graphics International, pp.120–125, 2003.
[36] S.Kaiser, K.Fazel.“Comparison of error concealment techniques for an MPEG-2video decoder in terrestrial TV-broadcasting,”Signal Processing: Image Communication, 1999, 14, 655-676.
[37] S.Shirani, F.Kossentini, R.Ward.“Error concealment methods, a comparative study”. In Procedings of IEEE Conference on Electrical and Computer Engineering, 1999, 5, 835-840.
[38] Y.Wang, Q.F.Zhu.“Error control and concealment for video communication: a review”. In Procedings of IEEE Multimedia Signal Processing, 1998, 5, 974-997.
[39] E.Asbun, P.Salama, E.J.Delp.“Real-time error concealment in digital video streams using digital signal processors,”IEEE Transactions on Consumer Electronics, 2001, 47(4), 904-909.
[40] D. Agrafiotis et al.,“Enhanced error concealment with mode selection”, IEEE Trans. Circuits Syst. Video Technol, vol., 16, no. 8, August 2006.
[41] J. Zhang, J. F. Arnold, and M. R. Frater,“A cell-loss concealment technique for MPEG-2 coded video,”IEEE Trans. Circuits Syst. Video Technol., Jun. 2000, 10(6), 659–665
[42] N. Otsu,“A Threshold Selection Method From Gray Level Histograms,”IEEE Transactions on Systems, Man, and Cybernetics, SMC-9, 1979, 62-66.
[43] J N Kapur, P K Sahoo, A K C. Wong,“A new method for gray-level picture thresholding using the entropy of the histogram,”Computer Graphics, Vision and Image Processing, 1985, 273-285.
[44] Soo-Chang Pei, Jing-Ming Guo,“3-Step Bi-Level Images for Multiscaling and Lossless Compression,”IEEE Information Communications and Signal Processing, Dec. 2005, 886-889.
[45] W.M.Lam, A.R.Reibmant, B.D.Liu.“Recovery of lost or erroneously received motion vectors,”In Processing IEEE ICASSP, 1993, 5, 417-420.