H.264视频解码优化及DSP实现
摘要
作为最新的视频压缩标准,H.264/AVC在压缩性能和网络传输质量上全面优于MPEG-4和H.263,将运动图像压缩技术又向前推进了一大步。目前H.264的影响力越来越显著,很多公司和研究机构都在研究基于H.264编解码算法标准的视频商业化产品。H.264/AVC采用了一系列全新的视频压缩技术,但是在某些算法的实现较为复杂,一般的处理器很难实现实时的视频编解码。但是随着数字信号处理器(DSP)的高速发展,为高效地实现音视频信号处理提供了可能性。其中ADI公司推出的低功耗、高性能Blackfin处理器的DSP系列芯片,是H.264标准DSP实现的理想平台。
本论文主要是探讨H.264软件解码器的优化及在ADSP-BF561上的实现。目的是实现支持main profile的H.264视频解码,并且解码D1尺寸视频速度到达实时。论文首先介绍了H.264视频压缩标准的基本原理、方法,以及数字视频压缩标准的发展过程。接着介绍了H.264视频标准解码的关键技术。然后在PC平台下实现了基于FFMPEG的H.264 main profile解码器,分析了该解码器流程,确定软件解码方案。本文在PC平台上完成了对该解码器的初步优化的基础上,实现了H.264解码器的移植,最后以ADSP-BF561 EZ-KIT LITE评估板为解码系统的VisualDSP编译环境下,使用各种优化方法和技巧,完成对H.264解码器的优化。
根据BF561的结构特点,论文主要从系统级和程序语言级对H.264的解码代码进行优化,使之能够达到实际应用的要求。软件优化分为语法的优化和算法的优化,着重介绍软件语法的优化,这是软件优化的通用方法,合理的运用这些方法,可以大大提高软件的执行效率。着重用线性汇编优化了H.264的耗时模块,根据BF561的高速缓存机制,启用CACHE,提高系统解码速度。并且,使用性能测试工具,用不同的测试序列对各个阶段的优化效果进行测试,确定较优的H.264视频解码器的优化方案,使解码器的性能有较大的提高。
经过测试表明本文设计的基于FFMPEG的H.264解码器支持main profile解码并且具有较高的解码效率。
H.264/AVC, as the latest video coding standard, has an excellent performance over both MPEG-4 and H.263 in the compression and the quality of transmission through the network. Nowadays, H.264 is used widely because of its high compression and better image quality; many companies are developing the products based on H.264. However, because of its complex algorithm, the application is limited. As the high speed development of the Digital Signal Processor (DSP), the implemention the H.264 algorithm on ADI high performance DSP is valuable.
The main discussion in the paper is the optimization and implementation of H.264 decoder based on BF561.The aim of the paper is to realize the decoder system based on H.264 standard which support the main profile and real-time application in deocding the D1 vidoe.Firstly, the author introduces the basic thought and theory of H.264, and the key technology about decoding, then the developing theories of BF561. Secondly, the author realizes the H.264 decorder based on FFMPEG in the PC platform, analyzes the flow of the decoder based on FFMPEG, and decides the software decoding scheme. Thirdly, the author realizes the migration of decoder based on VisualDSP. Finally, the author completes the optimization of decoder by various methords and skills based on the PC platform and the VsiaulDSP which used the ADSP-BF561 EZ-KIT LITE evaluation board as the video coding system.
According to the characteristic of BF561, the author optimizes the decoder based on the system and the programming-languge which emphasis on the software grammar optimization; the method can efficiently promote the efficiency. Secondly, optimizes the time-consuming module using linear assemble language. Thirdly, makes use of the mechanism of Cache in order to improve the decoding rate. At last, tests the effect of the optimizing in every phases by using several test sequences and decides the best scheme.
According to the test, the decorder designed in this paper which based on FFMPEG and supports the main profile decoding, has higher decoding efficiency.
本论文主要是探讨H.264软件解码器的优化及在ADSP-BF561上的实现。目的是实现支持main profile的H.264视频解码,并且解码D1尺寸视频速度到达实时。论文首先介绍了H.264视频压缩标准的基本原理、方法,以及数字视频压缩标准的发展过程。接着介绍了H.264视频标准解码的关键技术。然后在PC平台下实现了基于FFMPEG的H.264 main profile解码器,分析了该解码器流程,确定软件解码方案。本文在PC平台上完成了对该解码器的初步优化的基础上,实现了H.264解码器的移植,最后以ADSP-BF561 EZ-KIT LITE评估板为解码系统的VisualDSP编译环境下,使用各种优化方法和技巧,完成对H.264解码器的优化。
根据BF561的结构特点,论文主要从系统级和程序语言级对H.264的解码代码进行优化,使之能够达到实际应用的要求。软件优化分为语法的优化和算法的优化,着重介绍软件语法的优化,这是软件优化的通用方法,合理的运用这些方法,可以大大提高软件的执行效率。着重用线性汇编优化了H.264的耗时模块,根据BF561的高速缓存机制,启用CACHE,提高系统解码速度。并且,使用性能测试工具,用不同的测试序列对各个阶段的优化效果进行测试,确定较优的H.264视频解码器的优化方案,使解码器的性能有较大的提高。
经过测试表明本文设计的基于FFMPEG的H.264解码器支持main profile解码并且具有较高的解码效率。
H.264/AVC, as the latest video coding standard, has an excellent performance over both MPEG-4 and H.263 in the compression and the quality of transmission through the network. Nowadays, H.264 is used widely because of its high compression and better image quality; many companies are developing the products based on H.264. However, because of its complex algorithm, the application is limited. As the high speed development of the Digital Signal Processor (DSP), the implemention the H.264 algorithm on ADI high performance DSP is valuable.
The main discussion in the paper is the optimization and implementation of H.264 decoder based on BF561.The aim of the paper is to realize the decoder system based on H.264 standard which support the main profile and real-time application in deocding the D1 vidoe.Firstly, the author introduces the basic thought and theory of H.264, and the key technology about decoding, then the developing theories of BF561. Secondly, the author realizes the H.264 decorder based on FFMPEG in the PC platform, analyzes the flow of the decoder based on FFMPEG, and decides the software decoding scheme. Thirdly, the author realizes the migration of decoder based on VisualDSP. Finally, the author completes the optimization of decoder by various methords and skills based on the PC platform and the VsiaulDSP which used the ADSP-BF561 EZ-KIT LITE evaluation board as the video coding system.
According to the characteristic of BF561, the author optimizes the decoder based on the system and the programming-languge which emphasis on the software grammar optimization; the method can efficiently promote the efficiency. Secondly, optimizes the time-consuming module using linear assemble language. Thirdly, makes use of the mechanism of Cache in order to improve the decoding rate. At last, tests the effect of the optimizing in every phases by using several test sequences and decides the best scheme.
According to the test, the decorder designed in this paper which based on FFMPEG and supports the main profile decoding, has higher decoding efficiency.
引文
[1]毕厚杰.新一代视频压缩编码标准—H.264/AVC.北京:人民邮电出版社.2005,2-10,245-251
[2] Musmann, H.G.“Object-Oriented Ananlysis-synthesis Coding based on source models of moving 2D-and3D-objects”.IEEE International Conference.Vol.1,Apri.1993:99-102
[3] Mauricio Hess,Geovanni Martinez.“AUTOMATIC ADAPTION OF A HUMAN FACE MODEL FOR MODEL-BASED CODING”, IEEE Circuits and Systems for Video Technology, vol.8,1998:781-795
[4] Li Zhang,Keith Noah Snavely,Brian Curless,Steve M.Seitz.“Spacetime Faces:High-Resolution Capture for Modeling and Animation”,SIGGRAPH,2004
[5] JVT(Joint Video Team of ITU-T and ISO/IEC).“Recommendation and Final Draft International Standard of Joint Video Specification”ITU-T Rec.H.264|ISO/IEC 14496-10 AVC, March,2003
[6]郭晓强,解伟.H.264/AVC视频压缩编码标准的新发展.[EB/OL] http://video.com.cn,2008
[7]杜建超.基于H.264/AVC的视频容错技术研究. [博士学位论文].西安:西安电子科技大学,2006
[8] Vivel K Goyal.“Multiple Description Coding:Compression Meets the Network”.IEEE Signal Processing Magazine.September.2001:3-5
[9] Abhik Majumadar, Daniel Grobe Sachs, Kannan Ramchandran etc.“Multicast and Unicast Real-Time Video Streaming Over Wireless LANS”.IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY,VOL.12,NO.6,2002:1-6
[10] P.A.Chou, S.Methrotra, A.Wang.“Multriple description decoding of over complete expansions using projections onto convex sets”,in Pro.IEEE Data Compression Conf.,Snowbird,UT,Mar.1999:72-80
[11] R.Singh,A.Orrega,L.Perrer,etc.“Comparison of multiple description coding and layerd coding based on network simulation”,in Proc.SIPE Image Video Proc.,San Jose,CA,Jan.2000:929-939
[12] A.Said,Imaging Systems Laboratory.“Comparative Analysis of Arithmetic Coding Computational Complexity”.IEEE Data Compression Conference.March,2004:23-25
[13]欧阳合.H.264和MPEG-4视频压缩:新一代多媒体的视频编码技术.北京:国防科技大学出版社.2004,200-209
[14]余兆明,查日勇,黄磊等.图像编码标准H.264技术.北京:人民邮电出版社.2006年,40-43
[15] Alexis Michael Tourapis,Karsten Suhrin,Gary Sullivan.H.264/MPEG-4AVC Reference SoftwareManual.JointVideoTeam(JVT)ofISO/IECMPEG&ITU-TVCEG 14th Meeting ,HongKong,PRC China,Jan,2005,18-20
[16]王颖.H.264视频编码器在ADSP-BF561上的实现及优化. [硕士学位论文].成都:西南交通大学,2007
[17] YaoMin Huang,JinJang Leou,MingHui Cheng.“A Post Deblocking Filter for H.264 Video”. Computer Communications and Networks, 2007. ICCCN 2007. Proceedings of 16th International Conference on Volume,Issue.Aug,2007:1137 - 1142
[18] Yu Hu,Qing Li,SiWei Ma,etc.“Decoder-Friendly Adaptive Deblocking Filter(DF-ADF) Mode Decision in H.264/AVC”. IEEE International Symposium on Circuits and Systems (ISCAS), New Orleans, Louisiana, USA, May, 2007:3976-3978
[19]陈峰.《Blackfin系列DSP原理与系统设计》.北京:电子工业出版社,2004年1月,211-215
[20] Blackfin? DSP Instruction Set Reference, Analog Device,Mar 2002
[21] AnalogDevices.ADSP-BF561Blackfin processor Hardware Reference. preliminary Revision0.3,January2005.AnalogDevices,Inc.
[22] Analog Devices , Inc. ADSP-BF53x/BF56x Blackfin Processor Programming Reference(Revision 1.2,February 2007)
[23] AnalogDevices,Inc.ADSP-BF561 Blackfin Processors Hardware Reference.[EB/OL] http://www.analog.com/industry/dsp/teeh_doe/gen_PurPose.html,2008
[24] AnalogDevices,Inc.Blackfin Processor Instruction Set Reference.[EB/OL] http://www.analog.eom/proeessors/resourees/teehniealLibrary/manuals,2008
[25] Blackfin EZ-Extender for Analog Devices ADSP-BF533 and ADSP-BF561 EZ-KIT Lite. [EB/OL]http://www.analog.com/zh/embedded-processing-dsp/blackfin/BF-EXTENDER/processors/product.html,2008
[26] H.264/AVCReferenceSoftwareJM86.[EB/OL] http://iphome.hhi.de/suehring/tml/,2003
[27] FFMPEG source code.[EB/OL]http://ffmpeg.mplayerhq.hu/,2008
[28] T264 source code.[EB/OL]http://sourceforge.net/projects/t264,2007
[29] X264 source code.[EB/OL]http://developers.videolan.org/x264/html,2007
[30] FFMPEG0.5 released.[EB/OL] http://svn.ffmpeg.org/ffmpeg/branches/0.5/RELEASE,2009
[31] FFMPEG SDK source code.[EB/OL]http://www.ffmpeg.com.cn,2009
[32] Herbert Shchildt.C语言大全(第四版).(王子恢,戴健鹏,赵新,etc,译者).北京:电子工业出版社,2004年2月,185-190
[33] AnalogDevices,Ine.VisualDSP++4.0LinkerandUtilitiesManual.[EB/OL] http://www.analog.eom/proeessors/resourees/teehniea1Library/manuals,2005
[34] Harold Abelson,Gerald Jay Sussman,Julie Sussman.计算机程序的构造和解释(原书第二版).(裘宗燕,译者).北京:机械工业出版社,2004年2月,397-405
[35]姚莹琳.H.264大尺寸解码器的实现与优化: [硕士学位论文].北京:北京邮电大学,2007
[36]林炜.基于DSP的H.264运动估计算法的研究与实现:[硕士学位论文].成都:电子科技大学,2007
[37]席道光.基于H.264/AVC标准的视频编码系统应用研究:[硕士学位论文].浙江:浙江工业大学,2007
[38]陈峰.《基于Blackfin DSP的数字图像处理》.北京:电子工业出版社,2009年1月,48-55
[2] Musmann, H.G.“Object-Oriented Ananlysis-synthesis Coding based on source models of moving 2D-and3D-objects”.IEEE International Conference.Vol.1,Apri.1993:99-102
[3] Mauricio Hess,Geovanni Martinez.“AUTOMATIC ADAPTION OF A HUMAN FACE MODEL FOR MODEL-BASED CODING”, IEEE Circuits and Systems for Video Technology, vol.8,1998:781-795
[4] Li Zhang,Keith Noah Snavely,Brian Curless,Steve M.Seitz.“Spacetime Faces:High-Resolution Capture for Modeling and Animation”,SIGGRAPH,2004
[5] JVT(Joint Video Team of ITU-T and ISO/IEC).“Recommendation and Final Draft International Standard of Joint Video Specification”ITU-T Rec.H.264|ISO/IEC 14496-10 AVC, March,2003
[6]郭晓强,解伟.H.264/AVC视频压缩编码标准的新发展.[EB/OL] http://video.com.cn,2008
[7]杜建超.基于H.264/AVC的视频容错技术研究. [博士学位论文].西安:西安电子科技大学,2006
[8] Vivel K Goyal.“Multiple Description Coding:Compression Meets the Network”.IEEE Signal Processing Magazine.September.2001:3-5
[9] Abhik Majumadar, Daniel Grobe Sachs, Kannan Ramchandran etc.“Multicast and Unicast Real-Time Video Streaming Over Wireless LANS”.IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY,VOL.12,NO.6,2002:1-6
[10] P.A.Chou, S.Methrotra, A.Wang.“Multriple description decoding of over complete expansions using projections onto convex sets”,in Pro.IEEE Data Compression Conf.,Snowbird,UT,Mar.1999:72-80
[11] R.Singh,A.Orrega,L.Perrer,etc.“Comparison of multiple description coding and layerd coding based on network simulation”,in Proc.SIPE Image Video Proc.,San Jose,CA,Jan.2000:929-939
[12] A.Said,Imaging Systems Laboratory.“Comparative Analysis of Arithmetic Coding Computational Complexity”.IEEE Data Compression Conference.March,2004:23-25
[13]欧阳合.H.264和MPEG-4视频压缩:新一代多媒体的视频编码技术.北京:国防科技大学出版社.2004,200-209
[14]余兆明,查日勇,黄磊等.图像编码标准H.264技术.北京:人民邮电出版社.2006年,40-43
[15] Alexis Michael Tourapis,Karsten Suhrin,Gary Sullivan.H.264/MPEG-4AVC Reference SoftwareManual.JointVideoTeam(JVT)ofISO/IECMPEG&ITU-TVCEG 14th Meeting ,HongKong,PRC China,Jan,2005,18-20
[16]王颖.H.264视频编码器在ADSP-BF561上的实现及优化. [硕士学位论文].成都:西南交通大学,2007
[17] YaoMin Huang,JinJang Leou,MingHui Cheng.“A Post Deblocking Filter for H.264 Video”. Computer Communications and Networks, 2007. ICCCN 2007. Proceedings of 16th International Conference on Volume,Issue.Aug,2007:1137 - 1142
[18] Yu Hu,Qing Li,SiWei Ma,etc.“Decoder-Friendly Adaptive Deblocking Filter(DF-ADF) Mode Decision in H.264/AVC”. IEEE International Symposium on Circuits and Systems (ISCAS), New Orleans, Louisiana, USA, May, 2007:3976-3978
[19]陈峰.《Blackfin系列DSP原理与系统设计》.北京:电子工业出版社,2004年1月,211-215
[20] Blackfin? DSP Instruction Set Reference, Analog Device,Mar 2002
[21] AnalogDevices.ADSP-BF561Blackfin processor Hardware Reference. preliminary Revision0.3,January2005.AnalogDevices,Inc.
[22] Analog Devices , Inc. ADSP-BF53x/BF56x Blackfin Processor Programming Reference(Revision 1.2,February 2007)
[23] AnalogDevices,Inc.ADSP-BF561 Blackfin Processors Hardware Reference.[EB/OL] http://www.analog.com/industry/dsp/teeh_doe/gen_PurPose.html,2008
[24] AnalogDevices,Inc.Blackfin Processor Instruction Set Reference.[EB/OL] http://www.analog.eom/proeessors/resourees/teehniealLibrary/manuals,2008
[25] Blackfin EZ-Extender for Analog Devices ADSP-BF533 and ADSP-BF561 EZ-KIT Lite. [EB/OL]http://www.analog.com/zh/embedded-processing-dsp/blackfin/BF-EXTENDER/processors/product.html,2008
[26] H.264/AVCReferenceSoftwareJM86.[EB/OL] http://iphome.hhi.de/suehring/tml/,2003
[27] FFMPEG source code.[EB/OL]http://ffmpeg.mplayerhq.hu/,2008
[28] T264 source code.[EB/OL]http://sourceforge.net/projects/t264,2007
[29] X264 source code.[EB/OL]http://developers.videolan.org/x264/html,2007
[30] FFMPEG0.5 released.[EB/OL] http://svn.ffmpeg.org/ffmpeg/branches/0.5/RELEASE,2009
[31] FFMPEG SDK source code.[EB/OL]http://www.ffmpeg.com.cn,2009
[32] Herbert Shchildt.C语言大全(第四版).(王子恢,戴健鹏,赵新,etc,译者).北京:电子工业出版社,2004年2月,185-190
[33] AnalogDevices,Ine.VisualDSP++4.0LinkerandUtilitiesManual.[EB/OL] http://www.analog.eom/proeessors/resourees/teehniea1Library/manuals,2005
[34] Harold Abelson,Gerald Jay Sussman,Julie Sussman.计算机程序的构造和解释(原书第二版).(裘宗燕,译者).北京:机械工业出版社,2004年2月,397-405
[35]姚莹琳.H.264大尺寸解码器的实现与优化: [硕士学位论文].北京:北京邮电大学,2007
[36]林炜.基于DSP的H.264运动估计算法的研究与实现:[硕士学位论文].成都:电子科技大学,2007
[37]席道光.基于H.264/AVC标准的视频编码系统应用研究:[硕士学位论文].浙江:浙江工业大学,2007
[38]陈峰.《基于Blackfin DSP的数字图像处理》.北京:电子工业出版社,2009年1月,48-55
© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号 地址：北京市海淀区学院路29号 邮编：100083 电话：办公室：(+86 10)66554848；文献借阅、咨询服务、科技查新：66554700 |