H.264视频编码算法研究及DSP实现
摘要
H.264标准是由视频图像编码组和运动图像编码组共同开发的新一代视频编码标准。在相同的编码图像质量下,H.264比H.263、MPEG-4标准分别能节约50%和20%的码流,而且加强了对网络和流媒体应用的支持,但是H.264的优越性能是以实现的高复杂度为代价的,这给嵌入式应用带来了巨大障碍。因而,研究H.264标准在有关视频芯片上的实现对视频技术在嵌入式领域的应用具有重要的意义。
本文主要工作是研究H.264中的关键技术及其在TM320DM642 DSP上的应用。首先详细分析了H.264视频编码标准,对标准中使用的一些新技术做了比较详尽的探讨。例如帧内预测、帧间预测、变换编码、环路滤波、熵编码等编码技术;其次,本文选用X264作为H.264编码器的参考源码,研究了其编码流程,包括编码的主流程、帧编码流程、宏块编码流程,以及不同参数设置对编码性能的影响。在此基础上对计算复杂度高的预测模式选择算法做了适当的改进,提出了快速的帧内预测算法与帧间预测算法,并通过测试数据验证了其有效性。论文进一步结合DM642自身特点,经过代码修改、性能优化、线性汇编三个阶段,进行了H.264编码器在DM642平台上的移植和优化。
实验结果表明,在信噪比和码流变化不大的情况下,基于DM642优化的效果还是比较明显的,编码时间有了大幅度的减短,存储所需容量也大幅度降低。
H.264 video coding standard is jointly developed by Video Coding Experts Group and Moving Picture Experts Group. Under the same reconstruction video quality, H.264 has 50% and 20% bit-stream, compared with H.263 and MPEG-4 respectively. H.264 improves the ability to support the network application and the video stream application. But the superior performace of H.264 is achieved at the expense of high complexity,and this is the obstacle for embedded applications with H.264. Therefor, the reserch on the implement and optimization of H.264 based on the related video chip is signification application of video technology on embeded system.
The main task of this thesis is to study H.264 key technology of video coding and its implement on TMS320DM642. First, encoding principle of H.264 is analysed in detail, and describes some technology introduced by H.264. Such as intra prediction, inter prediction, transform encoding, loop-filter, entropy encoding. Second, using the open code X264 as a reference model, the thesis studied H.264 encoding flow, including encoding main flow, frame encoding flow and macroblock encoding flow, and the influence of different parameters on the coding efficiency. On this basis, prediction module with high computational complexity is perfered to be optimized: an algorithm of fast INTRA mode decision and an algorithm of fast INTER mode decision are proposed, and their availability is demonstrated by means of table. Further more, making full use of the resources of th DM642, H.264 coder was transplantated and optimized on DM642 after three development stages including code modification, performance optimization and linear assembly.
The experiments show that under the condition that SNR and bit-stream are in little change, the effect of optimization based on DM642 is quite obvious: coding time is reduced and the required storage capacity is also significantly reduced.
本文主要工作是研究H.264中的关键技术及其在TM320DM642 DSP上的应用。首先详细分析了H.264视频编码标准,对标准中使用的一些新技术做了比较详尽的探讨。例如帧内预测、帧间预测、变换编码、环路滤波、熵编码等编码技术;其次,本文选用X264作为H.264编码器的参考源码,研究了其编码流程,包括编码的主流程、帧编码流程、宏块编码流程,以及不同参数设置对编码性能的影响。在此基础上对计算复杂度高的预测模式选择算法做了适当的改进,提出了快速的帧内预测算法与帧间预测算法,并通过测试数据验证了其有效性。论文进一步结合DM642自身特点,经过代码修改、性能优化、线性汇编三个阶段,进行了H.264编码器在DM642平台上的移植和优化。
实验结果表明,在信噪比和码流变化不大的情况下,基于DM642优化的效果还是比较明显的,编码时间有了大幅度的减短,存储所需容量也大幅度降低。
H.264 video coding standard is jointly developed by Video Coding Experts Group and Moving Picture Experts Group. Under the same reconstruction video quality, H.264 has 50% and 20% bit-stream, compared with H.263 and MPEG-4 respectively. H.264 improves the ability to support the network application and the video stream application. But the superior performace of H.264 is achieved at the expense of high complexity,and this is the obstacle for embedded applications with H.264. Therefor, the reserch on the implement and optimization of H.264 based on the related video chip is signification application of video technology on embeded system.
The main task of this thesis is to study H.264 key technology of video coding and its implement on TMS320DM642. First, encoding principle of H.264 is analysed in detail, and describes some technology introduced by H.264. Such as intra prediction, inter prediction, transform encoding, loop-filter, entropy encoding. Second, using the open code X264 as a reference model, the thesis studied H.264 encoding flow, including encoding main flow, frame encoding flow and macroblock encoding flow, and the influence of different parameters on the coding efficiency. On this basis, prediction module with high computational complexity is perfered to be optimized: an algorithm of fast INTRA mode decision and an algorithm of fast INTER mode decision are proposed, and their availability is demonstrated by means of table. Further more, making full use of the resources of th DM642, H.264 coder was transplantated and optimized on DM642 after three development stages including code modification, performance optimization and linear assembly.
The experiments show that under the condition that SNR and bit-stream are in little change, the effect of optimization based on DM642 is quite obvious: coding time is reduced and the required storage capacity is also significantly reduced.
引文
[1]余兆亮.数字电视和高清晰度电视.北京:人民邮电出版社,2004.
[2] Gary J. Sullivan, Pankaj Topiwala and Ajay Luthra. The H.264/AVC advanced video coding standard: Overview and Introduction to the fidelity range extension Conference on applications of Digital Image Processing.2003, 10.
[3] Kunt M, et al. Recent results in high-compression image coding. IEEE Transaction on Circuits and Systems for Video technology.1987, 6, 34(11).1306~1336。
[4] Casas J R,et al. Coding of details in very low bit-rate video systems.IEEE Transaction on Circuits and Systems for Video technology.1994, 8, 4(3).317~327。
[5] Jacquin A E. Fractal image coding: a review. Proceedings of the IEEE.1993, 8, 1(10).1451~1465。
[6]毕厚杰.新一代视频压缩编码标准-H.264/AVC.北京:人民邮电出版社,2005.
[7]林福宗.多媒体技术基础.第2版.北京:清华大学出版社,2002.
[8]唐薇娟,曹序芳.电视原理与接收技术.西安:西安电子科技大学出版社,1987.
[9] Joint Video Team of ITU-T and ISO/IEC JTC. Draft ITU-T Recommendation and Final Draft International Standard of Joint Video Specification. Joint Video Team of ISO/IEC MPEG and ITU-T VCGE, JVT-G050. 2003, 3.
[10] Detlev Marpe, Heiko Schwarz and Thomas Wiegand. Context-Based Adaptive Binary Arithmetic Coding in the H.264/AVC Video Compression Standard. IEEE Transaction on Circuits and Systems for Video technology.2003, 6,11(8).234~237。
[11] Texas Instruments Incorporated. TMS320C64X Technical Overview. 2004, 9.
[12]钟睿,吴东伟,何明一.一种高效的H.264去块滤波方法.计算机工程与应用. 2007, 7, 8 (10). 145~148。
[13] Peter Lec. H.264三大开源编码器之评测报告. 2005, 6.
[14]曹文锋,张颖,张兆扬等.一种适用于H.264的整像素运动估计方法.上海大学学报.2004, 6, 10(4).331-336。
[15] Texas Instrument Incorporated. TMS320C64X Technical Overview. 2001, 1.
[16] Texas Instruments Incorporated. TMS320C64X Technical Overview. 2002, 9.
[17] Texas Instruments Incorporated. TMS320DM642 Video/Imaging Fixed-Point Digital Signal Processor Data Manu.2002, 7.
[18] Texas Instruments Incorporated. TMS320C6000 Technical Brief. 1999, 2.
[19] Texas Instruments Incorporated.TMS320C6000 DSP Cache User's Guide. 2003,3.
[20] Texas Instruments Incorporated.TMS320 DM642 Video/Imaging Fixed-Point Digital signal Processor.2002, 7.
[21] Texas Instruments Incorporated. Code Composer Studio GettingStarted Guide. 2003, 8.
[22]彭启琮,管庆等. DSP集成开发环境---CCS及DSP/BIOS的原理与应用.北京:电子工业出版社. 2004.
[23]田黎育,何佩琨,朱梦宇. TMS320C6000系列DSP编程工具与指南.北京:清华大学出版社,2006.
[24] Texas Instruments Incorporated. Code Composer Studio Development Tools v3.1. 2005, 5.
[25] Texas Instruments Incorporated. Code Composer Studio Development Tools v3.1. 2005, 7.
[26]李方慧,王飞等. TMS320C6000系列DSP原理与应用[M].北京:电子工业出版社,2005.
[27] Texas Instruments Incorporated. TMS320C6000 CPU and Instruction Set Reference Guide.2000, 10.
[28] Texas Instruments Incorporated. TMS320C6000 Optimizing C Compiler Tutorial. 2002, 6.
[29] Texas Instruments Incorporated. TMS320C6000 Optimizing Compiler User's Guide. 2002, 10.
[30] Texas Instruments Incorporated. TMS320C6000 Optimizing C Compiler Tutorial. 2002, 10.
[2] Gary J. Sullivan, Pankaj Topiwala and Ajay Luthra. The H.264/AVC advanced video coding standard: Overview and Introduction to the fidelity range extension Conference on applications of Digital Image Processing.2003, 10.
[3] Kunt M, et al. Recent results in high-compression image coding. IEEE Transaction on Circuits and Systems for Video technology.1987, 6, 34(11).1306~1336。
[4] Casas J R,et al. Coding of details in very low bit-rate video systems.IEEE Transaction on Circuits and Systems for Video technology.1994, 8, 4(3).317~327。
[5] Jacquin A E. Fractal image coding: a review. Proceedings of the IEEE.1993, 8, 1(10).1451~1465。
[6]毕厚杰.新一代视频压缩编码标准-H.264/AVC.北京:人民邮电出版社,2005.
[7]林福宗.多媒体技术基础.第2版.北京:清华大学出版社,2002.
[8]唐薇娟,曹序芳.电视原理与接收技术.西安:西安电子科技大学出版社,1987.
[9] Joint Video Team of ITU-T and ISO/IEC JTC. Draft ITU-T Recommendation and Final Draft International Standard of Joint Video Specification. Joint Video Team of ISO/IEC MPEG and ITU-T VCGE, JVT-G050. 2003, 3.
[10] Detlev Marpe, Heiko Schwarz and Thomas Wiegand. Context-Based Adaptive Binary Arithmetic Coding in the H.264/AVC Video Compression Standard. IEEE Transaction on Circuits and Systems for Video technology.2003, 6,11(8).234~237。
[11] Texas Instruments Incorporated. TMS320C64X Technical Overview. 2004, 9.
[12]钟睿,吴东伟,何明一.一种高效的H.264去块滤波方法.计算机工程与应用. 2007, 7, 8 (10). 145~148。
[13] Peter Lec. H.264三大开源编码器之评测报告. 2005, 6.
[14]曹文锋,张颖,张兆扬等.一种适用于H.264的整像素运动估计方法.上海大学学报.2004, 6, 10(4).331-336。
[15] Texas Instrument Incorporated. TMS320C64X Technical Overview. 2001, 1.
[16] Texas Instruments Incorporated. TMS320C64X Technical Overview. 2002, 9.
[17] Texas Instruments Incorporated. TMS320DM642 Video/Imaging Fixed-Point Digital Signal Processor Data Manu.2002, 7.
[18] Texas Instruments Incorporated. TMS320C6000 Technical Brief. 1999, 2.
[19] Texas Instruments Incorporated.TMS320C6000 DSP Cache User's Guide. 2003,3.
[20] Texas Instruments Incorporated.TMS320 DM642 Video/Imaging Fixed-Point Digital signal Processor.2002, 7.
[21] Texas Instruments Incorporated. Code Composer Studio GettingStarted Guide. 2003, 8.
[22]彭启琮,管庆等. DSP集成开发环境---CCS及DSP/BIOS的原理与应用.北京:电子工业出版社. 2004.
[23]田黎育,何佩琨,朱梦宇. TMS320C6000系列DSP编程工具与指南.北京:清华大学出版社,2006.
[24] Texas Instruments Incorporated. Code Composer Studio Development Tools v3.1. 2005, 5.
[25] Texas Instruments Incorporated. Code Composer Studio Development Tools v3.1. 2005, 7.
[26]李方慧,王飞等. TMS320C6000系列DSP原理与应用[M].北京:电子工业出版社,2005.
[27] Texas Instruments Incorporated. TMS320C6000 CPU and Instruction Set Reference Guide.2000, 10.
[28] Texas Instruments Incorporated. TMS320C6000 Optimizing C Compiler Tutorial. 2002, 6.
[29] Texas Instruments Incorporated. TMS320C6000 Optimizing Compiler User's Guide. 2002, 10.
[30] Texas Instruments Incorporated. TMS320C6000 Optimizing C Compiler Tutorial. 2002, 10.
© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号 地址：北京市海淀区学院路29号 邮编：100083 电话：办公室：(+86 10)66554848；文献借阅、咨询服务、科技查新：66554700 |