视频点播系统服务器端设计及基于H.264/AVC的视频传输质量保障研究
|
摘要
近几年,随着网络应用的普及,人类通过网络获得的信息越来越丰富,同时对网络的依赖程度也逐步增加。多媒体信息具有直观和信息量大等特点,受到人们的广泛欢迎,这使得网络上的各项视频业务得到了飞速发展,如网络视频点播、网络可视电话、IPTV等。
在网络传输中,实际信道难以保证稳定可靠的传输质量,网络拥塞和网络误码都将导致信息的丢失。而原始视频信息数据量庞大,为了能在带宽受限的信道上传输视频,对视频信息进行数据压缩是必不可少的。为了获得高压缩比,目前的视频压缩编码技术均采用了运动补偿、预测和变长编码等技术来去掉视频序列中的大量时空相关性。冗余数据的减少使得压缩视频流在传输过程中对信道误码和包丢失十分敏感,即使单个突发性错误,也可能严重影响接收端的正常解码,造成恢复视频质量的急剧下降。因此视频业务的QoS受到了广泛关注,成为视频通信领域的研究热点之一。
本文主要研究视频通信系统开发及QoS技术中的相关问题,主要完成了如下一些工作:①研究并设计实现了一个具备并发服务能力的视频点播服务器,能够提供多用户视频点播服务。对于服务器端与客户端之间的命令交互,我们采用TCP协议以保持其完整和可靠递送,对于视频数据的传输由于实时性的要求则采用UDP协议,上层先用RTP协议进行封装。②研究和实验分析了H.264/AVC中相关差错控制技术,如灵活宏块次序FMO等。利用H.264/AVC的数据分割机制,实现了一种基于RTP的视频数据分割打包算法和FEC编译码算法,并通过不均衡错误保护来提高视频通信的抗差错能力。实验表明,这种方案在保证实时性的前提下能够有效的降低丢包率,提高了视频传输的可靠性。③本文还研究并实现了一种基于接收端反馈的速率控制方法,以解决拥塞控制问题。服务器可以根据客户端反馈的丢包率参数进行决策,对发送速率进行实时调整,从而降低丢包率,缓解拥塞,提高信道利用率。
As the prevalence of network applications in recent years, people has got more and more abundant information through the network, meantime they depend on network more and more. Multimedia information is welcomed by people because it is intuitionistic, full of great information content and so on. As a result, different kinds of video services on network are rapidly developed such as network video on demand, network video phone, IPTV and so on.
Steady and reliable transmission quality cannot be achieved by real channel during transmission, network congestion and network bit error both could cause information loss. At the same time, raw video data has got a large amount of information, so it is absolutely necessary to compress video data so as to carry out video transmission over bandwidth limited channel. For high compression ratio, video compression encoding standards today all adopt technologies such as motion compensation , prediction, variable length codes and so on to reduce abundant space-time relativity existing in video sequence. Reduction of redundant data make compressed video stream more sensitive to bit error and packet loss, even if single burst error has happened, it will take serious affect to natural decoding of the client and the video deconstruction quality will be rapidly dropped. As a result, QoS of video services is now attracting great attention, and it becomes one of the hot topics in video communication field.
This article mainly focuses on research and development of video communication system and related problems of QoS technologies, we mainly complete some tasks as follows: Firstly, we research and develop a video server with the ability of supporting concurrent streams, It can supply the multi-users with video on demand service. We adopt TCP protocol to assure the integrative and reliable delivery of alternant command, and UDP protocol is used on video data transmission as a result of its real-time requirement, meantime video data is encapsulated on the high layer using RTP protocol before. Secondly, we research and carry out experiments to analyze the related error control technologies based on H.264/AVC such as Flexible Macroblock Order and so on. Besides a scheme adopting H.264 data partition, fragmented packet encapsulation using rtp and unequal error protection based on forward error correction are presented. The experiment results demonstrate that this scheme could reduce packet loss rate effectively, also the real-time performance is assured and the reliability is enhanced. Thirdly, we research and realize a rate control method based on feedback from receiver so as to solve the congestion problem. The server could make a decision and adjust the sending speed of video packets timely according to the packet loss rate parameter submitted by client so as to reduce the packet loss rate, help to solve congestion and improve channel efficiency.
在网络传输中,实际信道难以保证稳定可靠的传输质量,网络拥塞和网络误码都将导致信息的丢失。而原始视频信息数据量庞大,为了能在带宽受限的信道上传输视频,对视频信息进行数据压缩是必不可少的。为了获得高压缩比,目前的视频压缩编码技术均采用了运动补偿、预测和变长编码等技术来去掉视频序列中的大量时空相关性。冗余数据的减少使得压缩视频流在传输过程中对信道误码和包丢失十分敏感,即使单个突发性错误,也可能严重影响接收端的正常解码,造成恢复视频质量的急剧下降。因此视频业务的QoS受到了广泛关注,成为视频通信领域的研究热点之一。
本文主要研究视频通信系统开发及QoS技术中的相关问题,主要完成了如下一些工作:①研究并设计实现了一个具备并发服务能力的视频点播服务器,能够提供多用户视频点播服务。对于服务器端与客户端之间的命令交互,我们采用TCP协议以保持其完整和可靠递送,对于视频数据的传输由于实时性的要求则采用UDP协议,上层先用RTP协议进行封装。②研究和实验分析了H.264/AVC中相关差错控制技术,如灵活宏块次序FMO等。利用H.264/AVC的数据分割机制,实现了一种基于RTP的视频数据分割打包算法和FEC编译码算法,并通过不均衡错误保护来提高视频通信的抗差错能力。实验表明,这种方案在保证实时性的前提下能够有效的降低丢包率,提高了视频传输的可靠性。③本文还研究并实现了一种基于接收端反馈的速率控制方法,以解决拥塞控制问题。服务器可以根据客户端反馈的丢包率参数进行决策,对发送速率进行实时调整,从而降低丢包率,缓解拥塞,提高信道利用率。
As the prevalence of network applications in recent years, people has got more and more abundant information through the network, meantime they depend on network more and more. Multimedia information is welcomed by people because it is intuitionistic, full of great information content and so on. As a result, different kinds of video services on network are rapidly developed such as network video on demand, network video phone, IPTV and so on.
Steady and reliable transmission quality cannot be achieved by real channel during transmission, network congestion and network bit error both could cause information loss. At the same time, raw video data has got a large amount of information, so it is absolutely necessary to compress video data so as to carry out video transmission over bandwidth limited channel. For high compression ratio, video compression encoding standards today all adopt technologies such as motion compensation , prediction, variable length codes and so on to reduce abundant space-time relativity existing in video sequence. Reduction of redundant data make compressed video stream more sensitive to bit error and packet loss, even if single burst error has happened, it will take serious affect to natural decoding of the client and the video deconstruction quality will be rapidly dropped. As a result, QoS of video services is now attracting great attention, and it becomes one of the hot topics in video communication field.
This article mainly focuses on research and development of video communication system and related problems of QoS technologies, we mainly complete some tasks as follows: Firstly, we research and develop a video server with the ability of supporting concurrent streams, It can supply the multi-users with video on demand service. We adopt TCP protocol to assure the integrative and reliable delivery of alternant command, and UDP protocol is used on video data transmission as a result of its real-time requirement, meantime video data is encapsulated on the high layer using RTP protocol before. Secondly, we research and carry out experiments to analyze the related error control technologies based on H.264/AVC such as Flexible Macroblock Order and so on. Besides a scheme adopting H.264 data partition, fragmented packet encapsulation using rtp and unequal error protection based on forward error correction are presented. The experiment results demonstrate that this scheme could reduce packet loss rate effectively, also the real-time performance is assured and the reliability is enhanced. Thirdly, we research and realize a rate control method based on feedback from receiver so as to solve the congestion problem. The server could make a decision and adjust the sending speed of video packets timely according to the packet loss rate parameter submitted by client so as to reduce the packet loss rate, help to solve congestion and improve channel efficiency.
引文
[1]Joint Video Team of ITU-T and ISO/IEC JTC 1,"Draft ITU-T Recommendation and Final Draft International Standard of Joint Video Specification(ITU-T Rec.H.264ISO/IEC 14496-10 AVC)," Joint Video Team(JVT)of ISO/IEC MPEG and ITU-T VCEG,JVT-G050,March 2003
[2]Iain E.G.Richarson.H.264 and MPEG-4 Video Compression.Aberdeen,UK.2003
[3]余兆明,查日勇,黄磊等,《图像编码标准H.264技术》,人民邮电出版社,2006年
[4]周宁兆,宋彬,常义林。基于H.264/AVC的视频通信抗分组丢失方法研究,计算机学报,2006,29(2):267-273
[5]Liu C C,Chen S S.Providing unequal reliability for transmitting layered video streams over wireless networks by multi-ARQ schemes.In:J Communications,ed.1999 International Conference on Image Processing.IEEE Operations Center,1999,3:100-104
[6]H.Schulzrinne,RFC1890:RTP Profile for Audio and Video Conferences with Minimal Control,January 1996
[7]马海燕,H.264的网络传输适应性解决方案,北京广播学院学报(自然科学版),2005,12(1):68-72
[8]W.Richard Stevens著,范建华,胥光辉,张涛等译,《TCP/IP详解卷1:协议》,机械工业出版社,2006年
[9]Douglas E.Comer著,林瑶,蒋慧,杜蔚轩等译,《用TCP/IP进行网际互联 第一卷:原理、协议与结构》,第四版,电子工业出版社,2003年
[10]H.Schulzrinne,S.Casner,R.Frederick et al.RFC1889:RTP:A Transport Protocol for Real-time Applications,January 1996
[11]蔡安妮,孙景鳌,《多媒体通信技术基础》,电子工业出版社,2000年
[12]J.Rosenberg,H.Schulzrinne.RFC2733:An RTP Payload Format for Generic Forward Error Correction.Reston,USA:IETF,1999
[13]Varsa V,Karczewicz M,Roth G,et al.Common test conditions for RTP/IP over 3GPP/3GPP2[C]//VCEG N80,JVT of ISO/ IEC MPEG & ITU-T VCEG 4th Meeting.Santa Barbara:[s.n.],2001
[14]W.Richard Stevens,BILL FENNER,ANDREW M.RUDOFF著,杨继张译, 《UNIX网络编程第1卷:套接口API》,第三版,清华大学出版社,2006年
[15]W.Richard Stevens,Stephen A.Rago著,尤晋元,张亚英,戚正伟译,《UNIX 环境高级编程》,第二版,人民邮电出版社,2006年
[16]T.Wiegand,G.J.Sullivan,G.Bjφntegaard,et al.Overview of the H.264/AVC video coding standard.IEEE Trans.Circuits Syst.Video Technol,vol.13,July 2003:560-576
[17]M.Karczewicz and R.Kureren.The SP and SI frames design for H.264/AVC.IEEE Trans.Circuits Syst.Video Technol,vol.13,July 2003:637-644
[18]H.264/AVC JM Software:http://bs.hhi.de/～suehring/tml/download
[19]安维嵘,张旭东。一种适用于H.264的时域差错掩盖改进算法,中国图象图形学报,2004,9(9):1124-1129
[20]Stephan Wenger.H.264/AVC over IP.IEEE Transactions on Circuits and Systems for Video Technology,2003,13(7):645-656
[21]Thomas Stockhammer,Miska M.Hannuksela,Thomas Wiegand.H.264/AVC in wireless environments.IEEE Transactions on Circuits and Systems for Video Technology,2003,13(7):657-673.
[22]S.Wenger,M.M.Hannuksela,T.Stockhammer,et al.RFC3984:RTP Payload Format for H.264 Video.Reston,USA:IETF,2005
[2]Iain E.G.Richarson.H.264 and MPEG-4 Video Compression.Aberdeen,UK.2003
[3]余兆明,查日勇,黄磊等,《图像编码标准H.264技术》,人民邮电出版社,2006年
[4]周宁兆,宋彬,常义林。基于H.264/AVC的视频通信抗分组丢失方法研究,计算机学报,2006,29(2):267-273
[5]Liu C C,Chen S S.Providing unequal reliability for transmitting layered video streams over wireless networks by multi-ARQ schemes.In:J Communications,ed.1999 International Conference on Image Processing.IEEE Operations Center,1999,3:100-104
[6]H.Schulzrinne,RFC1890:RTP Profile for Audio and Video Conferences with Minimal Control,January 1996
[7]马海燕,H.264的网络传输适应性解决方案,北京广播学院学报(自然科学版),2005,12(1):68-72
[8]W.Richard Stevens著,范建华,胥光辉,张涛等译,《TCP/IP详解卷1:协议》,机械工业出版社,2006年
[9]Douglas E.Comer著,林瑶,蒋慧,杜蔚轩等译,《用TCP/IP进行网际互联 第一卷:原理、协议与结构》,第四版,电子工业出版社,2003年
[10]H.Schulzrinne,S.Casner,R.Frederick et al.RFC1889:RTP:A Transport Protocol for Real-time Applications,January 1996
[11]蔡安妮,孙景鳌,《多媒体通信技术基础》,电子工业出版社,2000年
[12]J.Rosenberg,H.Schulzrinne.RFC2733:An RTP Payload Format for Generic Forward Error Correction.Reston,USA:IETF,1999
[13]Varsa V,Karczewicz M,Roth G,et al.Common test conditions for RTP/IP over 3GPP/3GPP2[C]//VCEG N80,JVT of ISO/ IEC MPEG & ITU-T VCEG 4th Meeting.Santa Barbara:[s.n.],2001
[14]W.Richard Stevens,BILL FENNER,ANDREW M.RUDOFF著,杨继张译, 《UNIX网络编程第1卷:套接口API》,第三版,清华大学出版社,2006年
[15]W.Richard Stevens,Stephen A.Rago著,尤晋元,张亚英,戚正伟译,《UNIX 环境高级编程》,第二版,人民邮电出版社,2006年
[16]T.Wiegand,G.J.Sullivan,G.Bjφntegaard,et al.Overview of the H.264/AVC video coding standard.IEEE Trans.Circuits Syst.Video Technol,vol.13,July 2003:560-576
[17]M.Karczewicz and R.Kureren.The SP and SI frames design for H.264/AVC.IEEE Trans.Circuits Syst.Video Technol,vol.13,July 2003:637-644
[18]H.264/AVC JM Software:http://bs.hhi.de/～suehring/tml/download
[19]安维嵘,张旭东。一种适用于H.264的时域差错掩盖改进算法,中国图象图形学报,2004,9(9):1124-1129
[20]Stephan Wenger.H.264/AVC over IP.IEEE Transactions on Circuits and Systems for Video Technology,2003,13(7):645-656
[21]Thomas Stockhammer,Miska M.Hannuksela,Thomas Wiegand.H.264/AVC in wireless environments.IEEE Transactions on Circuits and Systems for Video Technology,2003,13(7):657-673.
[22]S.Wenger,M.M.Hannuksela,T.Stockhammer,et al.RFC3984:RTP Payload Format for H.264 Video.Reston,USA:IETF,2005
© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号 地址：北京市海淀区学院路29号 邮编：100083 电话：办公室：(+86 10)66554848；文献借阅、咨询服务、科技查新：66554700 |