基于流媒体的视频监控系统的研究与实现
|
摘要
随着流媒体技术和网络技术的发展,视频监控系统在现实生活中的应用越来越广泛。如何有效地提高视频监控系统对主机资源和网络资源的利用效率,使其能够优质、高效、灵活地为工业生产和社会生活提供服务,成为当前视频监控系统研究的核心。
本文围绕江苏省“十五”科技攻关项目“网络化焊接机器人研制与跃进汽车集团焊接生产线应用工程”的子课题——机器人焊接生产线监控系统,讨论了基于流媒体的网络化视频监控系统的需求分析、系统设计和实现等问题。该系统实现了视频采集、录像、实时组播、查询点播和开放录像控制接口等功能。系统实现了采用RTP实时传输协议的视频数据传输,视频数据解码播放利用DirectShow架构实现。文中提出了一种动态录像的策略和算法,该算法可以在不影响录像效果的情况下,有效节省录像文件占用的存储空间。系统提供了允许第三方系统控制录像的接口,提高了系统的灵活性和开放性。
在深入研究视频数据网络传输的特点和现有拥塞控制策略特点的基础上,本文提出了一种先将原始的RGB图像按时间分层后再编码传输的分层编码流拥塞制策略,给出了实现方法和试验结果。在这一传输策略中,各层独立编码,去除了传统分层编码策略中各层分为基础层和增强层的顺序限制关系,使多媒体数据传输能适应更宽的网络带宽范围、提高了网络传输的灵活性和鲁棒性,并且易于实现。
With the development of streaming-media and network technology, video surveillance plays an increasingly important role in the national economy. How to utilize the hosts’resource and network resource more efficiently is the core technology of video surveillance.
In this dissertation, the R&D of a streaming-based digital video surveillance system is discussed detailedly surrounding with Monitoring and Control System of Robot Welding Product Line, which is a subtask of the Tenth Five Tackle Key Project of Jiangsu Province‘R&D of Open Network Industrial Robot and the Application Project of Automobile Welding Product Line of Yuejin Motor Company’. The system implements a lot of functions include video capture, video record, real-time multicast, video-on-demand (VOD) and the opening interface for third-party systems such as parameter monitoring system. The video data transmission part of the system employs the RTP/RTCP protocol; the video playback part is developed based on DirectShow architecture. A dynamical record algorithm is proposed in the dissertation. This algorithm can save a lot of disk space while obtaining well smooth record files. The system provides a control interface for the third systems with which they can control the system in video record. That improves the system in flexibility and opening.
To distribute video data on the Intranet better, a layered coding congestion control scheme is proposed. Using the scheme, the RGB video stream will be splitted into several substreams in temporal direction equably, and then each susstream will be encoded and send to the Intranet. The dissertation shows the process and the result of the experiment and the way of implementation. Also, the properties of this scheme are discussed. In this scheme, all layers will be encoded separately, the traditional constain, which separates all the layers as base layer and enhanced layers, and all layers have different important level, is wiped off, so that the scheme can be adapted to a larger scale of network bandwidth. And the scheme provides more flexibility and robustness; also the scheme can be implemented easily.
本文围绕江苏省“十五”科技攻关项目“网络化焊接机器人研制与跃进汽车集团焊接生产线应用工程”的子课题——机器人焊接生产线监控系统,讨论了基于流媒体的网络化视频监控系统的需求分析、系统设计和实现等问题。该系统实现了视频采集、录像、实时组播、查询点播和开放录像控制接口等功能。系统实现了采用RTP实时传输协议的视频数据传输,视频数据解码播放利用DirectShow架构实现。文中提出了一种动态录像的策略和算法,该算法可以在不影响录像效果的情况下,有效节省录像文件占用的存储空间。系统提供了允许第三方系统控制录像的接口,提高了系统的灵活性和开放性。
在深入研究视频数据网络传输的特点和现有拥塞控制策略特点的基础上,本文提出了一种先将原始的RGB图像按时间分层后再编码传输的分层编码流拥塞制策略,给出了实现方法和试验结果。在这一传输策略中,各层独立编码,去除了传统分层编码策略中各层分为基础层和增强层的顺序限制关系,使多媒体数据传输能适应更宽的网络带宽范围、提高了网络传输的灵活性和鲁棒性,并且易于实现。
With the development of streaming-media and network technology, video surveillance plays an increasingly important role in the national economy. How to utilize the hosts’resource and network resource more efficiently is the core technology of video surveillance.
In this dissertation, the R&D of a streaming-based digital video surveillance system is discussed detailedly surrounding with Monitoring and Control System of Robot Welding Product Line, which is a subtask of the Tenth Five Tackle Key Project of Jiangsu Province‘R&D of Open Network Industrial Robot and the Application Project of Automobile Welding Product Line of Yuejin Motor Company’. The system implements a lot of functions include video capture, video record, real-time multicast, video-on-demand (VOD) and the opening interface for third-party systems such as parameter monitoring system. The video data transmission part of the system employs the RTP/RTCP protocol; the video playback part is developed based on DirectShow architecture. A dynamical record algorithm is proposed in the dissertation. This algorithm can save a lot of disk space while obtaining well smooth record files. The system provides a control interface for the third systems with which they can control the system in video record. That improves the system in flexibility and opening.
To distribute video data on the Intranet better, a layered coding congestion control scheme is proposed. Using the scheme, the RGB video stream will be splitted into several substreams in temporal direction equably, and then each susstream will be encoded and send to the Intranet. The dissertation shows the process and the result of the experiment and the way of implementation. Also, the properties of this scheme are discussed. In this scheme, all layers will be encoded separately, the traditional constain, which separates all the layers as base layer and enhanced layers, and all layers have different important level, is wiped off, so that the scheme can be adapted to a larger scale of network bandwidth. And the scheme provides more flexibility and robustness; also the scheme can be implemented easily.
引文
[1] Kantarci, A., Tunali, T. The design and implementation of a streaming application for MPEG videos[C]. 2000 IEEE International Conference on Multimedia and Expo. ICME 2000, 30 July-2 Aug. 2000 Vol.2,1021 – 1024.
[2] 刘富强. 数字视频监控系统开发及应用[M]. 北京:机械工业出版社,2003,1
[3] 张海藩. 软件工程导论[M]. 第三版. 北京:清华大学出版社, 1998,1:5-15
[4] 过 国 忠 , 王 东 海 . 数 字 监 控 系 统 的 设 计 与 策 划 [J]. 浙 江 师 范 大 学 学 报 ( 自 然 科 学版).2003,26(4):360-364
[5] 郭英. 数字视频远程监控技术及应用[J]. 广东公安科技.2003,3:48-51
[6] 黄晓萍 , 王 斌 等 . 数字 视频监 控 技术 在 核 事 故 应 急 中 的 应 用 [J]. 原子 能科学 技术.2003,37(2):182-184
[7] 丰 洪 才 . IP 组 播 技 术 在 远 程 监 控 中 的 应 用 [J]. 华 中 科 技 大 学 学 报 ( 自 然 科 学版),2003,31(S1):40-42
[8] Microsoft. DirectX 9.0 Software Development Kit (SDK) with DirectX 9.0bRuntime[EB/OL].http://www.microsoft.com/downloads/details.aspx?FamilyID=1d97f320-9dfd-4e7a-b947-3a037ccf84af&displaylang=en.2003,07,21
[9] 潘爱民. COM 原理与应用[M]. 北京:清华大学出版社, 1999,11:11-14
[10] 陆其明. DirectShow 开发指南[M].北京:清华大学出版社,2003,12
[11] (美)W.Richard Stevens 著. TCP/IP 详解 卷 1:协议[M]. 范建华等 译.北京:机械工业出版社,2004,8:1,129,210
[12] 黎连业, 王 安,向东明 著. 交换机及其应用技术[M]. 北京:清华大学出版社,2004,7:211-215
[13] IETF. RTP: A Transport Protocol for Real-Time Applications (RFC 3550)[EB/OL].http://www.ietf.org/rfc/rfc3550.txt?number=3550. 2003,7
[14] IETF. Real Time Streaming Protocol (RTSP) (RFC2326)[EB/OL].http://www.ietf.org/rfc/rfc2326.txt?number=2326. 1998,4
[15] IETF. RTP Profile for Audio and Video Conferences with Minimal Control[EB/OL].http://www.ietf.org/rfc/rfc3550.txt?number=3551. 2003,7
[16] 史翠竹等.视频点播系统中客户端的缓存管理和码率控制策略研究[J].计算机工程与应用,2004,7:126-129
[17] 樊春梅 , 王旭东 , 张银秀 , 薛玲 . 视频信号采集系统的设计 [J]. 哈尔滨理工大学学报.2003,8(2),22-25
[18] 成功, 杨佃福. VC 中几种数据库访问技术的比较与选择[J]. 计算机应用研究. 2002,2:82-84
[19] 王军,吴志美.交换式以太网中连续实时流媒体的可靠组播[J].软件学报,2004,15(2):229-237
[20] 赵黔莉,涂国防.Internet 视频传输的拥塞控制策略[J].计算机工程,2004,30(1):144-147
[21] 徐建军, 李强. 视频监控系统中基于 MPEG-1 数据流的丢帧机制[J]. 空军雷达学院学报, 2002,16(4):28-30
[22] Sun Y.S., Tsou F.-M., Chen M.C., Tsai, Z. A TCP-friendly congestion control scheme for real-time packet video using prediction[C]. Global Telecommunications Conference, 1999. GLOBECOM '99 , 1999, vol.3 :1818 - 1822
[23] Cheng Wanxiang, Lei Zhenming. The research on constrained TCP-friendly congestion control[C]. 2001 International Conferences on Info-tech and Info-net ICII 2001 - Beijing., 29 Oct.-1 Nov. 2001 ,vol.2: 362 - 367
[24] 尹冬生, 刘郁恒, 张丰沛等. 一种面向多媒体的 TCP 友善的分层组播拥塞控制协议[J]. 电路与系统学报. 2004, 9(4):92-96
[25] Sisalem, D., Wolisz, A. Towards TCP-friendly adaptive multimedia applications based on RTP[C]. IEEE International Symposium on Computers and Communications. 6-8 July 1999:166 - 172
[26] Gharai L., Perkins C. Implementing congestion control in the real world[C]. 2002 IEEE International Conference on Multimedia and Expo. 26-29 Aug. 2002 ,vol.1: 397 - 400
[27] Abdul H. Sadka. Compressed Video Communications(影印版)(M).北京:科学出版社,2004,5:109-112
[28] Yao Wang, J?rn Ostermann et al. 视频处理与通信[M]. 候正信等译. 北京:电子工业出版社,2003. 269-287
[29] Kang, S.H. Effective bandwidth based scheduling for streaming multimedia[C]. 2003 International Conference on Image Processing. 14-17 Sept. 2003, vol.3: Ⅲ-633-Ⅲ-636
[30] 戚红一.数据访问技术ADO的CONNECTION对象对数据库服务器的性能影响[J]. 计算机时代. 2002,05: 24-25
[31] 陈坚,陈伟等. Visual C++网络高级编程[M]. 北京:人民邮电出版社,2001,8:19-28
[32] 苏羽,王媛媛. Visual C++网络游戏建模与实现[M]. 北京:北京科海电子出版社,2003,6:23-33
[33] (美)Anthony Jones, Jim Ohlund 著. Windows 网络编程技术[M], 京京工作室译. 北京:机械工业出版社,2000:89-100,261-288
[34] 李捷. 周云娴. 王雨等.网络视频编码中的分层技术[J]. 计算机工程与应用. 1999,8:81-86
[2] 刘富强. 数字视频监控系统开发及应用[M]. 北京:机械工业出版社,2003,1
[3] 张海藩. 软件工程导论[M]. 第三版. 北京:清华大学出版社, 1998,1:5-15
[4] 过 国 忠 , 王 东 海 . 数 字 监 控 系 统 的 设 计 与 策 划 [J]. 浙 江 师 范 大 学 学 报 ( 自 然 科 学版).2003,26(4):360-364
[5] 郭英. 数字视频远程监控技术及应用[J]. 广东公安科技.2003,3:48-51
[6] 黄晓萍 , 王 斌 等 . 数字 视频监 控 技术 在 核 事 故 应 急 中 的 应 用 [J]. 原子 能科学 技术.2003,37(2):182-184
[7] 丰 洪 才 . IP 组 播 技 术 在 远 程 监 控 中 的 应 用 [J]. 华 中 科 技 大 学 学 报 ( 自 然 科 学版),2003,31(S1):40-42
[8] Microsoft. DirectX 9.0 Software Development Kit (SDK) with DirectX 9.0bRuntime[EB/OL].http://www.microsoft.com/downloads/details.aspx?FamilyID=1d97f320-9dfd-4e7a-b947-3a037ccf84af&displaylang=en.2003,07,21
[9] 潘爱民. COM 原理与应用[M]. 北京:清华大学出版社, 1999,11:11-14
[10] 陆其明. DirectShow 开发指南[M].北京:清华大学出版社,2003,12
[11] (美)W.Richard Stevens 著. TCP/IP 详解 卷 1:协议[M]. 范建华等 译.北京:机械工业出版社,2004,8:1,129,210
[12] 黎连业, 王 安,向东明 著. 交换机及其应用技术[M]. 北京:清华大学出版社,2004,7:211-215
[13] IETF. RTP: A Transport Protocol for Real-Time Applications (RFC 3550)[EB/OL].http://www.ietf.org/rfc/rfc3550.txt?number=3550. 2003,7
[14] IETF. Real Time Streaming Protocol (RTSP) (RFC2326)[EB/OL].http://www.ietf.org/rfc/rfc2326.txt?number=2326. 1998,4
[15] IETF. RTP Profile for Audio and Video Conferences with Minimal Control[EB/OL].http://www.ietf.org/rfc/rfc3550.txt?number=3551. 2003,7
[16] 史翠竹等.视频点播系统中客户端的缓存管理和码率控制策略研究[J].计算机工程与应用,2004,7:126-129
[17] 樊春梅 , 王旭东 , 张银秀 , 薛玲 . 视频信号采集系统的设计 [J]. 哈尔滨理工大学学报.2003,8(2),22-25
[18] 成功, 杨佃福. VC 中几种数据库访问技术的比较与选择[J]. 计算机应用研究. 2002,2:82-84
[19] 王军,吴志美.交换式以太网中连续实时流媒体的可靠组播[J].软件学报,2004,15(2):229-237
[20] 赵黔莉,涂国防.Internet 视频传输的拥塞控制策略[J].计算机工程,2004,30(1):144-147
[21] 徐建军, 李强. 视频监控系统中基于 MPEG-1 数据流的丢帧机制[J]. 空军雷达学院学报, 2002,16(4):28-30
[22] Sun Y.S., Tsou F.-M., Chen M.C., Tsai, Z. A TCP-friendly congestion control scheme for real-time packet video using prediction[C]. Global Telecommunications Conference, 1999. GLOBECOM '99 , 1999, vol.3 :1818 - 1822
[23] Cheng Wanxiang, Lei Zhenming. The research on constrained TCP-friendly congestion control[C]. 2001 International Conferences on Info-tech and Info-net ICII 2001 - Beijing., 29 Oct.-1 Nov. 2001 ,vol.2: 362 - 367
[24] 尹冬生, 刘郁恒, 张丰沛等. 一种面向多媒体的 TCP 友善的分层组播拥塞控制协议[J]. 电路与系统学报. 2004, 9(4):92-96
[25] Sisalem, D., Wolisz, A. Towards TCP-friendly adaptive multimedia applications based on RTP[C]. IEEE International Symposium on Computers and Communications. 6-8 July 1999:166 - 172
[26] Gharai L., Perkins C. Implementing congestion control in the real world[C]. 2002 IEEE International Conference on Multimedia and Expo. 26-29 Aug. 2002 ,vol.1: 397 - 400
[27] Abdul H. Sadka. Compressed Video Communications(影印版)(M).北京:科学出版社,2004,5:109-112
[28] Yao Wang, J?rn Ostermann et al. 视频处理与通信[M]. 候正信等译. 北京:电子工业出版社,2003. 269-287
[29] Kang, S.H. Effective bandwidth based scheduling for streaming multimedia[C]. 2003 International Conference on Image Processing. 14-17 Sept. 2003, vol.3: Ⅲ-633-Ⅲ-636
[30] 戚红一.数据访问技术ADO的CONNECTION对象对数据库服务器的性能影响[J]. 计算机时代. 2002,05: 24-25
[31] 陈坚,陈伟等. Visual C++网络高级编程[M]. 北京:人民邮电出版社,2001,8:19-28
[32] 苏羽,王媛媛. Visual C++网络游戏建模与实现[M]. 北京:北京科海电子出版社,2003,6:23-33
[33] (美)Anthony Jones, Jim Ohlund 著. Windows 网络编程技术[M], 京京工作室译. 北京:机械工业出版社,2000:89-100,261-288
[34] 李捷. 周云娴. 王雨等.网络视频编码中的分层技术[J]. 计算机工程与应用. 1999,8:81-86
© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号 地址：北京市海淀区学院路29号 邮编：100083 电话：办公室：(+86 10)66554848；文献借阅、咨询服务、科技查新：66554700 |