多功能IP摄像机的设计实现及流媒体传输的研究
|
摘要
随着互联网的普及和网络传输技术的进步,使得基于有线或者无线IP网的多媒体通信成为现实。基于IP网的多媒体通信终端极大的降低了通信成本,使通信更加灵活、方便、快捷,内容更加丰富。
本文提出了一种多功能IP摄像机的设计实现方案,能够通过有线或者无线IP网络进行多媒体全双工通信,还能够与公共电话网进行互联,适用于大型工厂、车间、企业以及家庭门禁安防系统。在野外缺少通信基础设施的情况下,还能通过无线自组网实现通信。
多功能IP摄像机基于嵌入式硬件平台开发,以Z228高性能多媒体处理芯片为核心,内嵌MPEG-4硬件编解码器,能够实时地对视频信息进行编解码,具有很强的多媒体处理能力和网络交互能力。
多功能IP摄像机采用了嵌入式Linux操作系统,负责对系统硬件和软件的管理,对资源的分配和回收,并提供人机交互接口。
本文主要完成了多功能IP摄像机模块化驱动程序和应用软件的开发。其中应用软件的设计与实现是本文的重点,主要包括:基于socket interface异步并发处理服务器模型的构建,基于实例的模块化应用程序结构的设计与具体功能的实现,多功能IP摄像机专用通信协议的设计与实现,基于参考窗口的帧率控制算法的设计实现和性能分析、基于闭环控制原理的网络带宽自适应控制器,并初步实现了通过RTP协议进行流媒体的传输。
目前已经成功实现了多功能IP摄像机之间的消息通信,全双工多媒体实时通信,远程控制和管理,用户管理,较为精确和稳定的帧率控制,网络带宽自适应控制,基于RTP协议的流媒体传输。
With the development of network transmission technology and prevalence of Internet, the dream of multimedia communication based on LAN or WLAN can be translated into reality. Generally speaking, multimedia communication based on LAN or WLAN is lower cost, faster, more flexible and convenience.
In this thesis, we propose a design for a kind of multi-function IP camera which is developed as a platform for full-duplex and real-time multimedia communication through LAN or WLAN, and interconnection with public telephone network. This IP camera can be used in large-scale factories, workshop, enterprise and family monitor & security system. Additional, in outdoors IP cameras are able to communicate with each other base on MANET(Mobile Ad Hoc Network), without communication infrastructure, such as base station, rely station and so on.
The development of multi-function IP camera is based on embedded hardware platform, whose kernel is Z228 high performance processor. For integrated with MPEG-4 hardware encoder and decoder, Z228 provide high capability for multimedia process and network transmission.
The Linux operation system is ported to embedded hardware system of the IP camera, which is responsible for system resources management and providing friendly interactive interface with local user.
The work in this thesis is related with development of modularized driver program and application program. And in this thesis, a great emphases is put on design for application program, including design for currency handle architecture based on asynchronous socket interface, modularized application program development in instantiation method, design and performance analysis for frame rate controller based on reference window time algorithm, design for multi-function IP camera communication protocol, implementation of network automatic adaptation control based on loop control theory, and streaming media transmission by RTP protocol.
In this thesis, the following functions have been implemented: message communication between multi-function IP cameras, full-duplex and real-time multimedia communication, remote control and management, user information management, relatively precise and stable frame rate control, network automatic adaptation control and streaming media transmission by RTP protocol.
本文提出了一种多功能IP摄像机的设计实现方案,能够通过有线或者无线IP网络进行多媒体全双工通信,还能够与公共电话网进行互联,适用于大型工厂、车间、企业以及家庭门禁安防系统。在野外缺少通信基础设施的情况下,还能通过无线自组网实现通信。
多功能IP摄像机基于嵌入式硬件平台开发,以Z228高性能多媒体处理芯片为核心,内嵌MPEG-4硬件编解码器,能够实时地对视频信息进行编解码,具有很强的多媒体处理能力和网络交互能力。
多功能IP摄像机采用了嵌入式Linux操作系统,负责对系统硬件和软件的管理,对资源的分配和回收,并提供人机交互接口。
本文主要完成了多功能IP摄像机模块化驱动程序和应用软件的开发。其中应用软件的设计与实现是本文的重点,主要包括:基于socket interface异步并发处理服务器模型的构建,基于实例的模块化应用程序结构的设计与具体功能的实现,多功能IP摄像机专用通信协议的设计与实现,基于参考窗口的帧率控制算法的设计实现和性能分析、基于闭环控制原理的网络带宽自适应控制器,并初步实现了通过RTP协议进行流媒体的传输。
目前已经成功实现了多功能IP摄像机之间的消息通信,全双工多媒体实时通信,远程控制和管理,用户管理,较为精确和稳定的帧率控制,网络带宽自适应控制,基于RTP协议的流媒体传输。
With the development of network transmission technology and prevalence of Internet, the dream of multimedia communication based on LAN or WLAN can be translated into reality. Generally speaking, multimedia communication based on LAN or WLAN is lower cost, faster, more flexible and convenience.
In this thesis, we propose a design for a kind of multi-function IP camera which is developed as a platform for full-duplex and real-time multimedia communication through LAN or WLAN, and interconnection with public telephone network. This IP camera can be used in large-scale factories, workshop, enterprise and family monitor & security system. Additional, in outdoors IP cameras are able to communicate with each other base on MANET(Mobile Ad Hoc Network), without communication infrastructure, such as base station, rely station and so on.
The development of multi-function IP camera is based on embedded hardware platform, whose kernel is Z228 high performance processor. For integrated with MPEG-4 hardware encoder and decoder, Z228 provide high capability for multimedia process and network transmission.
The Linux operation system is ported to embedded hardware system of the IP camera, which is responsible for system resources management and providing friendly interactive interface with local user.
The work in this thesis is related with development of modularized driver program and application program. And in this thesis, a great emphases is put on design for application program, including design for currency handle architecture based on asynchronous socket interface, modularized application program development in instantiation method, design and performance analysis for frame rate controller based on reference window time algorithm, design for multi-function IP camera communication protocol, implementation of network automatic adaptation control based on loop control theory, and streaming media transmission by RTP protocol.
In this thesis, the following functions have been implemented: message communication between multi-function IP cameras, full-duplex and real-time multimedia communication, remote control and management, user information management, relatively precise and stable frame rate control, network automatic adaptation control and streaming media transmission by RTP protocol.
引文
[1]Yeonjoon Chung;Min Ho Park;Eui Hyun Paik.A QoS negotiable service framework for multimedia services connected through subscriber networks.Consumer Electronics,2006.ISCE '06.2006 IEEE Tenth Intemational Symposium on 2006 Page(s):1-4
[2]常永宏.第三代移动通信系统与技术.人民邮电出版社,2002
[3]Ryu,B.;Andersen,T.;Elbatt,T.;Zhang,Y.Multitier mobile ad hoc networks:architecture,protocols,and performance.Military Communications Conference,2003.MILCOM 2003.IEEE Volume 2,13-16 Oct.2003Page(s):1280-1285 Vol.2
[4]Jung-Hyuck Jo;Jayant,H.Performance evaluation of multiple IEEE 802.11b WLAN stations in the presence of Bluetooth radio interference.Communications,2003.ICC '03.IEEE International Conference on Volume 2,11-15 May 2003 Page(s):1163-1168 vol.
[5]Janevski,T.;Tudzarov,A.;Stojanovski,P.;Temkov,D.Applicative Solution for Easy Introduction of WLAN as Value-Added Service in Mobile Networks.Vehicular Technology Conference,2007.VTC2007-Spring.IEEE 65~(th)22-25April 2007 Page(s):1096-1100
[6]Song,S.;Wu,Z.A broadband integrated services network architecture based on DWDM.Electrical and Computer Engineering,2001.Canadian Conference on Volume 1,13-16 May 2001 Page(s):347-352 vol.1
[7]Mysore,S.;Villa,R.;Beveridge,G Performance of broadband DWDM networks.Electronic-Enhanced Optics,Optical Sensing in Semiconductor Manufacturing,Electro-Optics in Space,Broadband Optical Networks,2000.Digest of the LEOS Summer Topical Meetings 24-28 July 2000 Page(s):Ⅳ23-Ⅳ24
[8]Bittlestone,C.;Hill,A.;Singhal,V.;Arvind,N.V.Architecting ASIC libraries and flows in nanometer era.Design Automation Conference,2003.Proceedings 2-6 June 2003 Page(s):776-781
[9]Iain E.G.Richardson.H.264 and MPEG-4 Video Commpression.John Wiley &Sons Ltd.2003
[10]Iain E.G.Richardson.H.264/MPEG-4 Part10 White Paper.www.vcodex.com 07/10/02
[11]Joint Video Team(JVT)of ISO/IEC MPEG and ITU-T VCEG Draft ITU-T Recommendation and Final Draft International Standard of Joint Video Specification (ITU-T Rec. H.264|ISO/IEC 14496-10 AVC).03/2005
[12] Songan Yang; Hua Yang; Yuhan Yang. Architecture of high capacity VOD server and the implementation of its prototype. Consumer Electronics, IEEE Transactions on Volume 49, Issue 4, Nov. 2003 Page(s): 1169 -1177
[13] H.Schulzriane, A.Rao, R.lamphier, Real-time Streaming Protocol (RTSP) [ S ].RFC 2326, April, 1998
[14] Changwoo Jee, Shin, K.G, "A DAVIC Video-on-Demand system based on the RTSP" , Applications and the Internet, 2001.Proceedings. 2001 Symposium on, 8-12 Jan. 2001 Pages:231 - 238
[15] Apple QuickTime, http://www.apple.com/quitcktime
[16] RealNetworks, RealNetworks Document Library,http://service.real.com/help/library/index.html
[17] Microsoft Windows Media Player,http://www.microsoft.com/windows/windowsmedia/default.asp
[18] Casilari, E.; Gonzblez, F.J.; Sandoval, F. Modeling of HTTP traffic.Communications Letters, IEEE Volume 5, Issue 6, June 2001 Page(s):272-274
[19] Cranor, CD.; Green, M.; Kalmanek, C; Shur, D.; Sibal, S.; Van der Merwe, J.E.;Sreenan, C.J. Enhanced streaming services in a content distribution network.Internet Computing, IEEE Volume 5, Issue 4, July-Aug. 2001 Page(s):66 -75
[20] Fagui Liu; Qiang Tan. Detecting and Solving Block Problems in Stream Media Transmission. Pervasive Computing and Applications, 2006 1st International Symposium on 3-5 Aug. 2006 Page(s):247 - 250
[21] Roy, S.; Covell, M.; Ankcorn, J.; Wee, S.; Yoshimura, T. A system architecture for managing mobile streaming media services. Distributed Computing Systems Workshops, 2003. Proceedings. 23rd International Conference on 19-22 May 2003 Page(s):408 - 413
[22] Wee, S.; Apostolopoulos, J.; Wai-tian Tan; Roy, S. Research and design of a mobile streaming media content delivery network. Multimedia and Expo, 2003.ICME'03. Proceedings. 2003 International Conference on Volume 1, 6-9 July2003 Page(s):I-5-8 vol.1
[23] Moen, H.L.; Jelle, T. The Potential for Location-Based Services with Wi-Fi RFID Tags in Citywide Wireless Networks. Wireless Communication Systems,2007. ISWCS 2007. 4th International Symposium on 17-19 Oct. 2007 Page(s):148-152
[24]INTEL.Intel XScale Microarchitechure for the PXA255 Processor User's Manual March,2003
[25]Jade.Z228 Application Processor Technical Reference Manual Preliminary Ⅴ2.6
[26]Ross Finlayson.http://www.live555.com/
[27]Jonathan Corbet,Alessandro Rubini& Greg Kroah-Hartman.LINUX DEVICE DRIVERS.O'REILLY,2006,Page:13
[28]马忠梅,李善平,康慨,叶楠.ARM&Linux嵌入式系统教程.北京航空航天大学出版社,2004
[29]ISO/IEC 9945-1:1990
[30]Linux/fs.h
[31]CML Microcircuits.CMX865 FSK Modem and DTMF Coded Reference Manual.2005
[32]W.Richard Stevens.TCP/IP详解卷1:协议.机械工业出版社,2007,Page(s):4-12.
[33]W.Richard Stevens,Bill Fenner,Andrew M.Rudoff.UNIX网络编程,卷1:套接口API,第3版.清华大学出版社,2006,Page(s):56-57
[34]W.Richard Stevens,Bill Fenner,Andrew M.Rudoff.UNIX网络编程,卷1:套接口API,第3版.清华大学出版社,2006,Page(s):87-92
[35]W.Richard Stevens,Stephen A.Rago.Advanced Programming in the UNIX Environment.PEARSON EDUCATION ASIA LTD,2005,Page(s):355-358
[36]Jamjoom,H.;Chou,C.-T.;Shin,K.G.The impact of concurrency gains on the analysis and control of multi-threaded Internet services.INFOCOM 2004.Twenty-third Annual Joint Conference of the IEEE Computer and Communications Societies Volume 2,7-11 March 2004 Page(s):827-837vol.2
[37]Welsh M.The Staged Event-driven Architecture for Highly Concurrent Server Applications[D].UC Berkeley,2000-12.
[38]Schmidt D C,Stal M,Rohnert H,et al.面向模式的软件体系结构,卷2:用于并发和网络化对象的模式[M].北京:机械工业出版社,2003.
[39]谢希仁.计算机网络,第四版.大连理工大学出版社,2003,Page 242
[40]Transmission Control Protocol.RFC-793
[41]UTF-8,a transformation format of ISO 10646.RFC-2279
[42]Westerink,P,;Amini,L.,Veliah,S.,Belknap,W.,"A live intranet distance learning system using MPEG-4 over RTP/RTSP"Multimedia and Expo,2000. ICME 2000.2000 IEEE International Conference on,Volume:2,30 July-2Aug.2000,Pages:601-604 vol.2
[43]许华荣,李名世.基于RTP的实时视频传输系统.计算机工程与设计,2005.4
[44]Shu-Ching Chen,Sheng-Tun Li,Mei-Ling Shyu,Chengjun Zhan,Chengcui Zhang," A multimedia semantic model for RTSPbased multimedia presentation systems",Multimedia Software Engineering,2002.Proceedings.Fourth International Symposium
[45]高旭,沈苏彬等.网络多媒体实时传输协议浅析.计算机应用研究,2000.02.
[46]钟玉琢,向哲等.流媒体和视频服务器.清华大学出版社,2003
[2]常永宏.第三代移动通信系统与技术.人民邮电出版社,2002
[3]Ryu,B.;Andersen,T.;Elbatt,T.;Zhang,Y.Multitier mobile ad hoc networks:architecture,protocols,and performance.Military Communications Conference,2003.MILCOM 2003.IEEE Volume 2,13-16 Oct.2003Page(s):1280-1285 Vol.2
[4]Jung-Hyuck Jo;Jayant,H.Performance evaluation of multiple IEEE 802.11b WLAN stations in the presence of Bluetooth radio interference.Communications,2003.ICC '03.IEEE International Conference on Volume 2,11-15 May 2003 Page(s):1163-1168 vol.
[5]Janevski,T.;Tudzarov,A.;Stojanovski,P.;Temkov,D.Applicative Solution for Easy Introduction of WLAN as Value-Added Service in Mobile Networks.Vehicular Technology Conference,2007.VTC2007-Spring.IEEE 65~(th)22-25April 2007 Page(s):1096-1100
[6]Song,S.;Wu,Z.A broadband integrated services network architecture based on DWDM.Electrical and Computer Engineering,2001.Canadian Conference on Volume 1,13-16 May 2001 Page(s):347-352 vol.1
[7]Mysore,S.;Villa,R.;Beveridge,G Performance of broadband DWDM networks.Electronic-Enhanced Optics,Optical Sensing in Semiconductor Manufacturing,Electro-Optics in Space,Broadband Optical Networks,2000.Digest of the LEOS Summer Topical Meetings 24-28 July 2000 Page(s):Ⅳ23-Ⅳ24
[8]Bittlestone,C.;Hill,A.;Singhal,V.;Arvind,N.V.Architecting ASIC libraries and flows in nanometer era.Design Automation Conference,2003.Proceedings 2-6 June 2003 Page(s):776-781
[9]Iain E.G.Richardson.H.264 and MPEG-4 Video Commpression.John Wiley &Sons Ltd.2003
[10]Iain E.G.Richardson.H.264/MPEG-4 Part10 White Paper.www.vcodex.com 07/10/02
[11]Joint Video Team(JVT)of ISO/IEC MPEG and ITU-T VCEG Draft ITU-T Recommendation and Final Draft International Standard of Joint Video Specification (ITU-T Rec. H.264|ISO/IEC 14496-10 AVC).03/2005
[12] Songan Yang; Hua Yang; Yuhan Yang. Architecture of high capacity VOD server and the implementation of its prototype. Consumer Electronics, IEEE Transactions on Volume 49, Issue 4, Nov. 2003 Page(s): 1169 -1177
[13] H.Schulzriane, A.Rao, R.lamphier, Real-time Streaming Protocol (RTSP) [ S ].RFC 2326, April, 1998
[14] Changwoo Jee, Shin, K.G, "A DAVIC Video-on-Demand system based on the RTSP" , Applications and the Internet, 2001.Proceedings. 2001 Symposium on, 8-12 Jan. 2001 Pages:231 - 238
[15] Apple QuickTime, http://www.apple.com/quitcktime
[16] RealNetworks, RealNetworks Document Library,http://service.real.com/help/library/index.html
[17] Microsoft Windows Media Player,http://www.microsoft.com/windows/windowsmedia/default.asp
[18] Casilari, E.; Gonzblez, F.J.; Sandoval, F. Modeling of HTTP traffic.Communications Letters, IEEE Volume 5, Issue 6, June 2001 Page(s):272-274
[19] Cranor, CD.; Green, M.; Kalmanek, C; Shur, D.; Sibal, S.; Van der Merwe, J.E.;Sreenan, C.J. Enhanced streaming services in a content distribution network.Internet Computing, IEEE Volume 5, Issue 4, July-Aug. 2001 Page(s):66 -75
[20] Fagui Liu; Qiang Tan. Detecting and Solving Block Problems in Stream Media Transmission. Pervasive Computing and Applications, 2006 1st International Symposium on 3-5 Aug. 2006 Page(s):247 - 250
[21] Roy, S.; Covell, M.; Ankcorn, J.; Wee, S.; Yoshimura, T. A system architecture for managing mobile streaming media services. Distributed Computing Systems Workshops, 2003. Proceedings. 23rd International Conference on 19-22 May 2003 Page(s):408 - 413
[22] Wee, S.; Apostolopoulos, J.; Wai-tian Tan; Roy, S. Research and design of a mobile streaming media content delivery network. Multimedia and Expo, 2003.ICME'03. Proceedings. 2003 International Conference on Volume 1, 6-9 July2003 Page(s):I-5-8 vol.1
[23] Moen, H.L.; Jelle, T. The Potential for Location-Based Services with Wi-Fi RFID Tags in Citywide Wireless Networks. Wireless Communication Systems,2007. ISWCS 2007. 4th International Symposium on 17-19 Oct. 2007 Page(s):148-152
[24]INTEL.Intel XScale Microarchitechure for the PXA255 Processor User's Manual March,2003
[25]Jade.Z228 Application Processor Technical Reference Manual Preliminary Ⅴ2.6
[26]Ross Finlayson.http://www.live555.com/
[27]Jonathan Corbet,Alessandro Rubini& Greg Kroah-Hartman.LINUX DEVICE DRIVERS.O'REILLY,2006,Page:13
[28]马忠梅,李善平,康慨,叶楠.ARM&Linux嵌入式系统教程.北京航空航天大学出版社,2004
[29]ISO/IEC 9945-1:1990
[30]Linux/fs.h
[31]CML Microcircuits.CMX865 FSK Modem and DTMF Coded Reference Manual.2005
[32]W.Richard Stevens.TCP/IP详解卷1:协议.机械工业出版社,2007,Page(s):4-12.
[33]W.Richard Stevens,Bill Fenner,Andrew M.Rudoff.UNIX网络编程,卷1:套接口API,第3版.清华大学出版社,2006,Page(s):56-57
[34]W.Richard Stevens,Bill Fenner,Andrew M.Rudoff.UNIX网络编程,卷1:套接口API,第3版.清华大学出版社,2006,Page(s):87-92
[35]W.Richard Stevens,Stephen A.Rago.Advanced Programming in the UNIX Environment.PEARSON EDUCATION ASIA LTD,2005,Page(s):355-358
[36]Jamjoom,H.;Chou,C.-T.;Shin,K.G.The impact of concurrency gains on the analysis and control of multi-threaded Internet services.INFOCOM 2004.Twenty-third Annual Joint Conference of the IEEE Computer and Communications Societies Volume 2,7-11 March 2004 Page(s):827-837vol.2
[37]Welsh M.The Staged Event-driven Architecture for Highly Concurrent Server Applications[D].UC Berkeley,2000-12.
[38]Schmidt D C,Stal M,Rohnert H,et al.面向模式的软件体系结构,卷2:用于并发和网络化对象的模式[M].北京:机械工业出版社,2003.
[39]谢希仁.计算机网络,第四版.大连理工大学出版社,2003,Page 242
[40]Transmission Control Protocol.RFC-793
[41]UTF-8,a transformation format of ISO 10646.RFC-2279
[42]Westerink,P,;Amini,L.,Veliah,S.,Belknap,W.,"A live intranet distance learning system using MPEG-4 over RTP/RTSP"Multimedia and Expo,2000. ICME 2000.2000 IEEE International Conference on,Volume:2,30 July-2Aug.2000,Pages:601-604 vol.2
[43]许华荣,李名世.基于RTP的实时视频传输系统.计算机工程与设计,2005.4
[44]Shu-Ching Chen,Sheng-Tun Li,Mei-Ling Shyu,Chengjun Zhan,Chengcui Zhang," A multimedia semantic model for RTSPbased multimedia presentation systems",Multimedia Software Engineering,2002.Proceedings.Fourth International Symposium
[45]高旭,沈苏彬等.网络多媒体实时传输协议浅析.计算机应用研究,2000.02.
[46]钟玉琢,向哲等.流媒体和视频服务器.清华大学出版社,2003
© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号 地址：北京市海淀区学院路29号 邮编：100083 电话：办公室：(+86 10)66554848；文献借阅、咨询服务、科技查新：66554700 |