基于嵌入式Linux的视频监控系统设计与实现
摘要
Linux和嵌入式系统都是计算机学术领域中的技术热点，两者的结合，为它们开辟了新的发展空间。随着电子技术，多媒体技术及网络技术快速发展，视频监控系统正在向嵌入式，数字化，网络化方向发展。嵌入式视频监控系统充分利用大规模集成电路和网络的科技成果，实现体积小巧，性能稳定，通讯便利的监控设备。
本项目是在ARM微处理器平台上，移植嵌入式Linux操作系统，并完成视频采集、压缩、传输和控制等任务，在此基础之上，借助Linux下的开源软件，构建了整个嵌入式视频监控系统。
本系统采用ARM9微处理器S3C2410作为主处理器，以USB摄像头作为视频采集设备，用ffmpeg库对视频流数据进行MPEG-4压缩，并且通过以太网传输，远端用户可直接浏览监控区域的动态视频，达到实时监视的目的。另外，本将运动物体检测应用到嵌入式视频监控中。一旦有物体闯入监控区域，设备将通过短信的形式向用户发出报警。
论文首先简要介绍了视频监控系统的发展现状和，阐述了嵌入式视频监控系统的原理，给出了以S3C2410微处理器为核心的视频监控系统的硬件和软件方案。随后详细分析了嵌入式Linux系统的设计与实现，其中涉及Boot loader，Linux内核和文件系统，并讨论了嵌入式Linux下USB摄像头设备驱动，然后设计并实现了嵌入式视频监控系统软件部分，包括视频采集模块，运动检测模块，实时视频监控模块等。
Linux and Embedded System are both hot points in the academic field of computer technology. The combination of them two further expands their respective development area. With the rapid development of the electronic technology, multimedia technology and network technology, video surveillance system is going to the embedded, digital, networked direction. Taking full advantage of LSI and networks of scientific and technological achievements, the embedded video surveillance system achieves delicate volume, stable performance, facilitates the communication of the surveillance equipment.
The project is in arm microprocessor platform, and porting embedded Linux system in it. It completes video capturing, compression, transmission and control tasks. Based on the architecture and with the open source software in Linux, the whole embedded video surveillance system is implemented and tested.
ARM9 (S3C2410) are the main processor in the system. using USB webcam as video capturing equipment, the video stream data are compressed with MPEG-4 standard by way of transplant project ffmpeg, so the remote monitoring is actualized. In addition, the moving object detecting which this paper presents is applied to the embedded video surveillance system. The surveillance system will give an alarm to user during short message when some object are coming into the field of view.
This dissertation introduces the development and research status of the video surveillance system at first, then introduces the theory of the embedded video surveillance system. After that, it presents the hardware and software project of the embedded system based on the microprocessor S3C2410.It analyses carefully the technology of embedded Linux system involved the boot loader, Linux kernel, GUI and file system, and discusses how to drive the USB webcam in embedded Linux system. it designs and implements the software of the embedded video surveillance system including the video capturing, moving object detection and the real time video monitor module.
本项目是在ARM微处理器平台上，移植嵌入式Linux操作系统，并完成视频采集、压缩、传输和控制等任务，在此基础之上，借助Linux下的开源软件，构建了整个嵌入式视频监控系统。
本系统采用ARM9微处理器S3C2410作为主处理器，以USB摄像头作为视频采集设备，用ffmpeg库对视频流数据进行MPEG-4压缩，并且通过以太网传输，远端用户可直接浏览监控区域的动态视频，达到实时监视的目的。另外，本将运动物体检测应用到嵌入式视频监控中。一旦有物体闯入监控区域，设备将通过短信的形式向用户发出报警。
论文首先简要介绍了视频监控系统的发展现状和，阐述了嵌入式视频监控系统的原理，给出了以S3C2410微处理器为核心的视频监控系统的硬件和软件方案。随后详细分析了嵌入式Linux系统的设计与实现，其中涉及Boot loader，Linux内核和文件系统，并讨论了嵌入式Linux下USB摄像头设备驱动，然后设计并实现了嵌入式视频监控系统软件部分，包括视频采集模块，运动检测模块，实时视频监控模块等。
Linux and Embedded System are both hot points in the academic field of computer technology. The combination of them two further expands their respective development area. With the rapid development of the electronic technology, multimedia technology and network technology, video surveillance system is going to the embedded, digital, networked direction. Taking full advantage of LSI and networks of scientific and technological achievements, the embedded video surveillance system achieves delicate volume, stable performance, facilitates the communication of the surveillance equipment.
The project is in arm microprocessor platform, and porting embedded Linux system in it. It completes video capturing, compression, transmission and control tasks. Based on the architecture and with the open source software in Linux, the whole embedded video surveillance system is implemented and tested.
ARM9 (S3C2410) are the main processor in the system. using USB webcam as video capturing equipment, the video stream data are compressed with MPEG-4 standard by way of transplant project ffmpeg, so the remote monitoring is actualized. In addition, the moving object detecting which this paper presents is applied to the embedded video surveillance system. The surveillance system will give an alarm to user during short message when some object are coming into the field of view.
This dissertation introduces the development and research status of the video surveillance system at first, then introduces the theory of the embedded video surveillance system. After that, it presents the hardware and software project of the embedded system based on the microprocessor S3C2410.It analyses carefully the technology of embedded Linux system involved the boot loader, Linux kernel, GUI and file system, and discusses how to drive the USB webcam in embedded Linux system. it designs and implements the software of the embedded video surveillance system including the video capturing, moving object detection and the real time video monitor module.
引文
[1]刘慧明，王汝琳．视频监控系统的发展理念与实践．智能建筑．2004，3
[2]梁春雁，谢剑英．智能大厦的视频监控系统设计．测控技术．1999，10
[3]施裕丰，陈坚，陈启转，梁炯达．网络式多媒体监控系统．计算机工程．2000，3
[4]邹宪民，温惠英．数字监控系统在技防工程中的应用．交通与计算机，2001
[5]胡毅，胡咏梅，单玉峰，王成梅．基于网络的多媒体远程监视系统的研究与实现．计算机应用研究．2000，9
[6]江潮，苏祥芳．基于网络的数字视频监控系统[J]．武汉大学学报2000，46(5)：608-612
[7]陈耀武，伍鹏，汪乐宇．基于流媒体技术的网络化嵌入式视频监控系统工程[J]．设计学报．2004，11(2)：33-35
[8]刘富强．数字视频监控系统开发及应用[M]．机械工业出版社．2003
[9]郑旭东，张培仁，高修峰，陈云鹏．嵌入式网络视频监控系统．仪表技术与传感器．2006．8
[10]邵贝贝．UC/OS-Ⅱ--源代码公开的实时嵌入式操作系统[M]．中国电力出版社．2001
[11]杜春雷．ARM体系结构与编程．清华大学出版社．2004
[12]王田苗．嵌入式系统设计与实例开发[M]．清华大学出版社．2002
[13]Rui Wang and Shiyuan Yang, Senior Member. The Design of a Rapid Prototype Platform for ARM Based Embedded System. IEEE Transactions on Consumer Electronics, Vol. 50, No. 2, MAY 2004
[14]皱思轶．嵌入式Linux设计与应用．清华大学出版社．2002．1
[15]SAMSUNG electronic. S3C2410 User Manual. www.samsungsemi.com
[16]魏洪兴等．基于ARM9微处理器与Linux操作系统[M]．清华大学出版社．2005
[17]怀石工作室．Linux上的C编程[M]．中国电力出版社．2001
[18]王田苗．嵌人式系统设计与实例[M]．清华大学出版社．2003
[19]贾智平，张瑞华．嵌入式系统原理与接口技术．清华大学出版社．2005．7
[20]沈文斌．嵌入式硬件系统设计与开发实例详解．电子工业出版社．2005．11
[21]陈俊宏．Embedded Linux 嵌入式系统原理与实务．中国铁道出版社．2004．4
[22]Edukit-Ⅲ ARM9实验箱说明书．深圳英蓓特公司．2005．12
[23]孙天泽，袁文菊，张海峰．嵌入式设计及Linux驱动开发指南——基于ARM9处理器．电子工业出版社．2005．2
[24]王静，刘夏伟．基于Linux的嵌入式系统的启动设计．电子科技．2004．6
[25]李善平，刘文峰，王焕龙．Linux与嵌入式系统．清华大学出版社．2006．3
[26]许海燕，付炎．嵌入式系统技术与应用．机械工业出版社．2002．4
[27]梁元恩．http://www-128.ibm.com/developerworks/cn/linux/l-embcmpl/ 如何为嵌入式开发建立交叉编译环境
[28]http://www.arm7-arm9.com/arm/arm-2004.htm
[29]Jonathan Corbet,Alessandro Rubini, Greg Kroah-Hartman (美). 魏永明等译。Linux Device Drivers. 中国电力出版社．2006年1月
[30]http://www.alephl.co.uk/oldsite/armlinux//docs/toolchain/toolchHOWTO/t2.html The GNU Toolchain for ARM targets HOWTO
[31]马洪连，丁男，李屹璐，马艳华．嵌入式系统设计教程．电子工业出版社．2006．6
[32]刘浩．MPEG-4 视频编码的可分级技术研究[J]．南京邮电学院学报．2002．6
[33]林洪文等．基于减背景技术的运动目标检测方法研究[J]．国防科技大学学报．2003．3
[34]JJ.S. Weszka. A survey of threshold selection techniques. Comp. Graph Image Proc, vol 7, 259-265, 1978
[35]W.Snyder and G.Bilbro. Optimal thresholding-Anew approach. Patt. Recog. Lett., Vol Ⅱ, 803-810, 1990
[36]S.U.Lee, S.Y.Chung and R.H.Park. A comparative performance study of several global thresholding techniques for segmentation. Comp. Vis. Graph Image Proc, vol 52, 171—190, 1990
[37]XTEAM(中国)软件技术有限公司．QT程序设计．清华大学出版社．2002．3
[38]http://chinavideo.org
[39]Samsung Electronics. S3C2410X 32-Bit RISC Microprocessor User's Manual, Revision 1.0. 2002
[40] I. Haritaoglu, D. Harwood, and L. Davis, "W4: Realtime surveillance of people and their activities," in IEEE Transaction on Pattern Analysis and Machine Intelligence, vol. 22, 2000, pp. 809-830
[41] A. J. Lipton, C. H. Heartwell, N. Haering, and D. Madden, "Automated video protection, monitoring and detection," in IEEE Aerospace and Electronic Systems Magazine, vol. 18, 2003, 3-18
[42] Tosun, A.S. and Feng, W.-C., Efficient Multi-layer Coding and Encryption of MPEG Video Streams, International Conference on Multimedia and Expo, 2000, 119-122
[43] Zhaoyu Liu, Dichao Peng and Yuliang Zheng. Communication Protection in IP-based Video Surveillance Systems. Proceedings of the Seventh IEEE International Symposium on Multimedia (ISM'05). 2005,292-1295
[44] Ming Li; RuiMin Hu; Ge Gao; Wei Li; Zhongyuan Wang. Embedded video surveillance system for vehicle over WLAN and CDMA1X. Wireless Communications, Networking and Mobile Computing, 2005. Proceedings. 2005 International Conference on Volume 2, 23-26 Sept. 2005,1292-1295
[45] Wei Niu, Jiao Long, Dan Han, and Yuan-Fang Wang. Human Activity Detection and Recognition for Video Surveillance. 2004 IEEE International Conference on Multimedia and Expo. 2004,719-722
[46] Rui Wang and Shiyuan Yang. The Design of a Rapid Prototype Platform for ARM Based Embedded System. IEEE Transactions on Consumer Electronics, Vol. 50, No. 2, 2004.5
[47] 张亚生等．基于 MPEG-4 的网络视频监控系统设计[J]．无线电通信技术．2003．2
[48] System Software for embedded applications Ramamritham, K., Arya, K., Fohler,G.. Proceedings of the 17th International Conference on VLSI Design. 2004,12-14
[49] 姜敏，施健．基于嵌入式WEB服务器的远程视频监控技术[J]．计算机时代．2001．7
[50] 许社村．Red Hat Linux 9 中文版入门与进阶．清华大学出版社．2003
[51] 老虎工作室高鹏，安涛，寇怀成．电路设计与制版——protel 99 入门与提高．人民邮电出版社．2005
[2]梁春雁，谢剑英．智能大厦的视频监控系统设计．测控技术．1999，10
[3]施裕丰，陈坚，陈启转，梁炯达．网络式多媒体监控系统．计算机工程．2000，3
[4]邹宪民，温惠英．数字监控系统在技防工程中的应用．交通与计算机，2001
[5]胡毅，胡咏梅，单玉峰，王成梅．基于网络的多媒体远程监视系统的研究与实现．计算机应用研究．2000，9
[6]江潮，苏祥芳．基于网络的数字视频监控系统[J]．武汉大学学报2000，46(5)：608-612
[7]陈耀武，伍鹏，汪乐宇．基于流媒体技术的网络化嵌入式视频监控系统工程[J]．设计学报．2004，11(2)：33-35
[8]刘富强．数字视频监控系统开发及应用[M]．机械工业出版社．2003
[9]郑旭东，张培仁，高修峰，陈云鹏．嵌入式网络视频监控系统．仪表技术与传感器．2006．8
[10]邵贝贝．UC/OS-Ⅱ--源代码公开的实时嵌入式操作系统[M]．中国电力出版社．2001
[11]杜春雷．ARM体系结构与编程．清华大学出版社．2004
[12]王田苗．嵌入式系统设计与实例开发[M]．清华大学出版社．2002
[13]Rui Wang and Shiyuan Yang, Senior Member. The Design of a Rapid Prototype Platform for ARM Based Embedded System. IEEE Transactions on Consumer Electronics, Vol. 50, No. 2, MAY 2004
[14]皱思轶．嵌入式Linux设计与应用．清华大学出版社．2002．1
[15]SAMSUNG electronic. S3C2410 User Manual. www.samsungsemi.com
[16]魏洪兴等．基于ARM9微处理器与Linux操作系统[M]．清华大学出版社．2005
[17]怀石工作室．Linux上的C编程[M]．中国电力出版社．2001
[18]王田苗．嵌人式系统设计与实例[M]．清华大学出版社．2003
[19]贾智平，张瑞华．嵌入式系统原理与接口技术．清华大学出版社．2005．7
[20]沈文斌．嵌入式硬件系统设计与开发实例详解．电子工业出版社．2005．11
[21]陈俊宏．Embedded Linux 嵌入式系统原理与实务．中国铁道出版社．2004．4
[22]Edukit-Ⅲ ARM9实验箱说明书．深圳英蓓特公司．2005．12
[23]孙天泽，袁文菊，张海峰．嵌入式设计及Linux驱动开发指南——基于ARM9处理器．电子工业出版社．2005．2
[24]王静，刘夏伟．基于Linux的嵌入式系统的启动设计．电子科技．2004．6
[25]李善平，刘文峰，王焕龙．Linux与嵌入式系统．清华大学出版社．2006．3
[26]许海燕，付炎．嵌入式系统技术与应用．机械工业出版社．2002．4
[27]梁元恩．http://www-128.ibm.com/developerworks/cn/linux/l-embcmpl/ 如何为嵌入式开发建立交叉编译环境
[28]http://www.arm7-arm9.com/arm/arm-2004.htm
[29]Jonathan Corbet,Alessandro Rubini, Greg Kroah-Hartman (美). 魏永明等译。Linux Device Drivers. 中国电力出版社．2006年1月
[30]http://www.alephl.co.uk/oldsite/armlinux//docs/toolchain/toolchHOWTO/t2.html The GNU Toolchain for ARM targets HOWTO
[31]马洪连，丁男，李屹璐，马艳华．嵌入式系统设计教程．电子工业出版社．2006．6
[32]刘浩．MPEG-4 视频编码的可分级技术研究[J]．南京邮电学院学报．2002．6
[33]林洪文等．基于减背景技术的运动目标检测方法研究[J]．国防科技大学学报．2003．3
[34]JJ.S. Weszka. A survey of threshold selection techniques. Comp. Graph Image Proc, vol 7, 259-265, 1978
[35]W.Snyder and G.Bilbro. Optimal thresholding-Anew approach. Patt. Recog. Lett., Vol Ⅱ, 803-810, 1990
[36]S.U.Lee, S.Y.Chung and R.H.Park. A comparative performance study of several global thresholding techniques for segmentation. Comp. Vis. Graph Image Proc, vol 52, 171—190, 1990
[37]XTEAM(中国)软件技术有限公司．QT程序设计．清华大学出版社．2002．3
[38]http://chinavideo.org
[39]Samsung Electronics. S3C2410X 32-Bit RISC Microprocessor User's Manual, Revision 1.0. 2002
[40] I. Haritaoglu, D. Harwood, and L. Davis, "W4: Realtime surveillance of people and their activities," in IEEE Transaction on Pattern Analysis and Machine Intelligence, vol. 22, 2000, pp. 809-830
[41] A. J. Lipton, C. H. Heartwell, N. Haering, and D. Madden, "Automated video protection, monitoring and detection," in IEEE Aerospace and Electronic Systems Magazine, vol. 18, 2003, 3-18
[42] Tosun, A.S. and Feng, W.-C., Efficient Multi-layer Coding and Encryption of MPEG Video Streams, International Conference on Multimedia and Expo, 2000, 119-122
[43] Zhaoyu Liu, Dichao Peng and Yuliang Zheng. Communication Protection in IP-based Video Surveillance Systems. Proceedings of the Seventh IEEE International Symposium on Multimedia (ISM'05). 2005,292-1295
[44] Ming Li; RuiMin Hu; Ge Gao; Wei Li; Zhongyuan Wang. Embedded video surveillance system for vehicle over WLAN and CDMA1X. Wireless Communications, Networking and Mobile Computing, 2005. Proceedings. 2005 International Conference on Volume 2, 23-26 Sept. 2005,1292-1295
[45] Wei Niu, Jiao Long, Dan Han, and Yuan-Fang Wang. Human Activity Detection and Recognition for Video Surveillance. 2004 IEEE International Conference on Multimedia and Expo. 2004,719-722
[46] Rui Wang and Shiyuan Yang. The Design of a Rapid Prototype Platform for ARM Based Embedded System. IEEE Transactions on Consumer Electronics, Vol. 50, No. 2, 2004.5
[47] 张亚生等．基于 MPEG-4 的网络视频监控系统设计[J]．无线电通信技术．2003．2
[48] System Software for embedded applications Ramamritham, K., Arya, K., Fohler,G.. Proceedings of the 17th International Conference on VLSI Design. 2004,12-14
[49] 姜敏，施健．基于嵌入式WEB服务器的远程视频监控技术[J]．计算机时代．2001．7
[50] 许社村．Red Hat Linux 9 中文版入门与进阶．清华大学出版社．2003
[51] 老虎工作室高鹏，安涛，寇怀成．电路设计与制版——protel 99 入门与提高．人民邮电出版社．2005