面向云计算的计算环境动态部署系统
|
摘要
在计算机虚拟化技术推动下,云计算中包括虚拟机在内的计算资源急剧增加,通常需要在大量的计算资源上动态地部署或反部署软件,以构建不同的计算环境满足用户不断变化的需求。虽然现有的软件部署方法可以实现部分的软件部署,但是不能解决Windows系统中图形化交互式软件和Linux系统中依赖软件的部署问题。
面向云计算的计算环境动态部署系统有效地解决了上述问题。部署Windows系统中图形化交互式软件的基本思路是:通过分析图形化交互式软件安装包在Windows系统中部署的特征及进程信息,将其自动重构成基于命令行模式的软件安装包;为了提高效率,采用多机并发部署调度算法,将生成的软件安装包并发地传输到目标机器,通过命令行对软件进行动态部署。部署Linux系统中具有依赖关系软件的基本思路是:分析Linux软件的运行环境及依赖关系并生成该软件的部署描述文档;根据部署描述文档对目标环境进行自动检测以筛选符合要求的目标环境;采用基于工作流的依赖软件部署算法,对该软件及其依赖软件进行动态部署,并采用多机并发部署调度算法传输软件包,从而提高部署效率。为了保证部署的完整性,Windows系统和Linux系统分别采用基于进程匹配、I/O匹配的方法对部署的软件进行正确性验证。软件的反部署是部署的逆过程,通过部署记录将目标机器还原为部署之前的状态。
基于Windows、Linux操作系统和Apache平台,采用C++、PHP等语言及Web2.0技术,实现了该系统。功能测试表明:对于Windows系统中图形化交互式软件和Linux系统中具有依赖关系的软件,动态部署功能正常。性能测试表明:并发部署的加速比整体上与并发数N成正比,在100Mbps局域网内,4台、8台、12台、16台计算机并发部署100MB软件包的加速比分别为1.09、1.68、2.24、2.47,有效地提高了部署的效率。
Under the influence of virtualization technology, more and more virtual machines and other computing nodes are included in Cloud Computing environment. This situation usually requires manager to deploy or anti-deploy software dynamically in lots of computing resources to meet the evolving needs of the users. However, the existing solutions of software deployment have not solved the incremental deployment problems for the interactive graphics software in Windows and the dependency software in Linux.
DSCE, a Dynamic Deployment System of Computing Environments for Cloud Computing, solves above problem effectively. In Windows operating system, through the analysis of the deployment process for interactive graphical software package, the command-line package is generated in prescribed form, and this package could be deployed by the command script on the target machines in batch. In Linux operating system, for a large number of software dependencies, relying on the description of the software dependencies templates, for the specific software, DSCE detects the unmet software dependencies, and then deploys them in the method of workflow. Through the method of Process-Matching and I/O-Matching, DSCE achieves the deployment of correctness verification. Moreover, DSCE uses a strategy of the multicast communication to improve the efficiency of paralleling deployment.
Base on Windows, Linux operating system and Apache platform, adopting C++, PHP, and Web2.0 technologies, DSCE system is implemented. It effectively solves the problems of software incremental deployment and anti-deployment in Windows and Linux environment. In the case of the 100MB size of software package, the testing speedup is lower than the theoretical one. When the number of the target machines respectively is 4, 8, 12, and 16, the speedup time is corresponding to 1.09, 1.68, 2.24, and 2.47.
面向云计算的计算环境动态部署系统有效地解决了上述问题。部署Windows系统中图形化交互式软件的基本思路是:通过分析图形化交互式软件安装包在Windows系统中部署的特征及进程信息,将其自动重构成基于命令行模式的软件安装包;为了提高效率,采用多机并发部署调度算法,将生成的软件安装包并发地传输到目标机器,通过命令行对软件进行动态部署。部署Linux系统中具有依赖关系软件的基本思路是:分析Linux软件的运行环境及依赖关系并生成该软件的部署描述文档;根据部署描述文档对目标环境进行自动检测以筛选符合要求的目标环境;采用基于工作流的依赖软件部署算法,对该软件及其依赖软件进行动态部署,并采用多机并发部署调度算法传输软件包,从而提高部署效率。为了保证部署的完整性,Windows系统和Linux系统分别采用基于进程匹配、I/O匹配的方法对部署的软件进行正确性验证。软件的反部署是部署的逆过程,通过部署记录将目标机器还原为部署之前的状态。
基于Windows、Linux操作系统和Apache平台,采用C++、PHP等语言及Web2.0技术,实现了该系统。功能测试表明:对于Windows系统中图形化交互式软件和Linux系统中具有依赖关系的软件,动态部署功能正常。性能测试表明:并发部署的加速比整体上与并发数N成正比,在100Mbps局域网内,4台、8台、12台、16台计算机并发部署100MB软件包的加速比分别为1.09、1.68、2.24、2.47,有效地提高了部署的效率。
Under the influence of virtualization technology, more and more virtual machines and other computing nodes are included in Cloud Computing environment. This situation usually requires manager to deploy or anti-deploy software dynamically in lots of computing resources to meet the evolving needs of the users. However, the existing solutions of software deployment have not solved the incremental deployment problems for the interactive graphics software in Windows and the dependency software in Linux.
DSCE, a Dynamic Deployment System of Computing Environments for Cloud Computing, solves above problem effectively. In Windows operating system, through the analysis of the deployment process for interactive graphical software package, the command-line package is generated in prescribed form, and this package could be deployed by the command script on the target machines in batch. In Linux operating system, for a large number of software dependencies, relying on the description of the software dependencies templates, for the specific software, DSCE detects the unmet software dependencies, and then deploys them in the method of workflow. Through the method of Process-Matching and I/O-Matching, DSCE achieves the deployment of correctness verification. Moreover, DSCE uses a strategy of the multicast communication to improve the efficiency of paralleling deployment.
Base on Windows, Linux operating system and Apache platform, adopting C++, PHP, and Web2.0 technologies, DSCE system is implemented. It effectively solves the problems of software incremental deployment and anti-deployment in Windows and Linux environment. In the case of the 100MB size of software package, the testing speedup is lower than the theoretical one. When the number of the target machines respectively is 4, 8, 12, and 16, the speedup time is corresponding to 1.09, 1.68, 2.24, and 2.47.
引文
[1] Hayes B. Cloud Computing. Communications of the ACM, 2008, 51(7): 9~11
[2] Thain D, Tannenbaum T, Livny M. Distributed computing in practice: The Condor experience. Concurrency and Computation: Practice and Experience, 2005, 17(2): 323~356
[3]陈国良.并行计算.第2版.北京:高等教育出版社, 2003. 14~25
[4] Li M, Baker M.网格计算核心技术.王相林.北京:清华大学, 2006. 23~28
[5] Buyya R, Yeo C, Venugopal S. Market-oriented cloud computing: Vision, hype, and reality for delivering it services as computing utilities. in: Proceedings of the 2008 10th IEEE International Conference on High Performance Computing and Communications. NW Washington: IEEE Computer Society, 2008. 5~13
[6] Chang F, Dean J, Ghemawat S et al. Bigtable: A Distributed Storage System for Structured Data. ACM Transactions on Computer Systems (TOCS), 2008, 26(2): 1~26
[7] Rosenblum M, Garfinkel T. Virtual Machine Monitors: Current Technology and Future Trends. IEEE Computer, 2005, 38(5): 39~47
[8] Uhlig R, Neiger G, Rodgers D et al. Intel Virtualization Technology. IEEE Computer, 2005, 38(5): 48~56
[9] Weiss A. Computing in the Clouds. ACM Networker, 2007, 11(4): 16~25
[10] Dearle A. Software Deployment, Past, Present and Future. in: International Conference on Software Engineering. Massachusetts. NW Washington: IEEE Computer Society, 2007. 269~284
[11] Al-Ani B, Trainer E, Ripley R et al. Continuous coordination within the context of cooperative and human aspects of software engineering. in: Proceedings of the 2008 international workshop on Cooperative and human aspects of software engineering. NY. USA: ACM Press, 2008. 1~4
[12]薛耀锋,袁景淇.基于预排序的并行批处理过程调度模型.上海交通大学学报, 2007, 41(8): 1330~1333
[13] Vaquero L, Caceres J, Lindner M et al. A break in the clouds: towards a cloud definition. ACM SIGCOMM Computer Communication Review, 2009, 39(1): 50~55
[14] Sun W, Zhang K, Chen S et al. Software as a Service: An Integration Perspective. in: Proceedings of the 5th international conference on Service-Oriented Computing. Berlin: Springer-Verlag Press, 2007. 558~569
[15] Jacobs P. Enterprise software as service. Enterprise Distributed Computing, 2005, 3(6): 36~42
[16] PThomas E. SOA Principles of Service Design (The Prentice Hall Service-Oriented Computing Series from Thomas Erl). NJ USA: Prentice Hall PTR, 2007. 123~140
[17] Krsul I, Ganguly A, Zhang P et al. VMPlants: Providing and Managing Virtual Machine Execution Environments for Grid Computing. in: Proceedings of the 2004 ACM/IEEE conference on Supercomputing. NW Washington. USA: IEEE Computer Society, 2004. 7~18
[18] Nishimura H, Maruyama N, Matsuoka S. Virtual Clusters on the Fly -- Fast, Scalable and Flexible Installation. in: Proceedings of the Seventh IEEE International Symposium(CCGRID’07), NW Washington: IEEE Computer Society, 2007. 549~556
[19] Garfinkel S. Commodity Grid Computing with Amazon’s S3 and EC2. in: Proceedings of the USENIX Annual Technical Conference (USENIX’07). Anaheim. NY USA: ACM Press, 2007. 7~13
[20] Sun C, He L, Wang Q et al. Simplifying Service Deployment with Virtual Appliances. in: Proceedings of the 2008 IEEE International Conference on Services Computing. NW Washington: IEEE Computer Society, 2008. 265~272
[21] Engel M, Freisleben B. Supporting autonomic computing functionality via dynamic operating system kernel aspects. in: Proceedings of the 4th international conference on Aspect-oriented software development. NY USA: ACM Press, 2005. 51~62
[22] Open Source Software Deployment and Distribution. http://www.wpkg.org
[23] Kaseya IT Managed Services Software. http:// www.kaseya.com
[24] Altintas P, Ludaescher B, Klasky S et al. Introduction to scientific workflow management and the Kepler system. in: Proceedings of the 2006 ACM/IEEE conference on Supercomputing. NY USA: ACM Press, 2006. 205~214
[25] Russinovich M, Solomon D. Microsoft Windows Internals: Microsoft Windows Server(TM) 2003, Windows XP, and Windows 2000. 4 Editions. WA USA: Microsoft Press, 2004. 235~259
[26] Barrett D, Silverman R. SSH The Secure Shell: The Definitive Guide. CA USA: O'Reilly Associates, Inc., 2001
[27] Vossen P, Hagemann P. Unleashing web 2.0: from concepts to creativity. Ubiquity, 2007, 8(50): 1~3
[28]户家富,李立新,周雁舟等.基于策略和虚拟机技术的动态远程证明框架.武汉大学学报, 2009, 55: 45~48
[29] Extensible markup language (XML) 1.0 (second edition) - W3C recommendation. http://www.w3.org/TR/2000/REC-xml-20001006
[30] Thomson L. PHP和Mysql Web开发.武欣.北京:机械工业出版社, 2009. 152~154
[31]罗海滨,范玉顺,吴澄.工作流技术综述.软件学报, 2000, 11(7): 899~907
[32] Zhang Y, Wang X, Hong L. Portable desktop applications based on P2P transportation and virtualization. in: Proceedings of the 22nd conference on Large installation system administration conference. California. CA USA: USENIX Association, 2008. 133~144
[33] Kim Y, Hong D. Windows Registry and Hiding Suspects' Secret in Registry. in: Proceedings of the 2008 International Conference on Information Security and Assurance. NW Washington: IEEE Computer Society, 2008. 393~398
[34] Swift M, Bershad B, Levy M. Recovering Device Drivers. ACM Transactions on Computer Systems, 2006, 24(4): 333~360
[35] Conallen J. Building Web Applications with Uml. MA USA: Addison-Wesley Longman Publishing Co., Inc., 2002. 69~104
[36] Matthew N, Stones R. Linux程序设计.第3版.陈健.北京:人民邮电出版社, 2007. 58~62
[37] Popovici P, Guerin X, Rousseau P et al. Efficient Software Development Platforms for Multimedia Applications at Different Abstraction Levels. in: Proceedings of the 18th IEEE/IFIP International Workshop on Rapid System Prototyping. NW Washington: IEEE Computer Society, 2007. 113~122
[38]刘卫平,蔡皖东.基于SSH的安全iSCSI技术研究.小型微型计算机系统, 2006, 27(5): 805~808
[39]金海.搭建资源共享平台-中国教育科研网格ChinaGrid.中国教育网络, 2006, 25~26
[40] Meliksetian D, Prost J, Bahl A et al. Design and implementation of an enterprise grid. IBM Systems Journal, 2004, 43(4): 646~664
[41] Allcock W, Bresnahan J, Kettimuthu R et al. The Globus Striped GridFTP Framework and Server. Proceedings of the 2005 ACM/IEEE conference on Supercomputing. NW Washington: IEEE Computer Society, 2005. 54~60
[2] Thain D, Tannenbaum T, Livny M. Distributed computing in practice: The Condor experience. Concurrency and Computation: Practice and Experience, 2005, 17(2): 323~356
[3]陈国良.并行计算.第2版.北京:高等教育出版社, 2003. 14~25
[4] Li M, Baker M.网格计算核心技术.王相林.北京:清华大学, 2006. 23~28
[5] Buyya R, Yeo C, Venugopal S. Market-oriented cloud computing: Vision, hype, and reality for delivering it services as computing utilities. in: Proceedings of the 2008 10th IEEE International Conference on High Performance Computing and Communications. NW Washington: IEEE Computer Society, 2008. 5~13
[6] Chang F, Dean J, Ghemawat S et al. Bigtable: A Distributed Storage System for Structured Data. ACM Transactions on Computer Systems (TOCS), 2008, 26(2): 1~26
[7] Rosenblum M, Garfinkel T. Virtual Machine Monitors: Current Technology and Future Trends. IEEE Computer, 2005, 38(5): 39~47
[8] Uhlig R, Neiger G, Rodgers D et al. Intel Virtualization Technology. IEEE Computer, 2005, 38(5): 48~56
[9] Weiss A. Computing in the Clouds. ACM Networker, 2007, 11(4): 16~25
[10] Dearle A. Software Deployment, Past, Present and Future. in: International Conference on Software Engineering. Massachusetts. NW Washington: IEEE Computer Society, 2007. 269~284
[11] Al-Ani B, Trainer E, Ripley R et al. Continuous coordination within the context of cooperative and human aspects of software engineering. in: Proceedings of the 2008 international workshop on Cooperative and human aspects of software engineering. NY. USA: ACM Press, 2008. 1~4
[12]薛耀锋,袁景淇.基于预排序的并行批处理过程调度模型.上海交通大学学报, 2007, 41(8): 1330~1333
[13] Vaquero L, Caceres J, Lindner M et al. A break in the clouds: towards a cloud definition. ACM SIGCOMM Computer Communication Review, 2009, 39(1): 50~55
[14] Sun W, Zhang K, Chen S et al. Software as a Service: An Integration Perspective. in: Proceedings of the 5th international conference on Service-Oriented Computing. Berlin: Springer-Verlag Press, 2007. 558~569
[15] Jacobs P. Enterprise software as service. Enterprise Distributed Computing, 2005, 3(6): 36~42
[16] PThomas E. SOA Principles of Service Design (The Prentice Hall Service-Oriented Computing Series from Thomas Erl). NJ USA: Prentice Hall PTR, 2007. 123~140
[17] Krsul I, Ganguly A, Zhang P et al. VMPlants: Providing and Managing Virtual Machine Execution Environments for Grid Computing. in: Proceedings of the 2004 ACM/IEEE conference on Supercomputing. NW Washington. USA: IEEE Computer Society, 2004. 7~18
[18] Nishimura H, Maruyama N, Matsuoka S. Virtual Clusters on the Fly -- Fast, Scalable and Flexible Installation. in: Proceedings of the Seventh IEEE International Symposium(CCGRID’07), NW Washington: IEEE Computer Society, 2007. 549~556
[19] Garfinkel S. Commodity Grid Computing with Amazon’s S3 and EC2. in: Proceedings of the USENIX Annual Technical Conference (USENIX’07). Anaheim. NY USA: ACM Press, 2007. 7~13
[20] Sun C, He L, Wang Q et al. Simplifying Service Deployment with Virtual Appliances. in: Proceedings of the 2008 IEEE International Conference on Services Computing. NW Washington: IEEE Computer Society, 2008. 265~272
[21] Engel M, Freisleben B. Supporting autonomic computing functionality via dynamic operating system kernel aspects. in: Proceedings of the 4th international conference on Aspect-oriented software development. NY USA: ACM Press, 2005. 51~62
[22] Open Source Software Deployment and Distribution. http://www.wpkg.org
[23] Kaseya IT Managed Services Software. http:// www.kaseya.com
[24] Altintas P, Ludaescher B, Klasky S et al. Introduction to scientific workflow management and the Kepler system. in: Proceedings of the 2006 ACM/IEEE conference on Supercomputing. NY USA: ACM Press, 2006. 205~214
[25] Russinovich M, Solomon D. Microsoft Windows Internals: Microsoft Windows Server(TM) 2003, Windows XP, and Windows 2000. 4 Editions. WA USA: Microsoft Press, 2004. 235~259
[26] Barrett D, Silverman R. SSH The Secure Shell: The Definitive Guide. CA USA: O'Reilly Associates, Inc., 2001
[27] Vossen P, Hagemann P. Unleashing web 2.0: from concepts to creativity. Ubiquity, 2007, 8(50): 1~3
[28]户家富,李立新,周雁舟等.基于策略和虚拟机技术的动态远程证明框架.武汉大学学报, 2009, 55: 45~48
[29] Extensible markup language (XML) 1.0 (second edition) - W3C recommendation. http://www.w3.org/TR/2000/REC-xml-20001006
[30] Thomson L. PHP和Mysql Web开发.武欣.北京:机械工业出版社, 2009. 152~154
[31]罗海滨,范玉顺,吴澄.工作流技术综述.软件学报, 2000, 11(7): 899~907
[32] Zhang Y, Wang X, Hong L. Portable desktop applications based on P2P transportation and virtualization. in: Proceedings of the 22nd conference on Large installation system administration conference. California. CA USA: USENIX Association, 2008. 133~144
[33] Kim Y, Hong D. Windows Registry and Hiding Suspects' Secret in Registry. in: Proceedings of the 2008 International Conference on Information Security and Assurance. NW Washington: IEEE Computer Society, 2008. 393~398
[34] Swift M, Bershad B, Levy M. Recovering Device Drivers. ACM Transactions on Computer Systems, 2006, 24(4): 333~360
[35] Conallen J. Building Web Applications with Uml. MA USA: Addison-Wesley Longman Publishing Co., Inc., 2002. 69~104
[36] Matthew N, Stones R. Linux程序设计.第3版.陈健.北京:人民邮电出版社, 2007. 58~62
[37] Popovici P, Guerin X, Rousseau P et al. Efficient Software Development Platforms for Multimedia Applications at Different Abstraction Levels. in: Proceedings of the 18th IEEE/IFIP International Workshop on Rapid System Prototyping. NW Washington: IEEE Computer Society, 2007. 113~122
[38]刘卫平,蔡皖东.基于SSH的安全iSCSI技术研究.小型微型计算机系统, 2006, 27(5): 805~808
[39]金海.搭建资源共享平台-中国教育科研网格ChinaGrid.中国教育网络, 2006, 25~26
[40] Meliksetian D, Prost J, Bahl A et al. Design and implementation of an enterprise grid. IBM Systems Journal, 2004, 43(4): 646~664
[41] Allcock W, Bresnahan J, Kettimuthu R et al. The Globus Striped GridFTP Framework and Server. Proceedings of the 2005 ACM/IEEE conference on Supercomputing. NW Washington: IEEE Computer Society, 2005. 54~60
© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号 地址：北京市海淀区学院路29号 邮编：100083 电话：办公室：(+86 10)66554848；文献借阅、咨询服务、科技查新：66554700 |