网格环境下资源监测与发现服务的研究与设计
|
摘要
建设网格首先要解决资源监测与资源发现问题。资源监测为其他的网格中间件提供了必要的与资源有关的性能数据,是资源发现和任务分配的基础。资源发现就是根据用户或应用的资源发现请求,采用一定的方法和手段获取所需资源信息的过程。资源发现是网格计算一个非常重要的方面,在广域网络环境中,由于资源数量多、范围广、多管理域,要实现对资源的有效共享,就必须实现一个高效的资源发现机制,提供资源发现服务。
本文在研究Globus系统框架和MDS(Monitoring and Discovery Service,监测与发现服务)模块的基础上,分析资源监测与发现服务的主要功能,确定系统的设计思想,运用当前比较成熟的Web Service技术和DOM解析技术,设计并实现了网格环境下资源监测与发现服务模块。
(1)本文首先对网格技术进行了深入的学习与研究。通过对OGSA网格服务体系结构的研究,以及对它的具体实现模型OGSI和WSRF的比较,得出WSRF有着OGSI无法比拟的优势,并最终选用WSRF作为本课题的实现模型。
(2)接着对基于WSRF模型的网格平台GT4下的监测与发现服务原理进行研究与分析,结合存储网格对于MDS的要求,即实时地为整个网格系统提供节点资源信息,提出用Web Service结合DOM的方法来实现存储网格下资源监测与发现服务模块。
(3)然后在网格中间件GT4.0平台上进行具体的开发和部署,为在此平台上进行后续开发提供了样例。
The resource monitoring and discovery is highlighted as the essential criteria for building grid. As the foundation of resource monitoring and task distribution, resource investigation offers necessary performance data regarding the resource for the other grid mid-layer components. The resource discovery can be identified as the process that using specific methods to achieve the required information according to the requests from the users or applications. Resource discovery is an important instrument for the grid computing. In order to realize the function of resources sharing, a effective resource discovery mechanism aimed for the reliable, flexible and effective service is vital regarding the condition of numerous resources, multiple ranges and domains in WAN.
Based on the research of Globus framework and MDS module, this paper analyzed the main functions of resource monitoring and discovery and determined the design of the system. The Web Service and DOM resolution are managed to design and implement the resource monitoring and discovery module in grid environment.
(1) Based on the research of grid, the comparisons about OGSI and WSRF which are the detailed modules under the OGSA grid service architecture are made in this paper. Since WSRF has significant advantage than OGSI, it is chosen as the module researched in this paper.
(2) According to the research and analysis about the theory of MDS4 under GT4, the methodology of the combination of Web Service and DOM is designed to realize the development of resource monitoring and discovery service in storage grid, which aimed to offer real-time node resource information according to the MDS (Monitoring and Discovery Service) requests from storage grid.
(3) This design is developed and deployed on GT4.0, providing a sample for follow-up.
本文在研究Globus系统框架和MDS(Monitoring and Discovery Service,监测与发现服务)模块的基础上,分析资源监测与发现服务的主要功能,确定系统的设计思想,运用当前比较成熟的Web Service技术和DOM解析技术,设计并实现了网格环境下资源监测与发现服务模块。
(1)本文首先对网格技术进行了深入的学习与研究。通过对OGSA网格服务体系结构的研究,以及对它的具体实现模型OGSI和WSRF的比较,得出WSRF有着OGSI无法比拟的优势,并最终选用WSRF作为本课题的实现模型。
(2)接着对基于WSRF模型的网格平台GT4下的监测与发现服务原理进行研究与分析,结合存储网格对于MDS的要求,即实时地为整个网格系统提供节点资源信息,提出用Web Service结合DOM的方法来实现存储网格下资源监测与发现服务模块。
(3)然后在网格中间件GT4.0平台上进行具体的开发和部署,为在此平台上进行后续开发提供了样例。
The resource monitoring and discovery is highlighted as the essential criteria for building grid. As the foundation of resource monitoring and task distribution, resource investigation offers necessary performance data regarding the resource for the other grid mid-layer components. The resource discovery can be identified as the process that using specific methods to achieve the required information according to the requests from the users or applications. Resource discovery is an important instrument for the grid computing. In order to realize the function of resources sharing, a effective resource discovery mechanism aimed for the reliable, flexible and effective service is vital regarding the condition of numerous resources, multiple ranges and domains in WAN.
Based on the research of Globus framework and MDS module, this paper analyzed the main functions of resource monitoring and discovery and determined the design of the system. The Web Service and DOM resolution are managed to design and implement the resource monitoring and discovery module in grid environment.
(1) Based on the research of grid, the comparisons about OGSI and WSRF which are the detailed modules under the OGSA grid service architecture are made in this paper. Since WSRF has significant advantage than OGSI, it is chosen as the module researched in this paper.
(2) According to the research and analysis about the theory of MDS4 under GT4, the methodology of the combination of Web Service and DOM is designed to realize the development of resource monitoring and discovery service in storage grid, which aimed to offer real-time node resource information according to the MDS (Monitoring and Discovery Service) requests from storage grid.
(3) This design is developed and deployed on GT4.0, providing a sample for follow-up.
引文
[1]都志辉,陈渝,刘鹏著.网格计算.北京:清华大学出版社.2002
[2]IBM网格计算概述.http://www-900.ibm.com/cn/grid/
[3]Ian Foster.网格:21世纪信息技术基础设施的蓝图.1998
[4]徐志伟,李伟.织女星网格的体系结构.计算机研究与发展.2002,39
[5]中国国家网格(China National Grid).http://www.cngrid.org/cn_introduce.htm
[6]I.Foster,C.Kesselman,J.Nick,S.Tuecke.The Physiology of the Grid:An Open Grid Services Architecture for Distributed Systems Integration.January,2002
[7]Foster I,Kesselman C,Nick J,Tuecke S.The physiology of the grid:An open grid services architecture for distributed systems integration.2002,P1,P9http://www.globus.org/research/papers/ogsa.pdf
[8]The WS-Resource Framework.http://www.globus.org/wsrf/
[9]Globus网格项目.http://www.globus.org
[10]Globus Alliance.Tutorial of Gram.http://www-unix.globus.org/toolkit/docs/4.0/execution/wsgram/.May 7,2005
[11]网格实践:在SOA-Web服务环境中监视和发现网格服务.http://www.ibm.com/developerworks/cn/grid/gr-gt4mds
[12]GT 4.0 WS MDS Aggregator Framework:Aggregator Sources Reference.http://www.globus.org/toolkit/docs/4.0/info/aggregator/WS_MDS_Aggregator_Sources_R eference.html
[13]The introduce of Condor.http://www.cs.wisc.edu/condor/
[14]Nick LeRoy.Tutorial:Using Condor;Monday.April 30,2007http://www.cs.wisc.edu/condor/PCW2007/presentations/nleroy_user_tutorial.ppt
[15]Alan De Smet.Tutorial:Administrating Condor.April 30,2007http://www.cs.wisc.edu/condor/PCW2007/presentations/admin_tutorial.ppt
[16]Introduce of condor-g,http://www.cs.wisc.edu/condor/condorg/
[17]GT4 官方安装手册 GT4 Admin Guide.http://www.globus.org/toolkit/docs/development/4.1.0/admin/docbook/gtadmin-install.htm
[18]徐志平.基于Web Service网格计算解决方案.计算机工程.2004年3月
[19]Web Service体系结构.http://tag.csdn.net/Article/86cb2116-cb3f-46ec-a38a-55ba787468f9.html
[20]SOA and Web Services.http://www.ibm.com/developerworks/cn/webservices/
[21]中国网格信息中转站.http://www.chinagrid.net/
[22]Global Grid Forum.http://www.gridforum.org/
[23]W.Allcock,J.Bresnahan,R.Kettimuthu,M.Link,C.Dumitrescu,I.Raicu,I.Foster.The Globus Striped GridFTP Framework and Server.Proceedings of Super Computing 2005(SC05),November 3,2005
[24] K. Keahey, I. Foster, T. Freeman, and X. Zhang. Virtual Workspaces: Achieving Quality of Service and Quality of Life in the Grid. Scientific Programming Journal. 2006
[25] Foster I, Kesselman C, Nick J, Tuecke S. The physiology of the grid: An open grid services architecture for distributed systems integration, 2002. http://www.globus.org/research/papers/ogsa.pdf
[26] Jennifer M. Schopf, Mike D'Arcy, Neill Milleret. Monitoring and Discovery in a Web Services Framework: Functionality and Performance of the Globus Toolkit's MDS4, Argonne National Laboratory Technical Report #ANL/MCS-P1248-0405
[27] Thomas Myer. Open standards architecture at the GGF. http://www.128.ibm.com/developerworks/library/gr-watch2.html. Nov 18, 2003
[28] Jay Unger, Matt Haynos. A visual tour of Open Grid Services Architecture. http://www.128.ibm.com/developerworks/library/gr-visual/index.html. Jun 29, 2005
[29] The Physiology of the Grid: An Open Grid Services Architecture for Distributed Systems Integration. January 21, 2002
[30] Babu Sundaram. Register a Globus Toolkit 4 grid service. http://www.128.ibm.com/developerworks/grid/library/gr-mdsgt4/. May 10, 2005
[31] Jennifer M.Schopf. Distributed Monitoring and Information Services for the Grid. Argonne National Laboratory. Sep 30, 2005
[32] GLUE Schema collaboration. The GLUE Schema homepage. http://infnforge.cnaf.infn.it/glueinfomodel
[33] Jeff Mausolf. Monitor and discover grid services in an SOA/Web Services environment. http://www.128.ibm.com/developerworks/grid/library/gr-gt4mds/. Sep 6, 2005
[34] Karl Czajkowski, Don Ferguson, Ian Foster, Jeff Frey, Steve Graham, Tom Maguire, David Snelling, Steve Tuecke. From OGSI to WS-Resource Framework: Refactoring and Evolution. http://www.globus.org/wsrf/specs/ogsi_to_wsrf_1.0.pdf
[2]IBM网格计算概述.http://www-900.ibm.com/cn/grid/
[3]Ian Foster.网格:21世纪信息技术基础设施的蓝图.1998
[4]徐志伟,李伟.织女星网格的体系结构.计算机研究与发展.2002,39
[5]中国国家网格(China National Grid).http://www.cngrid.org/cn_introduce.htm
[6]I.Foster,C.Kesselman,J.Nick,S.Tuecke.The Physiology of the Grid:An Open Grid Services Architecture for Distributed Systems Integration.January,2002
[7]Foster I,Kesselman C,Nick J,Tuecke S.The physiology of the grid:An open grid services architecture for distributed systems integration.2002,P1,P9http://www.globus.org/research/papers/ogsa.pdf
[8]The WS-Resource Framework.http://www.globus.org/wsrf/
[9]Globus网格项目.http://www.globus.org
[10]Globus Alliance.Tutorial of Gram.http://www-unix.globus.org/toolkit/docs/4.0/execution/wsgram/.May 7,2005
[11]网格实践:在SOA-Web服务环境中监视和发现网格服务.http://www.ibm.com/developerworks/cn/grid/gr-gt4mds
[12]GT 4.0 WS MDS Aggregator Framework:Aggregator Sources Reference.http://www.globus.org/toolkit/docs/4.0/info/aggregator/WS_MDS_Aggregator_Sources_R eference.html
[13]The introduce of Condor.http://www.cs.wisc.edu/condor/
[14]Nick LeRoy.Tutorial:Using Condor;Monday.April 30,2007http://www.cs.wisc.edu/condor/PCW2007/presentations/nleroy_user_tutorial.ppt
[15]Alan De Smet.Tutorial:Administrating Condor.April 30,2007http://www.cs.wisc.edu/condor/PCW2007/presentations/admin_tutorial.ppt
[16]Introduce of condor-g,http://www.cs.wisc.edu/condor/condorg/
[17]GT4 官方安装手册 GT4 Admin Guide.http://www.globus.org/toolkit/docs/development/4.1.0/admin/docbook/gtadmin-install.htm
[18]徐志平.基于Web Service网格计算解决方案.计算机工程.2004年3月
[19]Web Service体系结构.http://tag.csdn.net/Article/86cb2116-cb3f-46ec-a38a-55ba787468f9.html
[20]SOA and Web Services.http://www.ibm.com/developerworks/cn/webservices/
[21]中国网格信息中转站.http://www.chinagrid.net/
[22]Global Grid Forum.http://www.gridforum.org/
[23]W.Allcock,J.Bresnahan,R.Kettimuthu,M.Link,C.Dumitrescu,I.Raicu,I.Foster.The Globus Striped GridFTP Framework and Server.Proceedings of Super Computing 2005(SC05),November 3,2005
[24] K. Keahey, I. Foster, T. Freeman, and X. Zhang. Virtual Workspaces: Achieving Quality of Service and Quality of Life in the Grid. Scientific Programming Journal. 2006
[25] Foster I, Kesselman C, Nick J, Tuecke S. The physiology of the grid: An open grid services architecture for distributed systems integration, 2002. http://www.globus.org/research/papers/ogsa.pdf
[26] Jennifer M. Schopf, Mike D'Arcy, Neill Milleret. Monitoring and Discovery in a Web Services Framework: Functionality and Performance of the Globus Toolkit's MDS4, Argonne National Laboratory Technical Report #ANL/MCS-P1248-0405
[27] Thomas Myer. Open standards architecture at the GGF. http://www.128.ibm.com/developerworks/library/gr-watch2.html. Nov 18, 2003
[28] Jay Unger, Matt Haynos. A visual tour of Open Grid Services Architecture. http://www.128.ibm.com/developerworks/library/gr-visual/index.html. Jun 29, 2005
[29] The Physiology of the Grid: An Open Grid Services Architecture for Distributed Systems Integration. January 21, 2002
[30] Babu Sundaram. Register a Globus Toolkit 4 grid service. http://www.128.ibm.com/developerworks/grid/library/gr-mdsgt4/. May 10, 2005
[31] Jennifer M.Schopf. Distributed Monitoring and Information Services for the Grid. Argonne National Laboratory. Sep 30, 2005
[32] GLUE Schema collaboration. The GLUE Schema homepage. http://infnforge.cnaf.infn.it/glueinfomodel
[33] Jeff Mausolf. Monitor and discover grid services in an SOA/Web Services environment. http://www.128.ibm.com/developerworks/grid/library/gr-gt4mds/. Sep 6, 2005
[34] Karl Czajkowski, Don Ferguson, Ian Foster, Jeff Frey, Steve Graham, Tom Maguire, David Snelling, Steve Tuecke. From OGSI to WS-Resource Framework: Refactoring and Evolution. http://www.globus.org/wsrf/specs/ogsi_to_wsrf_1.0.pdf
© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号 地址：北京市海淀区学院路29号 邮编：100083 电话：办公室：(+86 10)66554848；文献借阅、咨询服务、科技查新：66554700 |