中国地震网格试验系统中资源管理与作业调度研究——资源管理和作业动态分配模型ProRMJS的建立
|
摘要
通过分析与研究建立资源管理和作业动态分配ProRMJS模型,解决了中国地震灾害仿真网格试验系统(CEDAGrid)中网格科学计算平台在初期建设中存在的一些资源管理方面的问题.针对网格科学计算平台默认各个计算节点均能提供计算服务的问题,ProRMJS通过“计算池”这一虚拟组织为调度器分发作业提供支撑;而调度器则根据计算池中各个节点的计算能力和状态,动态分配任务,这样就保证了计算平台的稳定性.针对默认各个计算节点均能完成任务的问题,ProRMJS通过监控各个节点所负担作业的运行进度和设定作业时间阈值来管理作业运行.对于各个节点计算能力大小的区别,ProRMJS通过对各个节点计算性能的权值量化,实行按“需”分配作业.对各个节点计算性能的权值量化,ProRMJS是通过综合考虑各个因素对机器计算能力大小的影响后通过加权计算的方式完成的,从而提高了整个计算平台的工作效率.最后通过实现地震应力触发科学计算实例验证了方案的有效性,为网格技术在地震领域内的进一步应用作了有意义的探索.
Grid technique is taken as the third generation internet technology and resource management is the core of it. Aiming at the problems of resource management of CEDAGrid (China Earthquake Disaster Alleviation and Simulation Grid) in its preliminary construction, this paper presents a resource management and job scheduling model: ProRMJS to solve these problems. For platform supposed agreeably each computing node can provide computation service, ProRMJS uses "computation pool" to support scheduler, and then the scheduler allocates jobs dynamically according to computing capability and status of each node to ensure the stability of the platform. At the same time, ProRMJS monitors the status of job on each node and sets a time threshold to manage the job scheduling. By estimating the computing capability of each node, ProRMJS allocates jobs on demand to solve the problem of supposing each node can finish the job acquiescently. When calculating the computing capability of each node, ProRMJS allows for the various factors that affect the computing capability and then the efficiency of the platform is improved. Finally the validity of the model is verified by an example.
Grid technique is taken as the third generation internet technology and resource management is the core of it. Aiming at the problems of resource management of CEDAGrid (China Earthquake Disaster Alleviation and Simulation Grid) in its preliminary construction, this paper presents a resource management and job scheduling model: ProRMJS to solve these problems. For platform supposed agreeably each computing node can provide computation service, ProRMJS uses "computation pool" to support scheduler, and then the scheduler allocates jobs dynamically according to computing capability and status of each node to ensure the stability of the platform. At the same time, ProRMJS monitors the status of job on each node and sets a time threshold to manage the job scheduling. By estimating the computing capability of each node, ProRMJS allocates jobs on demand to solve the problem of supposing each node can finish the job acquiescently. When calculating the computing capability of each node, ProRMJS allows for the various factors that affect the computing capability and then the efficiency of the platform is improved. Finally the validity of the model is verified by an example.
引文
陈吉荣.2004.中国地震减灾仿真网格关键技术研究[D]:[学位论文].北京:北京理工大学,1~35
侯建民,刘瑞丰,任枭.2006a.网格技术研究进展[J].地震地磁观测与研究,27(1):84~90
侯建民,刘瑞丰,任枭,等.2006b.基于GT3的网格计算平台的构建及应用[J].地震,26(3):99~107
王晓东(编著).2000.计算机算法设计与分析[M].北京:电子工业出版社,13~17
杨学良,张占军(编著).2002.分布式多媒体计算机系列教程[M].北京:电子工业出版社,1~202
余详宣,催国华,邹海明.2000.计算机算法基础(第二版)[M].武汉:华中科技大学出版社,1~7
DeFanti T,Ian Foster,Papka ME,et al.1996.Overviewof the I-WAY:Wide area visual supercomputing[J].Interna-tional Journal of Supercomputing Applications,10(2):123~130
Dougles E Comer,David L Stevens(著).2004.张卫,王能(译).2004.TCP/IP网络互联技术(卷三):客户—服务器编程与应用(Windows套接字版)[M].北京:清华大学出版社,111~117,125~130
John L Hennessy,David APatterson(著).2004.郑纬民,汤志忠,汪东升(译).2004.计算机系统结构量化研究方法(第三版)[M].北京:电子工业出版社,16~57
侯建民,刘瑞丰,任枭.2006a.网格技术研究进展[J].地震地磁观测与研究,27(1):84~90
侯建民,刘瑞丰,任枭,等.2006b.基于GT3的网格计算平台的构建及应用[J].地震,26(3):99~107
王晓东(编著).2000.计算机算法设计与分析[M].北京:电子工业出版社,13~17
杨学良,张占军(编著).2002.分布式多媒体计算机系列教程[M].北京:电子工业出版社,1~202
余详宣,催国华,邹海明.2000.计算机算法基础(第二版)[M].武汉:华中科技大学出版社,1~7
DeFanti T,Ian Foster,Papka ME,et al.1996.Overviewof the I-WAY:Wide area visual supercomputing[J].Interna-tional Journal of Supercomputing Applications,10(2):123~130
Dougles E Comer,David L Stevens(著).2004.张卫,王能(译).2004.TCP/IP网络互联技术(卷三):客户—服务器编程与应用(Windows套接字版)[M].北京:清华大学出版社,111~117,125~130
John L Hennessy,David APatterson(著).2004.郑纬民,汤志忠,汪东升(译).2004.计算机系统结构量化研究方法(第三版)[M].北京:电子工业出版社,16~57
版权所有：© 2023 中国地质图书馆 中国地质调查局地学文献中心