云计算海量光纤数据的差异化调度研究
|
摘要
伴随信息技术不断革新互联网应用迅速发展,由于对数据传输速度及质量要求提高,光纤网络逐渐被广泛应用。为满足数据高效率传输目的,在云计算环境下,提出基于动态数据摆放的差异性调度特征匹配方法,对光纤数据实现有效调度。在保证数据任务请求满足期望执行效果条件下,采用数据摆放方法,对数据进行预处理操作,通过数据共享规则在云资源池中对数据块实行动态摆放,依据节点资源利用机率确定数据摆放位置,达到覆盖最多数据块的目的,为调度策略提供资源基础。以决策树最优解路径为基础,提出差异性数据调度匹配策略,在云环境下从全局角度考虑数据任务优先级,基于云资源公用库,将决策树节点分别布置到每个存储器上,并对数据资源分类进行控制,实现光纤数据差异化调度。实验证明,通过运用文中数据调度方法能够提升光纤数据传输质量。
With the continuous innovation of information technology and the rapid development of Internet applications,due to the increase in data transmission speed and quality requirements,fiber optic networks are gradually being widely used. In order to meet the purpose of high-efficiency data transmission,in the cloud computing environment,a differential scheduling feature matching method based on dynamic data placement is proposed to realize effective scheduling of fiber data. Under the condition that the data task request is guaranteed to meet the expected execution effect,the data placement method is used to preprocess the data,and the data block is dynamically placed in the cloud resource pool through the data sharing rule,and the data position is determined according to the probability of using the node resource. The placement location reaches the goal of covering the most data blocks to provide a resource basis for the scheduling strategy. Based on the optimal solution path of the decision tree,a differential data scheduling matching strategy is proposed. In the cloud environment,the data task priority is considered from a global perspective. Based on the cloud resource common library,the decision tree nodes are respectively arranged on each storage,and control data resource classification to achieve differential scheduling of fiber data. Experiments show that the data transmission quality of optical fiber can be improved by using the data scheduling method in the paper.
With the continuous innovation of information technology and the rapid development of Internet applications,due to the increase in data transmission speed and quality requirements,fiber optic networks are gradually being widely used. In order to meet the purpose of high-efficiency data transmission,in the cloud computing environment,a differential scheduling feature matching method based on dynamic data placement is proposed to realize effective scheduling of fiber data. Under the condition that the data task request is guaranteed to meet the expected execution effect,the data placement method is used to preprocess the data,and the data block is dynamically placed in the cloud resource pool through the data sharing rule,and the data position is determined according to the probability of using the node resource. The placement location reaches the goal of covering the most data blocks to provide a resource basis for the scheduling strategy. Based on the optimal solution path of the decision tree,a differential data scheduling matching strategy is proposed. In the cloud environment,the data task priority is considered from a global perspective. Based on the cloud resource common library,the decision tree nodes are respectively arranged on each storage,and control data resource classification to achieve differential scheduling of fiber data. Experiments show that the data transmission quality of optical fiber can be improved by using the data scheduling method in the paper.
引文
[1]熊淑平.无线传感器网络激光主动供能采集系统研究[J].长沙民政职业技术学院学报,2017,24(2):136-137.
[2]周炜.基于云计算的政府智能数据服务平台研究与设计[J].电子技术与软件工程,2017,18:176-176.
[3]戴霞娟,姚克明,高倩.光纤激光器多通道自混合干涉的光谱和温度效应[J].光学与光电技术,2016,14(1):42-46.
[4]南钢洋,王启武,孙继华,等.分布式光纤传感数据采集系统设计[J].山东科学,2017,30(6):65-70.
[5]谭小地.大数据时代的光存储技术[J].红外与激光工程,2016,45(9):19-22.
[6]刘昊,李喆,石晶,等.基于卷积神经网络的材质分类识别研究[J].激光与红外,2017,47(8):1024-1028.
[7]王玉文,董志伟,李瀚宇,等.纳米网络中的太赫兹波大气传输和信道分析[J].强激光与粒子束,2016,28(6):146-152.
[8]黄晨,王建军,薛莉,等.下一代天文望远镜及巡天任务(下)[J].红外与激光工程,2016,45(3):160-165.
[9]余飞,陈楚江,王丽园.海量激光雷达点云数据的多尺度可视化高效管理[J].工程勘察,2016,44(9):69-73.
[10]高文科,张志胜,周一帆,等.存在故障相关及不完备检测的主辅并联系统可靠性建模与维修策略[J].自动化学报,2015,41(12):2100-2114.
[11]蔺小虎,姚顽强,马润霞,等.基于海量点云数据的大雁塔三维重建[J].文物保护与考古科学,2017,29(3):67-72.
[12]崔博,刘利平.网络考试信息的交互调度模型仿真分析[J].计算机仿真,2016,33(6):185-188
[13]乞耀龙,王彦平,谭维贤,等.基于光纤模式数据采集方案的阵列快拍成像雷达[J].信号处理,2017,4:583-588.
[14]赵中民,习友宝.三维激光扫描系统的固有误差校正算法[J].激光与红外,2016,46(1):34-38.
[15]曹强,严文瑞,姚杰,等.一种超大容量自动光盘库的设计与实现[J].红外与激光工程,2016,45(9):28-35.
[16]谢洪,吴博义,胡晓斌.一种车载移动海量多源数据管理方法[J].遥感信息,2017,32(5):15-22.
[2]周炜.基于云计算的政府智能数据服务平台研究与设计[J].电子技术与软件工程,2017,18:176-176.
[3]戴霞娟,姚克明,高倩.光纤激光器多通道自混合干涉的光谱和温度效应[J].光学与光电技术,2016,14(1):42-46.
[4]南钢洋,王启武,孙继华,等.分布式光纤传感数据采集系统设计[J].山东科学,2017,30(6):65-70.
[5]谭小地.大数据时代的光存储技术[J].红外与激光工程,2016,45(9):19-22.
[6]刘昊,李喆,石晶,等.基于卷积神经网络的材质分类识别研究[J].激光与红外,2017,47(8):1024-1028.
[7]王玉文,董志伟,李瀚宇,等.纳米网络中的太赫兹波大气传输和信道分析[J].强激光与粒子束,2016,28(6):146-152.
[8]黄晨,王建军,薛莉,等.下一代天文望远镜及巡天任务(下)[J].红外与激光工程,2016,45(3):160-165.
[9]余飞,陈楚江,王丽园.海量激光雷达点云数据的多尺度可视化高效管理[J].工程勘察,2016,44(9):69-73.
[10]高文科,张志胜,周一帆,等.存在故障相关及不完备检测的主辅并联系统可靠性建模与维修策略[J].自动化学报,2015,41(12):2100-2114.
[11]蔺小虎,姚顽强,马润霞,等.基于海量点云数据的大雁塔三维重建[J].文物保护与考古科学,2017,29(3):67-72.
[12]崔博,刘利平.网络考试信息的交互调度模型仿真分析[J].计算机仿真,2016,33(6):185-188
[13]乞耀龙,王彦平,谭维贤,等.基于光纤模式数据采集方案的阵列快拍成像雷达[J].信号处理,2017,4:583-588.
[14]赵中民,习友宝.三维激光扫描系统的固有误差校正算法[J].激光与红外,2016,46(1):34-38.
[15]曹强,严文瑞,姚杰,等.一种超大容量自动光盘库的设计与实现[J].红外与激光工程,2016,45(9):28-35.
[16]谢洪,吴博义,胡晓斌.一种车载移动海量多源数据管理方法[J].遥感信息,2017,32(5):15-22.
© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号 地址：北京市海淀区学院路29号 邮编：100083 电话：办公室：(+86 10)66554848；文献借阅、咨询服务、科技查新：66554700 |