基于模型驱动的异构数据集成平台研究与实现
|
摘要
伴随着互联网络技术和Web应用的快速发展与普及,日常生活和工作方式发生改变,企业内部及企业之间迫切地需要实现可用资源的共享。因此,异构数据集成的实现技术,已经引起高度重视。
OMG组织提出的模型驱动体系结构(MDA),为解决异构数据的集成问题,提供了一个新的思路。模型驱动体系结构是一个以模型为中心的规范和开发应用软件的方法。它的基本思路是,通过映射规则将PIM转换成为与实现技术相关的特定平台模型(PSM,Platform Specific Model),并将PSM转换成目标代码和测试框架。
本文通过对这一思想的升华,将模型驱动的思想应用于软件的运行期,提出运行期模型驱动的思想。根据这一思想,提出实现一种基于模型驱动的异构数据集成技术,并将其用于油田勘探专业数据采集、集成平台的开发,通过建立数据词典元模型对各类异构数据模型进行描述,为数据映射关系建立提供统一的数据模型基础。数据映射关系脱离具体的应用,独立于具体数据模型,由映射词典进行独立、统一地描述。数据交换工具以动态加载数据映射关系的方式,完成异构数据集成。在完成数据集成的基础上,给出了数据应用的体系。目前该系统已成功应用于勘探录井专业数据库中。
Nowadays the Information System is used in almost every trade in our society and play a very important role.With the development of InterNet it become possible that the imformation can be shared in Web.Almost every lage-scale,medium-sized and small company become more and more depending on IT.The Information Sharing change the working-way of people,the efficiency and collaboration of work between enterprises is promoted and strengthened through this way.But there is a problem,because former Information System was built independently in different way,the data and information between Information Systems is heterogeneous,so communication and Resource Sharing appers hard.The result is there appears a lot of single Information-Island.
The Integration of Heterogeneous Data,integrating the inter and outer data source of a system,is the technology base of enterprise carries on resources sharing and realization Product Data Management(PDM)、Enterpris Application Integration(EAI)、Enterprise Resource Plan(ERP).Now,the isomerism data integration mainstream way is carries on the data exchange through the network.Realization system loose coupling integration,one of in which key technologies is realize the source data and the digital target information the different construction of data transformation.This article into further realizes isomerism data transformation of through the establishment source data and a digital target information Metadata to lay the foundation. Against metadata, based on the theme of this paper, a meta-data management and metadata management of a multi-dimensional framework. Metadata management is multidimensional that can be from different angles, according to the theme of metadata classification, and management from a different perspective and access metadata. Through the realization of this structure to complete the various metadata of the system. We rights management, the framework management, configuration management, and other documents as a framework composed of the basic modules to achieve, and the business-related portion of the expansion of the framework.
The data of various construct internal and external one system could be integrated by Integration of heterogeneous data.Some important Enterprise-Application, such as PDM、EAI、ERP and so on,depend on the Integration very much.And generally Integration of heterogeneous data is achieved through the exchange of Web data.This kind of Integration is loose-coupling and one of key techenologies is the transformation of data of various construct between Source and Target.On the base of Metadata,this article present a kind of Data Integration techenology .Base on the united descript of DataModel,we may descript the Mapping Relation conformably and normally.So we can accomplish the transformation of data from Source to Target that is to say the integration between heterogeneous with the uniform exchange way by the means of loading the Mapping Relation. MDA(Model Driven Architecture)is a architecture cried up by OMG,it break the traditional Software Engineer way,the core of software development is Model and Model run through every stage of development, analysis, design, realization, deployment, maintenance and management.Appearance of MDA make the United Data Modeling mature.With the thinking of MDA this article introduce the logic construce of Data Dictionary that discprit the Data Model uniformly.At the same time on the MetaModel level of Data Dictionary and based Data Dictionary this article analyse the Mapping Relation between heterogeneous Data Models. Then on the base of the research of Mapping Relation ,this article show how to accomplish the Data Integration and apply this to the procession of oil exploration,and resolve some questions.
In the process of oil and gas exploration, the exploration data collection, processing, storage, explained after the application form for the exploration and production results based on the provision of information. Exploration and production rely on large amounts of data, and produce large amounts of data, data management become the basic operations of exploration and production. The topics run by the idea of model-driven, for the exploration sector development of a data integration platform to support exploration and operations staff in the development of software can be customized to meet the exploration business needs. In the exploration business data environment, data sources, professional library, the main centre of the database structure used for a certain difference. In order to enable different systems between data sharing, the need for data between various database format conversion. Mapping data model describes the structure of the database between any two counterparts, this relationship is between the table and table, field and the field between the name of the control, it may also be a function of the transformation, such as Mosaic, the calculation. Mapping data model can be achieved data from the source database to database migration purposes, so as to achieve the purpose of data integration.
OMG组织提出的模型驱动体系结构(MDA),为解决异构数据的集成问题,提供了一个新的思路。模型驱动体系结构是一个以模型为中心的规范和开发应用软件的方法。它的基本思路是,通过映射规则将PIM转换成为与实现技术相关的特定平台模型(PSM,Platform Specific Model),并将PSM转换成目标代码和测试框架。
本文通过对这一思想的升华,将模型驱动的思想应用于软件的运行期,提出运行期模型驱动的思想。根据这一思想,提出实现一种基于模型驱动的异构数据集成技术,并将其用于油田勘探专业数据采集、集成平台的开发,通过建立数据词典元模型对各类异构数据模型进行描述,为数据映射关系建立提供统一的数据模型基础。数据映射关系脱离具体的应用,独立于具体数据模型,由映射词典进行独立、统一地描述。数据交换工具以动态加载数据映射关系的方式,完成异构数据集成。在完成数据集成的基础上,给出了数据应用的体系。目前该系统已成功应用于勘探录井专业数据库中。
Nowadays the Information System is used in almost every trade in our society and play a very important role.With the development of InterNet it become possible that the imformation can be shared in Web.Almost every lage-scale,medium-sized and small company become more and more depending on IT.The Information Sharing change the working-way of people,the efficiency and collaboration of work between enterprises is promoted and strengthened through this way.But there is a problem,because former Information System was built independently in different way,the data and information between Information Systems is heterogeneous,so communication and Resource Sharing appers hard.The result is there appears a lot of single Information-Island.
The Integration of Heterogeneous Data,integrating the inter and outer data source of a system,is the technology base of enterprise carries on resources sharing and realization Product Data Management(PDM)、Enterpris Application Integration(EAI)、Enterprise Resource Plan(ERP).Now,the isomerism data integration mainstream way is carries on the data exchange through the network.Realization system loose coupling integration,one of in which key technologies is realize the source data and the digital target information the different construction of data transformation.This article into further realizes isomerism data transformation of through the establishment source data and a digital target information Metadata to lay the foundation. Against metadata, based on the theme of this paper, a meta-data management and metadata management of a multi-dimensional framework. Metadata management is multidimensional that can be from different angles, according to the theme of metadata classification, and management from a different perspective and access metadata. Through the realization of this structure to complete the various metadata of the system. We rights management, the framework management, configuration management, and other documents as a framework composed of the basic modules to achieve, and the business-related portion of the expansion of the framework.
The data of various construct internal and external one system could be integrated by Integration of heterogeneous data.Some important Enterprise-Application, such as PDM、EAI、ERP and so on,depend on the Integration very much.And generally Integration of heterogeneous data is achieved through the exchange of Web data.This kind of Integration is loose-coupling and one of key techenologies is the transformation of data of various construct between Source and Target.On the base of Metadata,this article present a kind of Data Integration techenology .Base on the united descript of DataModel,we may descript the Mapping Relation conformably and normally.So we can accomplish the transformation of data from Source to Target that is to say the integration between heterogeneous with the uniform exchange way by the means of loading the Mapping Relation. MDA(Model Driven Architecture)is a architecture cried up by OMG,it break the traditional Software Engineer way,the core of software development is Model and Model run through every stage of development, analysis, design, realization, deployment, maintenance and management.Appearance of MDA make the United Data Modeling mature.With the thinking of MDA this article introduce the logic construce of Data Dictionary that discprit the Data Model uniformly.At the same time on the MetaModel level of Data Dictionary and based Data Dictionary this article analyse the Mapping Relation between heterogeneous Data Models. Then on the base of the research of Mapping Relation ,this article show how to accomplish the Data Integration and apply this to the procession of oil exploration,and resolve some questions.
In the process of oil and gas exploration, the exploration data collection, processing, storage, explained after the application form for the exploration and production results based on the provision of information. Exploration and production rely on large amounts of data, and produce large amounts of data, data management become the basic operations of exploration and production. The topics run by the idea of model-driven, for the exploration sector development of a data integration platform to support exploration and operations staff in the development of software can be customized to meet the exploration business needs. In the exploration business data environment, data sources, professional library, the main centre of the database structure used for a certain difference. In order to enable different systems between data sharing, the need for data between various database format conversion. Mapping data model describes the structure of the database between any two counterparts, this relationship is between the table and table, field and the field between the name of the control, it may also be a function of the transformation, such as Mosaic, the calculation. Mapping data model can be achieved data from the source database to database migration purposes, so as to achieve the purpose of data integration.
引文
[1] Roger S.Pressman 著,梅 宏 译.软件工程—实践者的研究方法[M].北京:机械工业出版社.2005.3-26.3-45.
[2] David S.Frankel 著,鲍志云 译.应用 MDA[M].北京:人民邮电出版社.2003.35-83
[3] Anneke Kleppe 著,鲍志云 译.解析 MDA[M].北京:人民邮电出版社.2004.2-33
[4] OMG.MDA Guide Version1.0.1[EB/OL]. http://www.omg.org, 2003-06-12.
[5] 余彤鹰.复杂系统的层级原理与模型驱动的体系结构[EB/OL]. http://www.ee-forum.org,2002.
[6] 董建武.模型驱动体系结构的剖析及应用[D].浙江:浙江大学2002,18-21,35-36.
[7] 颜玉兰,何克清,刘 进.一种基于有限状态机的模型转换方法[J].计算机工程,2006,32(1):93-95.
[8] 鹿旭东,万建成.元模型支持下的模型转换[J].计算机工程与 应用,2005,36:72-75.
[9] 林 炜,夏宽理.基于 MDA 的模型转换方法研究[J]. .计算机工程与 应用,2005,2:80-83.
[10]王学斌,王怀民,吴泉源等.一种模型转换的编制框架[J].软件 学报,2006,17(6):1424-1434.
[11] 夏 雷,欧阳松. MDA 中关联从 UML 模型到 Java 模型的转换[J].计算机工程与设计,2006,27(16):3078-3081.
[12] 吴春水,唐 胜.MDA 中从 PIM 到 PSM 的模型转换[J].计算机 工程,2004,30(3):1-3.
[2] David S.Frankel 著,鲍志云 译.应用 MDA[M].北京:人民邮电出版社.2003.35-83
[3] Anneke Kleppe 著,鲍志云 译.解析 MDA[M].北京:人民邮电出版社.2004.2-33
[4] OMG.MDA Guide Version1.0.1[EB/OL]. http://www.omg.org, 2003-06-12.
[5] 余彤鹰.复杂系统的层级原理与模型驱动的体系结构[EB/OL]. http://www.ee-forum.org,2002.
[6] 董建武.模型驱动体系结构的剖析及应用[D].浙江:浙江大学2002,18-21,35-36.
[7] 颜玉兰,何克清,刘 进.一种基于有限状态机的模型转换方法[J].计算机工程,2006,32(1):93-95.
[8] 鹿旭东,万建成.元模型支持下的模型转换[J].计算机工程与 应用,2005,36:72-75.
[9] 林 炜,夏宽理.基于 MDA 的模型转换方法研究[J]. .计算机工程与 应用,2005,2:80-83.
[10]王学斌,王怀民,吴泉源等.一种模型转换的编制框架[J].软件 学报,2006,17(6):1424-1434.
[11] 夏 雷,欧阳松. MDA 中关联从 UML 模型到 Java 模型的转换[J].计算机工程与设计,2006,27(16):3078-3081.
[12] 吴春水,唐 胜.MDA 中从 PIM 到 PSM 的模型转换[J].计算机 工程,2004,30(3):1-3.
© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号 地址：北京市海淀区学院路29号 邮编：100083 电话：办公室：(+86 10)66554848；文献借阅、咨询服务、科技查新：66554700 |