MDA在数据仓库维度建模中的应用研究
|
摘要
数据仓库的设计涉及到多个层面,如ETL过程、可操作数据源、数据仓库存储等。每个层面都会有不同的建模方法,这些方法往往只是针对单个方面提出的,这样建模制品就会缺乏一致性和可复用性,设计者很难从一个统一的、整体的角度对数据仓库进行设计。模型驱动架构(MDA)是一种用于软件开发的标准框架,着重用模型描述软件开发的整个生命周期。把MDA应用于数据仓库开发中,能很好地解决设计中的整体性和统一性问题。
维度建模是数据仓库存储设计的基础,本文针对维度建模中存在的一些问题,如无法从多维概念模型自动转换成多维逻辑模型,建模制品可复用性不高、且不利于数据仓库元数据的交换或共享等,提出了一种把MDA和维度建模结合起来的方法——模型驱动的维度建模(Model Driven Demensional Modeling MDDM)。
本文用扩展的UML进行多维概念的建模,然后通过形式化方法——查询/视图/转换(QVT)清晰地定义出多维概念模型到逻辑模型的转换,使其具有可重用性,并实现了多维概念模型到逻辑模型的自动转换,转换结果遵从公共数据仓库元模型(CWM)标准。这样既有利于数据仓库中不同平台和工具间的元数据的交换和集成,又降低了设计者对CWM建模的难度,同时提高了建模制品的可复用性。
Several aspects should be considered in the design of data warehouse (DW) System, such as ETL process, operational data source, DW repository, etc. There are different methods for modeling in the processes of designing different aspects of DW.However they are all targeted at particular aspects of DW design, as a consequence, the artifacts of modeling are lacking in coherence and model reusability, designers find it hard to design data warehouse in an integrated and standard manner. While Model Driven Architecture (MDA) is a standard framework for the software development, it can describe the whole life cycle by means of models. The combination of MDA and data warehouse can help to solve the problem of lacking in coherence and reusibility.
Dimensional modeling is the foundation for the design of DW repository. This paper proposes a method which called Model Driven Dimensional Modeling (MDDM). It applies MDA to dimensional modeling so as to solve some of the problems in the dimensional modeling. For instance, 1) some methods can not shift from multidimensional conceptual model to multidimensional logical model automatically. 2) The reusibility of models is not very promising. 3) The artifacts of the modeling can not facilitate the interchange and share of metadata.
With the MDDM method, a multidimensional conceptual model is built using extended UML.Therefore it can provide the designer a standard and integrated way to design DW repository. The transformation from conceptual models to logical ones is defined clearly by the formal way Query/View/Transform (QVT). As a result the transformation is reusable. The conceptual model can be automatically transformed into a logical model which is compliant with Common Warehouse Model (CWM). Therefore the complexity of CWM modeling is decreased, and the reusibility of the modeling artifact is improved. It also helps the interchange and integration of the metadata in data warehouse.
维度建模是数据仓库存储设计的基础,本文针对维度建模中存在的一些问题,如无法从多维概念模型自动转换成多维逻辑模型,建模制品可复用性不高、且不利于数据仓库元数据的交换或共享等,提出了一种把MDA和维度建模结合起来的方法——模型驱动的维度建模(Model Driven Demensional Modeling MDDM)。
本文用扩展的UML进行多维概念的建模,然后通过形式化方法——查询/视图/转换(QVT)清晰地定义出多维概念模型到逻辑模型的转换,使其具有可重用性,并实现了多维概念模型到逻辑模型的自动转换,转换结果遵从公共数据仓库元模型(CWM)标准。这样既有利于数据仓库中不同平台和工具间的元数据的交换和集成,又降低了设计者对CWM建模的难度,同时提高了建模制品的可复用性。
Several aspects should be considered in the design of data warehouse (DW) System, such as ETL process, operational data source, DW repository, etc. There are different methods for modeling in the processes of designing different aspects of DW.However they are all targeted at particular aspects of DW design, as a consequence, the artifacts of modeling are lacking in coherence and model reusability, designers find it hard to design data warehouse in an integrated and standard manner. While Model Driven Architecture (MDA) is a standard framework for the software development, it can describe the whole life cycle by means of models. The combination of MDA and data warehouse can help to solve the problem of lacking in coherence and reusibility.
Dimensional modeling is the foundation for the design of DW repository. This paper proposes a method which called Model Driven Dimensional Modeling (MDDM). It applies MDA to dimensional modeling so as to solve some of the problems in the dimensional modeling. For instance, 1) some methods can not shift from multidimensional conceptual model to multidimensional logical model automatically. 2) The reusibility of models is not very promising. 3) The artifacts of the modeling can not facilitate the interchange and share of metadata.
With the MDDM method, a multidimensional conceptual model is built using extended UML.Therefore it can provide the designer a standard and integrated way to design DW repository. The transformation from conceptual models to logical ones is defined clearly by the formal way Query/View/Transform (QVT). As a result the transformation is reusable. The conceptual model can be automatically transformed into a logical model which is compliant with Common Warehouse Model (CWM). Therefore the complexity of CWM modeling is decreased, and the reusibility of the modeling artifact is improved. It also helps the interchange and integration of the metadata in data warehouse.
引文
1. Mazon J_N, Trujillo J.,Serrano M., Piattini M.Designing data warehouses: from business requirement analysis to multidimensional modeling[EB/OL]. 13thIEEE International Requirements Engineering Confenrence Workshop on Requirements Engineering for Business Needs and IT Alignment(REBNITA),Paris.August, 2005 http://homepage.mac.com/karlalancox/documents/MazonCRC_000.pdf
2. Luján-Mora S.,Trujillo J.,Song I-Y. Multidimensional modeling with UML package diagrams[J]. 21st Intl.Conference on Conceptual Modeling (ER2002). Volume 2503 of LNCS:199-213. Springer-Verlag, 2002
3. Juan Trujillo. Applying MDA to the Development of Data Warehouses[J] ACM: 57-66, November 2005
4. Object Management Group.MOF 2.0 Query/Views/Transformations[EB/OL]. http://www.omg.org/cgi-bin/doc?ptc/2005-11-01.
5. John Poole Dan Chang, Douglas M. Tolbert 等著,彭蓉,刘进等译.公共仓库元模型开发指南[M].机械工业出版社,2004
6. Object Management Group.Unified Modeling Language:Superstructure Version 2.0[EB/OL].http://www.omg.org/technology/documents/formal/uml.htm, June 2005
7. Robert A. Maksimchuk, Eric J. Naiburg 著,李虎等译.UML 初学者指南[M].人民邮电出版社,2005
8. W.H.Inmon. Building the Data Warehouse Third Edition[M], John Wiley&Sons,2002
9. Ralph Kimball,Margy Ross 著,谭明金译.数据仓库工具箱:维度建模的完全指南[M],电子工业出版社,2003
10. David S Frankel 著,鲍志云译.应用 MDA[M],人民邮电出版社,2003
11. Anneke Kleppe, Jos Warmer,Wim Bast 著,鲍志云译.解析 MDA[M],人民邮电出版社,2004
12. 刘奎.基于模式的 PIM 到 PSM 模型变换方法的研究 [硕士学位论文],2005
13. 张利青.模型驱动系统架构(MDA)的实现研究[硕士学位论文],2006
14. 陈刚编者.Eclipse 从入门到精通[M],清华大学出版社,2005
15. Object Management Group. Java Metadata Interface Specification[EB/OL], http://www.jcp,org/,June 2002
16. Mellor S., Scott K., Uhl A.,Weise D. MDA distilled: principles of Model-Driven Architecture [M]. Addison-Wesley. 2004
17. Poole J. Model Driven Data Warehouse [EB/OL], www. cwmforum.org/ POOLE Integrate 2003.pdf
18. Golfarelli M., Maio D., Rizzi S. The Dimensional Fact Model: A Conceptual Model for Data Warehouses[J]. Int. J. Cooperative Inf. Syst. 7(2-3): 215-247. 1998
19. Tryfona N. Busborg F., Christiansen J. starER: A Conceptual Model for Data Warehouse Design [J]. In: Proc. Of the ACM 2nd Intl. Workshop on Data Warehousing and OLAP (DOLAP’99), Kansas City, USA. 1999
20. Cabibbo L., Torlone R. A Logical Approach to Multidimensional Databases[J]. In: Proc. Of the 6th Intl. Conf. on Extending Database Technology (EDBT’98). Volume 1377 of LNCS, pp. 183-197. Valencia, Spain. 1998
21. Kimball, R., Ross, M..The Data Warehouse Toolkit, second edition[M], John Wiley & Sons.2002
22. Jarke M., Lenzerini M., Vassiliou Y., Vassiliadis P. Fundamentals of Data Warehouses[M]. Springer. 2000
23. Luján-Mora S., Trujillo J., Song I-Y. Extending UML for Multidimensional Modeling[J]. 5th International Conference on the Unified Modeling Language (UML 2002), LNCS 2460, 290-304. 2002
24. Trujillo J., Luján-Mora S. A UML based Approach for Modeling ETL Processes in Data Warehouses[J]. In proceedings of the 22nd International Conference on Conceptual Modeling (ER’03), volume 2813 of Lecture Notes in Computer Science, pages 307-320, Chicago, USA, October 2003. Springer-Verlag
25. Luján-Mora S., Trujillo J. Physical Modeling of Data Warehouses using UML[J]. In: Proc. Of the ACM 7th Intl. Workshop on Data Warehousing and OLAP (DOLAP’04), Washington, D.C., USA. 2004
26. David Marco 著,张铭,李钦等译.元数据仓储的构建与管理[M],机械工业出版社,2004.5
27. 数 据 仓 库 和 元 数 据 管 理 [EB/OL],http://www.stcore.com/oracle/2006-06-14/ 1150252273d26681.html
28. Paulraj Ponniah 著,段云峰,李剑威,韩洁等译.数据仓库基础[M],电子工业出版社,2004.4
29. Timothy J.Grose,Gray C. Doney, Stehpen A. Brodsky 著,徐强等译.精通 XMI—使用 XMI、XML 和 UML 进行 Java 编程[M],电子工业出版社,2004
30. Object Management Group: Meta Object Facility Specification, version 1.4[EB/OL], OMG document formal/02-04-03
2. Luján-Mora S.,Trujillo J.,Song I-Y. Multidimensional modeling with UML package diagrams[J]. 21st Intl.Conference on Conceptual Modeling (ER2002). Volume 2503 of LNCS:199-213. Springer-Verlag, 2002
3. Juan Trujillo. Applying MDA to the Development of Data Warehouses[J] ACM: 57-66, November 2005
4. Object Management Group.MOF 2.0 Query/Views/Transformations[EB/OL]. http://www.omg.org/cgi-bin/doc?ptc/2005-11-01.
5. John Poole Dan Chang, Douglas M. Tolbert 等著,彭蓉,刘进等译.公共仓库元模型开发指南[M].机械工业出版社,2004
6. Object Management Group.Unified Modeling Language:Superstructure Version 2.0[EB/OL].http://www.omg.org/technology/documents/formal/uml.htm, June 2005
7. Robert A. Maksimchuk, Eric J. Naiburg 著,李虎等译.UML 初学者指南[M].人民邮电出版社,2005
8. W.H.Inmon. Building the Data Warehouse Third Edition[M], John Wiley&Sons,2002
9. Ralph Kimball,Margy Ross 著,谭明金译.数据仓库工具箱:维度建模的完全指南[M],电子工业出版社,2003
10. David S Frankel 著,鲍志云译.应用 MDA[M],人民邮电出版社,2003
11. Anneke Kleppe, Jos Warmer,Wim Bast 著,鲍志云译.解析 MDA[M],人民邮电出版社,2004
12. 刘奎.基于模式的 PIM 到 PSM 模型变换方法的研究 [硕士学位论文],2005
13. 张利青.模型驱动系统架构(MDA)的实现研究[硕士学位论文],2006
14. 陈刚编者.Eclipse 从入门到精通[M],清华大学出版社,2005
15. Object Management Group. Java Metadata Interface Specification[EB/OL], http://www.jcp,org/,June 2002
16. Mellor S., Scott K., Uhl A.,Weise D. MDA distilled: principles of Model-Driven Architecture [M]. Addison-Wesley. 2004
17. Poole J. Model Driven Data Warehouse [EB/OL], www. cwmforum.org/ POOLE Integrate 2003.pdf
18. Golfarelli M., Maio D., Rizzi S. The Dimensional Fact Model: A Conceptual Model for Data Warehouses[J]. Int. J. Cooperative Inf. Syst. 7(2-3): 215-247. 1998
19. Tryfona N. Busborg F., Christiansen J. starER: A Conceptual Model for Data Warehouse Design [J]. In: Proc. Of the ACM 2nd Intl. Workshop on Data Warehousing and OLAP (DOLAP’99), Kansas City, USA. 1999
20. Cabibbo L., Torlone R. A Logical Approach to Multidimensional Databases[J]. In: Proc. Of the 6th Intl. Conf. on Extending Database Technology (EDBT’98). Volume 1377 of LNCS, pp. 183-197. Valencia, Spain. 1998
21. Kimball, R., Ross, M..The Data Warehouse Toolkit, second edition[M], John Wiley & Sons.2002
22. Jarke M., Lenzerini M., Vassiliou Y., Vassiliadis P. Fundamentals of Data Warehouses[M]. Springer. 2000
23. Luján-Mora S., Trujillo J., Song I-Y. Extending UML for Multidimensional Modeling[J]. 5th International Conference on the Unified Modeling Language (UML 2002), LNCS 2460, 290-304. 2002
24. Trujillo J., Luján-Mora S. A UML based Approach for Modeling ETL Processes in Data Warehouses[J]. In proceedings of the 22nd International Conference on Conceptual Modeling (ER’03), volume 2813 of Lecture Notes in Computer Science, pages 307-320, Chicago, USA, October 2003. Springer-Verlag
25. Luján-Mora S., Trujillo J. Physical Modeling of Data Warehouses using UML[J]. In: Proc. Of the ACM 7th Intl. Workshop on Data Warehousing and OLAP (DOLAP’04), Washington, D.C., USA. 2004
26. David Marco 著,张铭,李钦等译.元数据仓储的构建与管理[M],机械工业出版社,2004.5
27. 数 据 仓 库 和 元 数 据 管 理 [EB/OL],http://www.stcore.com/oracle/2006-06-14/ 1150252273d26681.html
28. Paulraj Ponniah 著,段云峰,李剑威,韩洁等译.数据仓库基础[M],电子工业出版社,2004.4
29. Timothy J.Grose,Gray C. Doney, Stehpen A. Brodsky 著,徐强等译.精通 XMI—使用 XMI、XML 和 UML 进行 Java 编程[M],电子工业出版社,2004
30. Object Management Group: Meta Object Facility Specification, version 1.4[EB/OL], OMG document formal/02-04-03