工业实时数据库的应用设计及数据处理研究
|
摘要
随着工业过程系统日益复杂,为确保其安全稳定高效地运行,工业实时数据库系统在工业过程监控中得到越来越广泛的应用,并逐渐成为先进控制和过程监测以及厂级信息管理的不可或缺的基础数据平台,带来了显著的经济和社会效益。工业实时数据库系统具有独特的时间特性与体系结构、强大的实时数据采集和历史数据保存功能、丰富的应用程序接口和数据管理模块。在充分了解其各个功能模块的基础上进行应用设计与开发,并将其采集保存的数据有效地用于生产监控具有重要的应用价值。本文以某石化企业聚乙烯生产监控系统的开发为背景,对实时数据库系统的应用设计以及针对实时数据库的数据预处理技术进行了研究。
本文的主要研究内容与研究成果如下:
(1)介绍了实时数据库的产生、功能与发展趋势、层次结构与管理结构,阐述了实时数据库的特点,着重比较了当前的两种典型实时数据库系统:PI与InfoPlus.21,综述了当前实时数据库在工业过程控制中的应用情况。
(2)给出了在工业控制中实时数据库应用设计的基本步骤,以PI数据库和项目中系统开发为例,详细说明了工业实时数据库系统应用设计的步骤。
(3)对实时数据库与DCS系统接口的OPC技术进行了详细介绍,并对本项目中的系统配置进行了着重说明;以PI数据库为例,详细阐述了实时数据库与应用程序的接口设计中利用API与SDK两种方法进行设计的详细步骤,并分别利用两种方法开发了PI的接口程序,还利用SDK方法开发了一个集点的查询与修改和数据查询、修改、删除于一体的PI管理软件,对PI的功能进行了有效补充,最后对两种接口方法的效率和适用环境进行了比较和评价。
(4)阐述了实时数据库中数据用于过程监控建模的缺失、冗余、异常、高维等问题,给出了对数据进行预处理的方法和步骤,结合Excel、VB、Mat lab三种平台并利用插值、滤波、主元分析等技术开发了一个数据预处理软件,通过在项目中的应用说明了其有效性与适应性。
(5)基于上述应用设计以及数据预处理技术与软件,在PI实时数据库上开发了聚乙烯生产监控系统,实现了系统在现场的安全运行,给出了系统的运行界面和运行效果和作者自己的开发体会,对系统的进一步开发进行了展望。
With industrial process systems increasingly becoming more and more complicated, the industrial real-time database has been widely used for industrial process control and monitoring to guarantee that the systems are operating safely, stably and with high efficiency. Furthermore, such real-time database is gradually becoming an indispensable basic data platform for advanced control and process monitoring as well as plant-wide information management, which results in significant economic and social benefits. The industrial real-time database system is provided with unique time characteristic and system structure, powerful functions for real-time data collection and historical data preservation, and abundant Application Programming Interface and Data Management modules, hence, based on a thorough comprehension of its various functional modules, it is of great application value to carry out application design and development for the database and further effectively make use of the data collected or preserved therein for process control and monitoring. With the development of a polyethylene production control and monitoring system for a petrochemical plant as the background, this thesis focuses on the application design and data processing for industrial real-time database.
The main contents and results of this thesis are as follows:
(1) Basic concepts of real-time database are introduced, such as its generation, functions, development trend, hierarchical and management structure. Depended on a detailed description of the characteristics of real-time database, a comparison between two typical real-time database systems: PI and InfoPlus.21 are presented. The current application of real-time database in industrial process control is also reviewed.
(2) The basic steps of application design of real-time database in industrial control are presented as well as a detailed description of the database design, which are illustrated by a practical application of PI database design in a project development
(3) Both the OPC interface of real-time database and DCS system and the system configuration are described in detail. Then the API and SDK methods for interface design of real-time database and application are introduced. A software for managing the PI system by means of SDK method is developed, by which querying and editing the points and data in the database are easy to be realized. The efficiency and application environment of the two methods are valued in the end.
(4) The difficulties of effectively using data in real-time database for modeling are presented, e.g. there generally exist missing data, redundant data, or abnormal data in database and the data dimensionality is always very high. The general steps and methods such as linear and nonlinear interpolation, data filtering, principal component analysis are adopted to overcome the foregoing problems, and a software for data preprocessing integrating the described steps and methods is developed under a combined development environment with the advantages of Excel, VB and Matlab. Its validity and adaptability are verified through the application to real projects.
(5) Based on the application design, interface design and the data preprocessing, a polyethylene production monitoring platform is developed, which is running safely in industrial field. According to author's own experience, the further development of the system is forecasted.
本文的主要研究内容与研究成果如下:
(1)介绍了实时数据库的产生、功能与发展趋势、层次结构与管理结构,阐述了实时数据库的特点,着重比较了当前的两种典型实时数据库系统:PI与InfoPlus.21,综述了当前实时数据库在工业过程控制中的应用情况。
(2)给出了在工业控制中实时数据库应用设计的基本步骤,以PI数据库和项目中系统开发为例,详细说明了工业实时数据库系统应用设计的步骤。
(3)对实时数据库与DCS系统接口的OPC技术进行了详细介绍,并对本项目中的系统配置进行了着重说明;以PI数据库为例,详细阐述了实时数据库与应用程序的接口设计中利用API与SDK两种方法进行设计的详细步骤,并分别利用两种方法开发了PI的接口程序,还利用SDK方法开发了一个集点的查询与修改和数据查询、修改、删除于一体的PI管理软件,对PI的功能进行了有效补充,最后对两种接口方法的效率和适用环境进行了比较和评价。
(4)阐述了实时数据库中数据用于过程监控建模的缺失、冗余、异常、高维等问题,给出了对数据进行预处理的方法和步骤,结合Excel、VB、Mat lab三种平台并利用插值、滤波、主元分析等技术开发了一个数据预处理软件,通过在项目中的应用说明了其有效性与适应性。
(5)基于上述应用设计以及数据预处理技术与软件,在PI实时数据库上开发了聚乙烯生产监控系统,实现了系统在现场的安全运行,给出了系统的运行界面和运行效果和作者自己的开发体会,对系统的进一步开发进行了展望。
With industrial process systems increasingly becoming more and more complicated, the industrial real-time database has been widely used for industrial process control and monitoring to guarantee that the systems are operating safely, stably and with high efficiency. Furthermore, such real-time database is gradually becoming an indispensable basic data platform for advanced control and process monitoring as well as plant-wide information management, which results in significant economic and social benefits. The industrial real-time database system is provided with unique time characteristic and system structure, powerful functions for real-time data collection and historical data preservation, and abundant Application Programming Interface and Data Management modules, hence, based on a thorough comprehension of its various functional modules, it is of great application value to carry out application design and development for the database and further effectively make use of the data collected or preserved therein for process control and monitoring. With the development of a polyethylene production control and monitoring system for a petrochemical plant as the background, this thesis focuses on the application design and data processing for industrial real-time database.
The main contents and results of this thesis are as follows:
(1) Basic concepts of real-time database are introduced, such as its generation, functions, development trend, hierarchical and management structure. Depended on a detailed description of the characteristics of real-time database, a comparison between two typical real-time database systems: PI and InfoPlus.21 are presented. The current application of real-time database in industrial process control is also reviewed.
(2) The basic steps of application design of real-time database in industrial control are presented as well as a detailed description of the database design, which are illustrated by a practical application of PI database design in a project development
(3) Both the OPC interface of real-time database and DCS system and the system configuration are described in detail. Then the API and SDK methods for interface design of real-time database and application are introduced. A software for managing the PI system by means of SDK method is developed, by which querying and editing the points and data in the database are easy to be realized. The efficiency and application environment of the two methods are valued in the end.
(4) The difficulties of effectively using data in real-time database for modeling are presented, e.g. there generally exist missing data, redundant data, or abnormal data in database and the data dimensionality is always very high. The general steps and methods such as linear and nonlinear interpolation, data filtering, principal component analysis are adopted to overcome the foregoing problems, and a software for data preprocessing integrating the described steps and methods is developed under a combined development environment with the advantages of Excel, VB and Matlab. Its validity and adaptability are verified through the application to real projects.
(5) Based on the application design, interface design and the data preprocessing, a polyethylene production monitoring platform is developed, which is running safely in industrial field. According to author's own experience, the further development of the system is forecasted.
引文
[1].Liang J,Qian J X.Multivariate Statistical Process Monitoring and Control Recent Developments and Applications to Chemical Industry,2003,11(2):191-203
[2].Macgregor J F,Penlidis A,Hamielec a E.Control of polymerization reactors,Polymer Process & Engineering,1984,2(2&3):179-209
[3].Embirucu M,Lima E L,Pinto J C.ASurvey of advanced control ofploymerization reactors,Polymer Engineering & Science,1996,36(2):433-447
[4].王慧.计算机控制系统[M],2000:化学工业出版社,244-256
[5].元利兴,姚鸿雁.用于CIPS的实时数据库系统,河北工业大学学报,2000(29)
[6].王树青等.先进控制技术及应用[M],2001:化学工业出版社
[7].万力.工业实时数据库的应用设计及多元接口开发,2006,浙江大学
[8].叶建位.实时数据库的发展及中控ESP-iSYS的特点,新自动化,2005(5):57-59
[9].吴剑强.流程工业实时数据库系统研究与开发,2005,浙江大学:杭州
[10].王琳,喻成,李昌一.实时数据库的现状与发展,河北理工学院学报[J],2003,25(4):93-98
[11].刘吉臻,房方,牛玉广.电力企业中的实时数据库技术,中国电力[J],2004,37(2):73-77
[12].尚运.工业控制中实时数据库系统研究,甘肃科技[J],2006,22(11):70-72
[13].刘卫昌,马增良.企业综合自动化系统中实时数据库系统设计,计算机应用研究,2005(8):147-150
[14].陶加祥,陈志文.高性能实时数据库组件设计,物探化探计算技术,2006,29(4)
[15].高春光,邹骁,王冠.实时数据库主导企业信息化格局,数字石油与化工,2007(6):60-62
[16].王淑蓉,李耀君,赵晋松.实时数据库与关系数据库在电厂中的集成应用,热力发电,2006(6):9-13
[17].庄建军.实时数据库在化工企业的应用:计算机与信息化,2005(6):39-40
[18].王成光,苏宏业,褚健.石化企业大型数据库系统的结构设计,化工自动化及仪表,2002(29)
[19].王小慧.实时数据库与DCS通讯接口的设计与实现,化工自动化及仪表,2002(29):48-50
[20].胡立微.火电厂厂级监控信息系统的功能设计与实现,华北电力技术,2006(10):27-28
[21].李蔚,陈坚红.火电厂的SIS建设及实时数据库平台的选择,浙江大学学报,2003,37(5):547-549
[22].周双喜.Infoplus.21实时数据库在钢铁企业数据采集系统中的应角,甘肃冶金,2007,29(3):59-61
[23].彭春华,林中达.PI实时数据库及其在电厂SIS系统中的应用,工业控制计算机,2003,16(6):28-30
[24].杨缳.PI实时数据库系统在石油化工生产管理中的应用,石油化工应用,2007,26(4):69-72
[25].张彩文.高霞.三维力控实时数据库Pspace在胜利油田油气集输生产中的应用 信息技术与信息化,2007(5):108-110
[26].杨军,邢宏伟,徐治国.PI实时数据库在国电蓬莱电厂的应用,山东电力技术2006(6):31-34
[27].田家英,赵舫.PI实时数据库在供电企业中的应用,继电器,2006,34(15):46-50
[28].匡杨.PI实时数据库系统的结构、管理及其应用,石化技术,2003,10(35-38)
[29].Osi.PI Support 2002
[30].郭强,周勇,张德成,刘伟.PI实时数据库在株洲电厂SIS系纺中的应用.[cited;
[31].高枫.聚丙烯生产过程计算机监控系统的集成与开发,2006,浙江大学
[32].任云晖.基于ASPEN InfoPlus21软件的实时数据库的实现,工业控制计算机,2007,20(4):59-61
[33].张丽丽.基于PI实时数据阵的电厂故障诊断系统研究,2007
[34].Y Shimanuk.OLE for Process Control(OPC)for new industrial automation systems,in Systems,Man,and Cybernetic,1999.1048-1050
[35].M Janke.OPC-Simple software integration for legacy system,in Advanced Process Control Application for Industry Workshop,1999
[36].Osisoft.PI-API,
[37].Osisoft.PI-SDK,
[38].赵恒平,俞金寿.纪工数据预处理及其在建模中的应用,华东理工大学学报,2005,31(2):223-226
[39].刘越江,黄今慧.数据挖掘中的数据预处理技术,科技情报开发与经济,2003,13(5):170-171
[40].吴蓉晕.荣宏.数据预处理在电力远程智能监测系统的应用,高电压技术,2005,31(7):58-60
[41].戴稳胜,谢邦昌.实验设计中缺失值的处理,理论新探,2004(9):6-7
[42].王学民.统计报表中异常值的识别与缺失值的预测,数理统计与管理,2004,25(4):31-36
[43].李有法.数值计算方法[M],1994:高等教育出版社
[44].刘国伟,尹洪宗,何锡文.不确定度评定中离群值的检验及计算机编程,冶金分析,2004,24(4):63-66
[45].王中宇,张海滨,刘智敏.剔除离群值的学生化残差新方法,仪器仪表学报,2006,27(6):624-629
[46].万星火,檀亦丽.主成分分析原始数据的预处理问题,中国卫生统计,2005,22(5)
[47].Manabu Kano,Shinji Hasebe,Iori Hashimoto,Hiromu Ohno.A new multivariate statistical process monitoring method using principal component analysis,Computers and Chemical Engineering,2001(25):1103-1113
[48].Venkat Venkatasubramanian,Raghunathan Rengaswamy,Surya N.Kavur,Kewen Yin.A review of process fault detection and diagnosis,Computers and Chemical Engineering 2003(27):327-346
[49].谢磊.间歇过程统计性能研究,2005,浙江大学
[50].Manabu Kano,Koji Nagao,Shinji Hasebe,Iori Hashimoto,Hiromu Ohno,et al.Comparison of multivariate statistical process monitoring methods with applications to the Eastman challenge problem,Computers and Chemical Engineering,2002(26)
[51].F.Macgregor,T.Kourtl.Statistical Process Control of Multivariate Processes,Control Engineering Practice,1995,3(3):403-414
[52].徐冬翔.VBA在自动化软件中的应用,石油化工自动化,2006(3):64-66
[53].王永华,张浞,李斌,罗刚.基于Excel VBA技术的自动数据采集系统,南京工业大学学报,2006,28(5):93-95
[54].朱培育,朱佳苗,赵俊香,龚耀.Excel VBA数据处理软件开发,地震地磁观测与研究,2006,27:108-115
[55].李雁翔.Visual Basic程序设计[M],2004:清华大学出版社
[56].Mcauley K B,Macgregor J F.A kinetic model for industrial gas phase ethylene copolymerization AIChE.Journal,1990(36):837
[57].Mcauley K B,Macgregor J F.On-line inference of polymer properties in an industrial polyethylene reactor AIChE.Journal,1991(37):825-835
[58].陈建伟.典型工业聚合过程建模与应用研究,2007,浙江大学
[59].沈倩.聚丙烯生产过程的建模与运行监控研究,2006,浙江大学
[60].Ppatricia Ralston,Gail Depyu.Computed-based monitoring and fault diagnosis,in ISA transaction,2001
[61].Wise Bm,Gallagher N B.The process chemometries approach to process monitoring and fualt detection,Journal of Process Control,1996,6(2):329-348
[62].Chu,S.J,Y H.Qin,C.H.Han.Falut delection and operation identification based on pattern classification with variable selection,Ind.Eng.Chem.Res,2004(43):1701-1710
[63].Anno,Alaser.Catalyzed rout to Polyethylene,Chemical Week,2004
[64].Bermner T,Cook D G,Rudin A.Melt flow inces values and molecular weight distributions of commerial thermoplasties,Appl.Polym.Sci,1990,41
[65].马志杰.改进的中低压下泡点、露点和等温闪蒸编程计算方法,广州化工,2002
[66].Shou Gang Wang,Bu Xing Han,Hong Wei Xiang.The PVT Properties Calculation of Water by BWR Equation,Chinese Chemical Letters,2001
[2].Macgregor J F,Penlidis A,Hamielec a E.Control of polymerization reactors,Polymer Process & Engineering,1984,2(2&3):179-209
[3].Embirucu M,Lima E L,Pinto J C.ASurvey of advanced control ofploymerization reactors,Polymer Engineering & Science,1996,36(2):433-447
[4].王慧.计算机控制系统[M],2000:化学工业出版社,244-256
[5].元利兴,姚鸿雁.用于CIPS的实时数据库系统,河北工业大学学报,2000(29)
[6].王树青等.先进控制技术及应用[M],2001:化学工业出版社
[7].万力.工业实时数据库的应用设计及多元接口开发,2006,浙江大学
[8].叶建位.实时数据库的发展及中控ESP-iSYS的特点,新自动化,2005(5):57-59
[9].吴剑强.流程工业实时数据库系统研究与开发,2005,浙江大学:杭州
[10].王琳,喻成,李昌一.实时数据库的现状与发展,河北理工学院学报[J],2003,25(4):93-98
[11].刘吉臻,房方,牛玉广.电力企业中的实时数据库技术,中国电力[J],2004,37(2):73-77
[12].尚运.工业控制中实时数据库系统研究,甘肃科技[J],2006,22(11):70-72
[13].刘卫昌,马增良.企业综合自动化系统中实时数据库系统设计,计算机应用研究,2005(8):147-150
[14].陶加祥,陈志文.高性能实时数据库组件设计,物探化探计算技术,2006,29(4)
[15].高春光,邹骁,王冠.实时数据库主导企业信息化格局,数字石油与化工,2007(6):60-62
[16].王淑蓉,李耀君,赵晋松.实时数据库与关系数据库在电厂中的集成应用,热力发电,2006(6):9-13
[17].庄建军.实时数据库在化工企业的应用:计算机与信息化,2005(6):39-40
[18].王成光,苏宏业,褚健.石化企业大型数据库系统的结构设计,化工自动化及仪表,2002(29)
[19].王小慧.实时数据库与DCS通讯接口的设计与实现,化工自动化及仪表,2002(29):48-50
[20].胡立微.火电厂厂级监控信息系统的功能设计与实现,华北电力技术,2006(10):27-28
[21].李蔚,陈坚红.火电厂的SIS建设及实时数据库平台的选择,浙江大学学报,2003,37(5):547-549
[22].周双喜.Infoplus.21实时数据库在钢铁企业数据采集系统中的应角,甘肃冶金,2007,29(3):59-61
[23].彭春华,林中达.PI实时数据库及其在电厂SIS系统中的应用,工业控制计算机,2003,16(6):28-30
[24].杨缳.PI实时数据库系统在石油化工生产管理中的应用,石油化工应用,2007,26(4):69-72
[25].张彩文.高霞.三维力控实时数据库Pspace在胜利油田油气集输生产中的应用 信息技术与信息化,2007(5):108-110
[26].杨军,邢宏伟,徐治国.PI实时数据库在国电蓬莱电厂的应用,山东电力技术2006(6):31-34
[27].田家英,赵舫.PI实时数据库在供电企业中的应用,继电器,2006,34(15):46-50
[28].匡杨.PI实时数据库系统的结构、管理及其应用,石化技术,2003,10(35-38)
[29].Osi.PI Support 2002
[30].郭强,周勇,张德成,刘伟.PI实时数据库在株洲电厂SIS系纺中的应用.[cited;
[31].高枫.聚丙烯生产过程计算机监控系统的集成与开发,2006,浙江大学
[32].任云晖.基于ASPEN InfoPlus21软件的实时数据库的实现,工业控制计算机,2007,20(4):59-61
[33].张丽丽.基于PI实时数据阵的电厂故障诊断系统研究,2007
[34].Y Shimanuk.OLE for Process Control(OPC)for new industrial automation systems,in Systems,Man,and Cybernetic,1999.1048-1050
[35].M Janke.OPC-Simple software integration for legacy system,in Advanced Process Control Application for Industry Workshop,1999
[36].Osisoft.PI-API,
[37].Osisoft.PI-SDK,
[38].赵恒平,俞金寿.纪工数据预处理及其在建模中的应用,华东理工大学学报,2005,31(2):223-226
[39].刘越江,黄今慧.数据挖掘中的数据预处理技术,科技情报开发与经济,2003,13(5):170-171
[40].吴蓉晕.荣宏.数据预处理在电力远程智能监测系统的应用,高电压技术,2005,31(7):58-60
[41].戴稳胜,谢邦昌.实验设计中缺失值的处理,理论新探,2004(9):6-7
[42].王学民.统计报表中异常值的识别与缺失值的预测,数理统计与管理,2004,25(4):31-36
[43].李有法.数值计算方法[M],1994:高等教育出版社
[44].刘国伟,尹洪宗,何锡文.不确定度评定中离群值的检验及计算机编程,冶金分析,2004,24(4):63-66
[45].王中宇,张海滨,刘智敏.剔除离群值的学生化残差新方法,仪器仪表学报,2006,27(6):624-629
[46].万星火,檀亦丽.主成分分析原始数据的预处理问题,中国卫生统计,2005,22(5)
[47].Manabu Kano,Shinji Hasebe,Iori Hashimoto,Hiromu Ohno.A new multivariate statistical process monitoring method using principal component analysis,Computers and Chemical Engineering,2001(25):1103-1113
[48].Venkat Venkatasubramanian,Raghunathan Rengaswamy,Surya N.Kavur,Kewen Yin.A review of process fault detection and diagnosis,Computers and Chemical Engineering 2003(27):327-346
[49].谢磊.间歇过程统计性能研究,2005,浙江大学
[50].Manabu Kano,Koji Nagao,Shinji Hasebe,Iori Hashimoto,Hiromu Ohno,et al.Comparison of multivariate statistical process monitoring methods with applications to the Eastman challenge problem,Computers and Chemical Engineering,2002(26)
[51].F.Macgregor,T.Kourtl.Statistical Process Control of Multivariate Processes,Control Engineering Practice,1995,3(3):403-414
[52].徐冬翔.VBA在自动化软件中的应用,石油化工自动化,2006(3):64-66
[53].王永华,张浞,李斌,罗刚.基于Excel VBA技术的自动数据采集系统,南京工业大学学报,2006,28(5):93-95
[54].朱培育,朱佳苗,赵俊香,龚耀.Excel VBA数据处理软件开发,地震地磁观测与研究,2006,27:108-115
[55].李雁翔.Visual Basic程序设计[M],2004:清华大学出版社
[56].Mcauley K B,Macgregor J F.A kinetic model for industrial gas phase ethylene copolymerization AIChE.Journal,1990(36):837
[57].Mcauley K B,Macgregor J F.On-line inference of polymer properties in an industrial polyethylene reactor AIChE.Journal,1991(37):825-835
[58].陈建伟.典型工业聚合过程建模与应用研究,2007,浙江大学
[59].沈倩.聚丙烯生产过程的建模与运行监控研究,2006,浙江大学
[60].Ppatricia Ralston,Gail Depyu.Computed-based monitoring and fault diagnosis,in ISA transaction,2001
[61].Wise Bm,Gallagher N B.The process chemometries approach to process monitoring and fualt detection,Journal of Process Control,1996,6(2):329-348
[62].Chu,S.J,Y H.Qin,C.H.Han.Falut delection and operation identification based on pattern classification with variable selection,Ind.Eng.Chem.Res,2004(43):1701-1710
[63].Anno,Alaser.Catalyzed rout to Polyethylene,Chemical Week,2004
[64].Bermner T,Cook D G,Rudin A.Melt flow inces values and molecular weight distributions of commerial thermoplasties,Appl.Polym.Sci,1990,41
[65].马志杰.改进的中低压下泡点、露点和等温闪蒸编程计算方法,广州化工,2002
[66].Shou Gang Wang,Bu Xing Han,Hong Wei Xiang.The PVT Properties Calculation of Water by BWR Equation,Chinese Chemical Letters,2001