基于组件技术的多媒体应用系统开发技术研究
|
摘要
多媒体应用系统的开发，既符合软件工程的思想，又因其自身的“多”且“海量”的特点而与其它的应用系统的开发过程有所不同，采用组件技术进行多媒体应用系统的开发，将是一种行之有效的途径。
本文主要对以下内容作了详尽的阐述：
1．通过介绍多媒体技术的发展和软件开发方法的变迁，分析了多媒体应用系统的开发流程，提出了一个以组件技术为核心的多媒体应用系统开发模型。以组件制作为核心技术，制作完成了文本—语音转换、物体的三维透视以及平滑滚动字幕等可以复用的实用组件。
2．将常用汉字、词组的读音以WAV文件格式存储在数据库表中并建立索引。设计了最大匹配算法，从数据库表中找出与文本最大匹配的字或词组的读音，实现了文本到语音的转换。
3．使用四维坐标来表示物体的透视变换矩阵，通过对该矩阵进行归一化处理，简化了Z坐标的计算；通过增加帧缓冲区的数量，修正了物体表面Z坐标在屏幕上对应点的坐标值，对利用DirectX的缓冲区进行物体三维透视的方法进行了改进，提高了透视精度。
4．对WindowsAPI技术进行了深入研究，给出了如何利用WindowsAPl调用实现平滑滚动字幕的方法。
5．依据提出的组件开发模型和制作的组件工具，以VB为开发工具，设计并实现了一个《心脏多媒体教学系统》。该系统实现了心脏结构的人机交互式教学过程，具有清晰、直观、操作简便、易于扩充的特点，可以通过单独修改各个组件实现系统的升级和扩展，体现了以组件技术开发多媒体应用系统的特点。
组件技术可以灵活、高效的实现可交互输入、重用、完全分布式、与语言无关的各种应用，是提高软件开发效率、保证软件开发质量、解决软件重用的重要手段。随着组件技术的发展，组件技术在应用程序中的作用将会越来越重要。
The development of multimedia application system, not only accord with the thinking of software engineer, but also different from others application system' s because of its traits of multi and huge storage. It will be an efficient way to develop multimedia application system using component technique.
In this thesis, the major works are involved as follows:
1. A multimedia application system developing model, component as its core, is put forward and the development flow of multimedia application system is discussed through introducing the changing process of the method of software developing and the development of multimedia techniques. Focusing on components making, functions such as smooth caption scrolling, 3D perspective of object and Chinese Text-to-Speech are encapsulated into components that can be reused.
2. The pronunciation of words and phrases are stored in database table with wav file format and index is created. The maximum match method is designed to find out the pronunciation of words or phrases maximum matched with the text, the process of text-to-speech is realized.
3. Using 4D coordinate to express the convert matrix of perspective, it is predigested to calculate Z coordinate through changing to one. The coordinates of pixels in screen correspond with the Z coordinate of object surface are modified by adding the numbers of buffer. The method of 3D perspective using DirectX buffer is improved. So does the precision of perspective.
4. The Windows API techniques are described in detail. A method to realize smooth text scrolling by using Windows API is discussed.
5. The MuCtimedu Teaching System of Jfeart is designed and accomplished using components, directed by the developing model mentioned above and
VB as its tool. The teaching process of the structure of heart, with traits of clear, intuition, easy operating and extending, is illustrated by using this system. The system can be updated and extended easily by modifying the components. The essential characteristic of multimedia application' s development based on components technique is fully reflected.
The component technique, a very important way to improve efficiency, ensure quality and solve reuse of the software development, can realize many applications efficiently and neatly that can inter input and output, reuse, completely distributed and independent of language. With the development of component technique, its functions in applications are becoming more and more important.
本文主要对以下内容作了详尽的阐述：
1．通过介绍多媒体技术的发展和软件开发方法的变迁，分析了多媒体应用系统的开发流程，提出了一个以组件技术为核心的多媒体应用系统开发模型。以组件制作为核心技术，制作完成了文本—语音转换、物体的三维透视以及平滑滚动字幕等可以复用的实用组件。
2．将常用汉字、词组的读音以WAV文件格式存储在数据库表中并建立索引。设计了最大匹配算法，从数据库表中找出与文本最大匹配的字或词组的读音，实现了文本到语音的转换。
3．使用四维坐标来表示物体的透视变换矩阵，通过对该矩阵进行归一化处理，简化了Z坐标的计算；通过增加帧缓冲区的数量，修正了物体表面Z坐标在屏幕上对应点的坐标值，对利用DirectX的缓冲区进行物体三维透视的方法进行了改进，提高了透视精度。
4．对WindowsAPI技术进行了深入研究，给出了如何利用WindowsAPl调用实现平滑滚动字幕的方法。
5．依据提出的组件开发模型和制作的组件工具，以VB为开发工具，设计并实现了一个《心脏多媒体教学系统》。该系统实现了心脏结构的人机交互式教学过程，具有清晰、直观、操作简便、易于扩充的特点，可以通过单独修改各个组件实现系统的升级和扩展，体现了以组件技术开发多媒体应用系统的特点。
组件技术可以灵活、高效的实现可交互输入、重用、完全分布式、与语言无关的各种应用，是提高软件开发效率、保证软件开发质量、解决软件重用的重要手段。随着组件技术的发展，组件技术在应用程序中的作用将会越来越重要。
The development of multimedia application system, not only accord with the thinking of software engineer, but also different from others application system' s because of its traits of multi and huge storage. It will be an efficient way to develop multimedia application system using component technique.
In this thesis, the major works are involved as follows:
1. A multimedia application system developing model, component as its core, is put forward and the development flow of multimedia application system is discussed through introducing the changing process of the method of software developing and the development of multimedia techniques. Focusing on components making, functions such as smooth caption scrolling, 3D perspective of object and Chinese Text-to-Speech are encapsulated into components that can be reused.
2. The pronunciation of words and phrases are stored in database table with wav file format and index is created. The maximum match method is designed to find out the pronunciation of words or phrases maximum matched with the text, the process of text-to-speech is realized.
3. Using 4D coordinate to express the convert matrix of perspective, it is predigested to calculate Z coordinate through changing to one. The coordinates of pixels in screen correspond with the Z coordinate of object surface are modified by adding the numbers of buffer. The method of 3D perspective using DirectX buffer is improved. So does the precision of perspective.
4. The Windows API techniques are described in detail. A method to realize smooth text scrolling by using Windows API is discussed.
5. The MuCtimedu Teaching System of Jfeart is designed and accomplished using components, directed by the developing model mentioned above and
VB as its tool. The teaching process of the structure of heart, with traits of clear, intuition, easy operating and extending, is illustrated by using this system. The system can be updated and extended easily by modifying the components. The essential characteristic of multimedia application' s development based on components technique is fully reflected.
The component technique, a very important way to improve efficiency, ensure quality and solve reuse of the software development, can realize many applications efficiently and neatly that can inter input and output, reuse, completely distributed and independent of language. With the development of component technique, its functions in applications are becoming more and more important.
引文
1．David J.Kruglinski,Scot Wingo & George Shepherd著，希望图书创作室译．VC++ 6.0技术内幕(第五版)．北京：北京希望电子出版社，1999
2. http://www.microsoft.com
3. Bradley Bargen, Peter Donnelly. Inside DirectX. Jan 1999
4. DirectX 7.0 Programmer' s Reference September 02,1999
5. Olivera L C, Viana MC.A Rule-Based Text-to-Speech System for portuguese. ICASSP, 1992
6. HORACE H S I, YIN Li-jun. Constructing a 3D individualized head model from two orthogonal views[J].The Visual Computer, 1996,12(6)
7. Ronald J. Norman. Object-Oriented System Analysis and Design. 2000
8．刘源等，信息处理用现代汉语分词规范及自动分词方法．北京：清华大学出版社，1994
9．李建民等．汉语文语转换系统(TTS)．计算机工程与应用，2000，9
10．林良玉．多媒体创作中ActiveX控件的应用．电子技术，2001，7
11．钟玉琢．多媒体技术．北京：清华大学出版社，1998
12．冠群制作室．多媒体制作实用教程．北京：机械工业出版社，1999
13．卢正鼎等．多媒体数据的聚簇开采．计算机工程与应用，2000，36(8)
14．王中平．计算机多媒体实用技术．陕西电子杂志社，1997
15．王纪成．PC多媒体应用指南，清华大学出版社
16．周治平．多媒体CAI及其程序设计．微电脑应用，1999
17．郑人杰．实用软件工程．清华大学出版社，1997
18．邵维忠，杨芙清．面向对象的系统设计．清华大学出版社，1998
19．王彦．面向对象的理论与VB应用，北京：清华大学出版社，1998
20．李刚，金茂忠．一种可重用构件的设计方法．计算机研究发展．2000，5
21．王新成．多媒体实用技术(图像分册)．成都：电子科技大学出版社．1995
22．李建民．汉语TTS系统．清华大学博士学位选题报告，1997
23．微软(中国)有限公司．Visual Basic 5.0程序员指南．科学出版社．1997
24．胡峪，刘静．Visual C++编程技巧与示例．西安电子科技大学出版社，2000，6
25．刘超，张莉，可视化面向对象建模技术．北京航天航空大学出版社，1999，7
26．王怡．基于组件技术的WEB应用研究．西北大学硕士论文，2001
27．卡斯尔曼(Castleman Kenneth R.)．数字图象处理，英文影印本．[M]北京：清华大学出版社，1998．3
28．泰卡尔普仃(Tekalp,A.Murat)．数字视频处理，英文影印本．[M]北京：清华大学出版社，1998．5
29．黎洪松．数字视频技术及其应用．[M]北京：清华大学出版社，1997．5
2. http://www.microsoft.com
3. Bradley Bargen, Peter Donnelly. Inside DirectX. Jan 1999
4. DirectX 7.0 Programmer' s Reference September 02,1999
5. Olivera L C, Viana MC.A Rule-Based Text-to-Speech System for portuguese. ICASSP, 1992
6. HORACE H S I, YIN Li-jun. Constructing a 3D individualized head model from two orthogonal views[J].The Visual Computer, 1996,12(6)
7. Ronald J. Norman. Object-Oriented System Analysis and Design. 2000
8．刘源等，信息处理用现代汉语分词规范及自动分词方法．北京：清华大学出版社，1994
9．李建民等．汉语文语转换系统(TTS)．计算机工程与应用，2000，9
10．林良玉．多媒体创作中ActiveX控件的应用．电子技术，2001，7
11．钟玉琢．多媒体技术．北京：清华大学出版社，1998
12．冠群制作室．多媒体制作实用教程．北京：机械工业出版社，1999
13．卢正鼎等．多媒体数据的聚簇开采．计算机工程与应用，2000，36(8)
14．王中平．计算机多媒体实用技术．陕西电子杂志社，1997
15．王纪成．PC多媒体应用指南，清华大学出版社
16．周治平．多媒体CAI及其程序设计．微电脑应用，1999
17．郑人杰．实用软件工程．清华大学出版社，1997
18．邵维忠，杨芙清．面向对象的系统设计．清华大学出版社，1998
19．王彦．面向对象的理论与VB应用，北京：清华大学出版社，1998
20．李刚，金茂忠．一种可重用构件的设计方法．计算机研究发展．2000，5
21．王新成．多媒体实用技术(图像分册)．成都：电子科技大学出版社．1995
22．李建民．汉语TTS系统．清华大学博士学位选题报告，1997
23．微软(中国)有限公司．Visual Basic 5.0程序员指南．科学出版社．1997
24．胡峪，刘静．Visual C++编程技巧与示例．西安电子科技大学出版社，2000，6
25．刘超，张莉，可视化面向对象建模技术．北京航天航空大学出版社，1999，7
26．王怡．基于组件技术的WEB应用研究．西北大学硕士论文，2001
27．卡斯尔曼(Castleman Kenneth R.)．数字图象处理，英文影印本．[M]北京：清华大学出版社，1998．3
28．泰卡尔普仃(Tekalp,A.Murat)．数字视频处理，英文影印本．[M]北京：清华大学出版社，1998．5
29．黎洪松．数字视频技术及其应用．[M]北京：清华大学出版社，1997．5