虚拟演播室中虚拟场景生成系统的设计与实现
摘要
虚拟演播室系统可以使现场视频与计算机产生的三维图形实时地集成在一起。它突破了传统演播室实景制作和场景设计的时空限制，能将真实人物与虚拟环境自由组合，完美地表现出电视节目制作者的非凡创意，提高电视节目制作的质量和效率，同时降低了节目制作费用。
目前较成熟的商用虚拟演播室系统均是基于独立工作站平台开发，其价格昂贵。对于中小型电视台而言，购买一整套虚拟演播室系统成本较高。因此，开发一种成本低、实用性强的虚拟演播室系统具有广阔的应用前景和现实意义。而利用PC机实现虚拟演播室系统具有成本低、控制灵活等特点，能够满足中小型电视台的电视节目制作需求。因此，利用PC机实现虚拟演播室系统已成为目前的研究热点。
在此背景下，本论文在基于已有的虚拟演播室系统理论的基础上，从开发一套实际的基于PC机的虚拟演播室系统的角度出发，将研究工作主要集中在基于PC机的虚拟演播室中虚拟场景生成系统的研究、设计和实现上。论文先从理论上对虚拟演播室系统的意义、工作原理和关键技术以及现有虚拟演播室系统的优缺点进行了阐述，确定了基于PC机和Direct3D技术进行虚拟演播室系统开发的方案；接着对虚拟演播室系统的虚拟场景生成技术进行了研究；同时详细介绍了实现本系统所采用的Direct3D技术，重点对其整体构架及相关知识点进行了论述。
在此分析和研究的基础上，选择Direct3D作为系统的3D开发平台、使用Visual C++7.0作为开发工具及采用面向对象的设计方法对虚拟演播室中虚拟场景生成系统按工作流程从整体到局部进行了整体构架设计，并在此设计基础上具体实现了虚拟场景生成系统的事件处理、渲染初始化、场景数据预处理和管理、虚拟摄像机管理、场景渲染及图像数据输出模块，最终实现了基于Direct3D技术的虚拟场景生成原型系统，为虚拟演播室系统提供了良好的功能服务。
The virtual studio system can integrate the scene video and the three-dimensional graph produced by computer in real-time. It can break through the space-time limit of traditional studio scene about production and design, combine the real character with virtual background freely, expose perfectly the television programmer's extraordinary creativity, improve the quality and the efficiency of the television program creation, and reduce the cost of the program manufacture.
Currently, the mature commercial virtual studio system which developed on the basis of independent workstation platform is extremely expensive. It will cost many to purchase virtual studio system for the middle or small scaled television station. Thus, it has a fairly bright future for utilization to develop a low-cost and practical virtual studio system. The virtual studio system based on PC is cheap and flexible to control. It can satisfy the requirement of program manufacture for the middle or small scaled television station. Therefore, the virtual studio system research using the PC machine realization has become hotspot now.
Under this background, this thesis's research, which based on old virtual studio system theory, is focus primarily on the design and implement of virtual scene render system in virtual studio system which based on PC machine. First, this thesis expounds theoretically significance and the principle of work and the pivotal technologies of virtual studio system as well as merit and flaw of the existing virtual studio system. It makes sure project that developing virtual studio system based on Direct3D technology on PC machine. Next, this thesis has conducted the thorough research to virtual scene render technology in virtual studio system. Meanwhile, it has introduced the Direct3D technology in detail.
This thesis chooses Direct3D as develop platform, and uses visual C++ 7.0 development kit as develop tool, and adopts the oriented-object design method to develop the system. And it has carry out the overall design to virtual scene render system in according to the workflow from the whole to the part. The thesis has realized concretely virtual scene render system which involves that handling event, initialization, preprocessing of scene data, management of scene data, management of virtual camera, scene render and outputting image data. The virtual scene render system has provided the good function service for virtual studio system.
目前较成熟的商用虚拟演播室系统均是基于独立工作站平台开发，其价格昂贵。对于中小型电视台而言，购买一整套虚拟演播室系统成本较高。因此，开发一种成本低、实用性强的虚拟演播室系统具有广阔的应用前景和现实意义。而利用PC机实现虚拟演播室系统具有成本低、控制灵活等特点，能够满足中小型电视台的电视节目制作需求。因此，利用PC机实现虚拟演播室系统已成为目前的研究热点。
在此背景下，本论文在基于已有的虚拟演播室系统理论的基础上，从开发一套实际的基于PC机的虚拟演播室系统的角度出发，将研究工作主要集中在基于PC机的虚拟演播室中虚拟场景生成系统的研究、设计和实现上。论文先从理论上对虚拟演播室系统的意义、工作原理和关键技术以及现有虚拟演播室系统的优缺点进行了阐述，确定了基于PC机和Direct3D技术进行虚拟演播室系统开发的方案；接着对虚拟演播室系统的虚拟场景生成技术进行了研究；同时详细介绍了实现本系统所采用的Direct3D技术，重点对其整体构架及相关知识点进行了论述。
在此分析和研究的基础上，选择Direct3D作为系统的3D开发平台、使用Visual C++7.0作为开发工具及采用面向对象的设计方法对虚拟演播室中虚拟场景生成系统按工作流程从整体到局部进行了整体构架设计，并在此设计基础上具体实现了虚拟场景生成系统的事件处理、渲染初始化、场景数据预处理和管理、虚拟摄像机管理、场景渲染及图像数据输出模块，最终实现了基于Direct3D技术的虚拟场景生成原型系统，为虚拟演播室系统提供了良好的功能服务。
The virtual studio system can integrate the scene video and the three-dimensional graph produced by computer in real-time. It can break through the space-time limit of traditional studio scene about production and design, combine the real character with virtual background freely, expose perfectly the television programmer's extraordinary creativity, improve the quality and the efficiency of the television program creation, and reduce the cost of the program manufacture.
Currently, the mature commercial virtual studio system which developed on the basis of independent workstation platform is extremely expensive. It will cost many to purchase virtual studio system for the middle or small scaled television station. Thus, it has a fairly bright future for utilization to develop a low-cost and practical virtual studio system. The virtual studio system based on PC is cheap and flexible to control. It can satisfy the requirement of program manufacture for the middle or small scaled television station. Therefore, the virtual studio system research using the PC machine realization has become hotspot now.
Under this background, this thesis's research, which based on old virtual studio system theory, is focus primarily on the design and implement of virtual scene render system in virtual studio system which based on PC machine. First, this thesis expounds theoretically significance and the principle of work and the pivotal technologies of virtual studio system as well as merit and flaw of the existing virtual studio system. It makes sure project that developing virtual studio system based on Direct3D technology on PC machine. Next, this thesis has conducted the thorough research to virtual scene render technology in virtual studio system. Meanwhile, it has introduced the Direct3D technology in detail.
This thesis chooses Direct3D as develop platform, and uses visual C++ 7.0 development kit as develop tool, and adopts the oriented-object design method to develop the system. And it has carry out the overall design to virtual scene render system in according to the workflow from the whole to the part. The thesis has realized concretely virtual scene render system which involves that handling event, initialization, preprocessing of scene data, management of scene data, management of virtual camera, scene render and outputting image data. The virtual scene render system has provided the good function service for virtual studio system.
引文
[1] 陈文飞，陈福民．一种基于PC的虚拟演播室系统的实现．微型电脑应用．2003，19(7)：37～39．
[2] 陈晓东，汪雄海．高端虚拟演播室系统设计．广播与电视技术．2006，(6)：90～92．
[3] 马辛宇．色键及虚拟演播室在电视气象节目中的运用．浙江气象．2006，24(4)：31～33．
[4] 王丹．虚拟演播室技术及其应用．沈阳教育学院学报，2004，06(3)：102～103．
[5] 阎军屹，陈军．虚拟演播室技术及应用．中国有线电视．2006，(18)：1829．
[6] 庄宁．虚拟演播室中遮挡技术的实现．国防科学技术大学硕士学位论文．2002．
[7] 王钊．电视节目制作中的虚拟演播室技术．内江师范学院学报．2004，19(4)：40～42．
[8] 齐越，胡晓峰．虚拟演播室：结构及关键技术．中国图象图形学报．2000，05(6)：457-460．
[9] 张瞻高，周敏．虚拟演播室在城市电视台的应用．电视字幕特效与动画．2002，(2)．
[10] Simon Gibbs,et al. Virtual studio :An overview. IEEE Multimedia. 1998, January-March: 18～35.
[11] 鲁敏，郁文贤．基于机电跟踪的三维虚拟演播室系统．电子学报．2003，31(12)：2035～2037．
[12] 刘建辉，闫月琴．虚拟演播室技术在广播电视中的应用．中国有线电视．2005，(3)：347～348．
[13] 卢英锁．国内市场的虚拟演播室系统．电视技术．2002，(08)：54～55．
[14] 陆锋．电视虚拟演播室系统研发实践．广播与电视技术．2003，(6)：60～62．
[15] 袁绪龙，张宇文．一种高性价比虚拟演播室系统设计与实现．电脑开发与应用．2003，16(12)：19～21．
[16] 王莉莉．虚拟演播室原型系统中的关键技术研究．山东科技大学工程硕士 学位论文．2004．
[17] 赵明友．虚拟演播室系统与技术．渝西学院学报．2004，03(1)：22～25．
[18] 张文俊．当代传媒新技术．上海：复旦大学出版社，1998．
[19] 宿晶亮，李明，刘宁．DirectX在战场环境模拟中的应用．探测与控制学报．2000，22(4)：22～25．
[20] 茅忠明，王行骏，陈玮．基于DirectX软件包进行三维图形的开发应用．上海理工大学学报．2002，24(1)：48～50．
[21] Akeley K,Jermoluk T. High-Performance Polygon Rendering. Computer Graphics(SIGGRAPH '88 Proceedings). 1988.
[22] Rogers,David F. Mathematical Elements for Computer Graphics. Second Edition. McGraw-Hill, 1998.
[23] Gouraud H.Continuous shading of curved surfaces.IEEE Transactions on Computers.1971,20:623～629.
[24] Catmull,Edwin. Computer Display of Curved Surfaces. Proceedings of the IEEE Conference on Computer Graphics. Pattern Recognition and Data Structure Los Angeles, 1975.
[25] 陆斌，何友金．基于DirectX的动态全景图像生成方法研究．海军航空工程学院学报．2005，20(1)：136～138．
[26] 王柏冬，王洪升．3D API及在开发三维实时交互图形图像中的应用．计算机应用(增刊)．1999，19(10)：135～136．
[27] Birn,Jeremy.Digital Lighting & Rendering.New Riders Publishing,2000.
[28] Kershaw,Kathleen.A Generalized Texture-Mapping Pipeline.M.S. Thesis, Program of Computer Graphics,Cornell University, Ithaca,New York. 1992.
[29] Williams,Lance.Pyramidal Parametrics.Computer Graphics. 1983,7(3): 1～11.
[30] Barkans,Anthony C. High-Quality Rendering Using the Talisman Are-hit ecture. ACM SIGGRAPH/Eurographics Workshop on Graphics Hardware.Los Angeles,CA. 1997:79～88.
[31] 张奇，屈年赦．基于VC、Opengl和DirectX的三维景观浏览．现代测绘．2006，29(1)：18～20．
[32] 莫勇腾．设计模式．北京：清华大学出版社，2006．
[33] 黎艳，刘光昌，王晋海．基于设计模式的SP短信网关系统设计．计算机工程与设计．2007，28(6)：1466～1467．
[34] Noel Llopis．C++ for Games Programmers．李鹏，贾传俊．北京：清华大学出版社，2004．
[35] DirectX 8.1 SDK. Microsoft, 2006.
[36] Blinn,James. Simulation of wrinkled surfaces. Computer Graphics (SIGGRAPH '78 Proceedings). 1978.
[37] Tomas Akenine-Moller,Eric Haines et al．Real-Time Rendering．普建涛．Second Edition．北京：北京大学出版社，2004．
[38] 刘涛，王增波．碰撞检测过程中的包围盒技术及应用研究．西安科技大学学报．2006，26(3)：395～397．
[39] Thomas Larsson, Tomas Akenine- Moiler.Efficient collision detection for models deformed by morphing[J].The Visual Computer, 2003; 19:164～174.
[40] Klosowski J, Held M, Mitchell J S Bet al.Efficient Coilisionte on Using Bounding Volume Hierarchies of k- DOPs[J].IEEE Trans on Visualization on Computer Graphics, 1998; 4(1): 21～37.
[41] Kristian J. Dana, Brain van Ginneken, Shree K. Nayar and Jan J. Koen2 derink. "Reflectance and Texture of Real2World Surfaces" . ACM Trans2 actions on Graphics, 1999. 1, 3.
[42] D. McAllister, A. Lastra, andW. Heidrich. "Efficient rendering of Spatial bi2directional reflectance distribution functions". Graphics Hardware 2002, Eurographics/SIG GRAPH Workshop Proceedings, 2002. 1, 3.
[43] SWo rley. A cellular texture basis function. In: P roc ofACM S IGGRA PH. New Orleans: ACM Press, 1996. 291～294.
[44] G Turk. Generating textures on arbitrary surfaces using reaction diffusion. In: P roc of ACM S IGGRA PH. Lo s A ngeles:ACM Press, 1991. 289～298.
[45] Y Xu, B Guo, H Y Shum. Chao smo saic: Fast andmemory efficient texture synthesis. M icro soft Research, Tech Rep:M SR2TR22000232, 2000.
[46] E P Simoncelli, J Po rtilla. Texture characterization via joint statistics of wavelet coefficient magnitudes. In: Fifth International Conference on Image P rocessing. Los Angeles: CA Press, 1998.62～66.
[47] L Y W ei, M L evoy. Fast texture synthesis using tree structured vector quantization. In: P roc ofACM S IGGRA PH. Los Angeles: ACM Press, 2000. 479～488.
[48] Edelsbrunner H. Computing the extreme distances between two convex polygons [J ]. Journal of A lgo rithm s, 1985, 6 (2): 213—224.
[49] Toussaint G T. A simple linear algo rithm fo r intersecting convex polygons[J ]. The V isual Computer, 1985, 6 (1): 118- 123.
[50] Redon S, KheddarA, Coquieeart S. An algebraic solution to the problem of collision detection fo r rigid po lyhedral objects [A ].In: Proceedings of IEEE International Conference on Robotics and A utomation [C ], San F rancisco, CA, U SA, 2000: 3733-3738.
[51] Zachmann G. Exact and Fast Collision Detection [D]. PhD thesis, U niv ersity of Bonn, German, 1994.
[2] 陈晓东，汪雄海．高端虚拟演播室系统设计．广播与电视技术．2006，(6)：90～92．
[3] 马辛宇．色键及虚拟演播室在电视气象节目中的运用．浙江气象．2006，24(4)：31～33．
[4] 王丹．虚拟演播室技术及其应用．沈阳教育学院学报，2004，06(3)：102～103．
[5] 阎军屹，陈军．虚拟演播室技术及应用．中国有线电视．2006，(18)：1829．
[6] 庄宁．虚拟演播室中遮挡技术的实现．国防科学技术大学硕士学位论文．2002．
[7] 王钊．电视节目制作中的虚拟演播室技术．内江师范学院学报．2004，19(4)：40～42．
[8] 齐越，胡晓峰．虚拟演播室：结构及关键技术．中国图象图形学报．2000，05(6)：457-460．
[9] 张瞻高，周敏．虚拟演播室在城市电视台的应用．电视字幕特效与动画．2002，(2)．
[10] Simon Gibbs,et al. Virtual studio :An overview. IEEE Multimedia. 1998, January-March: 18～35.
[11] 鲁敏，郁文贤．基于机电跟踪的三维虚拟演播室系统．电子学报．2003，31(12)：2035～2037．
[12] 刘建辉，闫月琴．虚拟演播室技术在广播电视中的应用．中国有线电视．2005，(3)：347～348．
[13] 卢英锁．国内市场的虚拟演播室系统．电视技术．2002，(08)：54～55．
[14] 陆锋．电视虚拟演播室系统研发实践．广播与电视技术．2003，(6)：60～62．
[15] 袁绪龙，张宇文．一种高性价比虚拟演播室系统设计与实现．电脑开发与应用．2003，16(12)：19～21．
[16] 王莉莉．虚拟演播室原型系统中的关键技术研究．山东科技大学工程硕士 学位论文．2004．
[17] 赵明友．虚拟演播室系统与技术．渝西学院学报．2004，03(1)：22～25．
[18] 张文俊．当代传媒新技术．上海：复旦大学出版社，1998．
[19] 宿晶亮，李明，刘宁．DirectX在战场环境模拟中的应用．探测与控制学报．2000，22(4)：22～25．
[20] 茅忠明，王行骏，陈玮．基于DirectX软件包进行三维图形的开发应用．上海理工大学学报．2002，24(1)：48～50．
[21] Akeley K,Jermoluk T. High-Performance Polygon Rendering. Computer Graphics(SIGGRAPH '88 Proceedings). 1988.
[22] Rogers,David F. Mathematical Elements for Computer Graphics. Second Edition. McGraw-Hill, 1998.
[23] Gouraud H.Continuous shading of curved surfaces.IEEE Transactions on Computers.1971,20:623～629.
[24] Catmull,Edwin. Computer Display of Curved Surfaces. Proceedings of the IEEE Conference on Computer Graphics. Pattern Recognition and Data Structure Los Angeles, 1975.
[25] 陆斌，何友金．基于DirectX的动态全景图像生成方法研究．海军航空工程学院学报．2005，20(1)：136～138．
[26] 王柏冬，王洪升．3D API及在开发三维实时交互图形图像中的应用．计算机应用(增刊)．1999，19(10)：135～136．
[27] Birn,Jeremy.Digital Lighting & Rendering.New Riders Publishing,2000.
[28] Kershaw,Kathleen.A Generalized Texture-Mapping Pipeline.M.S. Thesis, Program of Computer Graphics,Cornell University, Ithaca,New York. 1992.
[29] Williams,Lance.Pyramidal Parametrics.Computer Graphics. 1983,7(3): 1～11.
[30] Barkans,Anthony C. High-Quality Rendering Using the Talisman Are-hit ecture. ACM SIGGRAPH/Eurographics Workshop on Graphics Hardware.Los Angeles,CA. 1997:79～88.
[31] 张奇，屈年赦．基于VC、Opengl和DirectX的三维景观浏览．现代测绘．2006，29(1)：18～20．
[32] 莫勇腾．设计模式．北京：清华大学出版社，2006．
[33] 黎艳，刘光昌，王晋海．基于设计模式的SP短信网关系统设计．计算机工程与设计．2007，28(6)：1466～1467．
[34] Noel Llopis．C++ for Games Programmers．李鹏，贾传俊．北京：清华大学出版社，2004．
[35] DirectX 8.1 SDK. Microsoft, 2006.
[36] Blinn,James. Simulation of wrinkled surfaces. Computer Graphics (SIGGRAPH '78 Proceedings). 1978.
[37] Tomas Akenine-Moller,Eric Haines et al．Real-Time Rendering．普建涛．Second Edition．北京：北京大学出版社，2004．
[38] 刘涛，王增波．碰撞检测过程中的包围盒技术及应用研究．西安科技大学学报．2006，26(3)：395～397．
[39] Thomas Larsson, Tomas Akenine- Moiler.Efficient collision detection for models deformed by morphing[J].The Visual Computer, 2003; 19:164～174.
[40] Klosowski J, Held M, Mitchell J S Bet al.Efficient Coilisionte on Using Bounding Volume Hierarchies of k- DOPs[J].IEEE Trans on Visualization on Computer Graphics, 1998; 4(1): 21～37.
[41] Kristian J. Dana, Brain van Ginneken, Shree K. Nayar and Jan J. Koen2 derink. "Reflectance and Texture of Real2World Surfaces" . ACM Trans2 actions on Graphics, 1999. 1, 3.
[42] D. McAllister, A. Lastra, andW. Heidrich. "Efficient rendering of Spatial bi2directional reflectance distribution functions". Graphics Hardware 2002, Eurographics/SIG GRAPH Workshop Proceedings, 2002. 1, 3.
[43] SWo rley. A cellular texture basis function. In: P roc ofACM S IGGRA PH. New Orleans: ACM Press, 1996. 291～294.
[44] G Turk. Generating textures on arbitrary surfaces using reaction diffusion. In: P roc of ACM S IGGRA PH. Lo s A ngeles:ACM Press, 1991. 289～298.
[45] Y Xu, B Guo, H Y Shum. Chao smo saic: Fast andmemory efficient texture synthesis. M icro soft Research, Tech Rep:M SR2TR22000232, 2000.
[46] E P Simoncelli, J Po rtilla. Texture characterization via joint statistics of wavelet coefficient magnitudes. In: Fifth International Conference on Image P rocessing. Los Angeles: CA Press, 1998.62～66.
[47] L Y W ei, M L evoy. Fast texture synthesis using tree structured vector quantization. In: P roc ofACM S IGGRA PH. Los Angeles: ACM Press, 2000. 479～488.
[48] Edelsbrunner H. Computing the extreme distances between two convex polygons [J ]. Journal of A lgo rithm s, 1985, 6 (2): 213—224.
[49] Toussaint G T. A simple linear algo rithm fo r intersecting convex polygons[J ]. The V isual Computer, 1985, 6 (1): 118- 123.
[50] Redon S, KheddarA, Coquieeart S. An algebraic solution to the problem of collision detection fo r rigid po lyhedral objects [A ].In: Proceedings of IEEE International Conference on Robotics and A utomation [C ], San F rancisco, CA, U SA, 2000: 3733-3738.
[51] Zachmann G. Exact and Fast Collision Detection [D]. PhD thesis, U niv ersity of Bonn, German, 1994.
© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号 地址：北京市海淀区学院路29号 邮编：100083 电话：办公室：(+86 10)66554848；文献借阅、咨询服务、科技查新：66554700 |