分布式大规模虚拟环境消息序一致性时间管理技术研究
|
摘要
分布式虚拟环境是研究多用户进行分布交互、信息共享和仿真的网络计算环境,它通过分布在各地的计算结点与虚拟环境进行交互,共享虚拟环境的局部或全局数据信息,协同完成分布到多计算结点上的任务,给用户提供一种整体的、真实的、可沉浸的虚拟空间。时间管理技术是分布式虚拟环境的基础性关键技术,对于维护分布式仿真中一致的消息处理顺序和保证仿真逻辑的合理性具有重要意义。针对时间管理技术基本原理和关键算法的研究是分布式虚拟环境领域公认的重点和难点,目前正面临着广域网、大规模、高交互等时空复杂性挑战。本文针对时间管理技术一致性、实时性、可扩展性等问题,面向消息因果序、完全序一致性开展理论与方法研究,支持分布式大规模虚拟环境下的时间管理与维护。
针对绝对时钟下因果序一致性的实时维护问题,本文提出了基于生命周期约束的动态控制方法LRTCO。该方法的基本思想是:首先分析得到网络传输延迟的动态性是事件不能及时传到、发生因果关系颠倒的基本原因,再通过预测事件消息的网络传输时间区间动态选取因果一致性控制信息,适应网络延迟变化,来有效解决已到达的因果事件难以在生命周期内实时、正确传递因果关系的技术难题。模拟评估与分析表明,该方法控制信息传输量与系统规模无关,可扩展性良好,能够分布、实时、有效地维护广域网条件下分布式大规模虚拟环境的因果消息序一致性。
针对独立时钟下因果序一致性的实时维护问题,本文提出了独立时钟下的实时因果序时间管理方法ADCO。该方法的基本思想是:基于先发后收的物理常识来确定不同结点上时间值的比较原则,突破事件时间值比较的关键技术;通过动态、适当地选择因果控制信息内容,确保任一结果事件可以在已传到事件中计算出当前最小原因事件,避免因果违背现象发生;根据网络状况动态调节控制信息量,既能够在事件生命周期内维护因果关系,又不占用过多的网络资源,满足实时性要求。分析与评估结果表明,该方法能够通过有限的因果控制信息,在异步时钟条件下实时维护带生命周期限制的因果消息序一致性。
针对绝对时钟下完全序一致性维护问题,本文提出了面向广播和多播两种不同运行场景的完全序一致性分布式控制方法。该方法的基本思想是:通过问题分析确定引起完全序不一致现象的基本原因,利用已处理事件与未处理事件的全局推进向量,推导出各结点的事件可处理时刻,使不同事件能够按产生顺序被有效执行,从而在各结点保持一致的事件处理先后关系。评估与分析表明,该控制方法能够用较低的系统开销减少完全序不一致现象,达到完全序一致性时间管理的要求。
针对独立时钟下完全序一致性维护问题,本文提出了一种独立时钟下的完全序一致性分布式控制方法。该方法的基本思想是:基于消息先发后收的原则,区分独立时钟值比较后可能出现的事件先后关系,通过定义“独立时钟间隔差”,进一步判断事件推进的先后顺序,从而维护完全消息序一致性。模拟评估结果表明,该方法在独立时钟环境下能有效提高完全序的一致性控制度,具有良好的可扩展性和应用性。
针对一致性方法的测试与验证,本文在局域网环境下研究建立了一个面向分布式大规模虚拟环境的消息序一致性时间管理模拟验证平台。其整体架构分为数据采集和数据生成两部分,包含底层支撑环境、广域网延迟模拟器、一致性方法控制模块、应用行为层、视觉表现输出、结点监控模块、数据回收统计等模块。在平台上,研究人员既可以测试、分析新的一致性设计方法,还可以通过应用实例对新方法进行验证,达到不断改进、不断创新的目的。
Distributed Virtual Environments (DVEs) are networking computing environmentsin which multiple participants can interact with one another, share simulation data, and soon. A DVE aims to proffer for participants a real, integral and immersive virtual worldthrough interactions among geographically distributed computing nodes, local or globaldata share and task collaborations. Time management approaches are the key and fun-damental ones in DVEs, which are important to preserve the consistency of message de-livery order and ensure the rational logic of distributed simulations. It's well known thatthe research on the basic principle and key algorithms of time management is one of thefocuses and difficulties in DVEs. Currently, the research work confronts the challengeof time-space complexity arisen from Wide Area Network (WAN), large scale, frequentinteractions, etc. As to the present time management problems of consistency, real-timeproperty, scalability, and so on, this dissertation carries out the research on the theoriesand approaches oriented to message delivery causal order consistency and total order con-sistency, and provides the time management and preservation in large-scale DVEs.
Todistributedlypreservethecausalorderconsistencyofmessagedeliveryinrealtimewith global clock, this dissertation has proposed a novel Lightweight Real-Time CausalOrder(LRTCO)algorithmbasedonmessagelifetimeconstraint. ThebasicideaofLRTCOis: firstly, analyze that the dynamicity of network transmission delay is the primary reasonwhyeventscan'tarrivedestinationnodesintimesothatthecausalorderviolationshappen;secondly, predict and compare the network transmission times of messages so as to selectthe proper causal control information of which the amount is dynamically adapted to thenetwork latency variations; thirdly, effectively resolve the problem about preserving thecorrect cause-effect relation in real time with the message lifetime constraint. Experimen-tal results demonstrate that the network transmission amount of LRTCO is unconcernedwithsystemscales, moreover, itcanimprovethescalabilityofDVEsystemsanddistribut-edly preserve the causal order consistency of message delivery with real-time property inlarge-scale DVEs running on WAN.
To maintain the causal order consistency of message delivery in real time withoutglobal clock, this dissertation has proposed a real-time causal order time management approach ADCO (Asynchronous Deadline Causal Order). The basic idea of ADCO is:firstly, deduce the comparison principle of time values of different events from differentnodesbasedonthecommonsensethatamessageisboundtobesentbeforebeingreceived;secondly, throughdynamicallyandproperlyselectingthecausalordercontrolinformationfor each event, ensure that any effect event can identify its current minimum causal eventamong arrived events so as to avoid the causal order violations; thirdly, adjust the amountof control information in accordance with network transmission condition, thus the cause-effect relation can be preserved before the event deadline without costing much networkbandwidth. Analysis and simulations show that with limited causal order control informa-tion, ADCO can still real timely maintain the message delivery causal order consistencywith the message lifetime constraint in the condition of asynchronous clocks.
To preserve the total order consistency of message delivery with the global clock,this dissertation has proposed a distributed total order control approach for two differentcommunication scenarios of broadcast and multicast. The basic idea of the approach is:firstly, respectively compute the global vectors of delivered events and undelivered eventsthrough analyzing the fundamental reason for total order violations; secondly, deduce theevent processable moment of each node so that different events can be effectively de-livered in the order of their occurrences, which ensures that all nodes in a DVE preserveconsistent before-after relation of event delivery. Analysis and experiments show that thiscontrol approach can reduce the total order violations with smaller overhead and meet therequirement of total order time management.
To keep the total order consistency of message delivery without global clock, thisdissertation has proposed a distributed total order control approach applied in the con-dition of asynchronous clocks. The basic idea of the approach is: firstly, differentiatethe possible before-after relation of events after comparing the asynchronous clocks ofthem based on the principle that sending a message always happens before receiving it;secondly, compute the delivery order of events by defining the ``Interval of Local Simu-lation Time'', which can keep the total order consistency of event delivery. Simulationsand experiments demonstrate that this approach can enhance the degree of total order con-trol with asynchronous clocks, in the meanwhile, it has good scalability and widespreadapplication.
To evaluate the performance of consistency control approaches, this dissertation has designed and established a multi-layered message ordering simulation and verificationplatform for time management in large-scale DVEs. Generally, the platform has twoparts: Data Generation and Data Acquisition. It contains several modules as RTI (RunTime Infrastructure), Network Delay Simulator, Consistency Control Approach Module,Application BehaviorLayer, VisualDisplayOutput, Node MonitorModule, DataStatisticModule, etc. On the platform, the researchers can not only testify and analyze a newlydesigned consistency control approach, but also verify the performance of it with appli-cation instances, which is quite beneficial to improve and refine the effectiveness of theapproach.
针对绝对时钟下因果序一致性的实时维护问题,本文提出了基于生命周期约束的动态控制方法LRTCO。该方法的基本思想是:首先分析得到网络传输延迟的动态性是事件不能及时传到、发生因果关系颠倒的基本原因,再通过预测事件消息的网络传输时间区间动态选取因果一致性控制信息,适应网络延迟变化,来有效解决已到达的因果事件难以在生命周期内实时、正确传递因果关系的技术难题。模拟评估与分析表明,该方法控制信息传输量与系统规模无关,可扩展性良好,能够分布、实时、有效地维护广域网条件下分布式大规模虚拟环境的因果消息序一致性。
针对独立时钟下因果序一致性的实时维护问题,本文提出了独立时钟下的实时因果序时间管理方法ADCO。该方法的基本思想是:基于先发后收的物理常识来确定不同结点上时间值的比较原则,突破事件时间值比较的关键技术;通过动态、适当地选择因果控制信息内容,确保任一结果事件可以在已传到事件中计算出当前最小原因事件,避免因果违背现象发生;根据网络状况动态调节控制信息量,既能够在事件生命周期内维护因果关系,又不占用过多的网络资源,满足实时性要求。分析与评估结果表明,该方法能够通过有限的因果控制信息,在异步时钟条件下实时维护带生命周期限制的因果消息序一致性。
针对绝对时钟下完全序一致性维护问题,本文提出了面向广播和多播两种不同运行场景的完全序一致性分布式控制方法。该方法的基本思想是:通过问题分析确定引起完全序不一致现象的基本原因,利用已处理事件与未处理事件的全局推进向量,推导出各结点的事件可处理时刻,使不同事件能够按产生顺序被有效执行,从而在各结点保持一致的事件处理先后关系。评估与分析表明,该控制方法能够用较低的系统开销减少完全序不一致现象,达到完全序一致性时间管理的要求。
针对独立时钟下完全序一致性维护问题,本文提出了一种独立时钟下的完全序一致性分布式控制方法。该方法的基本思想是:基于消息先发后收的原则,区分独立时钟值比较后可能出现的事件先后关系,通过定义“独立时钟间隔差”,进一步判断事件推进的先后顺序,从而维护完全消息序一致性。模拟评估结果表明,该方法在独立时钟环境下能有效提高完全序的一致性控制度,具有良好的可扩展性和应用性。
针对一致性方法的测试与验证,本文在局域网环境下研究建立了一个面向分布式大规模虚拟环境的消息序一致性时间管理模拟验证平台。其整体架构分为数据采集和数据生成两部分,包含底层支撑环境、广域网延迟模拟器、一致性方法控制模块、应用行为层、视觉表现输出、结点监控模块、数据回收统计等模块。在平台上,研究人员既可以测试、分析新的一致性设计方法,还可以通过应用实例对新方法进行验证,达到不断改进、不断创新的目的。
Distributed Virtual Environments (DVEs) are networking computing environmentsin which multiple participants can interact with one another, share simulation data, and soon. A DVE aims to proffer for participants a real, integral and immersive virtual worldthrough interactions among geographically distributed computing nodes, local or globaldata share and task collaborations. Time management approaches are the key and fun-damental ones in DVEs, which are important to preserve the consistency of message de-livery order and ensure the rational logic of distributed simulations. It's well known thatthe research on the basic principle and key algorithms of time management is one of thefocuses and difficulties in DVEs. Currently, the research work confronts the challengeof time-space complexity arisen from Wide Area Network (WAN), large scale, frequentinteractions, etc. As to the present time management problems of consistency, real-timeproperty, scalability, and so on, this dissertation carries out the research on the theoriesand approaches oriented to message delivery causal order consistency and total order con-sistency, and provides the time management and preservation in large-scale DVEs.
Todistributedlypreservethecausalorderconsistencyofmessagedeliveryinrealtimewith global clock, this dissertation has proposed a novel Lightweight Real-Time CausalOrder(LRTCO)algorithmbasedonmessagelifetimeconstraint. ThebasicideaofLRTCOis: firstly, analyze that the dynamicity of network transmission delay is the primary reasonwhyeventscan'tarrivedestinationnodesintimesothatthecausalorderviolationshappen;secondly, predict and compare the network transmission times of messages so as to selectthe proper causal control information of which the amount is dynamically adapted to thenetwork latency variations; thirdly, effectively resolve the problem about preserving thecorrect cause-effect relation in real time with the message lifetime constraint. Experimen-tal results demonstrate that the network transmission amount of LRTCO is unconcernedwithsystemscales, moreover, itcanimprovethescalabilityofDVEsystemsanddistribut-edly preserve the causal order consistency of message delivery with real-time property inlarge-scale DVEs running on WAN.
To maintain the causal order consistency of message delivery in real time withoutglobal clock, this dissertation has proposed a real-time causal order time management approach ADCO (Asynchronous Deadline Causal Order). The basic idea of ADCO is:firstly, deduce the comparison principle of time values of different events from differentnodesbasedonthecommonsensethatamessageisboundtobesentbeforebeingreceived;secondly, throughdynamicallyandproperlyselectingthecausalordercontrolinformationfor each event, ensure that any effect event can identify its current minimum causal eventamong arrived events so as to avoid the causal order violations; thirdly, adjust the amountof control information in accordance with network transmission condition, thus the cause-effect relation can be preserved before the event deadline without costing much networkbandwidth. Analysis and simulations show that with limited causal order control informa-tion, ADCO can still real timely maintain the message delivery causal order consistencywith the message lifetime constraint in the condition of asynchronous clocks.
To preserve the total order consistency of message delivery with the global clock,this dissertation has proposed a distributed total order control approach for two differentcommunication scenarios of broadcast and multicast. The basic idea of the approach is:firstly, respectively compute the global vectors of delivered events and undelivered eventsthrough analyzing the fundamental reason for total order violations; secondly, deduce theevent processable moment of each node so that different events can be effectively de-livered in the order of their occurrences, which ensures that all nodes in a DVE preserveconsistent before-after relation of event delivery. Analysis and experiments show that thiscontrol approach can reduce the total order violations with smaller overhead and meet therequirement of total order time management.
To keep the total order consistency of message delivery without global clock, thisdissertation has proposed a distributed total order control approach applied in the con-dition of asynchronous clocks. The basic idea of the approach is: firstly, differentiatethe possible before-after relation of events after comparing the asynchronous clocks ofthem based on the principle that sending a message always happens before receiving it;secondly, compute the delivery order of events by defining the ``Interval of Local Simu-lation Time'', which can keep the total order consistency of event delivery. Simulationsand experiments demonstrate that this approach can enhance the degree of total order con-trol with asynchronous clocks, in the meanwhile, it has good scalability and widespreadapplication.
To evaluate the performance of consistency control approaches, this dissertation has designed and established a multi-layered message ordering simulation and verificationplatform for time management in large-scale DVEs. Generally, the platform has twoparts: Data Generation and Data Acquisition. It contains several modules as RTI (RunTime Infrastructure), Network Delay Simulator, Consistency Control Approach Module,Application BehaviorLayer, VisualDisplayOutput, Node MonitorModule, DataStatisticModule, etc. On the platform, the researchers can not only testify and analyze a newlydesigned consistency control approach, but also verify the performance of it with appli-cation instances, which is quite beneficial to improve and refine the effectiveness of theapproach.
引文
[1] Strassburger S, Schulze T, Fujimoto R M. Survey on Future Trends in DistributedSimulationandDistributedVirtualEnvironments: ResultsofAPeerStudy[C]Pro-ceedings of the 2008 Winter Simulation Conference. 2008:777--785.
[2] FujimotoRM. ParallelandDistributedSimulationSystems[M]. NewYork: WileyInterscience, 2000.
[3] Declan D, Tomas W, Seamus M. On Consistency and Network Latency in Dis-tributed Interactive Applications: A Survey- Part I [J] . Presence: Teleoperatorsand Virtual Environments, 2006, 15(2):218--234.
[4] Joslin C, Molet T, Magnenat-Thalmann N. Distributed Virtual Reality Systems [C]. 2001.
[5]潘志庚,姜晓红,张明敏,等.分布式虚拟环境综述[J].软件学报,2000,11(004):461--467.
[6] Stytz M. Distributed virtual environments [J] . Computer Graphics and Applica-tions, IEEE, 2002, 16(3):19--31.
[7] Martin R, ADAMS T, STEVEN M. Distributed Virtual Environments [J] . IEEEComputer Graphics and Applica-tions, 1996.
[8] Zhang W, Zhou H, Peng Y, et al. Asynchronous time consistency control methodsin distributed interactive simulation [J] . Ruan Jian Xue Bao(Journal of Software),2010, 21(6):1208--1219.
[9] Zhang W, Zhou H, Peng Y, et al. Providing Responsiveness Requirement BasedConsistency in DVE [C] 2009 15th International Conference on Parallel and Dis-tributed Systems. 2009:594--601.
[10] Calvin J, Dickens A, Gaines B, et al. The SIMNET virtual world architecture [C]Virtual Reality Annual International Symposium. 1993:450--455.
[11] MillerD,ThorpeJ. SIMNET:Theadventofsimulatornetworking[J]. Proceedingsof the IEEE, 1995, 83(8):1114--1123.
[12] KanarickC. AtechnicaloverviewandhistoryoftheSIMNETproject[J]. Advancesin Parallel and Distributed Simulation, 1991, 23:104--111.
[13] TarrR,JacobsJ. DistributedInteractiveSimulation(DIS):Whatisitandwhereisitgoing? [C] SUMMER COMPUTER SIMULATION CONFERENCE. 1995:1010--1029.
[14] Fullford D. Distributed interactive simulation: its past, present, and future [C]Proceedings of the 28th conference on Winter simulation. 1996:179--185.
[15] IEEE Std 1278.1-1995. IEEE Standard for Distributed Interactive Simulation-Application Protocols.
[16] IEEE Std 1278.2-1995. IEEE Standard for Distributed Interactive Simulation-Communication Services and Profiles.
[17] IEEE P1278.3. Draft. Recommended Practice for distributed InteractiveSimulation-Exercise Management and Feedback.
[18] Wilson A, Weatherly R. The aggregate level simulation protocol: an evolvingsystem [C] Proceedings of the 26th conference on Winter simulation. 1994:781--787.
[19] Weatherly R, Wilson A, Canova B, et al. Advanced distributed simulation throughthe aggregate level simulation protocol [C] System Sciences, 1996., Proceedingsof the Twenty-Ninth Hawaii International Conference on,. 2002,1:407--415.
[20] Fischer M. Aggregate level simulation protocol (alsp) managing confederationdevelopment [C] Simulation Conference Proceedings. 2002:775--780.
[21] IEEE 1516-2010 - Standard for Modeling and Simulation High Level Architecture- Framework and Rules.
[22] IEEE 1516.1-2010 - Standard for Modeling and Simulation High Level Architec-ture - Federate Interface Specification.
[23] IEEE 1516.2-2010 - Standard for Modeling and Simulation High Level Architec-ture - Object Model Template (OMT) Specification.
[24] IEEE 1516.3-2003 - Recommended Practice for High Level Architecture Federa-tion Development and Execution Process (FEDEP).
[25] IEEE 1516.4-2007 - Recommended Practice for Verification, Validation, and Ac-creditation of a Federation an Overlay to the High Level Architecture FederationDevelopment and Execution Process.
[26] Thorpe J. The New Technology of Large Scale Simulator Networking: Implica-tionsforMasteringtheArtofWarfighting[C]the9thInterservice/IndustryTrainingSystems Conference. 1987:495--503.
[27] Lenoir T. Programming theatres of war: Gamemakers as soldiers [J] . Latham, R.Bombs and Bandwidth: The emerging relationship between information technol-ogy and security. New York: The New Press., 2003, 14:2006.
[28] Dahmann J, Fujimoto R, Weatherly R. The DoD high level architecture: an update[C] Proceedings of the 30th conference on Winter simulation. 1998:797--804.
[29] MessinaP,BrunettS,DavisD,etal. Distributedinteractivesimulationforsyntheticforces [C] Proceedings of the 6th Heterogeneous Computing Workshop (HCW'97).1997:112.
[30] DiotC,GautierL. Adistributedarchitectureformultiplayerinteractiveapplicationson the internet [J] . Network, IEEE, 2002, 13(4):6--15.
[31] Cai W, Lee F, Chen L. An auto-adaptive dead reckoning algorithm for distributedinteractive simulation [C] Workshop on Parallel and Distributed Simulation: Pro-ceedingsofthethirteenthworkshoponParallelanddistributedsimulation. 1999:82.
[32] Canova B, Page E, Weatherly R, et al. Advanced Distributed Simulation throughthe Aggregate Level Simulation Protocol [C] Proceedings of the 29th Hawaii In-ternational Conference on System Sciences Volume 1: Software Technology andArchitecture. 1996:407.
[33] Kuhl F, Weatherly R, Dahmann J. Creating computer simulation systems: anintroduction to the high level architecture [M] . Prentice Hall PTR Upper SaddleRiver, NJ, USA, 1999.
[34] Dahmann J, Fujimoto R, Weatherly R. The department of defense high level archi-tecture [C] Proceedings of the 29th conference on Winter simulation. 1997:142--149.
[35]周彦,戴剑伟.HLA仿真程序设计[M].Vol. 6.电子工业出版社,2002.
[36] FujimotoR. Timemanagementinthehighlevelarchitecture[J]. Simulation, 1998,71(6):388.
[37] CalvinJ,WeatherlyR. Anintroductiontothehighlevelarchitecture(HLA)runtimeinfrastructure (RTI) [C] 14th Workshop on Standards for the Interoperability ofDistributed Simulations. 1996:96--14.
[38] Fujimoto R, Weatherly R. HLA time management and DIS [C] 14th Workshop onStandards for the Interoperability of Distributed Simulation. 1996.
[39] Fujimoto R, Hoare P. HLA RTI performance in high speed LAN environments [C]in Proceedings of the Fall Simulation Interoperability Workshop. 1998.
[40] Carothers C, Fujimoto R, Weatherly R, et al. Design and implementation of HLAtime management in the RTI version F. 0 [C] Proceedings of the 29th conferenceon Winter simulation. 1997:380--388.
[41]姚益平.高性能分布式交互仿真运行支撑平台关键技术研究[D].长沙:国防科学技术大学,2003.
[42]刘步权.分布式仿真运行支撑平台中时间管理服务的研究[D].长沙:国防科学技术大学,2004.
[43] Yen L, Chi K, Huang T. A scalable scheme for causal message ordering [C] Pro-ceedings of the National Computer Symposium (NCS'03), Taiwan. 2003.
[44] Furuichi M, Mizuno M, Miyata H. Performance evaluation model of HLA-RTIand evaluation result of eRTI [C] Proc. of the 1997 Fall Simulation InteroperabilityWorkshop. 1997,10991109.
[45]刘步权,王怀民,姚益平.RTI中乐观推进机制的实现[J].软件学报,2004,15(003):338--347.
[46] Fujimoto R, McLean T, Perumalla K, et al. Design of high performance RTI soft-ware [C] Distributed Simulation and Real-Time Applications, 2000.(DS-RT 2000).Proceedings. Fourth IEEE International Workshop on. 2002:89--96.
[47] Malinga L, Le Roux W. HLA RTI performance evaluation [C] Simulation Inter-operability Standards 2009 SISO European Simulation Interoperability Workshop,Istanbul, Turkey. 2009:13--16.
[48] DMSO. High Level Architecture Interface Specification Version 1.3[EB/OL].http://www.dmso.mil/, 1998.
[49] High Level Architecture OMT Specification Version 1.3[EB/OL].http://www.dmso.mil/, 1998.
[50] DMSO. HLA Time Management Design Document, Version 1.0 , 15,1996[EB/OL]. http://hla.dmso.mil/..
[51] DefenseModeling&SimulationOffice.RTINextGenerationUpdate.Presentationat the HLA Architecture Management Group Meeting 32, August 1999.
[52] SAIC.RTI-NG 1.3V3.2 Release Notes.Science Applications InternationalCorp.2000.
[53] Sj(o|¨)str(o|¨)mR,JohanssonU,NybergA. RTINGandpRTIPerformancefor SimulatedAircraft, Real Time Updates [C] 99SSIW-058, Spring Simulation InteroperabilityWorkshop. 1999.
[54] Torpey M, Wilbert D, Helfinstine B, et al. Experiences and lessons learned usingRTI-NG in a large-scale, platform-level federation [C] Proc. of the Spring Simula-tion Interoperability Workshop. Orlando. 2001.
[55] CivinskasW,DufaultB,WilbertD. RTI-NGPerformanceinLarge-Scale,Platform-Level Federations [C] in Proceedings of the 2000 Fall Simulation InteroperabilityWorkshop. 2000.
[56] M(A|¨)K Technologies. http://www.mak.com/products/rti.php.
[57] Pitch AB. pRTI 1516 USERS GUIDE. http://www.pitch.se.
[58] Karlsson M, Olsson L. PRTI 1516-rationale and design [C] Fall Simulation Inter-operability Workshop, Orlando, FL., USA. 2001.
[59] Karlsson M, Lof S, Lofstrand B. Experiences from Implementing an RTI in Java[C] Proceedings of the 2 nd Simulation Interoperability Workshop, 98s-SIW-062.1998.
[60] Haanpaa, Douglas and Jacobus, Charles. Using OpenSkies to Implement Multi-Level Security in a Mixed HLA/DIS Environment. http://www.openskies.net/papers/papers.html.
[61] Fujimoto, Richard.FDKUsersGuide(Version3.0), CollegeofComputing, GeorgiaInstitute of Technology, February 2001.
[62] Georgia Tech Research Corporation. FDK - Federated Simulations DevelopmentKit. http://www.cc.gatech.edu/computing/pads/fdk.html, 1999.
[63] Hoare P, Magee G, Moody I. The Development of a Prototype HLA RuntimeInfrastructure [RTI-Lite] Using CORBA [C] 1997 Summer Computer SimulationConference,. 1997.
[64]金士尧,党岗.银河高性能分布仿真系统的设计和实现[J].计算机研究与发展,2001, 38(004):458--466.
[65]凌云翔.基于HLA/RTI分布交互仿真系统的体系结构及其时间管理的研究与实现[D].长沙:国防科学技术大学,1999.
[66]史扬.新一代仿真技术框架HLA/RTI中数据过滤技术的研究及实现[D].长沙:国防科学技术大学,1999.
[67]王召福.HLA邦元范型框架及其关键技术研究[D].长沙:国防科学技术大学,2002.
[68]刘晓建.大规模分布式仿真信息传输延迟技术研究[D].长沙:国防科学技术大学,2003.
[69]钟海荣.大规模分布仿真系统中时间推进[D].长沙:国防科学技术大学,2005.
[70]刘步权,王怀民,姚益平.一种无死锁的时间管理算法[J].软件学报,2003,14(9).
[71]刘步权,王怀民,姚益平.层次式仿真运行支撑环境StarLink中的关键技术[J].软件学报,2004,15(1):9--16.
[72]刘步权,王怀民,姚益平.基于HLA的时间同步技术[J].计算机工程与科学,2004,26(008):96--99.
[73]黄柯棣,刘宝宏,黄健,等.作战仿真技术综述[J].系统仿真学报,2004,16(009):1887--1895.
[74]黄健.HLA仿真系统软件支撑框架及其关键技术研究[D].长沙:国防科学技术大学,2000.
[75]郝建国.高层体系结构(HLA)中的多联邦互连技术研究与实现[D].长沙:国防科学技术大学,2003.
[76] Zhao Q, Zhou Z, Lu F. Algorithm of simulation time synchronization over large-scalenodes[J]. ScienceinChinaSeriesF:InformationSciences,2008,51(9):1239--1255.
[77] Zhang Y, Zhou Z, Wu W. A hierarchical time management mechanism for HLA-based distributed virtual environment [J] . Journal of Computational InformationSystems, 2006, 1(2):7--15.
[78] Zhou Z, Zhao Q. Reducing time cost of distributed run-time infrastructure [J] .Advances in Artificial Reality and Tele-Existence, 2006:969--979.
[79] Zhou Z, Wu W. LoI: Efficient relevance evaluation and filtering for distributedsimulation [J] . Science in China Series F: Information Sciences, 2009, 52(3):470--489.
[80] WeiS,ZhouZ,WuW. AninterestfilteringmechanismbasedonLoI[J]. Advancesin Artificial Reality and Tele-Existence, 2006:334--343.
[81] Quan L, Zhong Z, Wei W, et al. DVE-RTI: Distributed Interactive Simulation Run-Time Infrastructure [J] . Journal of Computer Research and Development, 2004,5.
[82] BH-RTI 2.4使用手册.
[83]卿杜政,李伯虎.HLA运行支撑框架(SSS-RTI)的研究与开发[J].系统仿真学报,2000,12(005):490--493.
[84]柴旭东,李伯虎.层次体系结构HLA/RTI及其实现[J].系统仿真学报,1999,11(2):12--96.
[85]惠天舒,李伯虎.分布交互仿真技术综述[J].系统仿真学报,1998,10(001):1--7.
[86] Lu T, Lin M, Lee C. Control mechanism for large-scale virtual environments [J] .Journal of Visual Languages & Computing, 1999, 10(1):69--85.
[87] Page E, Smith R. Introduction to military training simulation: a guide for discreteevent simulationists [C] Proceedings of the 30th conference on Winter simulation.1998:53--60.
[88] Bennington R. Joint Simulation System (JSIMS)-an overview [C] Aerospace andElectronics Conference, 1995. NAECON 1995., Proceedings of the IEEE 1995 Na-tional. 2002,2:804--809.
[89] Scott M, Johnston C. Modeling Strategic and Cascading Effects in the Joint Simu-lation System (JSIMS) [C] Paper 01S-SIW-038 in Proceedings of the 2001 SpringSimulation Interoperability Workshop. 2001.
[90] JSIMS. The Joint Simulation System Federation Object Model. Version 7.1.November 2001. http://www.jsims.mil/.
[91] Youmans B. Determining RTI Suitability for the Joint Training Confederation [C]Paper 02S-SIW-018 in Proceedings of the 2002 Spring Simulation InteroperabilityWorkshop. 2002.
[92] Griffin S, Page E, Furness C, et al. Providing uninterrupted training to the jointtraining confederation (jtc) audience during the transition to the high level architec-ture (hla) [C] Proceedings of the 1997 Simulation Technology and Training Con-ference. 1997:17--20.
[93] Raytheon Company website, http://www.raytheonaircraft.com.
[94]李伯虎,王行仁.综合仿真系统研究[J].系统仿真学报,2000,12(005):429--434.
[95]李伯虎,文传源.系统仿真技术新动向[J].计算机仿真,1996,13(003):3--5.
[96]徐庚保,曾莲芝.论仿真技术的重点和其中的热点与难点[J].计算机仿真,2003,20(002):1--4.
[97] Ceranowicz A. STOW, the Quest for a Joint Synthetic Battlespace [J] . Web-basedTechnical Reference on Simulation Interoperability.
[98] ARPA. STOW-97 Program Plan, May 1997.
[99] Calvin J, Seeger J, Troxel G, et al. STOW realtime information transfer and net-workingsystemarchitecture[C]Proceedingsofthe12thDISWorkshop. 1995:343--353.
[100] Budge L, Strini R, Dehncke R, et al. Synthetic Theater of War (STOW) 97Overview [C] 1998 Spring Workshop on Simulation Interoperability.
[101] Rak S, Salisbury M, MacDonald R. HLA/RTI data distribution management inthe synthetic theater of war [C] Proceedings of the Fall 1997 DIS Workshop onSimulation Standards (97F-SIW-119).
[102] Laird J, Coulter K, Jones R, et al. Integrating intelligent computer generated forcesin distributed simulations: TacAir-Soar in STOW-97 [J] . Ann Arbor, 1001:2101--2110.
[103] CivinskasW,DufaultB,WilbertD.RTI-NGPerformanceinLarge-Scale, Platform-Level Federations [C] Paper 01S-SIW-038 in Proceedings of the 2001 Spring Sim-ulation Interoperability Workshop. 2001.
[104] Ceranowicz A, Torpey M, Helfinstine B, et al. Reflections on building the jointexperimental federation [C] The Interservice/Industry Training, Simulation & Ed-ucation Conference (I/ITSEC). 2002,2002.
[105] USJFCOM. Millennium Challenge 02[EB/OL]. http://www.jfcom.mil/about/experiments/mc02.htm. 2002.
[106] Ceranowicz. A. MC02 Federation Agreement Document. Version 5-011109.http://www.jfcom.mil/about/experiments/mc02.htm. December 2001.
[107] Ceranowicz. A. MC02 Scalability, JFCOM MC02 Document. http://www.jfcom.mil/about/experiments/mc02.htm. 2002.
[108]赵沁平.DVENET分布式虚拟环境[M].北京:科学出版社,2002.
[109]赵沁平,沈旭昆,吴威,等.分布式虚拟环境DVENET研究进展[J].系统仿真学报,2000,12(4):291--295.
[110] Qinping Z, Xukun S, Chunhe X, et al. DVENET: A DISTRIBUTED VIRTUALENVIRONMENT [J] . Journal of Computer Research and Development, 1998, 12.
[111]李思昆.分布式虚拟现实技术发展与挑战.http://www.cad.zju.edu.cn/chinagraph/chinese/hotreport/CG_Symposium05_LiShikun_DistributionVR.pdf.
[112] Zhou S, Cai W, Lee B, et al. Time-space consistency in large-scale distributed vir-tual environments [J] . ACM Transactions on Modeling and Computer Simulation(TOMACS), 2004, 14(1):31--47.
[113]彭宇行,张拥军,李思昆.分布式虚拟环境的时空一致性研究[J].电子学报,2005,33(002):313--316.
[114] Margery D, Arnaldi B, Plouzeau N. A general framework for cooperative manip-ulation in virtual environments [C] Virtual Environments. 1999,99:169--178.
[115] Fujimoto R, Tsai J, Gopalakrishnan G. Design and evaluation of the rollback chip:Special purpose hardware for Time Warp [J] . Computers, IEEE Transactions on,2002, 41(1):68--82.
[116]张伟.分布式大规模虚拟环境中的时序一致性[D].长沙:国防科学技术大学,2010.
[117] Zhang W, Zhou H, Peng Y, et al. An Irregular cutting based distributed mappingalgorithm for DVE systems [C] Computational Intelligence and Industrial Appli-cations, 2009. PACIIA 2009. Asia-Pacific Conference on. 2010,1:215--219.
[118]徐春蕾.大规模分布式虚拟环境的时空一致性[D].长沙:国防科学技术大学,2006.
[119] Xu C, Li S. An Efficient Relevance Filtering Method in Distributed Virtual Envi-ronment [C] Virtual Reality and its Application in Industry (VRAI). 2002.
[120] Fujimoto R. Parallel simulation: parallel and distributed simulation systems [C]Proceedings of the 33nd conference on Winter simulation. 2001:147--157.
[121] Dahmann J, Fujimoto R, Weatherly R. The department of defense high level archi-tecture [C] Proceedings of the 29th conference on Winter simulation. 1997:142--149.
[122] ZhangW,MerajiS,WangJ,etal. ASimulatedAnnealingTechniqueforOptimizingTime Warp Simulation [C] 2010 Second International Conference on ComputerModeling and Simulation. 2010:197--201.
[123] Wang K, Xu S, McGinnis L. Time management in distributed factory simulation, acasestudyusingHLA[C]Proceedingsofthe37thconferenceonWintersimulation.2005:1781--1786.
[124] LeeB,CaiW,ZhouJ. Acausalitybasedtimemanagementmechanismforfederatedsimulation [C] Proceedings of the fifteenth workshop on Parallel and distributedsimulation. 2001:83--90.
[125] Lamport L. Time, clocks, and the ordering of events in a distributed system [J] .Communications of the ACM, 1978, 21(7):558--565.
[126] Time Management. http://www.dmso.mil/dmso/docslib/hla/TIME_MGT.DOC.
[127] Zeng Y, Cai W, Turner S, et al. Characterization and delivery of directly coupledcausal messages in distributed systems [J] . Future Generation Computer Systems,2004, 20(1):171--178.
[128] Mattern F, Funfrocken S. A non-blocking lightweight implementation of causalorder message delivery [J] . Theory and Practice in Distributed Systems, 1995:197--213.
[129] Anastasi G, Bartoli A, Spadoni F. A reliable multicast protocol for distributedmobile systems: Design and evaluation [J] . IEEE Transactions on Parallel andDistributed Systems, 2001:1009--1022.
[130] Baldoni R, Milani A, Piergiovanni S. Optimal propagation-based protocols imple-menting causal memories [J] . Distributed Computing, 2006, 18(6):461--474.
[131] Guerraoui R, Hari C. On the consistency problem in mobile distributed computing[C]ProceedingsofthesecondACMinternationalworkshoponPrinciplesofmobilecomputing. 2002:57--62.
[132] Ram D, Mahesh M, Chandra Sekhar N, et al. Causal consistency in mobile envi-ronment [J] . ACM SIGOPS Operating Systems Review, 2001, 35(1):40.
[133] Turner S, Cai W, Chen J. A middleware approach to causal order delivery indistributed simulations [C] Proceedings of the 2003 European Simulation Interop-erability Workshop (Euro-SIW). 2003:085--121.
[134] Schiper A, Eggli J, Sandoz A. A new algorithm to implement causal ordering[C] the Proceedings of the 3rd International Workshop on Distributed Algorithms.1989:219--232.
[135] Raynal M, Schiper A, Toueg S. The causal ordering abstraction and a simple wayto implement it [J] . Inf Process Lett, 1991, 39(6):343--350.
[136] Prakash R, Raynal M, Singhal M. An Adaptive Causal Ordering Algorithm Suitedto Mobile Computing Environments [J] . Journal of Parallel and Distributed Com-puting, 1997, 41(2):190--204.
[137] Hernández S, Fanchon J, Drira K. The immediate dependency relation: an opti-mal way to ensure causal group communication [J] . Annual Review of ScalableComputing, 2004, 6:61--79.
[138] Zhou S, Cai W, Turner S J, et al. Critical causal order of events in distributedvirtual environments [J] . ACM Transactions on Multimedia Computing, Commu-nications, and Applications, 2007, 3(3):15--es.
[139] Zhou S, Cai W, Turner S J, et al. Critical causality in distributed virtual environ-ments [C] the 16th Workshop on Parallel and Distributed Simulation. 2002:47--53.
[140] Fidge C. Timestamps in Message-Passing Systems That Preserve the Partial Or-dering [C] the Proc. 11th Australian Computer Science Conference. University ofQueensland: 1988:55--66.
[141] Mattern F. Virtual Time and Global States in Distributed Systems [C] the Proc.Workshop on Parallel and Distributed Algorithms. Chateau de Bonas: 1989:215--226.
[142] Spezialetti M, Kearns J. Simultaneous Regions: A Framework for the ConsistentMonitoring of Distributed Systems [C] Proc. 9th Int. Conference on DistributedComputing Systems. Newport Beach, California: 1989:61--68.
[143] Schwarz R, Mattern F. Detecting causal relationships in distributed computations:In search of the holy grail [J] . Distributed Computing, 1994, 7(3):149--174.
[144] Kshemkalyani A, Singhal M. Necessary and sufficient conditions on informationfor causal message ordering and their optimal implementation [J] . DistributedComputing, 1998, 11(2):91--111.
[145]胡南炜,赵沁平.一种分布式交互仿真中的事件一致性处理算法[J].系统仿真学报,2000,12(004):360--363.
[146]史殿习,吴泉源.基于向量时间的因果序通信协议的研究与设计[J].计算机研究与发展,2001,38(011):1387--1392.
[147] Cai W, Turner S, Lee B, et al. An alternative time management mechanism for dis-tributedsimulations[J]. ACMTransactionsonModelingandComputerSimulation(TOMACS), 2005, 15(2):109--137.
[148] Cai W, Lee B, Zhou J. Causal order delivery in a multicast environment: Animproved algorithm [J] . Journal of Parallel and Distributed Computing, 2002,62(1):111--131.
[149] Anceaume E, Helary J, Raynal M. Tracking immediate predecessors in distributedcomputations [C] Proceedings of the fourteenth annual ACM symposium on Par-allel algorithms and architectures. 2002:210--219.
[150] Mostefaoui A, Raynal M. Causal multicasts in overlapping groups: towards alow cost approach [C] Proceedings of the Fourth Workshop on Future Trends ofDistributed Computing Systems. 2002:136--142.
[151] Baldoni R, Prakash R, Raynal M, et al. Efficient ?-Causal Broadcasting [J] . In-ternational Journal of Computer Systems Science and Engineering, 1998, 13:263--271.
[152] Baldoni R, Mostefaoui A, Raynal M. Causal delivery of messages with real-timedata in unreliable networks [J] . Real-Time Systems, 1996, 10(3):245--262.
[153] Adelstein F, Singhal M. Real-time causal message ordering in multimedia systems[J] . Telecommunication Systems, 1997, 7(1):59--74.
[154] Rodrigues L, Baldoni R, Anceaume E, et al. Deadline-constrained causal order[C] the Object-Oriented Real-Time Distributed Computing, 2000.(ISORC 2000)Proceedings. 2002:234--241.
[155] SchiperA,BirmanK,StephensonP. Lightweightcausalandatomicgroupmulticast[J] . ACM Transactions on Computer Systems (TOCS), 1991, 9(3):272--314.
[156] Birman K, Joseph T. Reliable communication in the presence of failures [J] . ACMTransactions on Computer Systems (TOCS), 1987, 5(1):76.
[157] Stone J. Debugging concurrent processes: a case study [C] Proceedings of theACM SIGPLAN 1988 conference on Programming Language Design and Imple-mentation. 1988:145--153.
[158] Stone J. A graphical representation of concurrent processes [J] . ACM SIGPLANNotices, 1989, 24(1):226--235.
[159] Li D, Li R. An approach to ensuring consistency in peer-to-peer real-time groupeditors [J] . Computer Supported Cooperative Work (CSCW), 2008, 17(5):553--611.
[160] Li D, Li R. An analysis of intention preservation in group editors [C] Proceed-ings of the Twenty-Sixth Annual ACM Symposium on Principles of DistributedComputing. 2007:348--349.
[161] Défago X, Schiper A, Urbán P. Total order broadcast and multicast algorithms:Taxonomy and survey [J] . ACM Computing Surveys (CSUR), 2004, 36(4):372--421.
[162] Mills D. Internet time synchronization: The network time protocol [J] . Commu-nications, IEEE Transactions on, 2002, 39(10):1482--1493.
[163] ScheuermannB,KiessW,RoosM,etal. Onthetimesynchronizationofdistributedlog files in networks with local broadcast media [J] . IEEE/ACM Transactions onNetworking (TON), 2009, 17(2):431--444.
[164] Veitch D, Babu S, Pàsztor A. Robust synchronization of software clocks acrossthe internet [C] Proceedings of the 4th ACM SIGCOMM conference on Internetmeasurement. 2004:219--232.
[165] Dabek F, Cox R, Kaashoek F, et al. Vivaldi: A decentralized network coordi-nate system [C] Proceedings of the 2004 conference on Applications, technologies,architectures, and protocols for computer communications. 2004:15--26.
[166] Agarwal S, Lorch J. Matchmaking for online games and other latency-sensitiveP2P systems [J] . ACM SIGCOMM Computer Communication Review, 2009,39(4):315--326.
[2] FujimotoRM. ParallelandDistributedSimulationSystems[M]. NewYork: WileyInterscience, 2000.
[3] Declan D, Tomas W, Seamus M. On Consistency and Network Latency in Dis-tributed Interactive Applications: A Survey- Part I [J] . Presence: Teleoperatorsand Virtual Environments, 2006, 15(2):218--234.
[4] Joslin C, Molet T, Magnenat-Thalmann N. Distributed Virtual Reality Systems [C]. 2001.
[5]潘志庚,姜晓红,张明敏,等.分布式虚拟环境综述[J].软件学报,2000,11(004):461--467.
[6] Stytz M. Distributed virtual environments [J] . Computer Graphics and Applica-tions, IEEE, 2002, 16(3):19--31.
[7] Martin R, ADAMS T, STEVEN M. Distributed Virtual Environments [J] . IEEEComputer Graphics and Applica-tions, 1996.
[8] Zhang W, Zhou H, Peng Y, et al. Asynchronous time consistency control methodsin distributed interactive simulation [J] . Ruan Jian Xue Bao(Journal of Software),2010, 21(6):1208--1219.
[9] Zhang W, Zhou H, Peng Y, et al. Providing Responsiveness Requirement BasedConsistency in DVE [C] 2009 15th International Conference on Parallel and Dis-tributed Systems. 2009:594--601.
[10] Calvin J, Dickens A, Gaines B, et al. The SIMNET virtual world architecture [C]Virtual Reality Annual International Symposium. 1993:450--455.
[11] MillerD,ThorpeJ. SIMNET:Theadventofsimulatornetworking[J]. Proceedingsof the IEEE, 1995, 83(8):1114--1123.
[12] KanarickC. AtechnicaloverviewandhistoryoftheSIMNETproject[J]. Advancesin Parallel and Distributed Simulation, 1991, 23:104--111.
[13] TarrR,JacobsJ. DistributedInteractiveSimulation(DIS):Whatisitandwhereisitgoing? [C] SUMMER COMPUTER SIMULATION CONFERENCE. 1995:1010--1029.
[14] Fullford D. Distributed interactive simulation: its past, present, and future [C]Proceedings of the 28th conference on Winter simulation. 1996:179--185.
[15] IEEE Std 1278.1-1995. IEEE Standard for Distributed Interactive Simulation-Application Protocols.
[16] IEEE Std 1278.2-1995. IEEE Standard for Distributed Interactive Simulation-Communication Services and Profiles.
[17] IEEE P1278.3. Draft. Recommended Practice for distributed InteractiveSimulation-Exercise Management and Feedback.
[18] Wilson A, Weatherly R. The aggregate level simulation protocol: an evolvingsystem [C] Proceedings of the 26th conference on Winter simulation. 1994:781--787.
[19] Weatherly R, Wilson A, Canova B, et al. Advanced distributed simulation throughthe aggregate level simulation protocol [C] System Sciences, 1996., Proceedingsof the Twenty-Ninth Hawaii International Conference on,. 2002,1:407--415.
[20] Fischer M. Aggregate level simulation protocol (alsp) managing confederationdevelopment [C] Simulation Conference Proceedings. 2002:775--780.
[21] IEEE 1516-2010 - Standard for Modeling and Simulation High Level Architecture- Framework and Rules.
[22] IEEE 1516.1-2010 - Standard for Modeling and Simulation High Level Architec-ture - Federate Interface Specification.
[23] IEEE 1516.2-2010 - Standard for Modeling and Simulation High Level Architec-ture - Object Model Template (OMT) Specification.
[24] IEEE 1516.3-2003 - Recommended Practice for High Level Architecture Federa-tion Development and Execution Process (FEDEP).
[25] IEEE 1516.4-2007 - Recommended Practice for Verification, Validation, and Ac-creditation of a Federation an Overlay to the High Level Architecture FederationDevelopment and Execution Process.
[26] Thorpe J. The New Technology of Large Scale Simulator Networking: Implica-tionsforMasteringtheArtofWarfighting[C]the9thInterservice/IndustryTrainingSystems Conference. 1987:495--503.
[27] Lenoir T. Programming theatres of war: Gamemakers as soldiers [J] . Latham, R.Bombs and Bandwidth: The emerging relationship between information technol-ogy and security. New York: The New Press., 2003, 14:2006.
[28] Dahmann J, Fujimoto R, Weatherly R. The DoD high level architecture: an update[C] Proceedings of the 30th conference on Winter simulation. 1998:797--804.
[29] MessinaP,BrunettS,DavisD,etal. Distributedinteractivesimulationforsyntheticforces [C] Proceedings of the 6th Heterogeneous Computing Workshop (HCW'97).1997:112.
[30] DiotC,GautierL. Adistributedarchitectureformultiplayerinteractiveapplicationson the internet [J] . Network, IEEE, 2002, 13(4):6--15.
[31] Cai W, Lee F, Chen L. An auto-adaptive dead reckoning algorithm for distributedinteractive simulation [C] Workshop on Parallel and Distributed Simulation: Pro-ceedingsofthethirteenthworkshoponParallelanddistributedsimulation. 1999:82.
[32] Canova B, Page E, Weatherly R, et al. Advanced Distributed Simulation throughthe Aggregate Level Simulation Protocol [C] Proceedings of the 29th Hawaii In-ternational Conference on System Sciences Volume 1: Software Technology andArchitecture. 1996:407.
[33] Kuhl F, Weatherly R, Dahmann J. Creating computer simulation systems: anintroduction to the high level architecture [M] . Prentice Hall PTR Upper SaddleRiver, NJ, USA, 1999.
[34] Dahmann J, Fujimoto R, Weatherly R. The department of defense high level archi-tecture [C] Proceedings of the 29th conference on Winter simulation. 1997:142--149.
[35]周彦,戴剑伟.HLA仿真程序设计[M].Vol. 6.电子工业出版社,2002.
[36] FujimotoR. Timemanagementinthehighlevelarchitecture[J]. Simulation, 1998,71(6):388.
[37] CalvinJ,WeatherlyR. Anintroductiontothehighlevelarchitecture(HLA)runtimeinfrastructure (RTI) [C] 14th Workshop on Standards for the Interoperability ofDistributed Simulations. 1996:96--14.
[38] Fujimoto R, Weatherly R. HLA time management and DIS [C] 14th Workshop onStandards for the Interoperability of Distributed Simulation. 1996.
[39] Fujimoto R, Hoare P. HLA RTI performance in high speed LAN environments [C]in Proceedings of the Fall Simulation Interoperability Workshop. 1998.
[40] Carothers C, Fujimoto R, Weatherly R, et al. Design and implementation of HLAtime management in the RTI version F. 0 [C] Proceedings of the 29th conferenceon Winter simulation. 1997:380--388.
[41]姚益平.高性能分布式交互仿真运行支撑平台关键技术研究[D].长沙:国防科学技术大学,2003.
[42]刘步权.分布式仿真运行支撑平台中时间管理服务的研究[D].长沙:国防科学技术大学,2004.
[43] Yen L, Chi K, Huang T. A scalable scheme for causal message ordering [C] Pro-ceedings of the National Computer Symposium (NCS'03), Taiwan. 2003.
[44] Furuichi M, Mizuno M, Miyata H. Performance evaluation model of HLA-RTIand evaluation result of eRTI [C] Proc. of the 1997 Fall Simulation InteroperabilityWorkshop. 1997,10991109.
[45]刘步权,王怀民,姚益平.RTI中乐观推进机制的实现[J].软件学报,2004,15(003):338--347.
[46] Fujimoto R, McLean T, Perumalla K, et al. Design of high performance RTI soft-ware [C] Distributed Simulation and Real-Time Applications, 2000.(DS-RT 2000).Proceedings. Fourth IEEE International Workshop on. 2002:89--96.
[47] Malinga L, Le Roux W. HLA RTI performance evaluation [C] Simulation Inter-operability Standards 2009 SISO European Simulation Interoperability Workshop,Istanbul, Turkey. 2009:13--16.
[48] DMSO. High Level Architecture Interface Specification Version 1.3[EB/OL].http://www.dmso.mil/, 1998.
[49] High Level Architecture OMT Specification Version 1.3[EB/OL].http://www.dmso.mil/, 1998.
[50] DMSO. HLA Time Management Design Document, Version 1.0 , 15,1996[EB/OL]. http://hla.dmso.mil/..
[51] DefenseModeling&SimulationOffice.RTINextGenerationUpdate.Presentationat the HLA Architecture Management Group Meeting 32, August 1999.
[52] SAIC.RTI-NG 1.3V3.2 Release Notes.Science Applications InternationalCorp.2000.
[53] Sj(o|¨)str(o|¨)mR,JohanssonU,NybergA. RTINGandpRTIPerformancefor SimulatedAircraft, Real Time Updates [C] 99SSIW-058, Spring Simulation InteroperabilityWorkshop. 1999.
[54] Torpey M, Wilbert D, Helfinstine B, et al. Experiences and lessons learned usingRTI-NG in a large-scale, platform-level federation [C] Proc. of the Spring Simula-tion Interoperability Workshop. Orlando. 2001.
[55] CivinskasW,DufaultB,WilbertD. RTI-NGPerformanceinLarge-Scale,Platform-Level Federations [C] in Proceedings of the 2000 Fall Simulation InteroperabilityWorkshop. 2000.
[56] M(A|¨)K Technologies. http://www.mak.com/products/rti.php.
[57] Pitch AB. pRTI 1516 USERS GUIDE. http://www.pitch.se.
[58] Karlsson M, Olsson L. PRTI 1516-rationale and design [C] Fall Simulation Inter-operability Workshop, Orlando, FL., USA. 2001.
[59] Karlsson M, Lof S, Lofstrand B. Experiences from Implementing an RTI in Java[C] Proceedings of the 2 nd Simulation Interoperability Workshop, 98s-SIW-062.1998.
[60] Haanpaa, Douglas and Jacobus, Charles. Using OpenSkies to Implement Multi-Level Security in a Mixed HLA/DIS Environment. http://www.openskies.net/papers/papers.html.
[61] Fujimoto, Richard.FDKUsersGuide(Version3.0), CollegeofComputing, GeorgiaInstitute of Technology, February 2001.
[62] Georgia Tech Research Corporation. FDK - Federated Simulations DevelopmentKit. http://www.cc.gatech.edu/computing/pads/fdk.html, 1999.
[63] Hoare P, Magee G, Moody I. The Development of a Prototype HLA RuntimeInfrastructure [RTI-Lite] Using CORBA [C] 1997 Summer Computer SimulationConference,. 1997.
[64]金士尧,党岗.银河高性能分布仿真系统的设计和实现[J].计算机研究与发展,2001, 38(004):458--466.
[65]凌云翔.基于HLA/RTI分布交互仿真系统的体系结构及其时间管理的研究与实现[D].长沙:国防科学技术大学,1999.
[66]史扬.新一代仿真技术框架HLA/RTI中数据过滤技术的研究及实现[D].长沙:国防科学技术大学,1999.
[67]王召福.HLA邦元范型框架及其关键技术研究[D].长沙:国防科学技术大学,2002.
[68]刘晓建.大规模分布式仿真信息传输延迟技术研究[D].长沙:国防科学技术大学,2003.
[69]钟海荣.大规模分布仿真系统中时间推进[D].长沙:国防科学技术大学,2005.
[70]刘步权,王怀民,姚益平.一种无死锁的时间管理算法[J].软件学报,2003,14(9).
[71]刘步权,王怀民,姚益平.层次式仿真运行支撑环境StarLink中的关键技术[J].软件学报,2004,15(1):9--16.
[72]刘步权,王怀民,姚益平.基于HLA的时间同步技术[J].计算机工程与科学,2004,26(008):96--99.
[73]黄柯棣,刘宝宏,黄健,等.作战仿真技术综述[J].系统仿真学报,2004,16(009):1887--1895.
[74]黄健.HLA仿真系统软件支撑框架及其关键技术研究[D].长沙:国防科学技术大学,2000.
[75]郝建国.高层体系结构(HLA)中的多联邦互连技术研究与实现[D].长沙:国防科学技术大学,2003.
[76] Zhao Q, Zhou Z, Lu F. Algorithm of simulation time synchronization over large-scalenodes[J]. ScienceinChinaSeriesF:InformationSciences,2008,51(9):1239--1255.
[77] Zhang Y, Zhou Z, Wu W. A hierarchical time management mechanism for HLA-based distributed virtual environment [J] . Journal of Computational InformationSystems, 2006, 1(2):7--15.
[78] Zhou Z, Zhao Q. Reducing time cost of distributed run-time infrastructure [J] .Advances in Artificial Reality and Tele-Existence, 2006:969--979.
[79] Zhou Z, Wu W. LoI: Efficient relevance evaluation and filtering for distributedsimulation [J] . Science in China Series F: Information Sciences, 2009, 52(3):470--489.
[80] WeiS,ZhouZ,WuW. AninterestfilteringmechanismbasedonLoI[J]. Advancesin Artificial Reality and Tele-Existence, 2006:334--343.
[81] Quan L, Zhong Z, Wei W, et al. DVE-RTI: Distributed Interactive Simulation Run-Time Infrastructure [J] . Journal of Computer Research and Development, 2004,5.
[82] BH-RTI 2.4使用手册.
[83]卿杜政,李伯虎.HLA运行支撑框架(SSS-RTI)的研究与开发[J].系统仿真学报,2000,12(005):490--493.
[84]柴旭东,李伯虎.层次体系结构HLA/RTI及其实现[J].系统仿真学报,1999,11(2):12--96.
[85]惠天舒,李伯虎.分布交互仿真技术综述[J].系统仿真学报,1998,10(001):1--7.
[86] Lu T, Lin M, Lee C. Control mechanism for large-scale virtual environments [J] .Journal of Visual Languages & Computing, 1999, 10(1):69--85.
[87] Page E, Smith R. Introduction to military training simulation: a guide for discreteevent simulationists [C] Proceedings of the 30th conference on Winter simulation.1998:53--60.
[88] Bennington R. Joint Simulation System (JSIMS)-an overview [C] Aerospace andElectronics Conference, 1995. NAECON 1995., Proceedings of the IEEE 1995 Na-tional. 2002,2:804--809.
[89] Scott M, Johnston C. Modeling Strategic and Cascading Effects in the Joint Simu-lation System (JSIMS) [C] Paper 01S-SIW-038 in Proceedings of the 2001 SpringSimulation Interoperability Workshop. 2001.
[90] JSIMS. The Joint Simulation System Federation Object Model. Version 7.1.November 2001. http://www.jsims.mil/.
[91] Youmans B. Determining RTI Suitability for the Joint Training Confederation [C]Paper 02S-SIW-018 in Proceedings of the 2002 Spring Simulation InteroperabilityWorkshop. 2002.
[92] Griffin S, Page E, Furness C, et al. Providing uninterrupted training to the jointtraining confederation (jtc) audience during the transition to the high level architec-ture (hla) [C] Proceedings of the 1997 Simulation Technology and Training Con-ference. 1997:17--20.
[93] Raytheon Company website, http://www.raytheonaircraft.com.
[94]李伯虎,王行仁.综合仿真系统研究[J].系统仿真学报,2000,12(005):429--434.
[95]李伯虎,文传源.系统仿真技术新动向[J].计算机仿真,1996,13(003):3--5.
[96]徐庚保,曾莲芝.论仿真技术的重点和其中的热点与难点[J].计算机仿真,2003,20(002):1--4.
[97] Ceranowicz A. STOW, the Quest for a Joint Synthetic Battlespace [J] . Web-basedTechnical Reference on Simulation Interoperability.
[98] ARPA. STOW-97 Program Plan, May 1997.
[99] Calvin J, Seeger J, Troxel G, et al. STOW realtime information transfer and net-workingsystemarchitecture[C]Proceedingsofthe12thDISWorkshop. 1995:343--353.
[100] Budge L, Strini R, Dehncke R, et al. Synthetic Theater of War (STOW) 97Overview [C] 1998 Spring Workshop on Simulation Interoperability.
[101] Rak S, Salisbury M, MacDonald R. HLA/RTI data distribution management inthe synthetic theater of war [C] Proceedings of the Fall 1997 DIS Workshop onSimulation Standards (97F-SIW-119).
[102] Laird J, Coulter K, Jones R, et al. Integrating intelligent computer generated forcesin distributed simulations: TacAir-Soar in STOW-97 [J] . Ann Arbor, 1001:2101--2110.
[103] CivinskasW,DufaultB,WilbertD.RTI-NGPerformanceinLarge-Scale, Platform-Level Federations [C] Paper 01S-SIW-038 in Proceedings of the 2001 Spring Sim-ulation Interoperability Workshop. 2001.
[104] Ceranowicz A, Torpey M, Helfinstine B, et al. Reflections on building the jointexperimental federation [C] The Interservice/Industry Training, Simulation & Ed-ucation Conference (I/ITSEC). 2002,2002.
[105] USJFCOM. Millennium Challenge 02[EB/OL]. http://www.jfcom.mil/about/experiments/mc02.htm. 2002.
[106] Ceranowicz. A. MC02 Federation Agreement Document. Version 5-011109.http://www.jfcom.mil/about/experiments/mc02.htm. December 2001.
[107] Ceranowicz. A. MC02 Scalability, JFCOM MC02 Document. http://www.jfcom.mil/about/experiments/mc02.htm. 2002.
[108]赵沁平.DVENET分布式虚拟环境[M].北京:科学出版社,2002.
[109]赵沁平,沈旭昆,吴威,等.分布式虚拟环境DVENET研究进展[J].系统仿真学报,2000,12(4):291--295.
[110] Qinping Z, Xukun S, Chunhe X, et al. DVENET: A DISTRIBUTED VIRTUALENVIRONMENT [J] . Journal of Computer Research and Development, 1998, 12.
[111]李思昆.分布式虚拟现实技术发展与挑战.http://www.cad.zju.edu.cn/chinagraph/chinese/hotreport/CG_Symposium05_LiShikun_DistributionVR.pdf.
[112] Zhou S, Cai W, Lee B, et al. Time-space consistency in large-scale distributed vir-tual environments [J] . ACM Transactions on Modeling and Computer Simulation(TOMACS), 2004, 14(1):31--47.
[113]彭宇行,张拥军,李思昆.分布式虚拟环境的时空一致性研究[J].电子学报,2005,33(002):313--316.
[114] Margery D, Arnaldi B, Plouzeau N. A general framework for cooperative manip-ulation in virtual environments [C] Virtual Environments. 1999,99:169--178.
[115] Fujimoto R, Tsai J, Gopalakrishnan G. Design and evaluation of the rollback chip:Special purpose hardware for Time Warp [J] . Computers, IEEE Transactions on,2002, 41(1):68--82.
[116]张伟.分布式大规模虚拟环境中的时序一致性[D].长沙:国防科学技术大学,2010.
[117] Zhang W, Zhou H, Peng Y, et al. An Irregular cutting based distributed mappingalgorithm for DVE systems [C] Computational Intelligence and Industrial Appli-cations, 2009. PACIIA 2009. Asia-Pacific Conference on. 2010,1:215--219.
[118]徐春蕾.大规模分布式虚拟环境的时空一致性[D].长沙:国防科学技术大学,2006.
[119] Xu C, Li S. An Efficient Relevance Filtering Method in Distributed Virtual Envi-ronment [C] Virtual Reality and its Application in Industry (VRAI). 2002.
[120] Fujimoto R. Parallel simulation: parallel and distributed simulation systems [C]Proceedings of the 33nd conference on Winter simulation. 2001:147--157.
[121] Dahmann J, Fujimoto R, Weatherly R. The department of defense high level archi-tecture [C] Proceedings of the 29th conference on Winter simulation. 1997:142--149.
[122] ZhangW,MerajiS,WangJ,etal. ASimulatedAnnealingTechniqueforOptimizingTime Warp Simulation [C] 2010 Second International Conference on ComputerModeling and Simulation. 2010:197--201.
[123] Wang K, Xu S, McGinnis L. Time management in distributed factory simulation, acasestudyusingHLA[C]Proceedingsofthe37thconferenceonWintersimulation.2005:1781--1786.
[124] LeeB,CaiW,ZhouJ. Acausalitybasedtimemanagementmechanismforfederatedsimulation [C] Proceedings of the fifteenth workshop on Parallel and distributedsimulation. 2001:83--90.
[125] Lamport L. Time, clocks, and the ordering of events in a distributed system [J] .Communications of the ACM, 1978, 21(7):558--565.
[126] Time Management. http://www.dmso.mil/dmso/docslib/hla/TIME_MGT.DOC.
[127] Zeng Y, Cai W, Turner S, et al. Characterization and delivery of directly coupledcausal messages in distributed systems [J] . Future Generation Computer Systems,2004, 20(1):171--178.
[128] Mattern F, Funfrocken S. A non-blocking lightweight implementation of causalorder message delivery [J] . Theory and Practice in Distributed Systems, 1995:197--213.
[129] Anastasi G, Bartoli A, Spadoni F. A reliable multicast protocol for distributedmobile systems: Design and evaluation [J] . IEEE Transactions on Parallel andDistributed Systems, 2001:1009--1022.
[130] Baldoni R, Milani A, Piergiovanni S. Optimal propagation-based protocols imple-menting causal memories [J] . Distributed Computing, 2006, 18(6):461--474.
[131] Guerraoui R, Hari C. On the consistency problem in mobile distributed computing[C]ProceedingsofthesecondACMinternationalworkshoponPrinciplesofmobilecomputing. 2002:57--62.
[132] Ram D, Mahesh M, Chandra Sekhar N, et al. Causal consistency in mobile envi-ronment [J] . ACM SIGOPS Operating Systems Review, 2001, 35(1):40.
[133] Turner S, Cai W, Chen J. A middleware approach to causal order delivery indistributed simulations [C] Proceedings of the 2003 European Simulation Interop-erability Workshop (Euro-SIW). 2003:085--121.
[134] Schiper A, Eggli J, Sandoz A. A new algorithm to implement causal ordering[C] the Proceedings of the 3rd International Workshop on Distributed Algorithms.1989:219--232.
[135] Raynal M, Schiper A, Toueg S. The causal ordering abstraction and a simple wayto implement it [J] . Inf Process Lett, 1991, 39(6):343--350.
[136] Prakash R, Raynal M, Singhal M. An Adaptive Causal Ordering Algorithm Suitedto Mobile Computing Environments [J] . Journal of Parallel and Distributed Com-puting, 1997, 41(2):190--204.
[137] Hernández S, Fanchon J, Drira K. The immediate dependency relation: an opti-mal way to ensure causal group communication [J] . Annual Review of ScalableComputing, 2004, 6:61--79.
[138] Zhou S, Cai W, Turner S J, et al. Critical causal order of events in distributedvirtual environments [J] . ACM Transactions on Multimedia Computing, Commu-nications, and Applications, 2007, 3(3):15--es.
[139] Zhou S, Cai W, Turner S J, et al. Critical causality in distributed virtual environ-ments [C] the 16th Workshop on Parallel and Distributed Simulation. 2002:47--53.
[140] Fidge C. Timestamps in Message-Passing Systems That Preserve the Partial Or-dering [C] the Proc. 11th Australian Computer Science Conference. University ofQueensland: 1988:55--66.
[141] Mattern F. Virtual Time and Global States in Distributed Systems [C] the Proc.Workshop on Parallel and Distributed Algorithms. Chateau de Bonas: 1989:215--226.
[142] Spezialetti M, Kearns J. Simultaneous Regions: A Framework for the ConsistentMonitoring of Distributed Systems [C] Proc. 9th Int. Conference on DistributedComputing Systems. Newport Beach, California: 1989:61--68.
[143] Schwarz R, Mattern F. Detecting causal relationships in distributed computations:In search of the holy grail [J] . Distributed Computing, 1994, 7(3):149--174.
[144] Kshemkalyani A, Singhal M. Necessary and sufficient conditions on informationfor causal message ordering and their optimal implementation [J] . DistributedComputing, 1998, 11(2):91--111.
[145]胡南炜,赵沁平.一种分布式交互仿真中的事件一致性处理算法[J].系统仿真学报,2000,12(004):360--363.
[146]史殿习,吴泉源.基于向量时间的因果序通信协议的研究与设计[J].计算机研究与发展,2001,38(011):1387--1392.
[147] Cai W, Turner S, Lee B, et al. An alternative time management mechanism for dis-tributedsimulations[J]. ACMTransactionsonModelingandComputerSimulation(TOMACS), 2005, 15(2):109--137.
[148] Cai W, Lee B, Zhou J. Causal order delivery in a multicast environment: Animproved algorithm [J] . Journal of Parallel and Distributed Computing, 2002,62(1):111--131.
[149] Anceaume E, Helary J, Raynal M. Tracking immediate predecessors in distributedcomputations [C] Proceedings of the fourteenth annual ACM symposium on Par-allel algorithms and architectures. 2002:210--219.
[150] Mostefaoui A, Raynal M. Causal multicasts in overlapping groups: towards alow cost approach [C] Proceedings of the Fourth Workshop on Future Trends ofDistributed Computing Systems. 2002:136--142.
[151] Baldoni R, Prakash R, Raynal M, et al. Efficient ?-Causal Broadcasting [J] . In-ternational Journal of Computer Systems Science and Engineering, 1998, 13:263--271.
[152] Baldoni R, Mostefaoui A, Raynal M. Causal delivery of messages with real-timedata in unreliable networks [J] . Real-Time Systems, 1996, 10(3):245--262.
[153] Adelstein F, Singhal M. Real-time causal message ordering in multimedia systems[J] . Telecommunication Systems, 1997, 7(1):59--74.
[154] Rodrigues L, Baldoni R, Anceaume E, et al. Deadline-constrained causal order[C] the Object-Oriented Real-Time Distributed Computing, 2000.(ISORC 2000)Proceedings. 2002:234--241.
[155] SchiperA,BirmanK,StephensonP. Lightweightcausalandatomicgroupmulticast[J] . ACM Transactions on Computer Systems (TOCS), 1991, 9(3):272--314.
[156] Birman K, Joseph T. Reliable communication in the presence of failures [J] . ACMTransactions on Computer Systems (TOCS), 1987, 5(1):76.
[157] Stone J. Debugging concurrent processes: a case study [C] Proceedings of theACM SIGPLAN 1988 conference on Programming Language Design and Imple-mentation. 1988:145--153.
[158] Stone J. A graphical representation of concurrent processes [J] . ACM SIGPLANNotices, 1989, 24(1):226--235.
[159] Li D, Li R. An approach to ensuring consistency in peer-to-peer real-time groupeditors [J] . Computer Supported Cooperative Work (CSCW), 2008, 17(5):553--611.
[160] Li D, Li R. An analysis of intention preservation in group editors [C] Proceed-ings of the Twenty-Sixth Annual ACM Symposium on Principles of DistributedComputing. 2007:348--349.
[161] Défago X, Schiper A, Urbán P. Total order broadcast and multicast algorithms:Taxonomy and survey [J] . ACM Computing Surveys (CSUR), 2004, 36(4):372--421.
[162] Mills D. Internet time synchronization: The network time protocol [J] . Commu-nications, IEEE Transactions on, 2002, 39(10):1482--1493.
[163] ScheuermannB,KiessW,RoosM,etal. Onthetimesynchronizationofdistributedlog files in networks with local broadcast media [J] . IEEE/ACM Transactions onNetworking (TON), 2009, 17(2):431--444.
[164] Veitch D, Babu S, Pàsztor A. Robust synchronization of software clocks acrossthe internet [C] Proceedings of the 4th ACM SIGCOMM conference on Internetmeasurement. 2004:219--232.
[165] Dabek F, Cox R, Kaashoek F, et al. Vivaldi: A decentralized network coordi-nate system [C] Proceedings of the 2004 conference on Applications, technologies,architectures, and protocols for computer communications. 2004:15--26.
[166] Agarwal S, Lorch J. Matchmaking for online games and other latency-sensitiveP2P systems [J] . ACM SIGCOMM Computer Communication Review, 2009,39(4):315--326.