基于灰色关联逼近理想解方法的测试用例评价模型研究
|
摘要
作为软件质量保证的关键环节,软件测试已经成为软件生命周期的重要组成部分,根据Boehm的统计,软件开发总成本中,用在测试上的开销会占到30%到50%。因此,提高测试效率和降低测试代价都具有十分现实的意义。近年来,随着复用和构件技术的发展,复用的粒度大大提高,构件的概念已经突破了程序代码的局限,拓宽到了软件开发的整个生命周期,软件测试中的测试计划和测试用例也成为软件复用中重要的一部分。测试用例是软件测试中的核心,每一个测试用例都体现了一个特定的测试方案,它在测试中起着指导测试过程的实施、设计测试的输入、评估测试结果的度量基准等作用。对测试用例的复用能够大大的提高测试的效率和质量,降低测试成本。
随着测试的进展,测试用例库越来越庞大,测试用例复用的难度也随之加大,测试用例优先级技术(Test case prioritization techniques)作为测试用例复用技术的辅助技术应运而生。这种技术主要是依据某种准则对测试用例设定优先级,按照优先级依次对库中的测试用例进行复用,进而提高检错速度。这种技术的关键问题就是依据何种准则对测试用例设定优先级。
本文从多属性决策分析的角度来解决测试用例优先级设定问题。多属性决策评价问题中,两个核心的问题是评价指标选取和指标权重值的设定。本文从这两个点出发,首先深入研究影响测试用例成功复用的因素,进而提出了十三个评价指标：测试团体的经验、用例类型设计的完备性、测试用例设计的精炼程度、覆盖率、发现从未发现的错误、发现错误的重要程度、检错数量、运行效率、可改进性、文档完整性、复用次数、独立性、信誉度。在赋权重值方面,本文使用三角模糊数层次分析法和熵权法,既能反映专家意见,同时又体现了指标值之间的内在规律。并且通过实验的方式对组合公式中的系数进行了调整。最后使用了灰色关联逼近理想解方法,对测试用例进行评价。
本文设计并实现了一个测试用例评价工具,并通过大量实验,验证了评价模型的有效性。
As a key step in software quality assurance, software testing is an important part in the software life cycle. According to Boehm's statistics, the cost of testing is about 30% to 50% of the total cost of software development. Therefore, it is practical to enhance the efficiency of software testing and reduce the test cost. In recent years, with the development of reuse and component technology, granularity of reuse have enhanced greatly. The concept of component has broken through the limitations of program code, and extended the entire life cycle of software development. The test plan and test case in software testing have become an important part of software reuse. Each test case indicates a specific test scheme, which guides the implementation of the testing process, the design of test input, the evaluation of measurement baseline of test results and etc. Reuse of test cases can greatly improve the efficiency and quality of testing, while reducing the cost of testing.
As the improvement of testing, the scale of test cases is more and more huge. And the difficulty of test case reuse is also increasing. Then test case prioritization techniques have emerged as an assistant technology of test case reuse. This technique is mainly to set priority of test cases based on a certain criteria, and reuse test cases in the library according to priority. Then the speed of error detection will increase. The key problem of this technique is how to set the priority criteria of test case.
This dissertation aimes at solving the test case prioritization based on the perspective of Multi-attribute Decision. There are two important problems in the Multi-attribute Decision. One is how to set indicators and the other is how to give weight of indicator. Through analyzing the factors impact the success of test case reuse, this dissertation finds thirteen indicators for test case, including Experience,Type,Terse,Coverage,DiscNewError, ErrorRank,ErrorCount,Efficiency,Improvement,DocIntegrity,ReuseDegree,Independence and Credit. We give the combinational weight of indicators using the Triangular Fuzzy Number AHP and Entropy Weighting method.The weights not only stand for the experts' experience, but also show the intrinsic rules of indicators'data. At last, this dissertation evaluates the test cases using a grey correlation and similarity to ideal solution evaluation method.
A test case evaluation tool was designed and implemented. Finally, large numbers of experiments are executed to validate the effectiveness of this evaluation model.
随着测试的进展,测试用例库越来越庞大,测试用例复用的难度也随之加大,测试用例优先级技术(Test case prioritization techniques)作为测试用例复用技术的辅助技术应运而生。这种技术主要是依据某种准则对测试用例设定优先级,按照优先级依次对库中的测试用例进行复用,进而提高检错速度。这种技术的关键问题就是依据何种准则对测试用例设定优先级。
本文从多属性决策分析的角度来解决测试用例优先级设定问题。多属性决策评价问题中,两个核心的问题是评价指标选取和指标权重值的设定。本文从这两个点出发,首先深入研究影响测试用例成功复用的因素,进而提出了十三个评价指标：测试团体的经验、用例类型设计的完备性、测试用例设计的精炼程度、覆盖率、发现从未发现的错误、发现错误的重要程度、检错数量、运行效率、可改进性、文档完整性、复用次数、独立性、信誉度。在赋权重值方面,本文使用三角模糊数层次分析法和熵权法,既能反映专家意见,同时又体现了指标值之间的内在规律。并且通过实验的方式对组合公式中的系数进行了调整。最后使用了灰色关联逼近理想解方法,对测试用例进行评价。
本文设计并实现了一个测试用例评价工具,并通过大量实验,验证了评价模型的有效性。
As a key step in software quality assurance, software testing is an important part in the software life cycle. According to Boehm's statistics, the cost of testing is about 30% to 50% of the total cost of software development. Therefore, it is practical to enhance the efficiency of software testing and reduce the test cost. In recent years, with the development of reuse and component technology, granularity of reuse have enhanced greatly. The concept of component has broken through the limitations of program code, and extended the entire life cycle of software development. The test plan and test case in software testing have become an important part of software reuse. Each test case indicates a specific test scheme, which guides the implementation of the testing process, the design of test input, the evaluation of measurement baseline of test results and etc. Reuse of test cases can greatly improve the efficiency and quality of testing, while reducing the cost of testing.
As the improvement of testing, the scale of test cases is more and more huge. And the difficulty of test case reuse is also increasing. Then test case prioritization techniques have emerged as an assistant technology of test case reuse. This technique is mainly to set priority of test cases based on a certain criteria, and reuse test cases in the library according to priority. Then the speed of error detection will increase. The key problem of this technique is how to set the priority criteria of test case.
This dissertation aimes at solving the test case prioritization based on the perspective of Multi-attribute Decision. There are two important problems in the Multi-attribute Decision. One is how to set indicators and the other is how to give weight of indicator. Through analyzing the factors impact the success of test case reuse, this dissertation finds thirteen indicators for test case, including Experience,Type,Terse,Coverage,DiscNewError, ErrorRank,ErrorCount,Efficiency,Improvement,DocIntegrity,ReuseDegree,Independence and Credit. We give the combinational weight of indicators using the Triangular Fuzzy Number AHP and Entropy Weighting method.The weights not only stand for the experts' experience, but also show the intrinsic rules of indicators'data. At last, this dissertation evaluates the test cases using a grey correlation and similarity to ideal solution evaluation method.
A test case evaluation tool was designed and implemented. Finally, large numbers of experiments are executed to validate the effectiveness of this evaluation model.
引文
[1]杨芙清,梅宏,李克勤.软件复用与软件构件技术[J].电子学报,1999,27(2)：68-75
[2]Sommerville L.Software Engineering[M],8th Edition. Boston:Addison Wesley,2006
[3]Pressman Roger S.Software Engineering:A Practitioner's Approach[M],6th Edition.New York:McGraw-Hill,2004
[4]Kozaczynski W, Booch G.Component-Based Software Engineering.IEEE Software, 1998,15(5):34-36
[5]Will Tracz. Confessions of a used program salesman:institutionalizing software reuse [M]. Addison-Wesley Publishing Co, New York, NY, April 1995
[6]郑人杰.计算机软件测试技术[M].北京：清华大学出版社,1992,12
[7]G.J.Myers,王峰,陈杰译.The Art of Software Testing (second Edition) [M].机械工业出版社,2006
[8]Beizer B. Software testing and quality assurance[M]. New York:International Thomson Computer Press,1996
[9]单锦辉,高友峰,张路等.一种新的变异测试数据自动生成方法[J].计算机学报,2008,31(6)：1025-1034
[10]毛澄映,卢炎生.构件软件回归测试用例选择策略[J].计算机研究与发展,2006,43(10)：1767-1774
[11]M.J.Harrold, L.Donglin. An Approach to Analyzing and Testing Component-based Systems. In:proc First International ICSE Workshop on Testing D istrib-uted Component-based Systems,1999,134-140
[12]M.J.Harrold, R Gupta, M.L Soffa. A Methodology for Controlling the Size of a Test Suit. ACM Trans. Software Eng and Methods,1993,2(3):270-285
[13]Schach S. Software engineering[M]. Boston, MA:Aksen Associates,1992
[14]Leung H K N, White L J. Insights into regression testing [C], Proceedings of the International Conference on Software Maintenance,1989:60-69
[15]Rothermel G, Harrold M J. A safe, efficient regression test selection technique [J].ACM Transactions on Software Engineering and Methodology,1997,6(2):173-210
[16]Chen T Y, Lau M F. On the divide-and-conquer approach towards test suite reduction [J].Journal of Information Sciences,2003,152(1):89-119.
[17]Wong W E, Horgan J R, London S, et, al. A study of effective regression testing in practice[C], Proceedings of IEEE International Symposium on Software Reliability Engineering, May,2002:119-129
[18]屈波,聂长海,徐宝文.回归测试中测试用例优先级技术研究综述[J].计算机科学与探索,2009,3(3)：225-233
[19]Wrong W E, Horgan J R, London S, et al. A study of effective regression testing in practice[C]//Proceedings of IEEE International Symposium on Software Reliability Engineering,1997:264-274
[20]Elbaum S, Malishevsky A G, Rothermel G. Prioritizing test cases for regression testing. Proceedings of the International Symposium on Software Testing and Analysis. Portland, Oregon,2000:102-112
[21]Rothermel G, Untch R H, Chu Cheng Yun, Harrold M J.Prioritizing test cases for regression testing. IEEE Transactions on Software Engineering,2001,27(10):929-948
[22]Kim J M, porter A. A History-Based Test Prioritization Technique for Regression Testing in Resource Constrained Environments. Proceedings of the 24 International Conference on Software Enginering. Orlando, Florida,2002:119-129
[23]Jeffrey D, Gupta N. Test case prioritization using relevant slices[C]//Proceedings of Computer Software and Applications Conference,2006:411-420
[24]Srivastava A, Thiagarajan J. Effectively prioritizing tests in development environment [C]//Proceedings of the International Symposium on Software Testing and Analysis, 2002:97-106
[25]Jones J, harrold M J. Test-suite reduction and prioritization for modified Condition /decision coverage[C]//Proceedings of the Workshop on Domain Specific Approaches to Test Automation,2007:1-7
[26]Walcott K, Soffa M, Kapfhammer G, Roos R. Time-aware test suite prioritization[C], Proceedings of the International Symposium on Software Testing and Analysis,2006:1-12
[27]Korel B, Tahat L H, Harman M. Test prioritization using system models[C], Proceedings of the International Conference on Software Maintenance,2005:559-568
[28]Korel B,koutsogiannakis G, Tahat L. Model-based test prioritization heuristic methods and their evaluation[C], Proceedings of the 3rd International Workshop on Advances in Model-based Testing,2007:34-43
[29]Srikanth H. Requirements-based test case prioritization[C], Student Research Forum in 12th ACM SIGSOFT Internation Symposium on the Foundations of Software Engineering, 2004
[30]Srikanth H, Williams L. On the economics of requirements-based test case prioritization[C], Proceedings of the International Workshop on Economics-driven Software Engineering Research,2005:1-3
[31]Tonella P,Avesani p, Susi A. Using the case-based ranking methodology for test case prioritization[C], Proceedings of the International Conference on Software Maintenance, 2006:123-133
[32]朱海燕,范辉等.测试用例排序研究[J].计算机工程与科学,2008,30(1)：79-81
[33]屈波,聂长海,徐宝文.基于测试用例设计信息的回归测试优先级算法[J].计算机学报,2008 31(3)：431-439
[34]Qu B, Nie C, Xu B, et al. Test case prioritization for black box testing[C], Proceedings of the International Computer Software and Applications Conference,2007:465-474
[35]方菲,孙家骗,王立福,杨芙清.面向对象软件回归测试技术研究[J].软件学报,2007,12(3)：372-376
[36]Roger S. Pressman著,梅宏译.软件工程,机械工业出版社,2002
[37]尚冬娟,郝克刚,葛玮,李海军.软件测试中的测试用例及复用研究[J].计算机技术与发展,16(1)：69-72
[38]徐仁佐,陈斌,陈波.构造面向对象软件可复用测试用例的模式研究[J].武汉大学理工学报,2003,49(5)：592-5931
[39]张江河.测试用例复用研究：[硕士学位论文].西安：西北工业大学,2005,6
[40]杨宇.多指标综合评价中赋权方法评析[J].统计与决策,2006,(7)：16-18
[41]岳超源.决策理论与决策方法.北京：科学出版社,2003
[42]刘树林,邱莞华.多属性决策基础理论研究[J].系统工程理论与实践.1998,18(1)：38-43
[43]苏志欣.加权灰色关联理想解法在多属性决策中的应用研究：[硕士学位论文].成都：成都理工大学,2007,5
[44]Satty T L. The Analysis of Hierarchy Process[M]. New York:McMraw-Hill,1980
[45]吕镇邦,周波.基于WOWA-FAHP的网络安全态势评估[J].计算机科学,2009,36(7)：63-67
[46]石为人,李渊,邓春光等.基于AHP的水环境安全风险评估模型设计及实现[J].仪器仪表学报,2009,(5)：1009-1013
[47]谢祥俊,邱全锋,鲁柳利.油藏经营管理综合评价的层次分析方法[J].西南石油大学学报,2009,31(3)：150-153
[48]周巍,夏国平,颜宁.基于WGA的导弹武器系统效能多目标评估[J].北京航空航天大学学报,2008,34(10)：1232-1235
[49]黄帅,盂友新,张瑞全.中小型生产企业供应商选择策略[J].计算机工程,2009,35(12)：64-66,69
[50]肖峻,罗凤章,王成山等.区间层次分析法权重计算中的概率分布分析[J].天津大学学报,2005,38(3)：189-194
[51]Entani T, Ichihashi h, Tanaka H. Evaluation Method Based on interval AHP and DEA[J].Physica-verlag CEJOR,2004:25-34
[52]郭均鹏,吴育华,李汶华.基于线性规划的区间标度层次分析法[J].哈尔滨工业大学学报,2007,39(2)：334-336
[53]杨红.适应性软件体系结构评价方法研究：[博士学位论文].大连：大连理工大学,2007
[54]曾祥纪,蒋惠园.基于三角模糊数的综合评价法在互通立交方案选取中的应用[J].武汉理工大学学报(交通科学与工程版),2008,32(3)：543-546
[55]倪九派,李萍,魏朝富,等.基于AHP和熵权法赋权的区域土地开发整理潜力评价[J].农业工程学报,2009,25(5)：202-209
[56]邓聚龙.灰理论基础[M].武汉：华中科技大学出版社,2002
[57]高阳,罗军周.基于灰色关联决策算法信息安全风险评估方法[J].东南大学学报(自然科学版),2009,39(2)：225-229
[58]Pang Jinghui, Zhang Qiang. Fuzzy-TOPSIS Method with Multi-goal. Journal of Beijing Institute of Technology,2009,18(1):112-116
[59]钱省三,黄旭.基于逼近理想解法的第三方物流企业绩效评价与外包决策.上海理工大学学报,2008,30(2)：171-174
[60]董小龙,孙金标.灰色关联综合优化法评估超视距空战效能[J].飞行力学,2009,27(1)：85-88
[61]张承平.灰色逼近理想解排序算法在多目标决策中的应用：[硕士论文].成都：成都理工大学,2005
[62]练荣政.一个基于探索性软件测试理论的测试用例生成系统的研究与实现：[硕士论文].北京：北京交通大学,2008
[63]林锉云,董加礼.多目标优化的方法与理论[M].长春：吉林教育出版社,1992
[64]焦安涛.测试用例综合评价模型的研究：[硕士论文].昆明：昆明理工大学.2009.
[65]卜国峰,孙志刚,丁小良.软件测试用例的复用研究[J].四川兵工学报,2009,30(5)：124-126
[66]刘靖旭,谭跃进,蔡怀平.多属性决策中线性组合赋权法的研究[J].国防科技大学学报,2005,27(4)：121-124
[2]Sommerville L.Software Engineering[M],8th Edition. Boston:Addison Wesley,2006
[3]Pressman Roger S.Software Engineering:A Practitioner's Approach[M],6th Edition.New York:McGraw-Hill,2004
[4]Kozaczynski W, Booch G.Component-Based Software Engineering.IEEE Software, 1998,15(5):34-36
[5]Will Tracz. Confessions of a used program salesman:institutionalizing software reuse [M]. Addison-Wesley Publishing Co, New York, NY, April 1995
[6]郑人杰.计算机软件测试技术[M].北京：清华大学出版社,1992,12
[7]G.J.Myers,王峰,陈杰译.The Art of Software Testing (second Edition) [M].机械工业出版社,2006
[8]Beizer B. Software testing and quality assurance[M]. New York:International Thomson Computer Press,1996
[9]单锦辉,高友峰,张路等.一种新的变异测试数据自动生成方法[J].计算机学报,2008,31(6)：1025-1034
[10]毛澄映,卢炎生.构件软件回归测试用例选择策略[J].计算机研究与发展,2006,43(10)：1767-1774
[11]M.J.Harrold, L.Donglin. An Approach to Analyzing and Testing Component-based Systems. In:proc First International ICSE Workshop on Testing D istrib-uted Component-based Systems,1999,134-140
[12]M.J.Harrold, R Gupta, M.L Soffa. A Methodology for Controlling the Size of a Test Suit. ACM Trans. Software Eng and Methods,1993,2(3):270-285
[13]Schach S. Software engineering[M]. Boston, MA:Aksen Associates,1992
[14]Leung H K N, White L J. Insights into regression testing [C], Proceedings of the International Conference on Software Maintenance,1989:60-69
[15]Rothermel G, Harrold M J. A safe, efficient regression test selection technique [J].ACM Transactions on Software Engineering and Methodology,1997,6(2):173-210
[16]Chen T Y, Lau M F. On the divide-and-conquer approach towards test suite reduction [J].Journal of Information Sciences,2003,152(1):89-119.
[17]Wong W E, Horgan J R, London S, et, al. A study of effective regression testing in practice[C], Proceedings of IEEE International Symposium on Software Reliability Engineering, May,2002:119-129
[18]屈波,聂长海,徐宝文.回归测试中测试用例优先级技术研究综述[J].计算机科学与探索,2009,3(3)：225-233
[19]Wrong W E, Horgan J R, London S, et al. A study of effective regression testing in practice[C]//Proceedings of IEEE International Symposium on Software Reliability Engineering,1997:264-274
[20]Elbaum S, Malishevsky A G, Rothermel G. Prioritizing test cases for regression testing. Proceedings of the International Symposium on Software Testing and Analysis. Portland, Oregon,2000:102-112
[21]Rothermel G, Untch R H, Chu Cheng Yun, Harrold M J.Prioritizing test cases for regression testing. IEEE Transactions on Software Engineering,2001,27(10):929-948
[22]Kim J M, porter A. A History-Based Test Prioritization Technique for Regression Testing in Resource Constrained Environments. Proceedings of the 24 International Conference on Software Enginering. Orlando, Florida,2002:119-129
[23]Jeffrey D, Gupta N. Test case prioritization using relevant slices[C]//Proceedings of Computer Software and Applications Conference,2006:411-420
[24]Srivastava A, Thiagarajan J. Effectively prioritizing tests in development environment [C]//Proceedings of the International Symposium on Software Testing and Analysis, 2002:97-106
[25]Jones J, harrold M J. Test-suite reduction and prioritization for modified Condition /decision coverage[C]//Proceedings of the Workshop on Domain Specific Approaches to Test Automation,2007:1-7
[26]Walcott K, Soffa M, Kapfhammer G, Roos R. Time-aware test suite prioritization[C], Proceedings of the International Symposium on Software Testing and Analysis,2006:1-12
[27]Korel B, Tahat L H, Harman M. Test prioritization using system models[C], Proceedings of the International Conference on Software Maintenance,2005:559-568
[28]Korel B,koutsogiannakis G, Tahat L. Model-based test prioritization heuristic methods and their evaluation[C], Proceedings of the 3rd International Workshop on Advances in Model-based Testing,2007:34-43
[29]Srikanth H. Requirements-based test case prioritization[C], Student Research Forum in 12th ACM SIGSOFT Internation Symposium on the Foundations of Software Engineering, 2004
[30]Srikanth H, Williams L. On the economics of requirements-based test case prioritization[C], Proceedings of the International Workshop on Economics-driven Software Engineering Research,2005:1-3
[31]Tonella P,Avesani p, Susi A. Using the case-based ranking methodology for test case prioritization[C], Proceedings of the International Conference on Software Maintenance, 2006:123-133
[32]朱海燕,范辉等.测试用例排序研究[J].计算机工程与科学,2008,30(1)：79-81
[33]屈波,聂长海,徐宝文.基于测试用例设计信息的回归测试优先级算法[J].计算机学报,2008 31(3)：431-439
[34]Qu B, Nie C, Xu B, et al. Test case prioritization for black box testing[C], Proceedings of the International Computer Software and Applications Conference,2007:465-474
[35]方菲,孙家骗,王立福,杨芙清.面向对象软件回归测试技术研究[J].软件学报,2007,12(3)：372-376
[36]Roger S. Pressman著,梅宏译.软件工程,机械工业出版社,2002
[37]尚冬娟,郝克刚,葛玮,李海军.软件测试中的测试用例及复用研究[J].计算机技术与发展,16(1)：69-72
[38]徐仁佐,陈斌,陈波.构造面向对象软件可复用测试用例的模式研究[J].武汉大学理工学报,2003,49(5)：592-5931
[39]张江河.测试用例复用研究：[硕士学位论文].西安：西北工业大学,2005,6
[40]杨宇.多指标综合评价中赋权方法评析[J].统计与决策,2006,(7)：16-18
[41]岳超源.决策理论与决策方法.北京：科学出版社,2003
[42]刘树林,邱莞华.多属性决策基础理论研究[J].系统工程理论与实践.1998,18(1)：38-43
[43]苏志欣.加权灰色关联理想解法在多属性决策中的应用研究：[硕士学位论文].成都：成都理工大学,2007,5
[44]Satty T L. The Analysis of Hierarchy Process[M]. New York:McMraw-Hill,1980
[45]吕镇邦,周波.基于WOWA-FAHP的网络安全态势评估[J].计算机科学,2009,36(7)：63-67
[46]石为人,李渊,邓春光等.基于AHP的水环境安全风险评估模型设计及实现[J].仪器仪表学报,2009,(5)：1009-1013
[47]谢祥俊,邱全锋,鲁柳利.油藏经营管理综合评价的层次分析方法[J].西南石油大学学报,2009,31(3)：150-153
[48]周巍,夏国平,颜宁.基于WGA的导弹武器系统效能多目标评估[J].北京航空航天大学学报,2008,34(10)：1232-1235
[49]黄帅,盂友新,张瑞全.中小型生产企业供应商选择策略[J].计算机工程,2009,35(12)：64-66,69
[50]肖峻,罗凤章,王成山等.区间层次分析法权重计算中的概率分布分析[J].天津大学学报,2005,38(3)：189-194
[51]Entani T, Ichihashi h, Tanaka H. Evaluation Method Based on interval AHP and DEA[J].Physica-verlag CEJOR,2004:25-34
[52]郭均鹏,吴育华,李汶华.基于线性规划的区间标度层次分析法[J].哈尔滨工业大学学报,2007,39(2)：334-336
[53]杨红.适应性软件体系结构评价方法研究：[博士学位论文].大连：大连理工大学,2007
[54]曾祥纪,蒋惠园.基于三角模糊数的综合评价法在互通立交方案选取中的应用[J].武汉理工大学学报(交通科学与工程版),2008,32(3)：543-546
[55]倪九派,李萍,魏朝富,等.基于AHP和熵权法赋权的区域土地开发整理潜力评价[J].农业工程学报,2009,25(5)：202-209
[56]邓聚龙.灰理论基础[M].武汉：华中科技大学出版社,2002
[57]高阳,罗军周.基于灰色关联决策算法信息安全风险评估方法[J].东南大学学报(自然科学版),2009,39(2)：225-229
[58]Pang Jinghui, Zhang Qiang. Fuzzy-TOPSIS Method with Multi-goal. Journal of Beijing Institute of Technology,2009,18(1):112-116
[59]钱省三,黄旭.基于逼近理想解法的第三方物流企业绩效评价与外包决策.上海理工大学学报,2008,30(2)：171-174
[60]董小龙,孙金标.灰色关联综合优化法评估超视距空战效能[J].飞行力学,2009,27(1)：85-88
[61]张承平.灰色逼近理想解排序算法在多目标决策中的应用：[硕士论文].成都：成都理工大学,2005
[62]练荣政.一个基于探索性软件测试理论的测试用例生成系统的研究与实现：[硕士论文].北京：北京交通大学,2008
[63]林锉云,董加礼.多目标优化的方法与理论[M].长春：吉林教育出版社,1992
[64]焦安涛.测试用例综合评价模型的研究：[硕士论文].昆明：昆明理工大学.2009.
[65]卜国峰,孙志刚,丁小良.软件测试用例的复用研究[J].四川兵工学报,2009,30(5)：124-126
[66]刘靖旭,谭跃进,蔡怀平.多属性决策中线性组合赋权法的研究[J].国防科技大学学报,2005,27(4)：121-124