统计方法在软件测试中的研究与实现
|
摘要
软件测试是软件工程的一个重要阶段,也是保证软件质量的重要手段,占用了软件开发过程中大量资源,然而软件测试却缺乏较好的理论基础,测试用例的选择往往是根据测试人员经验做出的,充满了个人的色彩和主观性。从而造成了软件质量不符合用户需求,降低客户对软件质量满意度的结果。
本文提出的基于统计方法的软件测试方法,是能生成具备一定充分性的测试用例的方法,是更适合软件工程实践的测试方法。该方法根据用户对软件的使用方式展开,对使用频繁的操作会进行更多的测试,因此可以有效地发现那些对软件可靠性影响较大的错误。统计测试首先构造出软件的马尔科夫链使用模型,根据该使用模型生成测试用例,实施测试后按照统计学模型对测试结果进行分析,从而评价软件可靠性和质量。鉴于关软件可靠性测试用例充分性准则的研究较少,本文提出了如何判断测试用例充分性的新方法。
在研究基于统计方法的软件测试基础上,本文设计实现了一个基于马尔科夫链模型的统计测试工具“MBCGA”,它实现了构建软件马尔科夫链使用模型,参数分析,生成测试用例,分析测试用例等功能,帮助测试人员生成具备充分性的测试用例,为测试人员提供了一个实用、易操作的基于统计方法进行软件测试的辅助工具。
利用统计测试工具“MBCGA”对车辆动力舱计算机辅助布局设计系统进行测试。更好地验证了基于统计方法的软件测试是一种有效加高效的测试方法,是成功的基于模型的软件测试,可以很好的用于软件可靠性评估与预测。
Software testing is an important stage of software engineering, it's also an important instrument to ensure software's quality.Software testing costs so much resource, but it lacks of great theory base. The testcases are always chosen by testers' experience, and also full of individual idea and subjectivity. So it results in that the software's quality isn't according to users' standard, and it reduces users' degree of satisfaction about the software's quality.
This paper proposes a software testing method based on statistical. It is a method that can generate sufficient testcases, and it is also a method more fit for software practice. This method bases on the users' using mode, and pays more attention to frequent operation, so it's effective to find the mistakes that own much more influence. Statistical testing constructs software's Markov chain usage model firstly, generates testcases according to usage model, analyses the test result according to statistical model after test the software, then evaluate the software's reliability and quality. Rule of judging adequate testcase about software's reliability is deficient, so this paper proposes a new method that can generate sufficient testcases.
With the basis of statistical testing theory, this dissertation designs and develops a statistical testing tool "MBCGA" based on Markov chain, it supports Markov chain usage model building, parameters analysis, test cases generation and analysis and so on. It helps testers to get testcases own strong sufficiency. It provides to testers an applied, easy-manipulative test tool based on statistical method.
Using statistical testing tool "MBCGA" to test Vehicle engine compartment computer aided layout design system can validate software testing based on statistical method is a test method with strong availability. And it's a successful software test based on model, so it can evaluate and forecast the software's reliability.
本文提出的基于统计方法的软件测试方法,是能生成具备一定充分性的测试用例的方法,是更适合软件工程实践的测试方法。该方法根据用户对软件的使用方式展开,对使用频繁的操作会进行更多的测试,因此可以有效地发现那些对软件可靠性影响较大的错误。统计测试首先构造出软件的马尔科夫链使用模型,根据该使用模型生成测试用例,实施测试后按照统计学模型对测试结果进行分析,从而评价软件可靠性和质量。鉴于关软件可靠性测试用例充分性准则的研究较少,本文提出了如何判断测试用例充分性的新方法。
在研究基于统计方法的软件测试基础上,本文设计实现了一个基于马尔科夫链模型的统计测试工具“MBCGA”,它实现了构建软件马尔科夫链使用模型,参数分析,生成测试用例,分析测试用例等功能,帮助测试人员生成具备充分性的测试用例,为测试人员提供了一个实用、易操作的基于统计方法进行软件测试的辅助工具。
利用统计测试工具“MBCGA”对车辆动力舱计算机辅助布局设计系统进行测试。更好地验证了基于统计方法的软件测试是一种有效加高效的测试方法,是成功的基于模型的软件测试,可以很好的用于软件可靠性评估与预测。
Software testing is an important stage of software engineering, it's also an important instrument to ensure software's quality.Software testing costs so much resource, but it lacks of great theory base. The testcases are always chosen by testers' experience, and also full of individual idea and subjectivity. So it results in that the software's quality isn't according to users' standard, and it reduces users' degree of satisfaction about the software's quality.
This paper proposes a software testing method based on statistical. It is a method that can generate sufficient testcases, and it is also a method more fit for software practice. This method bases on the users' using mode, and pays more attention to frequent operation, so it's effective to find the mistakes that own much more influence. Statistical testing constructs software's Markov chain usage model firstly, generates testcases according to usage model, analyses the test result according to statistical model after test the software, then evaluate the software's reliability and quality. Rule of judging adequate testcase about software's reliability is deficient, so this paper proposes a new method that can generate sufficient testcases.
With the basis of statistical testing theory, this dissertation designs and develops a statistical testing tool "MBCGA" based on Markov chain, it supports Markov chain usage model building, parameters analysis, test cases generation and analysis and so on. It helps testers to get testcases own strong sufficiency. It provides to testers an applied, easy-manipulative test tool based on statistical method.
Using statistical testing tool "MBCGA" to test Vehicle engine compartment computer aided layout design system can validate software testing based on statistical method is a test method with strong availability. And it's a successful software test based on model, so it can evaluate and forecast the software's reliability.
引文
[1]尹成义,张志华。软件统计测试的比较和改进。运筹与管理。2004,6。13(3)。107-108。
[2]Musa J D.Introduction to Software Reliability and Testing,Software Reliability Engineering Case Studies[C].Proceedings of the 8~(th)International Symposium on Software Reliability and Testing Course.USA.1997.3-12.
[3]Winfried Dulz,Fenhua Zhen.MaTeLo-Statistical Usage Testing by Annotated Sequence Diagrams,Markov Chains and TTCN.IEEE.3.2003
[4]James A.Whittaker and Michael G.Thomason,A Markov chain model for statistical software Testing.IEEE Transaction.Oct 1994
[5]Gemoets,Leopoldo.When to stop testing software? A fuzzy interval approach:IEEE Proc 1994.I int Jt ConfNAFIPS IFIS NASA.1994.182-186
[6]朱鸿,金凌紫。软件质量保障与测试。科学出版社。1997。79-80。
[7](美)STACY J.PROWELL CARMEN J.TRAMMELL RICHARD C.LINGER JESSE H.POORE。贲可荣,张志祥,张秀山等译。净室软件工程:技术与过程。电子工业出版社。2001。3-8,63-67。
[8]盛骤,谢式千。概率论与数理统计[M]。北京。高等教育出版社。1989。6。
[9]沈宏。基于用例和日志的Web统计测试。上海。上海师范大学。2004。4-5。
[10]Whittaker J A,Thomason M G.A Markov chain model for statistical software testing.IEEE Transactions on Software Engineering,1994,20(10):812-824.
[11]James A.Whittaker,Jesse H.Poore.Markov analysis of software specifications.ACM Transactions on Software Engineering and Methodology.1993.2(1).93-106.
[12]高海昌,冯博琴,曾明,贺晓红。基于Markov链路径使用模型的软件统计测试。计算机工程。32(19)。20-21。
[13]Poore J H,Trammell C J.Application of Statistical Science to Testing and Evaluating Software Intensive Systems,in Statistics,Testing,and Defense Acquistion[M].Washington,D.C.National Academy Press.1998.40-57.
[14]Prowell S J,Trammell C J,Linger R C,et al.Cleanroom software engineering:technology and process[M].Addison-Wesley Professional:Carnegie Mellon University.1998.56-82.
[15]HaflanD.Mills,Michael Dyer,and Richard C.Linger.Cleanroom Software Engineering.IEEE Software vol.4.September 1987.19-87.
[16]范为。基于马尔科夫链使用模型的软件统计测试。南京。河海大学。2007。10-14。
[17]J.A.Whittaker,J.H.Poore.Markov analysis of software specifications[J].ACM Transactions on Software Engineering and Methodology.1993,2(1).93-106.
[18]J.A.whittaker,J.H.Poore.Statistical testing for Cleanroom Software Engineering[A].Proeeedings of the Hawaii Intemational Conference on Systems Science,IEEE ComPuter Society Press.1992.428-436.
[19]冯华。基于净室软件工程统计测试的CASE工具的研究与实现。长沙。国防科学技术大学。27-37。
[20]Kullback S.Information Theory and Statistics[M].New York.Wiley.1958.10-83.
[21]Sayre K,Poore J H.Stopping Criteria for Statistical Testing[J].Information and Software Technology.2000.12 (42).851-857.
[22] Prowell S J.Computations for Markov Chain Usage Models.Software Quality Research Laboratory.
[23]Whittaker J A,Thomason M G.A Markov Chain Model for Statistical Software Testing IEEE, 1994.
[2]Musa J D.Introduction to Software Reliability and Testing,Software Reliability Engineering Case Studies[C].Proceedings of the 8~(th)International Symposium on Software Reliability and Testing Course.USA.1997.3-12.
[3]Winfried Dulz,Fenhua Zhen.MaTeLo-Statistical Usage Testing by Annotated Sequence Diagrams,Markov Chains and TTCN.IEEE.3.2003
[4]James A.Whittaker and Michael G.Thomason,A Markov chain model for statistical software Testing.IEEE Transaction.Oct 1994
[5]Gemoets,Leopoldo.When to stop testing software? A fuzzy interval approach:IEEE Proc 1994.I int Jt ConfNAFIPS IFIS NASA.1994.182-186
[6]朱鸿,金凌紫。软件质量保障与测试。科学出版社。1997。79-80。
[7](美)STACY J.PROWELL CARMEN J.TRAMMELL RICHARD C.LINGER JESSE H.POORE。贲可荣,张志祥,张秀山等译。净室软件工程:技术与过程。电子工业出版社。2001。3-8,63-67。
[8]盛骤,谢式千。概率论与数理统计[M]。北京。高等教育出版社。1989。6。
[9]沈宏。基于用例和日志的Web统计测试。上海。上海师范大学。2004。4-5。
[10]Whittaker J A,Thomason M G.A Markov chain model for statistical software testing.IEEE Transactions on Software Engineering,1994,20(10):812-824.
[11]James A.Whittaker,Jesse H.Poore.Markov analysis of software specifications.ACM Transactions on Software Engineering and Methodology.1993.2(1).93-106.
[12]高海昌,冯博琴,曾明,贺晓红。基于Markov链路径使用模型的软件统计测试。计算机工程。32(19)。20-21。
[13]Poore J H,Trammell C J.Application of Statistical Science to Testing and Evaluating Software Intensive Systems,in Statistics,Testing,and Defense Acquistion[M].Washington,D.C.National Academy Press.1998.40-57.
[14]Prowell S J,Trammell C J,Linger R C,et al.Cleanroom software engineering:technology and process[M].Addison-Wesley Professional:Carnegie Mellon University.1998.56-82.
[15]HaflanD.Mills,Michael Dyer,and Richard C.Linger.Cleanroom Software Engineering.IEEE Software vol.4.September 1987.19-87.
[16]范为。基于马尔科夫链使用模型的软件统计测试。南京。河海大学。2007。10-14。
[17]J.A.Whittaker,J.H.Poore.Markov analysis of software specifications[J].ACM Transactions on Software Engineering and Methodology.1993,2(1).93-106.
[18]J.A.whittaker,J.H.Poore.Statistical testing for Cleanroom Software Engineering[A].Proeeedings of the Hawaii Intemational Conference on Systems Science,IEEE ComPuter Society Press.1992.428-436.
[19]冯华。基于净室软件工程统计测试的CASE工具的研究与实现。长沙。国防科学技术大学。27-37。
[20]Kullback S.Information Theory and Statistics[M].New York.Wiley.1958.10-83.
[21]Sayre K,Poore J H.Stopping Criteria for Statistical Testing[J].Information and Software Technology.2000.12 (42).851-857.
[22] Prowell S J.Computations for Markov Chain Usage Models.Software Quality Research Laboratory.
[23]Whittaker J A,Thomason M G.A Markov Chain Model for Statistical Software Testing IEEE, 1994.
© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号 地址：北京市海淀区学院路29号 邮编：100083 电话：办公室：(+86 10)66554848；文献借阅、咨询服务、科技查新：66554700 |