Test software quality issues and connections to international standards

Attila Kovács; Kristóf Szabados

doi:10.2478/ausi-2014-0006

Abstract

This paper examines how ISO/IEC 9126-1 and ISO/IEC 25010 quality models can be applied to software testing products in industrial environment. We present a set of code smells for test systems written in TTCN-3 and their categorization according to quality model standards. We demonstrate our measurements on industrial and ETSI projects, and provide a method for estimating their effects on product risks in current projects.

References

[1] A. Bánsághi, B. G. ézsiás, A. Kovács, A. Tátrai, Source Code Scanners in Software Quality Management and Connections to International Standards, Annales Univ. Sci. Budapest. Sect. Comput., 37 (2012) 81-92. →79, 80
Search in Google Scholar
[2] B. W. Boehm, Ph. N. Papaccio, Understanding and Controlling Software Costs, IEEE Transactions on Software Engineering, 14, 10 (1988) 1462-1477. →78
Search in Google Scholar
[3] Checkstyle, http://checkstyle.sourceforger.net →84
Search in Google Scholar
[4] CMMI institute, http://cmmiinstitute.com/ →78
Search in Google Scholar
[5] ETSI ES 201 873-1 v4.5.1: Methods for Testing and Specification (MTS), The Testing and Test Control Notation version 3; Part 1: TTCN-3 Core Language. →85
Search in Google Scholar
[6] FindBugs, http://findbugs.sourceforge.net →84
Search in Google Scholar
[7] M. Fowler, Refactoring, Improving the Design of Existing Code, Addison-Wesley, 1999. →84
Search in Google Scholar
[8] FxCop, http://msdn.microsoft.com →80, 84
Search in Google Scholar
[9] S. Herbold, J. Grabovszki, S. Waack, Calculation and Optimization of Thresholds for Sets of Software Metrics. Empirical Software Engineering, Springer, Netherlands, May 2011. →94[10] W. S. Humphrey, The Team Software Process, (2000) Technical Report, CMU/SEI-2000-TR-023, ESC-TR-2000-023 →78
Search in Google Scholar
[11] ISO/IEC 9126:1991, ISO Standard for Software Engineering - Product Quality Revised by ISO/IEC 9126-1:2001. →78, 81
Search in Google Scholar
[12] ISO/IEC 9126-1:2001: ISO Standard for Software Engineering - Product Quality - Part 1: Quality Model. →81
Search in Google Scholar
[13] ISO/IEC TR 9126-2:2003: ISO Standard for Software Engineering - Product Quality - Part 2: External Metrics. →81
Search in Google Scholar
[14] ISO/IEC TR 9126-3:2003: ISO Standard for Software Engineering - Product Quality - Part 3: Internal Metrics. →81
Search in Google Scholar
[15] ISO/IEC TR 9126-4:2004: ISO Standard for Software Engineering - Product Quality - Part 4: Quality in Use Metrics. →81
Search in Google Scholar
[16] ISO/IEC 25010:2011: ISO Systems and Software Engineering - Systems and Software Quality Requirements and Evaluation (SQuaRE) - System and Software Quality Models. →78, 81
Search in Google Scholar
[17] S. H. Kan, Metrics and Models in Software Quality Engineering, Addison- Wesley, Boston, 2003. →80
Search in Google Scholar
[18] F. Khomh, M. Di Penta, Y-G. Gueheneuc, An Exploratory Study of the Impact of Code Smells on Software Change-proneness, Proc. 16th Working Conference on Reverse Engineering, 2009, pp. 75-84. →9410.1109/WCRE.2009.28
Search in Google Scholar
[19] W. Li, R. Shatnawi, An empirical study of the bad smells and class error probability in the post-release object-oriented system evolution, Systems and Software 80, 7 (2007) 1120-1128. →9410.1016/j.jss.2006.10.018
Search in Google Scholar
[20] G. Meszaros, xUnit Test Patterns: Refactoring Test Code, Addison-Wesley Professional, 2007. →84
Search in Google Scholar
[21] A. Monden, D. Nakae, T. Kamiya, S. Sato, K. Matsumoto, Software quality analysis by code clones in industrial legacy software, Symposium on Software Metrics, 2002, pp. 87-94. →94
Search in Google Scholar
[22] H. Neukirchen, B. Zeiss, J. Grabovszki, An approach to quality engineering of TTCN-3 test specifications, International Journal on Software Tools for Technology Transfer (STTT), 10, 4 (2008) 309-326. →8510.1007/s10009-008-0075-0
Search in Google Scholar
[23] H. Neukirchen, M. Bisanz, Utilising code smells to detect quality problems in TTCN-3 test suites, Proc 19th IFIP International Conference on Testing of Communicating Systems and 7th International Workshop on Formal Approaches to Testing of Software (TestCom/FATES 2007 ), June 26-29, 2007, Tallinn, Estonia. Lecture Notes in Computer Science (LNCS) 4581, 2007 pp. 228-243. → 8510.1007/978-3-540-73066-8_16
Search in Google Scholar
[24] PMD, http://pmd.sourceforge.net →80, 84
Search in Google Scholar
[25] R. van Solingen, E. Berghout, The Goal/Question/Metric Method, a Practical Method for Quality Improvement of Software Development, McGraw-Hill, 1999. →78
Search in Google Scholar
[26] K. Szabados, Structural analysis of large TTCN-3 projects, Proc. 21st IFIP WG 6.1 International Conference on Testing of Software and Communication Systems and 9th International FATES Workshop, Lecture Notes in Computer Science 5826:, Testing of Software and Communication Systems, Springer- Verlag Berlin, Heidelberg, 2009 pp. 241-246. →8010.1007/978-3-642-05031-2_19
Search in Google Scholar
[27] The Personal Software Process (PSP) Body of Knowledge, Version 2.0; Special Report; CMU/SEI-2009-SR-018 →78
Search in Google Scholar
[28] TRex, http://www.trex.informatik.uni-goettingen.de/trac →84
Search in Google Scholar
[29] B. Zeiss, D. Vega, I. Schiferdecker, H. Neukirchen, J. Grabovszki, Applying the ISO 9126 Quality Model to Test Specifications - Exemplified for TTCN-3 Test Specifictions, Software Engineering, Lecture Notes in Informatics (LNI) 105, 2007, pp. 231-242. Gesellschaft für Informatik, K¨ollen Verlag, Bonn, →79
Search in Google Scholar
[30] M. Zhang, T. Hall, N. Baddoo, Code Bad Smells: a review of current knowledge, J. Softw. Maint. Evol.: Research and Practice 23, 3 (2011) 179-202. →93 10.1002/smr.521
Search in Google Scholar

Test software quality issues and connections to international standards

Abstract

Paradigm

My account