Testability Guidance Using a Process Modeling
- 1 Department of Computer Science, College of Science, Sultan Qaboos University, Muscat, Oman
- 2 Department of Computer Science, College of Science, Sultan Qaboos University, Muscat, Oman
Abstract
Software testability took a lot of interests of software community. Indeed, this concept has been interpreted in a variety of ways. One interpretation is concerned with the extent of the modifications a program component requires, so that the entire behavior of the component is observable and controllable. Another interpretation is the ease with which faults, if present in a program, can be revealed and estimated by the testing process and the propagation, infection and execution (PIE) model. It has been suggested that this particular interpretation of testability might be linked with two concepts: 1 ) the metric domain-to-range ratio (DRR), i.e. the ratio of the cardinality of the set of all inputs (the domain) to the cardinality of the set of all outputs (the range) and 2 ) the semantic fault size. First, this paper describes the connections between 1 ) the domain-to-range ratio and the observability and controllability aspects of testability and 2 ) the PIE model and fault size. The main goal of the work described here, is to seek greater understanding of testability in general and, ultimately, to find easier ways of determining it. Second, in this paper we try to model the PIE estimation using formalism for process representation system which is MAP formalism. We also use this process model to elaborate and to present the relationship between testability, PIE, DRR and fault size. Our aim is to enhance the guidance mechanisms of the process execution. After clarifying the existing relationship between semantic fault and testability, we improve the MAP model by adding qualitative criteria. We then offer a way to express maps to offer an automatic guidance of the map.
- R. Bache and M. Müllerburg, “Measures of Testability as a Basis for Quality Assurance,” Software Engineering Journal, Vol. 5, No. 2, 1990, pp. 86-92. http://dx.doi.org/10.1049/sej.1990.0011
- J. Bainbridge, “Defining Testability Metrics Axiomatically,” Software Testing, Verification and Reliability, Vol. 4, No. 2, 1994, pp. 63-80. http://dx.doi.org/10.1002/stvr.4370040203
- A. Bertolino and L. Strigini, “On the Use of Testability Measures for Dependability Assessment,” IEEE Transactions on Software Engineering, Vol. 22, No. 2, 1996, pp. 97-108.
- B. W. Boehm, J. R. Brown and M. Lipow, “Quantitative Evaluation of Software Quality,” Proceedings of 2nd International Conference on Software Engineering, San Francisco, IEEE Press, 1976, pp. 592-605.
- R. S. Freedman, “Testability of Software Components,” IEEE Transactions on Software Engineering, Vol. 17, No. 6, 1991, pp. 553-564.
- J. M. Voas, L. J. Morell and K. W. Miller, “Predicting Where Faults Can Hide from Testing,” IEEE Software, Vol. 8, No. 2, 1991, pp. 41-48. http://dx.doi.org/10.1109/52.73748
- J. Gao, J. Tsao and Y. Wu, “Testing and Quality Assurance for Component-Based Software,” Artech House, 2005.
- N. Kazuteru, “Delay Fault Testability on Two-Rail Logic Circuits,” Proceeding of the Defect and Fault Tolerance of VLSI Systems, DFTVS ‘08. IEEE International Symposium, Boston, 1-3 October, 2008, pp. 482-490.
- J. M. Voas, “PIE: A Dynamic Failure-Based Technique,” IEEE Transactions on Software Engineering, Vol. 18, No. 8, 1992, pp. 717-727.
- M. R. Woodward and Z. A. Al-Khanjari, “Testability, Fault Size and the Domain-to-Range Ratio: An Eternal Triangle,” Software Engineering Notes, Vol. 25, No. 5, 2000, pp. 168-172. http://dx.doi.org/10.1145/347636.349016
- J. M. Voas and K. W. Miller, “Semantic Metrics for Software Testability,” The Journal of Systems and Software, Vol. 20, No. 3, 1993, pp. 207-216. http://dx.doi.org/10.1016/0164-1212(93)90064-5
- M. R. Woodward and Z. A. Khanjari, “Testability, Fault Size and the Domain-to-Range Ratio: An Eternal Triangle,” Proceedings of the ACM SIGSOFT International symposium on Software Testing and Analysis, Vol. 25, No. 5, 2000. pp. 168-172.
- A. J. Offutt and J. H. Hayes, “A Semantic Model of Program Faults,” Proc. Int. Symp. on Software Testing and Analysis ISSTA ’96, San Diego, ACM Press, 1996, pp. 195-200.