The ISBSG Software Project Repository: An Analysis from Six Sigma Measurement Perspective for Software Defect Estimation
- 1 École de Technologie Supérieure, Université du Québec, Montréal, Canada
- 2 École de Technologie Supérieure, Université du Québec, Montréal, Canada
Abstract
The International Software Benchmarking Standards Group (ISBSG) provides to researchers and practitioners a repository of software projects’ data that has been used to date mostly for benchmarking and project estimation purposes, but rarely for software defects analysis. Sigma , in statistics, measures how far a process deviates from its goal. Six Sigma focuses on reducing variations within processes, because such variations may lead to an inconsistency in achieving projects’ specifications which represent “defects”, which mean not meeting customers’ satisfaction. Six Sigma provides two methodologies to solve organizations’ problems: “Define-Measure-Analyze-Improve-Control” process cycle (DMAIC) and Design of Six Sigma (DFSS). The DMAIC focuses on improving the existed processes, while the DFSS focuses on redesigning the existing processes and developing new processes. This paper presents an approach to provide an analysis of ISBSG repository based on Six Sigma measurements. It investigates the use of the ISBSG data repository with some of the related Six Sigma measurement aspects, including Sigma defect measurement and software defect estimation. This study presents the dataset preparation consisting of two levels of data preparations, and then analyzed the quality-related data fields in the ISBSG MS-Excel data extract (Release 12 - 2013). It also presents an analysis of the extracted dataset of software projects. This study has found that the ISBSG MS-Excel data extract has a high ratio of missing data within the data fields of “Total Number of Defects” variable, which represents a serious challenge when the ISBSG dataset is being used for software defect estimation.
- Tonini, A.C., Spinola, M.D.M. and Laurindo, F.J.B. (2006) Six Sigma and Software Development Process: Dmaic Improvements. Technology Management for the Global Future, 6, 2815-2823. https://doi.org/10.1109/picmet.2006.296875
- Nanda, V. and Robinson, J. (2011) Six Sigma Software Quality Improvement. McGraw-Hill Education, New York.
- Wang, H. (2008) A Review of Six Sigma Approach: Methodology, Implementation and Future Research. Wireless Communications, Networking and Mobile Computing, Volume 1-4. https://doi.org/10.1109/wicom.2008.1887
- Feng, Q. (2008) Six Sigma: Continuous Improvement toward Excellence, in Collaborative Engineering. Springer, New York, 43-60. https://doi.org/10.1007/978-0-387-47321-5_3
- Antony, J. and Fergusson, C. (2004) Six Sigma in the Software Industry: Results from a Pilot Study. Managerial Auditing Journal, 19, 1025-1032. https://doi.org/10.1108/02686900410557926
- Teng, S.J. (2008) The Pros and Cons of Six Sigma Quality Management. Proceedings of International Conference on Advanced Information Technologies, Hanoi, 6-9 October 2008, 1-10.
- Al-Qutaish, R.E. and Al-Sarayreh, K.T. (2008) Applying Six-Sigma Concepts to the Software Engineering: Myths and Facts. Proceedings of the 7th International Conference on Software Engineering Parallel and Distributed Systems, Cambridge, 20-22 February 2008, 178-183.
- Hong, G. and Goh, T. (2003) Six Sigma in Software Quality. The TQM Magazine, 15, 364-373. https://doi.org/10.1108/09544780310502697
- Pan, Z., et al. (2007) A Six Sigma Framework for Software Process Improvements and Its Implementation. Proceedings of 14th Asia-Pacific Software Engineering Conference, 4-7 December 2007, 446-453. https://doi.org/10.1109/aspec.2007.43
- Motorola (2011) Free Six Sigma Lessons. http://web.archive.org/web/20051107013618/http://www.motorola.com/content /0,,3069-5787,00.html#
- Murugappan, M. and Keeni, G. (2000) Quality Improvement-The Six Sigma Way. Quality Software 2000 Proceedings of First Asia-Pacific Conference on IEEE, Hong Kong, 30-31 October 2000, 248-257. https://doi.org/10.1109/apaq.2000.883798
- Mahanti, R. and Antony, J. (2009) Six Sigma in the Indian Software Industry: Some Observations and Results from a Pilot Survey. The TQM Journal, 21, 549-564. https://doi.org/10.1108/17542730910995837
- International Software Benchmarking Standards Group (2013) ISBSG Development and Enhancement Repository R12. International Software Benchmarking Standards Group, Australia.