This study presents a decision making process in three steps of knowledge management for test organization using process simulation and financial analysis. First, project cost assessment of test knowledge management process subjects to different project duration and number of staffs. Two knowledge management simulation models representing experienced personnel with knowledge sharing and inexperienced personnel with internal training respectively are employed to contrast test personnel capability. Second, performance evaluation of software testing process by different personnel capability is conducted to simulate system test using three project metrics, namely, duration, effort cost, and quality. Third, a comparative financial analysis is prepared to determine the best solution by return on investment, payback period, and benefit cost ratio. The results from three stages of finding are discussed to arrive at the final scenario. We provide a case study evaluating how software testing industry needs to build effective test organization with high quality personnel for sustainable development and improvement.
M. I. Kellner, R. J. Madachy and D. M. Raffo, “Software Process Simulation Modelling: Why? What? How?” Journal of Systems and Software, Vol. 46, No. 2-3, 1999, pp. 91-105. doi:10.1016/S0164-1212(99)00003-5
W. Scacchi, “Understanding Software Process Redesign using Modeling, Analysis and Simulation,” Software Process Improvement and Practice, Vol. 5, No. 2-3, 2000, pp. 183-195. doi:10.1002/1099-1670(200006/09)5:2/3 3.0.CO;2-D
W. Wakeland, S. Shervais and D. Raffo, “Heuristic Optimization as a V&V Tool for Software Process Simulation Models,” Software Process Improvement and Practice, Vol. 10, No. 3, 2005, pp. 301-309. doi:10.1002/spip.231
M. Melis, I. Turnu, A. Cau and G. Concas, “Evaluating the Impact of Test-First Programming and Pair Programming through Software Process Simulation,” Software Process Improvement and Practice, Vol. 11, No. 4, 2006, pp. 345-360. doi:10.1002/spip.286
I. Rus, J. Collofello and P. Lakey, “Software Process Simulation for Reliability Management,” International Journal of Simulation, Vol. 46, No. 2-3, 1999, pp. 173-182.
D. M. Raffo and W. Wakeland, “Moving Up the CMMI Capability and Maturity Levels Using Simulation,” Technical Report CMU/SEI-2008-TR-002, ESC-TR-2008-002, Carnegie Mellon University, Pittsburgh, 2008.
D. M. Raffo, R. Ferguson, S. Setamanit and B. Sethanandha, “Evaluating the Impact of Requirements Analysis Tools Using Simulation,” Software Process Improvement and Practice, Vol. 13, No. 1, 2008, pp. 63-73. doi:10.1002/spip.364
D. M. Raffo, J. V. Vandeville and R. H. Martin, “Software Process Simulation to Achieve Higher CMM Levels,” Journal of Systems and Software, Vol. 46, No. 2-3, 1999, pp. 163-172. doi:10.1016/S0164-1212(99)00009-6
S. Setamanit, W. Wakeland and D.M. Raffo, “Using Simulation to Evaluate Global Software Development Task Allocation Strategies,” Software Process Improvement and Practice, Vol. 12, No. 5, 2007, pp. 491-503. doi:10.1002/spip.335
R. Martin and D. Raffo, “Application of a Hybrid Process Simulation Model to a Software Development Project,” Journal of Systems and Software, Vol. 59, No. 3, 2001, pp. 237-246. doi:10.1016/S0164-1212(01)00065-6
D. X. Houston, S. Ferreira, J. S. Collofello, D. C. Montgomery, G. T. Mackulak and D. L. Shunk, “Behavioral Characterization: Finding and Using the Influential Factors in Software Process Simulation Models,” Journal of Systems and Software, Vol. 59, No. 3, 2001, pp. 259-270. doi:10.1016/S0164-1212(01)00067-X
F. Stallinger, “Software Process Simulation to Support ISO/IEC 15504 Based Software Process Improvement,” Software Process Improvement and Practice, Vol. 5, No. 2-3, 2000, pp. 197-209. doi:10.1002/1099-1670(200006/09)5:2/3 3.0.CO;2-K
S. Ferreira, J. Collofello, D. Shunk and G. Mackulak, “Understanding the Effects of Requirements Volatility in Software Engineering by Using Analytical Modeling and Software Process Simulation,” Journal of Systems and Software, Vol. 82, No. 10, 2009, pp. 1568-1577. doi:10.1016/j.jss.2009.03.014
A. Ahmed, “Software Testing as a Service,” CRC Press, Boca Raton, 2010.
G. Tassey, “The Economic Impacts of Inadequate Infrastructure for Software Testing,” Technical Report, NIST, 2002.
C. Kaner, J. L. Falk and H. Q. Nguyen, “Testing Computer Software,” 2nd Edition, John Wiley & Sons, New York, 1999.
E. Dustin, “Effective Software Testing: 50 Specific Ways to Improve Your Testing,” John Addison-Wesley Longman Publishing, Boston, 2002.
A. M. J. Hass, “Guide to Advanced Software Testing,” Artech House, Norwood, 2008.
D. Graham, E. V. Veenendaal, I. Evans and R. Black, “Foundations of Software Testing: ISTQB Certification,” Thomson Learning, 2007.
E. J. Weyuker, T. J. Ostrand, J. Brophy and R. Prasad, “Clearing a Career Path for Software Testers,” IEEE Software, Vol. 17, No. 2, 2000, pp. 76-82. doi:10.1109/52.841696
I. Burnstein, “Practical Software Testing: A Process- Oriented Approach,” Springer Inc., New York, 2003.
T. A. Majchrzak, “Best Practices for the Organizational Implementation of Software Testing,” Proceedings of the 43th Annual Hawaii International Conference on System Sciences, Washington, 5-8 January 2010, pp. 1-10.
T. A. Majchrzak, “Improving the Technical Aspects of Software Testing in Enterprises,” International Journal of Advanced Computer Science and Applications, Vol. 1, No. 4, 2010, pp. 1-10.
L. Mathiassen and P. Pourkomeylian, “Managing Knowledge in a Software Organisation,” Journal of Knowledge Management, Vol. 7, No. 2, 2003, pp. 63-80. doi:10.1108/13673270310477298
O. Taipale, K. Karhu and K. Smolander, “Observing Software Testing Practice from the Viewpoint of Organizations and Knowledge Management,” Proceedings of the 1st International Symposium on Empirical Software Engineering and Measurement, IEEE Computer Society, Washington, 2007, pp. 21-30. doi:10.1109/ESEM.2007.18
K. Karhu, O. Taipale and K. Smolander, “Investigating the Relationship between Schedules and Knowledge Transfer in Software Testing,” Information and Software Technology, Vol. 51, No. 3, 2009, pp. 663-677. doi:10.1016/j.infsof.2008.09.001
C. F. Cohen, S. J. Birkin, M. J. Garfield and H. W. Webb, “Managing Conflict in Software Testing,” Communications of the ACM, Vol. 47, No. 1, 2004, pp. 76-81. doi:10.1145/962081.962083
C. Lovin and T. Yaptangco, “Best Practices: Enterprise Test Management,” Dell Power Solutions, 2006, pp. 37-39.
T. Parveen, S. Tilley and G. Gonzalez, “A Case Study in Test Management,” Proceedings of the 45th Annual Southeast Regional Conference, New York, 23-24 March 2007, pp. 82-87. doi:10.1145/1233341.1233357
T. Altiok and B. Melamed, “Simulation Modeling and Analysis with Arena,” Academic Press, San Diego, 2007.
W. Scacchi, “Experiences with Software Process Simulation and Modeling,” Journal of Systems and Software, Vol. 46, No. 2, 1999, pp. 183-192. doi:10.1016/S0164-1212(99)00011-4
F. Padberg, “A Discrete Simulation Model for Assessing Software Project Scheduling Policies,” Software Process Improvement and Practice, Vol. 7, No. 3-4, 2002, pp. 127-139. doi:10.1002/spip.160
K. G. Kouskouras and A. C. Georgiou, “A Discrete Event Simulation Model in the Case of Managing a Software Project,” European Journal of Operational Research, Vol. 181, No. 1, 2007, pp. 374-389. doi:10.1016/j.ejor.2006.05.031
E. M. O. Abu-Taieh and A. A. R. El Sheikh, “Commercial Simulation Packaged: A Comparative Study,” International Journal of Simulation, Vol. 8, No. 2, 2007, pp. 66-76.
A. Aurum, F. Daneshgar and J. Ward, “Investigating Knowledge Management Practices in Software Development Organizations—An Australian Experience,” Information and Software Technology, Vol. 50, No. 6, 2008, pp. 511-533. doi:10.1016/j.infsof.2007.05.005
K. Nogeste and D. Walker, “Using Knowledge Management to Revise Software-Testing Processes,” Journal of Workplace Learning, Vol. 18, No. 1, 2006, pp. 56-27. doi:10.1108/13665620610641283
C. Kerkhof, J. Ende and I. Bogenrieder, “Knowledge Management in the Professional Organization: A Model with Application to CMG Software Testing,” Knowledge and Process Management, Vol. 10, No. 2, 2003, pp. 77-84. doi:10.1002/kpm.167
T. Dingsoyr and R. Conradi, “A Survey of Case Studies of the Use of Knowledge Management in Software Engineering,” International Journal of Software Engineering and Knowledge Engineering, Vol. 12, No. 4, 2002, pp. 391-414. doi:10.1142/S0218194002000962
T. Lee, D. Baik and H. P. In, “Cost Benefit Analysis of Personal Software Process Training Program,” Proceedings of IEEE 8th International Conference on Computer and Information Technology Workshops, Sydney, 8-11 July 2008, pp. 631-636.
M. B. Carpenter, “Process Improvement for Software Engineering Training,” Proceedings of the 9th Conference on Software Engineering Education, Daytona Beach, 21-24 April 1996, pp. 172-183. doi:10.1109/CSEE.1996.491371
M. Carpenter and H. Hallman, “Training Guidelines: Creating a Training Plan for a Software Organization,” Technical Report CMU/SEI-95-TR-007, ESC-TR-95-007, Carnegie Mellon University, Pittsburgh, 1991.
W. E. Lewis, “Software Testing and Continuous Quality Improvement,” 3rd Edition, Auerbach Publications, Boca Raton, 2009.