For any software company that frequently performs quality assurance activities devoted to measurement, evaluation (ME) and change/improvement (MEC) projects, ME and MEC strategies can be valuable organizational assets. In this paper, we analyze the improvement of a ME strategy, which can be considered an organizational resource to be applied to quality assurance activities. This resource is called the GOCAME (Goal-Oriented Context-Aware Measurement and Evaluation) strategy. AME/MEC strategy embraces the next three integrated capabilities: 1) the ME/MEC domain conceptual base and framework; 2) the process perspective specifications; and, 3) the method specifications. The improvement of GOCAME was performed instantiating two strategy patterns. A strategy pattern is a reusable solution to recurrent problems in ME/MEC projects. For an improvement goal, the selected MEC strategy pattern allows instantiating in a project a set of tailored activities and methods for measurement, evaluation, analysis and change. Particularly, we instantiate the GoME_1QV (Goal-oriented Measurement and Evaluation for One Quality View) strategy pattern to understand the GOCAME current quality state and compare it with the so-called GQM+ Strategies. First, this evaluation and analysis allows us to know the GOCAME strengths and weaknesses with regard to the quality of the three capabilities. Second, we instantiate the GoMEC_1QV (Goal-oriented Measurement, Evaluation and Change for One Quality View) strategy pattern to improve the GOCAME current state, producing as result a new version of the GOCAME strategy.
ISO/IEC 25010 (2011) Systems and Software Engineering -Systems and Software Quality Requirements and Evaluation (SQuaRE) -System and Software Quality Models.
Rivera, B., Becker, P. and Olsina, L. (2015) Extending the Conceptual Base for a Holistic Quality Evaluation Approach. 1st Argentine Symposium on Ontologies and Their Applications (SAOA'15), Rosario, Vol. 1449, 121-130. http://ceur-ws.org/Vol-1449/
Becker, P., Papa, F. and Olsina, L. (2015) Process Ontology Specification for Enhancing the Process Compliance of a Measurement and Evaluation Strategy. CLEI Electronic Journal, 18, 1-26. http://dx.doi.org/10.19153/cleiej.18.1.2
Olsina, L., Papa, F. and Molina, H. (2008) How to Measure and Evaluate Web Applications in a Consistent Way. In: Rossi, G., Pastor, O., Schwabe, D. and Olsina, L., Eds., HCIS Springer book Web Engineering: Modeling and Implementing Web Applications, 385-420.
Papa, M.F. (2012) Toward the Improvement of a Measurement and Evaluation Strategy from a Comparative Study. In: , Grossniklauss, M. and Wimmer, M., Eds., LNCS 7703, Springer: Current Trends in Web Engineering, ICWE Int’l Workshops, 189-203. http://dx.doi.org/10.1007/978-3-642-35623-0_20
Lew, P., Olsina, L., Becker, P. and Zhang, L. (2012) An Integrated Strategy to Systematically Understand and Manage Quality in Use for Web Applications. Requirements Engineering Journal, Springer London, 17, 299-330. http://dx.doi.org/10.1007/s00766-011-0128-x
Olsina, L., Lew, P., Dieser, A. and Rivera, B. (2012) Updating Quality Models for Evaluating New Generation Web Applications. Journal of Web Engineering, Special Issue: Quality in New Generation Web Applications, 11, 209-246.
Olsina, L., Rossi, G., Garrido, A., Distante, D. and Canfora, G. (2008) Web Applications Refactoring and Evaluation: A Quality-Oriented Improvement Approach. Journal of Web Engineering, 7, 258-280.
Folmer, E. and Bosch, J. (2008) Experiences with Software Architecture Analysis of Usability. International Journal of Information Technology and Web Engineering, 3, 1-29. http://dx.doi.org/10.4018/jitwe.2008100101
Gamma, E., Helm, R., Johnson, R. and Vlissides, J. (1995) Design Patterns: Elements of Reusable Object-Oriented Software. Addisson-Wesley, Massachusetts.
Fowler, M. (1997) Analysis Patterns: Reusable Object Models. Addison-Wesley, Indianapolis.
Folmer, E., van Gurp, J. and Bosch, J. (2003) A Framework for Capturing the Relationship between Usability and Software Architecture. Software Process: Improvement and Practice, 8, 67-87. http://dx.doi.org/10.1002/spip.171
Hamza, H. and Fayad, M.E. (2004) Applying Analysis Patterns through Analogy: Problems and Solutions. Journal of Object Technology, 3, 197-208. http://dx.doi.org/10.5381/jot.2004.3.4.a11
Rivera, B., Becker, P., Lew, P. and Olsina, L. (2015) Strategy Patterns for Evaluating and Improving Usability. Proceeding of Argentine Symposium on Software Engineering (ASSE'15), 44 JAIIO, Rosario, 69-84.
Basili, V.R., Heidrich, J., Lindvall, M., Münch, J., Regardie, M., Rombach, H.D., Seaman, C.B. and Trendowicz, A. (2007) GQM+Strategies: A Comprehensive Methodology for Aligning Business Strategies with Software. MetriKon, Kaiserslautern, 1-14.
Basili, V., Lindvall, M., Regardie, M., Seaman, C., Heidrich, J., Jurgen, M., Rombach, D. and Trendowicz, A. (2010) Linking Software Development and Business Strategy through Measurement. Computer, 43, 57-65. http://dx.doi.org/10.1109/MC.2010.108
Moraga, M.A., Bertoa, M.F., Morcillo, M.C., Calero, C. and Vallecillo, A. (2008) Evaluating Quality-in-Use Using Bayesian Networks. QAOOSE 2008, Paphos, 7-11 July 2008, 1-10.
Basili, R., Caldiera, G. and Rombach, H.D. (1994) The Goal Question Metric Approach. Encyclopedia of Software Engineering, 1, 528-532.
Rodriguez, M., Genero, M., Torre, D., Blasco, B. and Piattini, M. (2010) A Methodology for Continuos Quality Assessment of Software Artefacts. 10th International Conference on Quality Software (QSIC 2010), Zhangjiajie, 14-15 July 2010, 254-261. http://dx.doi.org/10.1109/QSIC.2010.24
McGarry, J., Card, D., Jones, C., Layman, B., Clark, E., Dean, J. and Hall, F. (2001) Practical Software Measurement: Objective Information for Decision Makers. Addison-Wesley Professional, Boston.
Basili, V. (1989) Software Development: A Paradigm for the Future. Proceedings of the 13th Annual International Computer Software & Applications Conference (COMPSAC), Orlando, 20-22 September 1989, 471-485. http://dx.doi.org/10.1109/cmpsac.1989.65127
Mora, B., García, F., Ruiz, F., Piattini, M., Boronat, A., Gómez, A., Carsí, J.A. and Ramos, I. (2008) Software Generic Measurement Framework Based on MDA. IEEE Latin America Transactions, 6, 363-370. http://dx.doi.org/10.1109/TLA.2008.4815290
ISO/IEC 15939 (2007) Systems and Software Engineering—Measurement Process. 2nd Edition.
Barisic, A., Monteiro, P., Amaral, V., Goulao, M. and Monteiro, M. (2012) Patterns for Evaluating Usability of Domain-Specific Languages. 19th Conference on Pattern Languages of Programs (PLoP), Tucson, 19-21 October 2012, Article No.: 14.
Gruber, T.R. (1993) A Translation Approach to Portable Ontology Specifications. Knowledge Acquisition, 5, 199-220. http://dx.doi.org/10.1006/knac.1993.1008
van Heijst, G., Schreiber, A.T. and Wielinga, B.J. (1997) Using Explicit Ontologies in KBS Development. International Journal of Human-Computer Studies, 46, 183-292. http://dx.doi.org/10.1006/ijhc.1996.0090
OMG-UML (2005) Unified Modeling Language Specification, Version 2.0.
Curtis, B., Kellner, M. and Over, J. (1992) Process Modelling. Communications of the ACM, 35, 75-90. http://dx.doi.org/10.1145/130994.130998
Papa, M.F. (2015) Quality Assurance of an Organizational Resource: Evaluating and Improving an Integrated Measurement and Evaluation Strategy. PhD Thesis, School of Informatics, National University of La Plata, Buenos Aires. (In Spanish) http://hdl.handle.net/10915/44792
Dujmovic, J.J. (1996) A Method for Evaluation and Selection of Complex Hardware and Software Systems. Proceedings of the 22nd International Conference for the Resource Management and Performance Evaluation of Enterprise CS, CMG 96, 1, 368-378.
Kitchenham, B., Hughes, R. and Linkman, S. (2001) Modeling Software Measurement Data. IEEE Transactions on Software Engineering, 27, 788-804. http://dx.doi.org/10.1109/32.950316
Olsina, L. and Martin, M. (2004) Ontology for Software Metrics and Indicators. Journal of Web Engineering, 2, 262-281.
Abran, A. (2010) Software Metrics and Software Metrology. Wiley-IEEE Computer Society Press, Hoboken. http://dx.doi.org/10.1002/9780470606834