Fidelity of Intervention Implementation: A Review of Instruments
- 1 Arthur Labatt School of Nursing, University of Western Ontario, London, Canada
- 2 Daphne Cockwell School of Nursing, Ryerson University, Toronto, Canada
Abstract
Background: Interventions, whether simple or complex, are increasing in health care in response to the growing complexity and acuity of patient’s conditions. Monitoring the fidelity of implementing interventions is challenging. A common method to assess and monitor fidelity of intervention implementation is through a structured, reliable and valid instrument. Purpose: The purpose of this paper is to examine existing instruments measuring fidelity of intervention implementation in order to determine aspects of fidelity that have been assessed and reported on the reliability and validity of these instruments. Design: A descriptive review was conducted. Studies were included if they described and reported on the fidelity of intervention implementation instruments, their psychometric properties were published between 1980 and 2015. Methods: Data were extracted on the study characteristics, levels and aspects of fidelity and the psychometric properties, specifically the reliability and validity of the fidelity of intervention implementation instruments. Results: In total, 21 studies were included in the review. Overall results showed that some aspects and levels of fidelity of intervention implementation are included in the instruments. At the theoretical level, fidelity of intervention implementation is not accounted for majority of the studies and few explicitly reports on the use of instruments to evaluate intervention differentiation. At the operational level, interventionists’ adherence and competence are included in the instruments; however, participants’ engagement, exposure and enactment are not. The instruments demonstrate acceptable level of validity and reliability. Conclusion: Sustained focus on developing psychometrically sound instruments that account for all levels ( i.e. theoretical and operational) and aspects of fidelity of intervention implementation is imperative to strengthen the methodological literature for interventions research; and for researchers to correctly interpret research findings and to arrive at valid conclusions on the effectiveness of interventions, whether simple or complex.
- Sidani, S. and Braden, C.J. (2011) Design, Evaluation, and Translation of Nursing Interventions. Wiley-Blackwell, Ames.
- Eysenck, H. (1952) The Effects of Psychotherapy, an Evaluation. Journal of Consulting Psychology, 16, 319-324. http://dx.doi.org/10.1037/h0063633
- VandenBos, G.R. (1980) Psychotherapy: Practice, Research, Policy. Sage, Beverly Hills.
- Moncher, F.J. and Prinz, R.J. (1991) Treatment Fidelity in Outcome Studies. Clinical Psychology Review, 11, 247-266. http://dx.doi.org/10.1016/0272-7358(91)90103-2
- Gearing, R.E., El-Bassel, N., Ghesquiere, A., Baldwin, S., Gillies, J. and Ngeow, E. (2011) Major Ingredients of Fidelity: A Review and Scientific Guide to Improving Quality of Intervention Research Implementation. Clinical Psychology Review, 31, 79-88. http://dx.doi.org/10.1016/j.cpr.2010.09.007
- Bellg, A.J., Borrelli, B., Resnick, B., Hecht, J., Minicucci, D.S., Ory, M., et al. (2004) Enhancing Treatment Fidelity in Health Behavior Change Studies: Best Practices and Recommendations from the NIH Behaviour Change Consortium. Health Psychology, 23, 443-451. http://dx.doi.org/10.1037/0278-6133.23.5.443
- Carroll, C., Patterson, M., Wood, S., Booth, A., Rick, J. and Balain, S. (2007) A Conceptual Framework for Implementation Fidelity. Implementation Science, 2, 40. http://dx.doi.org/10.1186/1748-5908-2-40
- Stein, K.F., Sargent, J.T. and Rafaels, N. (2007) Intervention Research: Establishing Fidelity of the Independent Variable in Nursing Clinical Trials. Nursing Research, 56, 54-62. http://dx.doi.org/10.1097/00006199-200701000-00007
- Shadish, W.R., Cook, T.D. and Campbell, D.T. (2002) Experimental and Quasi-Experimental Designs for Generalized Causal Inference. Houghton Mifflin Company, Boston.
- Dusenbury, L., Brannigan, R., Falco, M. and Hansen, W.B. (2003) A Review of Research on Fidelity of Implementation: Implications for Drug Abuse Prevention in School Settings. Health Education Research, 18, 237-256. http://dx.doi.org/10.1093/her/18.2.237
- Brandt, P.A., Kirsch, S.D., Lewis, F.M. and Casey, S.M. (2004) Assessing the Strength and Integrity of an Intervention. Oncology Nursing Forum, 31, 833-837. http://dx.doi.org/10.1188/04.ONF.833-837
- Dumas, J.E., Lynch, A.M., Laughlin, J.E., Smith, P.E. and Prinze, R.J. (2001) Promoting Intervention Fidelity: Conceptual Issues, Methods, and Preliminary Results from the EARLY ALLIANCE Prevention Trial. American Journal of Preventive Medicine, 20, 38-47. http://dx.doi.org/10.1016/S0749-3797(00)00272-5