Copy Mean: A New Method to Impute Intermittent Missing Values in Longitudinal Studies
- 1 UMR U1027, INSERM, Université Paul Sabatier, Toulouse, France;CeRSM (EA 2931), UFR STAPS, Université de Paris Ouest Nanterre La Défense, Nanterre, France
- 2 Hospices Civils de Lyon, Service de Biostatistique, Lyon, France;Université Lyon 1, Villeurbanne, France;CNRS, UMR5558, Laboratoire de Biométrie et Biologie Evolutive, Villeurbanne, France
- 3 Université de Bordeaux, ISPED, Centre INSERM U897-Epidemiology-Biostatistique, Bordeaux, France
Abstract
Longitudinal studies are those in which the same variable is repeatedly measured at different times. These studies are more likely than others to suffer from missing values. Since the presence of missing values may have an important impact on statistical analyses, it is important that they should be dealt with properly. In this paper, we present “Copy Mean”, a new method to impute intermittent missing values. We compared its efficiency in eleven imputation methods dedicated to the treatment of missing values in longitudinal data. All these methods were tested on three markedly different real datasets (stationary, increasing, and sinusoidal pattern) with complete data. For each of them, we generated nine types of incomplete datasets that include 10%, 30%, or 50% of missing data using either a Missing Completely at Random, a Missing at Random, or a Missing Not at Random missingness mechanism. Our results show that Copy Mean has a great effectiveness, exceeding or equaling the performance of other methods in almost all configurations. The effectiveness of linear interpolation is highly data-dependent. The Last Occurrence Carried Forward method is strongly discouraged.
- R. Little, “Pattern-Mixture Models for Multivariate Incomplete Data,” Journal of the American Statistical Association, Vol. 88, No. 421, 1993, pp. 125-134.
- N. Laird, “Missing Data in Longitudinal Studies,” Statistics in Medicine, Vol. 7, No. 1-2, 1988, pp. 305-315. doi:10.1002/sim.4780070131
- J. Engels and P. Diehr, “Imputation of Missing Longitudinal Data: A Comparison of Methods,” Journal of Clinical Epidemiology, Vol. 56, No. 10, 2003, pp. 968-976. doi:10.1016/S0895-4356(03)00170-7
- R. Little, “Modeling the Drop-Out Mechanism in Repeated-Measures Studies,” Journal of the American Statistical Association, Vol. 90, No. 431, 1995, pp. 1112-1121. doi:10.1080/01621459.1995.10476615
- S. Zeger and K. Liang, “An Overview of Methods for the Analysis of Longitudinal Data,” Statistics in Medicine, Vol. 11, No. 14-15, 1992, pp. 1825-1839. doi:10.1002/sim.4780111406
- W. Shih, H. Quan, et al., “Testing for Treatment Differences with Dropouts Present in Clinical Trials—A Composite Approach,” Statistics in Medicine, Vol. 16, No. 11, 1997, pp. 1225-1239. doi:10.1002/(SICI)1097-0258(19970615)16:11 3.0.CO;2-Y
- E. Dantan, C. Proust-Lima, L. Letenneur and H. JacqminGadda, “Pattern Mixture Models and Latent Class Models for the Analysis of Multivariate Longitudinal Data with Informative Dropouts,” The International Journal of Biostatistics, Vol. 4, No. 1, 2008, pp. 1-26. doi:10.2202/1557-4679.1088
- J. Twisk and W. De Vente, “Attrition in Longitudinal Studies: How to Deal with Missing Data,” Journal of Clinical Epidemiology, Vol. 55, No. 4, 2002, pp. 329-337. doi:10.1016/S0895-4356(01)00476-0
- D. Rubin, “Inference and Missing Data,” Biometrika, Vol. 63, No. 3, 1976, pp. 581-592. doi:10.1093/biomet/63.3.581
- R. Little and D. Rubin, “Statistical Analysis with Missing Data,” Vol. 4, Wiley, New York, 1987.
- G. Molenberghs, H. Thijs, I. Jansen, C. Beunckens, M. Kenward, C. Mallinckrodt and R. Carroll, “Analyzing Incomplete Longitudinal Clinical Trial Data,” Biostatistics, Vol. 5, No. 3, 2004, pp. 445-464. doi:10.1093/biostatistics/kxh001
- J. Graham, S. Hofer and A. Piccinin, “Analysis with Missing Data in Drug Prevention Research,” NIDA Research Monograph, Vol. 142, 1994, pp. 13-63.
- F. Fritsch and R. Carlson, “Monotone Piecewise Cubic Interpolation,” SIAM Journal on Numerical Analysis, Vol. 17, No. 2, 1980, pp. 238-246. doi:10.1137/0717021