The Performance of Robust Methods in Logistic Regression Model
- 1 College of Applied Science, Department of Statistics, Beijing University of Technology, Beijing, China
- 2 College of Applied Science, Department of Statistics, Beijing University of Technology, Beijing, China
Abstract
Logistic regression is the most important tool for data analysis in various fields. The classical approach for estimating parameters is the maximum likelihood estimation, a disadvantage of this method is high sensitivity to outlying observations. Robust estimators for logistic regression are alternative techniques due to their robustness. This paper presents a new class of robust techniques for logistic regression. They are weighted maximum likelihood estimators which are considered as Mallows-type estimator. Moreover, we compare the performance of these techniques with classical maximum likelihood and some existing robust estimators. The results are illustrated depending on a simulation study and real datasets . The new estimators showed the best performance relative to other estimators.
- Pregibon, D. (1981) Logistic Regression Diagnostics. The Annals of Statistics, 4, 705-724. https://doi.org/10.1214/aos/1176345513
- Kunsch, H.R., Stefonski, L.A. and Carroll, R.J. (1989) Conditionally Unbiased Bounded-Influence Estimation in General Regression Models, with Applications to Generalized Linear Models. Journal of the American Statistical Association, 84, 460-466. https://doi.org/10.1080/01621459.1989.10478791
- Carroll, R.J. and Pederson, S. (1993) On Robustness in the Logistic Regression Model. Journal of the Royal Statistical Society. Series B (Methodological), 55, 693-706. https://doi.org/10.1111/j.2517-6161.1993.tb01934.x
- Hobza, T., Martin, N. and Pardo, L. (2017) A Wald-Type Test Statistic Based on Robust Modified Median Estimator in Logistic Regression Models. Journal of Statistical Computation and Simulation, 87, 2309-2333. https://doi.org/10.1080/00949655.2017.1330414
- Bergesio, A. and Yohai, V.J. (2011) Projection Estimators for Generalized Linear Models. Journal of the American Statistical Association, 106, 661-671. https://doi.org/10.1198/jasa.2011.tm09774
- Morgenthaler, S. (1992) Least-Absolute-Deviations Fits for Generalized Linear Models. Biometrika, 79, 747-754. https://doi.org/10.1093/biomet/79.4.747
- Cantoni, E. and Ronchetti, E. (2001) Robust Inference for Generalized Linear Models. Journal of the American Statistical Association, 96, 1022-1030. https://doi.org/10.1198/016214501753209004
- Wedderburn, R.W.M. (1974) Quasi-Likelihood Functions, Generalized Linear Models, and the Gauss Newton Method. Biometrika, 61, 439-447. https://doi.org/10.1093/biomet/61.3.439
- Croux, C., Flandre, C. and Haesbroeck, G. (2002) The Breakdown Behavior of the Maximum Likelihood Estimator in the Logistic Regression Model. Statistics and Probability Letters, 60, 377-386. https://doi.org/10.1016/S0167-7152(02)00292-4
- Bianco, A.M. and Yohai, V.J. (1996) Robust Estimation in the Logistic Regression Model. In: Reider, H., Ed., Robust Statistics, Data Analysis, and Computer Intensive Methods, Wiley, New York, 17-34. https://doi.org/10.1007/978-1-4612-2380-1_2
- Croux, C. and Haesbroeck, G. (2003) Implementing the Bianco and Yohai Estimator for Logistic Regression. Computational Statistics and Data Analysis Journal, 44, 273-295. https://doi.org/10.1016/S0167-9473(03)00042-2
- Muller, C.H. and Neykov, N. (1981) Breakdown Points of Trimmed Likelihood Estimators and Related Estimators in Generalized Linear Models. Journal of Statistical Planning and Inference, 116, 503-519. https://doi.org/10.1016/S0378-3758(02)00265-3