Adaptive Sparse Group Variable Selection for a Robust Mixture Regression Model Based on Laplace Distribution
- 1 Department of Mathematics, College of Science, Shanghai University, Shanghai, China
- 2 Department of Mathematics, College of Science, Shanghai University, Shanghai, China
Abstract
The traditional estimation of Gaussian mixture model is sensitive to heavy-tailed errors; thus we propose a robust mixture regression model by assuming that the error terms follow a Laplace distribution in this article. And for the variable selection problem in our new robust mixture regression model, we introduce the adaptive sparse group Lasso penalty to achieve sparsity at both the group-level and within-group-level. As numerical experiments show, compared with other alternative methods, our method has better performances in variable selection and parameter estimation. Finally, we apply our proposed method to analyze NBA salary data during the period from 2018 to 2019.
- Quandt, R.E. (1972) A New Approach to Estimating Switching Regressions. Journal of the American Statistical Association, 67, 306-310. https://doi.org/10.1080/01621459.1972.10482378
- Dempster, A.P., Laird, N.M. and Rubin, D.B. (1977) Maximum Likelihood from Incomplete Data via the EM Algorithm. Journal of the Royal Statistical Society: Series B, 39, 1-22. https://doi.org/10.1111/j.2517-6161.1977.tb01600.x
- Jiang, W.X. and Tanner, M.A. (1999) Hierarchical Mixtures-of-Experts for Exponential Family Regression Models: Approximation and Maximum Likelihood Estimation. The Annals of Statistics, 27, 987-1011. https://doi.org/10.1214/aos/1018031265
- McLachlan, G.J. and Peel, D. (2000) Finite Mixture Models. Wiley, New York. https://doi.org/10.1002/0471721182
- Frühwirth-Schnatter, S. (2006) Finite Mixture and Markov Switching Models. Springer, New York.
- Yao, W.X., Wei, Y. and Yu, C. (2014) Robust Mixture Regression Using the t-Distribution. Computational Statistics and Data Analysis, 71, 116-127. https://doi.org/10.1016/j.csda.2013.07.019
- Song, W.X., Yao, W.X. and Xing, Y.R. (2014) Robust Mixture Regression Model Fitting by Laplace Distribution. Computational Statistics and Data Analysis, 71, 128-137. https://doi.org/10.1016/j.csda.2013.06.022
- Wu, Q. and Yao, W.X. (2016) Mixtures of Quantile Regressions. Computational Statistics and Data Analysis, 93, 162-176. https://doi.org/10.1016/j.csda.2014.04.014
- Khalili, A. and Chen, J.H. (2007) Variable Selection in Finite Mixture of Regression Models. Journal of the American Statistical Association, 102, 1025-1038. https://doi.org/10.1198/016214507000000590
- Städler, N., Bühlmann, P. and van de Geer, S. (2010) L1-Penalization for Mixture Regression Models. TEST, 19, 209-256. https://doi.org/10.1007/s11749-010-0197-z
- Lloyd-Jones, L.R., Nguyen, H.D. and McLachlan, G.J. (2018) A Globally Convergent Algorithm for Lasso-Penalized Mixture of Linear Regression Models. Computational Statistics and Data Analysis, 119, 19-38. https://doi.org/10.1016/j.csda.2017.09.003
- Fang, K.N., Wang, X.Y., Zhang, S.W., Zhu, J.P. and Ma, S.G. (2015) Bi-Level Variable Selection via Adaptive Sparse Group Lasso. Journal of Statistical Computation and Simulation, 85, 2750-2760. https://doi.org/10.1080/00949655.2014.938241
- Hunter, D.R. and Li, R.Z. (2005) Variable Selection Using MM Algorithms. The Annals of Statistics, 33, 1617-1642. https://doi.org/10.1214/009053605000000200