Variable Selection for Robust Mixture Regression Model with Skew Scale Mixtures of Normal Distributions
- 1 Department of Mathematics, College of Science, Shanghai University, Shanghai, China
- 2 Department of Mathematics, College of Science, Shanghai University, Shanghai, China
Abstract
In this paper, we propose a robust mixture regression model based on the skew scale mixtures of normal distributions (RMR-SSMN) which can accommodate asymmetric, heavy-tailed and contaminated data better. For the variable selection problem, the penalized likelihood approach with a new combined penalty function which balances the SCAD and l 2 penalty is proposed. The adjusted EM algorithm is presented to get parameter estimates of RMR-SSMN models at a faster convergence rate. As simulations show, our mixture models are more robust than general FMR models and the new combined penalty function outperforms SCAD for variable selection. Finally, the proposed methodology and algorithm are applied to a real data set and achieve reasonable results.
- Krykun, I. (2018) The Arc-Sine Laws for the Skew Brownian Motion and Their Interpretation. Journal of Applied Mathematics and Physics, 6, 347-357. https://doi.org/10.4236/jamp.2018.62033
- McLachlan, G.J. and Peel, D. (2000) Finite Mixture Models. Wiley, New York. https://doi.org/10.1002/0471721182
- McLachlan, G.J. and Peel, D. (1998) Robust Cluster Analysis via Mixtures of Multivariate T-Distributions. Joint IAPR International Workshops on Statistical Techniques in Pattern Recognition (SPR) and Structural and Syntactic Pattern Recognition (SSPR), Sydney, 11-13 August 1998, 658-666. https://doi.org/10.1007/BFb0033290
- Basso, R.M., Lachos, V.H., Cabral, C.R.B. and Ghosh, P. (2011) Robust Mixture Modeling based on Scale Mixtures of Skew-Normal Distributions. Computational Statistics & Data Analysis, 54, 2926-2941. https://doi.org/10.1016/j.csda.2009.09.031
- Franczak, B.C., Browne, R.P. and McNicholas, P.D. (2014) Mixtures of Shifted Asymmetric Laplace Distributions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 36, 1149-1157. https://doi.org/10.1109/TPAMI.2013.216
- Zou, H. and Hastie, T. (2005) Regularization and Variable Selection via Elastic Net. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 67, 301-320. https://doi.org/10.1111/j.1467-9868.2005.00503.x
- Zhang, C.H. (2010) Nearly Unbiased Variable Selection under Minimax Concave Penalty. The Annals of Statistics, 38, 894-942. https://doi.org/10.1214/09-AOS729
- Fan, J. and Li, R. (2001) Variable Selection via Nonconcave Penalized Likelihood and Its Oracle Properties. Journal of the American Statistical Association, 96, 1348-1360. https://doi.org/10.1198/016214501753382273
- Ferreira, C.S., Bolfarine, H. and Lachos, V.H. (2011) Skew Scale Mixtures of Normal Distributions: Properties and Estimation. Statistical Methodology, 8, 154-171. https://doi.org/10.1016/j.stamet.2010.09.001
- Gomez, H.W., Venegas, O. and Bolfarine, H. (2007) Skew-Symmetric Distributions Generated by the Normal Distribution Function. Environmetrics, 18, 395-407. https://doi.org/10.1002/env.817
- Khalili, A. and Chen, J. (2007) Variable Selection in Finite Mixture of Regression Models. Journal of the American Statistical Association, 102, 1025-1038. https://doi.org/10.1198/016214507000000590
- Khalili, A. (2010) New Estimation and Feature Selection Methods in Mixture-of-Experts Models. Canadian Journal of Statistics, 38, 519-539. https://doi.org/10.1002/cjs.10083