Variable Selection in Finite Mixture of Time-Varying Regression Models
- 1 College of Science, Shanghai University, Shanghai, China
- 2 College of Science, Shanghai University, Shanghai, China
Abstract
In this paper, we research the regression problem of time series data from heterogeneous populations on the basis of the finite mixture regression model. We propose two finite mixed time-varying regression models to solve this. A regularization method for variable selection of the models is proposed, which is a mixture of the appropriate penalty functions and l 2 penalty. A Block-wise minimization maximization (MM) algorithm is used for maximum penalized log quasi-likelihood estimation of these models. The procedure is illustrated by analyzing simulations and with an application to analyze the behavior of urban vehicular traffic of the city of S ã o Paulo in the period from 14 to 18 December 2009, which shows that the proposed models outperform the FMR models.
- McLachlan, G.J. and Peel, D. (2000) Finite Mixture Models. Wiley, New York. https://doi.org/10.1002/0471721182
- Abbas, K. and Shili, L. (2013) Regularization in Finite Mixture of Regression Models with Diverging Number of Parameters. Biometrics, 69, 201-235. https://doi.org/10.1111/biom.12020
- Abbas, K. and Chen, J.H. (2007) Variable Selection in Finite Mixture of Regression Models. Journal of the American Statistical Association, 102, 1025-1038. https://doi.org/10.1198/016214507000000590
- Zhang, Z., Li, W.K. and Yuen, K.C. (2005) On a Mixture GARCH Time-Series Model. Journal of Time Series Analysis, 27, 577-597. https://doi.org/10.1111/j.1467-9892.2006.00467.x
- Haas, M., Krause, J., Paolella, M.S. and Steude, S.C. (2013) Time-Varying Mixture GARCH Models and Asymmetric Volatility. North American Journal of Economics and Finance, 26, 602-623. https://doi.org/10.1016/j.najef.2013.02.024
- Abbas, K. (2011) An Overview of the New Feature Selection Methods in Finite Mixture of Regression Models. Journal of the Iranian Statistical Society, 10, 201-235.
- Fan, J.Q. and Li, R.Z. (2001) Variable Selection via Nonconcave Penalized Likelihood and Its Oracle Properties. Journal of the American Statistical Association, 96, 1348-1360. https://doi.org/10.1198/016214501753382273
- Lloyd-Jones, L.R., Nguyen, H.D. and McLachlan, G.J. (2018) A Globally Convergent Algorithm for Lasso-Penalized Mixture of Linear Regression Models. Computational Statistics and Data Analysis, 119, 19-38. https://doi.org/10.1016/j.csda.2017.09.003
- Hwang, S.Y., et al. (2014) Quasilikelihood and Quasi-Maximum Likelihood for GARCH-Type Processes: Estimating Function Approach. Journal of the Korean Statistical Society, 1, 5. https://doi.org/10.1016/j.jkss.2014.01.005
- Razaviyayn, M., Hong, M. and Luo, Z.-Q. (2013) A Unified Convergence Analysis of Block Successive Minimization Methods for Nonsmooth Optimization. SIAM Journal on Optimization, 23, 1126-1153. https://doi.org/10.1137/120891009
- Lange, K. (2013) Optimization. Springer, New York. https://doi.org/10.1007/978-1-4614-5838-8