Variance Estimation for High-Dimensional Varying Index Coefficient Models
- 1 Department of Statistics, School of Economics, Jinan University, Guangzhou, China
- 2 Department of Statistics, School of Economics, Jinan University, Guangzhou, China
- 3 Department of Statistics, School of Economics, Jinan University, Guangzhou, China
Abstract
This paper studies the re-adjusted cross-validation method and a semi parametric regression model called the varying index coefficient model. We use the profile spline modal estimator method to estimate the coefficients of the parameter part of the Varying Index Coefficient Model (VICM), while the unknown function part uses the B-spline to expand. Moreover, we combine the above two estimation methods under the assumption of high-dimensional data. The results of data simulation and empirical analysis show that for the varying index coefficient model, the re-adjusted cross-validation method is better in terms of accuracy and stability than traditional methods based on ordinary least squares.
- Tibshirani, R. (1996) Regression Shrinkage and Selection via the Lasso. Journal of the Royal Statistical Society (Series B), 58, 267-288. https://doi.org/10.1111/j.2517-6161.1996.tb02080.x
- Fan, J. and Peng, H. (2004) On Nonconcave Penalized Likelihood with Diverging Number of Parameters. Annals of Statistics, 32, 928-961. https://doi.org/10.1214/009053604000000256
- Zhao, P. and Yu, B. (2006) On Model Selection Consistency of Lasso. Journal of Machine Learning Research, 7, 2541-2563.
- Bunea, F., Tsybakov, A. and Wegkamp, M. (2007) Sparsity Oracle Inequalities for the Lasso. Electronic Journal of Statistics, 64, 330-332. https://doi.org/10.1214/07-EJS008
- Zhang, C.H. and Huang, J. (2008) The Sparsity and Bias of the Lasso Selection in High-Dimensional Linear Regression. Annals of Statistics, 36, 1567-1594. https://doi.org/10.1214/07-AOS520
- Lv, J. and Fan, Y. (2009) A Unified Approach to Model Selection and Sparse Recovery Using Regularized Least Squares. Annals of Statistics, 37, 3498-3528. https://doi.org/10.1214/09-AOS683
- Fan, J. and Lv, J. (2011) Nonconcave Penalized Likelihood with NP-Dimensionality. Journal IEEE Transactions on Information Theory, 57, 5467-5484. https://doi.org/10.1109/TIT.2011.2158486
- Kim, Y., Choi, H. and Oh, H.S. (2008) Smoothly Clipped Absolute Deviation on High Dimensions. Journal of the American Statistical Association, 103, 1665-1673. https://doi.org/10.1198/016214508000001066
- Candes, E. and Tao, T. (2005) The Danzig Selector: Statistical Estimation When p Is Much Larger than n. Annals of Statistics, 35, 2313-2351. https://doi.org/10.1214/009053606000001523
- Fan, J. and Lv, J. (2008) Sure Independence Screening for Ultrahigh Dimensional Feature Space. Journal of the Royal Statistical Society, 70, 849-911. https://doi.org/10.1111/j.1467-9868.2008.00674.x
- Fan, J., Samworth, R. and Wu, Y. (2009) Ultrahigh Dimensional Feature Selection: Beyond the Linear Model. Journal of Machine Learning Research, 10, 2013-2038.
- Zhao, S.D., Cai, T.T. and Li, H. (2014) Variance Estimation in High-Dimensional Linear Models. Biometrika, 2, 269-284. https://doi.org/10.1093/biomet/ast065
- Reid, S., Tibshirani, R. and Friedman, J. (2016) A Study of Error Variance Estimation in Lasso Regression. Statistica Sinica, 26, 35-67. https://doi.org/10.5705/ss.2014.042