Research ArticleOpen AccessGoogle Scholar indexed
A Universal Selection Method in Linear Regression Models
Department of Computer Science and Communication Systems, Merseburg University of Applied Sciences,Merseburg, Germany
- 1 Department of Computer Science and Communication Systems, Merseburg University of Applied Sciences,Merseburg, Germany
Open Journal of Statistics·Volume 02 (2012)·Pages 153–162·Published 23 April 2012·DOI10.4236/ojs.2012.22017
Copy link · social · email
Abstract
In this paper we consider a linear regression model with fixed design. A new rule for the selection of a relevant submodel is introduced on the basis of parameter tests. One particular feature of the rule is that subjective grading of the model complexity can be incorporated. We provide bounds for the mis-selection error. Simulations show that by using the proposed selection rule, the mis-selection error can be controlled uniformly.
KeywordsLinear RegressionModel SelectionMultiple Tests
- H. Akaike, “A New Look at the Statistical Model Identification,” IEEE Transactions on Automatic Control, Vol. 19, 1974, pp. 716-723. doi:10.1109/TAC.1974.1100705
- C. Mallows, “Some Comments on Cp,” Technometrics, Vol. 15, No. 4, 1973, pp. 661-675. doi:10.2307/1267380
- G. Schwarz, “Estimating the Dimension of a Model,” Annals of Statistics, Vol. 6, No. 2, 1978, pp. 461-464. doi:10.1214/aos/1176344136
- J. Rissanen, “Modeling by Shortest Data Description,” Automatica, Vol. 14, No. 5, 1978, pp. 465-471. doi:10.1016/0005-1098(78)90005-5
- Y. Benjamini and Y. Hochberg, “Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing,” Journal of the Royal Statistical Society, Series B, Vol. 57, No. 1, 1995, pp. 289-300.
- F. Bunea, M. H. Wegkamp and A. Auguste, “Consistent Variable Selection in High Dimensional Regression via Multiple Testing,” Journal of Statistical Planning and Inference, Vol. 136, No. 12, 2006, pp. 4349-4364. doi:10.1016/j.jspi.2005.03.011
- Y. Benjamini, and Y. Gavrilov, “A simple forward selection procedure based on false discovery rate control,” Annals of Applied Statistics, Vol. 3, No. 1, 2009, pp. 179-198. doi:10.1214/08-AOAS194
- G. Claeskens and N. L. Hjort, “Model Selection and Model Averaging,” Cambridge University Press, Cambridge, 2008.
- H. Leeb and B. M. P?tscher, “Model Selection,” In: T. G. Andersen, et al., Eds., Handbook of Financial Time Series, Springer, Berlin, 2009, pp. 889-925. doi:10.1007/978-3-540-71297-8_39
- A. D. R. McQuarrie and C.-L. Tsai, “Regression and Time Series Model Selection,” World Scientific, Singapore City, 1998.
- A. J. Miller, “Subset Selection in Regression,” 2nd Edition, Chapman & Hall, New York, 2002.
- B. Droge, “Asymptotic Properties of Model Selection Procedures in Linear Regression,” Statistics, Vol. 40, No. 1, 2006, pp. 1-38. doi:10.1080/02331880500366050a
- R. Nishii, “Asymptotic Properties of Criteria for Selection of Variables in Multiple Regression,” Annals of Statistics, Vol. 12, No. 2, 1984, pp. 758-765. doi:10.1214/aos/1176346522
- C. R. Rao and Y. Wu, “A Strongly Consistent Procedure for Model Selection in a Regression Problem,” Biometrika, Vol. 76, No. 2, 1989, pp. 369-374. doi:10.1093/biomet/76.2.369
- J. Shao, “An Asymptotic Theory for Linear Model Selection,” Statistica Sinica, Vol. 7, 1997, pp. 221-264.