Performance of Existing Biased Estimators and the Respective Predictors in a Misspecified Linear Regression Model
- 1 Deparment of Physical Science, Vavuniya Campus of the University of Jaffna, Vavuniya, Sri Lanka
- 2 Department of Statistics and Computer Science, University of Peradeniya, Peradeniya, Sri Lanka
- 3 Postgraduate Institute of Science, University of Peradeniya, Peradeniya, Sri Lanka
Abstract
In this paper, the performance of existing biased estimators (Ridge Estimator (RE), Almost Unbiased Ridge Estimator (AURE), Liu Estimator (LE), Almost Unbiased Liu Estimator (AULE), Principal Component Regression Estimator (PCRE), r - k class estimator and r - d class estimator) and the respective predictors were considered in a misspecified linear regression model when there exists multicollinearity among explanatory variables. A generalized form was used to compare these estimators and predictors in the mean square error sense. Further, theoretical findings were established using mean square error matrix and scalar mean square error. Finally, a numerical example and a Monte Carlo simulation study were done to illustrate the theoretical findings. The simulation study revealed that LE and RE outperform the other estimators when weak multicollinearity exist s , and RE, r - k class and r - d class estimators outperform the other estimators when moderated and high multicollinearity exist for certain values of shrinkage parameters, respectively. The predictors based on the LE and RE are always superior to the other predictors for certain values of shrinkage parameters.
- Sarkar, N. (1989) Comparisons among Some Estimators in Misspecified Linear Models with Multicollinearity. Annals of the Institute of Statistical Mathematics, 41, 717-724. https://doi.org/10.1007/BF00057737
- Siray, G.ü. (2015) r-d Class Estimator under Misspecification. Communications in Statistics—Theory and Methods, 44, 4742-4756. https://doi.org/10.1080/03610926.2013.835421
- Wu, J. (2016) Superiority of the r-k Class Estimator over Some Estimators in a Misspecified Linear Model. Communication in Statistics—Theory and Methods, 45, 1453-1458. https://doi.org/10.1080/03610926.2013.863934
- Terasvirta, T. (1980) Linear Restrictions in Misspecified Linear Models and Polynomial Distributed Lag Estimation. Department of Statistics, University of Helsinki, Helsinki.
- Mittelhammer, R.C. (1981) On Specification Error in the General Linear Model and Weak Mean Square Error Superiority of the Mixed Estimator. Communications in Statistics—Theory and Methods, 167-176. https://doi.org/10.1080/03610928108828027
- Ohtani, K. and Honda, Y. (1984) On Small Sample Properties of the Mixed Regression Predictor under Misspecification. Communications in Statistics—Theory and Methods, 2817-2825. https://doi.org/10.1080/03610928408828863
- Kadiyala, K. (1986) Mixed Regression Estimator under Misspecification. Economic Letters, 21, 27-30. https://doi.org/10.1016/0165-1765(86)90115-1
- Trenkler, G. and Wijekoon, P. (1989) Mean Square Error Matrix Superiority of the Mixed Regression Estimator under Misspecification. Statistica, 49, 65-71.
- Wijekoon, P. and Trenkler, G. (1989) Mean Square Error Matrix Superiority of Estimators under Linear Restrictions and Misspecification. Economics Letters, 30, 141-149. https://doi.org/10.1016/0165-1765(89)90052-9
- Hubert, M. and Wijekoon, P. (2004) Superiority of the Stochastic Restricted Liu Estimator under Misspecification. Statistica, 64, 153-162.
- Massy, F. (1965) Principal Components Regression in Exploratory Statistical Research. Journal of the American Statistical Association, 60, 234-266. https://doi.org/10.1080/01621459.1965.10480787
- Hoerl, A. and Kennard, R. (1970) Ridge Regression: Biased Estimation for Nonorthogonal Problems. Technometrics, 12, 55-67. https://doi.org/10.1080/00401706.1970.10488634
- Baye, R. and Parker, F. (1984) Combining Ridge and Principal Component Regression: A Money Demand Illustration. Communications in Statistics—Theory and Methods, 13, 197-205. https://doi.org/10.1080/03610928408828675