Asymptotic Consistency of the James-Stein Shrinkage Estimator
- 1 School of Natural Sciences, University of Zambia, Lusaka, Zambia
- 2 School of Natural Sciences, University of Zambia, Lusaka, Zambia
Abstract
The study explores the asymptotic consistency of the James-Stein shrinkage estimator obtained by shrinking a maximum likelihood estimator. We use Hansen’s approach to show that the James-Stein shrinkage estimator converges asymptotically to some multivariate normal distribution with shrinkage effect values. We establish that the rate of convergence is of order and rate , hence the James-Stein shrinkage estimator is -consis tent. Then visualise its consistency by studying the asymptotic behaviour us ing simulating plots in R for the mean squared error of the maximum likelihood estimator and the shrinkage estimator. The latter graphically shows lower mean squared error as compared to that of the maximum likelihood estimator.
- Stein, C. (1956) Inadmissibility of the Usual Estimator for the Mean of a Multivariate Normal Distribution. In: Neyman, J., ed., Proceedings of the Third Berkeley Symposium on Mathematical Statistics and Probability, Volume I, Statistical Laboratory of the University of California, Berkeley, 197-206. https://doi.org/10.1525/9780520313880-018
- James, W. and Stein, C. (1961) Estimation with Quadratic Loss. In: Neyman, J., ed., Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability, Statistical Laboratory of the University of California, Berkeley.
- Baranchik, A.J. (1964) Multiple Regression and Estimation of the Mean of a Multivariate Normal Distribution. Technical Report No. 51. Department of Statistics, Stanford University, Stanford, CA.
- Berger, J.O. (1976) Minimax Estimation of Multivariate Normal Mean with Arbitrary Quadratic Loss. Journal of Multivariate Analysis, 6, 256-264. https://doi.org/10.1016/0047-259X(76)90035-X
- Stein, C. (1981) Estimation of the Mean of a Multivariate Normal Distribution. Annals of Statistics, 9, 1135-1151. https://doi.org/10.1214/aos/1176345632
- Carter, R.L. and Ullah, A. (1984) The Sampling Distribution of Estimators and Their F-Ratios in Regression Model. Journal of Econometrics, 25, 109-122. https://doi.org/10.1016/0304-4076(84)90040-X
- George, E. I. (1986) Minimax Multiple Shrinkage Estimation. Annals of Statistics, 14, 188-205. https://doi.org/10.1214/aos/1176349849
- Geyer, C.J. (1994) On the Asymptotic of Constrained M-Estimation. Annals of Statistics, 22, 1993-2010. https://doi.org/10.1214/aos/1176325768
- Hansen, E.B. (2008) Generalized Shrinkage Estimators. https://web-docs.stern.nyu.edu/old_web/emplibrary/shrink3.pdf
- Hansen, E.B. (2016) Efficient Shrinkage in Parametric Models. Journals of Econometrics, 190, 188-205. https://doi.org/10.1016/j.jeconom.2015.09.003
- Efron, B. (1975) Biased versus Unbiased Estimation. In Advances in Mathematics, Academic Press, New York. https://doi.org/10.1016/0001-8708(75)90114-0
- Newey, W.K. and Mcfadden, D.L. (1994) Large Sample Estimation and Hypothesis Testing. University Press, Holland, 2113-2245. https://doi.org/10.1016/S1573-4412(05)80005-4
- Stone, C.J. (1974) Asymptotic Properties of Estimators of a Location Parameter. The Annals of Statistics, 6, 1127-1137. https://doi.org/10.1214/aos/1176342869