Heteroskedasticity-Consistent Covariance Matrix Estimators in Small Samples with High Leverage Points
- 1 Department of Economics, Istanbul Bilgi University, Istanbul, Turkey
- 2 Department of Economics, Fatih University, Istanbul, Turkey
Abstract
The aim of this paper is to demonstrate the impact of high leverage observations on the performances of prominent and popular Heteroskedasticity-Consistent Covariance Matrix Estimators (HCCMEs) with the help of computer simulation. Firstly, we figure out high leverage observations, th en remove them and recalculate the HCCMEs without these observations in order to c ompare the HCCME performances with and without high leverage points. We identify high leverage observations with the Minimum Covariance Determinant (MCD). We select from among different covariate s and disturbance term variances from the related literature in simulation r uns in order to compare the percentage difference between the expected value of the HCCME and true covariance matrix as well as the symmetric loss function. Our results revealed that the elimination of high leve rage (high MCD distance) observations had improved the HCCME performances consid erably and under some settings substantially, depending on the degree of leverage. We hope our theoretical findings will be benefited for practical purposes in applications.
- White, H. (1980) A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity. Econometrica, 48, 817-838. http://dx.doi.org/10.2307/1912934
- Eicker, F. (1967) Limit Theorems for Regressions with Unequal and Dependent Errors. Proceedings of Fifth Berkeley Symposium on Mathematical Statistics and Probability, Vol. 1, No. 1, 59-82.
- Chesher, A. and Jewitt, I. (1987) The Bias of A Heteroskedasticity-Consistent Covariance Matrix Estimator. Econometrica, 55, 1217-1222. http://dx.doi.org/10.2307/1911269
- Hinkley, D.V. (1977) Jackknifing in Unbalanced Situations. Technometrics, 19, 285-292. http://dx.doi.org/10.1080/00401706.1977.10489550
- Horn, S.D., Horn, R.A. and Duncan, D.B. (1975) Estimating Heteroscedastic Variances in Linear Models. Journal of the American Statistical Association, 70, 380-385. http://dx.doi.org/10.1080/01621459.1975.10479877
- Efron, B. (1982) The Jackknife, the Bootstrap and other Resampling Plans. Society for Industrial and Applied Mathematics, Philadelphia, PA. http://dx.doi.org/10.1137/1.9781611970319
- Cribari-Neto, F. (2004) Asymptotic Inference under Heteroskedasticity of Unknown Form. Computational Statistics & Data Analysis, 45, 215-233. http://dx.doi.org/10.1016/S0167-9473(02)00366-3
- Cribari-Neto, F., Souza, T.C. and Vasconcellos, K.L.P. (2007) Inference under Heteroskedasticity and Leveraged Data. Communications in Statistics—Theory and Methods, 36, 1877-1888. http://dx.doi.org/10.1080/03610920601126589
- Mishkin, F.S. (1990) Does Correcting for Heteroscedasticity Help? Economics Letter, 34, 351-356. http://dx.doi.org/10.1016/0165-1765(90)90144-P
- MacKinnon, J.G. (2011) Thirty Years of Heteroskedasticity-Robust Inference. Queen’s Economics Department Working Paper No. 1268.
- Long, J.S. and Ervin, L.H. (2000) Using Heteroscedasticity Consistent Standard Errors in the Linear Regression Model. The American Statistician, 54, 217-224.
- Lima, M.C., Souza, T.C., Cribari-Neto, F. and Fernandes, G.B. (2010) Heteroscedasticity-Robust Inference in Linear Regressions. Communications in Statistics-Simulation and Computation, 39, 194-206. http://dx.doi.org/10.1080/03610910903402572
- Chesher, A. (1989) Hájek Inequalities, Measures of Leverage and the Size of Heteroskedasticity Robust Wald Tests. Econometrica, 57, 971-977. http://dx.doi.org/10.2307/1913779