Improving Accuracy of Normal Approximation
- 1 Department of Mathematics, Brock University, St. Catharines, Ontario, Canada
Abstract
The Central Limit Theorem occasionally results in extremely slow convergence to the Normal distribution, making the corresponding approximation virtually useless (a typical example being the sample correlation coefficient). In most of these cases, there is a relatively easy way of substantially improving the approximation by including a few extra terms of the corresponding Edgeworth expansion to match not only the distribution’s mean and variance, but also its skewness and kurtosis. A further improvement is possible by transforming the studied sample statistic to fully remove the skewness; this simplifies the resulting approximation, making it also more accurate. All this is amply demonstrated by many practical examples.
- (2001) Central Limit Theorem. In: Encyclopedia of Mathematics , EMS Press. http://encyclopediaofmath.org/index.php?title=Central_limit_theorem&oldid=18508
- Edgeworth, F.Y. (1905) The Law of Error I. Proceedings of the Cambridge Philosophical Society , 20, 36-65.
- Kendall, M.G. and Stuart, A. (1969) The Advanced Theory of Statistics. Volume 1, 3rd Edition, Griffin.
- Cornish, E.A. and Fisher, R.A. (1938) Moments and Cumulants in the Specification of Distributions. Revue de l ’ Institut International de Statistique / Review of the International Statistical Institute , 5, 307-320. https://doi.org/10.2307/1400905
- Vrbik, J. (2014) Asymptotic Expansion of Sampling Distributions of an MLE to 1/ n Accuracy. Advances and Applications in Statistics , 38, 37-50.
- Fisher, R.A. (1915) Frequency Distribution of the Values of the Correlation Coefficient in Samples from an Indefinitely Large Popuation. Biometrika , 10, 507-521. https://doi.org/10.1093/biomet/10.4.507
- Hotelling, H. (1953) New Light on the Correlation Coefficient and Its Transforms. Journal of the Royal Statistical Society Series B : Statistical Methodology , 15, 193-225. https://doi.org/10.1111/j.2517-6161.1953.tb00135.x
- Winterbottom, A. (1979) A Note on the Derivation of Fisher’s Transformation of the Correlation Coefficient. The American Statistician , 33, 142-143. https://doi.org/10.1080/00031305.1979.10482682
- Vrbik, J. (2022) Fisher Transformation via Edgeworth Expansion. https://arxiv.org/abs/2208.05070v1