Investigating Performances of Some Statistical Tests for Heteroscedasticity Assumption in Generalized Linear Model: A Monte Carlo Simulations Study
- 1 Department of Statistics, Faculty of Science, University of Abuja, Abuja, Nigeria
- 2 Department of Statistics, Faculty of Science, University of Abuja, Abuja, Nigeria
Abstract
In a linear regression model, testing for uniformity of the variance of the residuals is a significant integral part of statistical analysis. This is a crucial assumption that requires statistical confirmation via the use of some statistical tests mostly before carrying out the Analysis of Variance (ANOVA) technique. Many academic researchers have published series of papers (articles) on some tests for detecting variance heterogeneity assumption in multiple linear regression models. So many comparisons on these tests have been made using various statistical techniques like biases, error rates as well as powers. Aside comparisons, modifications of some of these statistical tests for detecting variance heterogeneity have been reported in some literatures in recent years. In a multiple linear regression situation, much work has not been done on comparing some selected statistical tests for homoscedasticity assumption when linear, quadratic, square root, and exponential forms of heteroscedasticity are injected into the residuals. As a result of this fact, the present study intends to work extensively on all these areas of interest with a view to filling the gap. The paper aims at providing a comprehensive comparative analysis of asymptotic behaviour of some selected statistical tests for homoscedasticity assumption in order to hunt for the best statistical test for detecting heteroscedasticity in a multiple linear regression scenario with varying variances and levels of significance. In the literature, several tests for homoscedasticity are available but only nine: Breusch-Godfrey test, studentized Breusch-Pagan test, White’s test, Nonconstant Variance Score test, Park test, Spearman Rank, Glejser test, Goldfeld-Quandt test, Harrison-McCabe test were considered for this study; this is with a view to examining, by Monte Carlo simulations, their asymptotic behaviours. However, four different forms of heteroscedastic structures: exponential and linear (generalize of square-root and quadratic structures) were injected into the residual part of the multiple linear regression models at different categories of sample sizes: 30, 50, 100, 200, 500 and 1000. Evaluations of the performances were done within R environment. Among other findings, our investigations revealed that Glejser and Park tests returned the best test to employ to check for heteroscedasticity in EHS and LHS respectively also White and Harrison-McCabe tests returned the best test to employ to check for homoscedasticity in EHS and LHS respectively for sample size less than 50.
- Bartlett, M.S. and Kendall, D.G. (1946) The Statistical Analysis of Variance Heterogeneity and the Logarithmic Transformation. Supplement to the Journal of the Royal Statistical Society, 8, 128-138. https://doi.org/10.2307/2983618
- Weerahandi, S. (1995) ANOVA under Unequal Error Variances. Biometrics, 51, 589-599. https://doi.org/10.2307/2532947
- Ogunleye, T.A., Olaleye, M.O. and Solomon, A.Z. (2014) Econometric Modelling of Commercial Banks’ Expenditure on the Sources of Profit Maximization in Nigeria. Scholars Journal of Economics, Business and Management, 1, 276-290.
- Lim, T.S. and Loh, W.Y. (1996) A Comparison of Tests of Equality of Variances. Computational Statistics and Data Analysis, 22, 287-301. https://doi.org/10.1016/0167-9473(95)00054-2
- White, H. (1980) A Heteroscedasticity Consistent Covariance Matrix and Direct Test for Heteroscedasticity. Econometrica, 48, 817-838. https://doi.org/10.2307/1912934
- Graybill, F.A. (1976) The Theory and Applications of the Linear Model. Duxbury Press, London.
- Conover, W.J., Johnson, M.E. and Johnsons, M.M. (1981) A Comparative Study of Tests for Homogeneity of Variances with Applications to the Outer Continental Shelf Bidding Data. Technometrics, 23, 351-361. https://doi.org/10.1080/00401706.1981.10487680
- Feingold, A. (1992) Sex Differences in Variability in Intellectual Abilities: A New Look at an Old Controversy. Review of Educational Research, 62, 61-84. https://doi.org/10.3102/00346543062001061
- Hedges, L.V. and Friedman, L. (1993) Gender Differences in Variability in Intellectual Abilities: A Re-Analysis of Feingold’s Results. Review of Educational Research, 63, 94-105. https://doi.org/10.3102/00346543063001094
- Carroll, R.J. (1982) Tests for Regression Parameters in Power Transformation Models. Scandinavian Journal of Statistics, 9, 217-222.
- Mendes, M. (2003) The Comparison of Levene, Bartlett, Neymann-Pearson and Bartlett 2 Tests in Terms of Actual Type I Error Rates. Journal of Agriculture Sciences, 9, 143-146. https://doi.org/10.1501/Tarimbil_0000000782
- Camdeviren, H. and Mendes, M. (2005) A Simulation Study for Type III Error Rates of Some Variance Homogeneity Tests. Pakistan Journal of Statistics, 21, 223-234.
- Rogan, J.C. and Keselman, H.J. (1977) Is the ANOVA F-Test Robust to Variance Heterogeneity When Sample Sizes Are Equal? An Investigation via a Coefficient of Variation. American Educational Research Journal, 14, 493-498. https://doi.org/10.3102/00028312014004493