The error distribution testing plays an important role in linear regression as distribution misspecification seriously affects the validity and efficiency of regression analysis. The least squares (OLS) residuals are often used to construct test statistics; in order to overcome the non-independent and identically residuals, the best linear unbiased scale (BLUS) residuals are applied in this paper, which, unlike OLS residuals, the residuals vector is identically and independently distributed. Based on the BLUS residuals, a new test statistic is constructed by using the sample random distance between sample quantile and quasi sample quantile derived from the null distribution, and the goodness-of-fit test of error distribution in the linear model is studied. The powers of the new tests under certain alternatives are examined. They are more powerful tests for the hypotheses concerned.
KeywordsGoodness of FitCramér-Von Mises StatisticKolmogorov-Smirnov StatisticAnderson-Darling StatisticSample QuantilesStochastic Sample Quantiles
Eubank, R.L. and Hart, J.D. (1992) Testing Goodness-of-Fit in Regression via Order Selection Criteria. Annals of Statistics, 20, 1412-1425. https://doi.org/10.1214/aos/1176348775
Milhem, H. (2003) Testing the Goodness-of-Fit in a Gaussian Regression. Proceedings of the European Young Statisticians Meeting (EYSM), Ovronnaz, 21-26 September 2003, 101-111.
Young, S.G. and Bowman, A.W. (1995) Non-Parametric Analysis of Covariance. Biometrics, 51, 920-931. https://doi.org/10.2307/2532993
Durbin, J. (1973) Distribution Theory for Tests Based on the Sample Distribution Function. Society for Industrial and Applied Mathematics, Philadelphia. https://doi.org/10.1137/1.9781611970586
Durbin, J., Knott, M. and Taylor, C.C. (1975) Components of Cramérvon Mises statistics II. Journal of the Royal Statistical Society: Series B (Methodological), 37, 216-237. https://doi.org/10.1111/j.2517-6161.1975.tb01537.x
D’Agostino, R.B. and Stephens, M.A. (1986) Goodness-of-Fit Techniques. Marcel Dekker, Inc., New York.
Cox, D., Koh, E., Wahba, G. and Yandell, B.S. (1988) Testing the (Parametric) Null Model Hypothesis in (Semiparametric) Partial and Generalized Spline Models. Annals of Statistics, 16, 113-119. https://doi.org/10.1214/aos/1176350693
Gu, C. (1992) Diagnostics for Nonparametric Regression Models with Additive Terms. Journal of the American Statistical Association, 87, 1051-1058. https://doi.org/10.1080/01621459.1992.10476260
Eubank, R.L. and Hart, J.D. (1993) Commonality of Cusum, von Neumann and Smoothing-Based Goodness-of-Fit Tests. Biometrika, 80, 89-98. https://doi.org/10.1093/biomet/80.1.89
Eubank, R.L. and La Riccia, V.N. (1993) Testing for No Effect in Nonparametric Regression. Journal of Statistical Planning and Inference, 36, 1-14. https://doi.org/10.1016/0378-3758(93)90097-P
Stute, W. (1997) Nonparametric Model Checks for Regression. Annals of Statistics, 25, 613-641. https://doi.org/10.1214/aos/1031833666
Stute, W. and Gonzáilez Manteiga, W. (1996) NN Goodness-of-Fit Tests for Linear Models. Journal of Statistical Planning and Inference, 53, 75-92. https://doi.org/10.1016/0378-3758(95)00144-1
Stute, W., González Manteiga, W. and Presedo Quindimil, M. (1998) Bootstrap Approximations in Model Checks for Regression. Journal of the American Statistical Association, 93, 141-149. https://doi.org/10.1080/01621459.1998.10474096
Stute, W., Thies, S. and Zhu, L.X. (1998) Model Checks for Regression: An Innovation Process Approach. Annals of Statistics, 26, 1916-1934. https://doi.org/10.1214/aos/1024691363
Stute, W. and Zhu, L.X. (2002) Model Checks for Generalized Linear Models. Scandinavian Journal of Statistics, 29, 535-545. https://doi.org/10.1111/1467-9469.00304
Koul, H.L. and Ni, P. (2004) Minimum Distance Regression Model Checking. Journal of Statistical Planning and Inference, 119, 109-141. https://doi.org/10.1016/S0378-3758(02)00415-9
Zhu, L., Zhu, R. and Song, S. (2008) Diagnostic Checking for Multivariate Regression Models. Journal of Multivariate Analysis, 99, 1841-1859. https://doi.org/10.1016/j.jmva.2008.01.022
Theil, H. (1968) A Simplification of the BLUS Procedure for Analyzing Regression Disturbances. Journal of the American Statistical Association, 63, 242-251. https://doi.org/10.1080/01621459.1968.11009238
Magnus, J.R. and Sinha, A.K. (2005) On Theil’s Errors. Econometrics Journal, 8, 39-54. https://doi.org/10.1111/j.1368-423X.2005.00150.x
White, H. and MacDonald, G. (1980) Some Large-Sample tests for Non-Normality in the Linear Regression Model. Journal of the American Statistical Association, 75, 16-28. https://doi.org/10.1080/01621459.1980.10477415
Cliff, H.J. and Ben, B.W. (1974) On the Testing of Regression Disturbances for Normality. Journal of the American Statistical Association, 69, 330-335. https://doi.org/10.1080/01621459.1974.10482948
Jurečková, J., Picek, J. and Sen, P.K. (2003) Goodness-of-Fit Test with Nuisance Regression and Scale. Metrika, 58, 235-258. https://doi.org/10.1007/s001840300262
Sen, P.K., Jurečková, J. and Picek, J. (2003) Goodness-of-Fit Test of Shapiro-Wilk Type with Nuisance Regression and Scale. Austrian Journal of Statist, 32, 163-177.
Shapiro, S.S. and Wilk, M.B. (1965) An Analysis of Variance Test for Normality. Biomatrika, 52, 591-611. https://doi.org/10.1093/biomet/52.3-4.591
Jurečková, J. and Picek, J. (2007) Shapiro-Wilk Type Test of Normality under Nuisance Regression and Scale. Computational Statistics & Data Analysis, 51, 5184-5191. https://doi.org/10.1016/j.csda.2006.08.026
Neumeyer, N., Dette, H. and Nagel, E.-R. (2006) Bootstrap Tests for the Error Distribution in Linear and Nonparametric Regression Models. Australian & New Zealand Journal of Statistics, 48, 129-156. https://doi.org/10.1111/j.1467-842X.2006.00431.x
Hattab, M.W. and Christensen, R. (2018) Lack of Fit Tests Based on Sums of Ordered Residuals for Linear Models. Australian & New Zealand Journal of Statistics, 60, 230-257. https://doi.org/10.1111/anzs.12231
Christensen, R. and Sun, S.K. (2010) Alternative Goodness-of-Fit Tests for Linear Models. Journal of the American Statistical Association, 105, 291-301. https://doi.org/10.1198/jasa.2009.tm08697
Christensen, R. and Lin, Y. (2015) Lack-of-fit Tests Based on Partial Sums of Residuals. Communications in Statistics - Theory and Methods, 44, 2862-2880. https://doi.org/10.1080/03610926.2013.844256
Ramsey, J.B. (1969) Tests for Specification Errors in Classical Linear Least Squares Regression Analysis. Journal of the Royal Statistical Society: Series B (Methodological), 31, 350-371. https://doi.org/10.1111/j.2517-6161.1969.tb00796.x
Chinchilli, V.M. (1987) Blus Residuals in Multivariate Linear Models. In: Bozdogan, H. and Gupta, A.K., Eds., Multivariate Statistical Modeling and Data Analysis, Springer, Dordrecht, 61-75. https://doi.org/10.1007/978-94-009-3977-6_4
Vougas, D.V. (2008) Unit Root Testing Based on BLUS Residuals. Statistics & Probability Letters, 78, 1943-1947. https://doi.org/10.1016/j.spl.2008.01.063
Shapiro, S.S., Wilk, M.B. and Chen, H.J. (1968) A Comparative Study of Various Tests for Normality. Journal of the American Statistical Association, 63, 1343-1372. https://doi.org/10.1080/01621459.1968.10480932
De Wet, T. and Venter, J.H. (1972) Asymptotic Distributions of Certain Test Criteria of Normality. South African Statistical Journal, 6, 135-149.
Del Barrio, E., Couesta-Albertos, J.A., Rodríguez-Rodríguez, J.M. and del Barrio, E. (1999) Tests of Goodness of Fit Based on the L2-Wasserstein Distance. The Annals of Statistics, 27, 1230-1239. https://doi.org/10.1214/aos/1017938923
Scheffe, H. and Tukey, J.W. (1945) Non-Parametric Estimation. I. Validation of Order Statistics. The Annals of Mathematical Statistics, 16, 187-192. https://doi.org/10.1214/aoms/1177731119
Zhao, J., Xu, X. and Ding, X. (2009) Some New Goodness-of-Fit Tests Based on Stochastic Sample Quantiles. Communications in Statistics - Simulation and Computation, 38, 571-589. https://doi.org/10.1080/03610910802585832
Zhao, J. and Xu, X. (2014) Goodness-of-Fit Tests for Location?Cscale Families Based on Random Distance. Journal of Statistical Computation and Simulation, 84, 739-752. https://doi.org/10.1080/00949655.2012.725246
Gan, F.F. and Koehler, K.J. (1990) Goodness-of-Fit Tests Based on P-P Probability Plots. Technometrics, 32, 289-303. https://doi.org/10.2307/1269106
Krauczi, É. (2007) A Study of the Quantile Correlation Test for Normality. Test, 18, 156-165. https://doi.org/10.1007/s11749-007-0074-6