Research ArticleOpen AccessGoogle Scholar indexed
On Identifying Influential Observations in the Presence of Multicollinearity
Department of Statistics, Nnamdi Azikiwe University, Awka, Nigeria
Department of Statistics, Nnamdi Azikiwe University, Awka, Nigeria
- 1 Department of Statistics, Nnamdi Azikiwe University, Awka, Nigeria
- 2 Department of Statistics, Nnamdi Azikiwe University, Awka, Nigeria
Open Journal of Statistics·Volume 11 (2021)·Pages 290–302·Published 8 March 2021·DOI10.4236/ojs.2021.112016
Copy link · social · email
Abstract
Influential observation is one which either individually or together with several other observations has a demonstrably large impact on the values of various estimates of regression coefficient. It has been suggested by some authors that multicollinearity should be controlled before attempting to measure influence of data point. In using ridge regression to mitigate the effect of multicollinearity, there arises a problem of choosing possible of ridge parameter that guarantees stable regression coefficients in the regression model. This paper seeks to check whether the choice of ridge parameter estimator influences the identified influential data points .
KeywordsMulticollinerityRidge ParameterInfluential MeasuresOutliersLeverage Point
- Belsley, A., Kuh, E. and Welsch, R. (1989) Regression Diagnostics: Identifying Influential Data and Sources of Collinearity. John Wiley and Sons, New York.
- Johnson, R.A. and Wichern, D.W. (2002) Applied Multivariate Statistical Analysis. Pearson Education, Delhi.
- Mickey, M.R., Dunn, O.J. and Clark, V. (1976) Note on the Use of Stepwise Regression in Detecting Outliers. Computers and Biomedical Research, 1, 105-111. https://doi.org/10.1016/0010-4809(67)90009-2
- Andrews, D.F. and Pregibon, D. (1978) Finding the Outliers That Matters. Journal of Royal Statistical Society, Series B, 40, 85-93. https://doi.org/10.1111/j.2517-6161.1978.tb01652.x
- Hoerl, A.E. and Kennard, R.W. (1970) Ridge Regression: Biased Estimation for Non-Orthogonal Problems. Technometrics, 12, 55-67. https://doi.org/10.1080/00401706.1970.10488634
- Hoerl, A.E., Kennard, R.W. and Baldwin, K.F. (1975) Ridge Regression: Some Simulations. Communications in Statistics, 4, 105-123. https://doi.org/10.1080/03610917508548342
- Lawless, J.F. and Wang, P. (1976) A Simulation Study of Ridge and Other Regression Estimators. Communications in Statistics A, 5, 307-323. https://doi.org/10.1080/03610927608827353
- Nomura, M. (1988) On the Almost Unbiased Ridge Regression Estimation. Communications in Statistics—Simulation and Computation, 17, 729-743. https://doi.org/10.1080/03610918808812690
- Khalaf, G. and Shukur, G. (2005) Choosing Ridge Regression Parameters for Regression Problems. Communications in Statistics—Simulation and Computations, 32, 419-435.
- Dorugade, A. (2014) New Ridge Parameters for Ridge Regression. Journal of the Association of Arab Universities for Basic and Applied Sciences, 15, 94-99. https://doi.org/10.1016/j.jaubas.2013.03.005
- Al-Hassan, Y.M. (2010) Performance of a New Ridge Regression Estimator. Journal of the Association of Arab Universities for Basic and Applied Science, 9, 23-26. https://doi.org/10.1016/j.jaubas.2010.12.006
- Dorugade, A.V. and Kashid, D.N. (2010) Alternative Methods for Choosing Ridge Parameter for Regression. Applied Mathematical Science, 4, 447-456.
- Saleh, A.K.Md. and Kibria, B.M.G. (1993) Performances of Some New Preliminary Test Ridge Regression Estimators and Their Properties. Communication in Statistics—Theory and Methods, 22, 2747-2764. https://doi.org/10.1080/03610929308831183