Robust Classification through a Nonparametric Kernel Discriminant Analysis
- 1 Department of Statistics and Actuarial Sciences, Jomo Kenyatta University of Agriculture and Technology, Nairobi, Kenya
- 2 Department of Statistics and Actuarial Sciences, Jomo Kenyatta University of Agriculture and Technology, Nairobi, Kenya
- 3 Department of Statistics and Actuarial Sciences, Jomo Kenyatta University of Agriculture and Technology, Nairobi, Kenya
- 4 Department of Statistics and Actuarial Sciences, Jomo Kenyatta University of Agriculture and Technology, Nairobi, Kenya
Abstract
The problem of classification in situations where the assumption of normality in the data is violated, and there are non-linear clustered structures in the dataset is addressed. A robust nonparametric kernel discriminant classification function, which is able to address this challenge, has been developed and the misclassification rates computed for various bandwidth matrices. A comparison with existing parametric classification functions such as the linear discriminant and quadratic discriminant is conducted to evaluate the performance of this classification function using simulated datasets. The results presented in this paper show good performance in terms of misclassification rates for the kernel discriminant classifier when the correct bandwidth is selected as compared to other identified existing classifiers. In this regard, the study recommends the use of the proposed kernel discriminant classification rule when one wishes to classify units into one of several categories or population groups where parametric classifiers might not be applicable.
- Manly, M. and Van Waas, L. (2014) The State of Statelessness Research: A Human Rights Imperative. Tilburg Law Review, 19, 3-10.
- Lachenbruch, P.A. (1974) Discriminant Analysis When the Initial Samples Are Misclassified II: Non-Random Misclassification Models. Technometrics, 16, 419-424. https://doi.org/10.1080/00401706.1974.10489211
- Johnson, R.A., Wichern, D.W., et al. (2014) Applied Multivariate Statistical Analysis. Volume 6, Pearson, London.
- Flury, B. (2013) A First Course in Multivariate Statistics. Springer Science & Business Media, Dordrecht.
- Cochran, W.G. (2007) Sampling Techniques. John Wiley & Sons, Inc., New York.
- Silverman, B.W. (2018) Density Estimation for Statistics and Data Analysis. Routledge, New York. https://doi.org/10.1201/9781315140919
- Scott, D.W. (1991) Feasibility of Multivariate Density Estimates. Biometrika, 78, 197-205. https://doi.org/10.1093/biomet/78.1.197
- Simonoff, J.S. (1996) Further Applications of Smoothing. In: Simonoff, J.S., Ed., Smoothing Methods in Statistics, Springer, New York, 252-274. https://doi.org/10.1007/978-1-4612-4026-6_7
- Hand, D.J. (1982) Kernel Discriminant Analysis. John Wiley & Sons, Inc., New York.
- Scott, D.W. (1992) Multivariate Density Estimation: Theory, Practice and Visualisation. John Willey and Sons, Inc., New York.
- Hall, P. and Wand, M.P. (1988) On Nonparametric Discrimination Using Density Differences. Biometrika, 75, 541-547. https://doi.org/10.1093/biomet/75.3.541