Research ArticleOpen AccessGoogle Scholar indexed
The SVM Classifier with Quartic Truncated Pinball Loss
Department of Mathematics, Jinan University, Guangzhou, China
Department of Mathematics, Jinan University, Guangzhou, China
- 1 Department of Mathematics, Jinan University, Guangzhou, China
- 2 Department of Mathematics, Jinan University, Guangzhou, China
Copy link · social · email
Abstract
In the field of machine learning, support vector machine (SVM) is popular for its powerful performance in classification tasks. However, this method could be adversely affected by data containing noise. One of the main reasons is that many loss functions are too sensitive to sample points far from their classes. In this paper, based on the idea of HTPSVM proposed in (Zhu, Song, et al .), we introduce the SVM classifier with quartic truncated pinball loss (QTPSVM), which can be solved by Bregman modified second accelerated proximal gradient method (BAPGs). Numerical experiments show that QTPSVM is more effective on many real data.
KeywordsSupport Vector Machinethe SVM Classifier with Huberized Truncated Pinball Loss (HTPSVM)the SVM Classifier with Quartic Truncated Pinball Loss (QTPSVM)the Bregman Modified Second APG Method (BAPGs)
- Vapnik, V.N. (1995) The Nature of Statistical Learning Theory. Springer-Verlag. https://doi.org/10.1007/978-1-4757-2440-0
- Bishop, C.M. (2006) Pattern Recognition and Machine Learning. Springer.
- Huang, X.L., Shi, L. and Suykens, J.A.K. (2014) Support Vector Machine Classifier with Pinball Loss. IEEE Transactions on Pattern Analysis and Machine Intelligence , 36, 984-997. https://doi.org/10.1109/tpami.2013.178
- Rastogi (nee. Khemchandani), R., Pal, A. and Chandra, S. (2018) Generalized Pinball Loss SVMs. Neurocomputing , 322, 151-165. https://doi.org/10.1016/j.neucom.2018.08.079
- Chong, E.K.P. and Zak, S.H. (2013) An Introduction to Optimization. 4th Edition, Wiley.
- Luo, J., Qiao, H. and Zhang, B. (2021) Learning with Smooth Hinge Losses. Neurocomputing , 463, 379-387. https://doi.org/10.1016/j.neucom.2021.08.060
- Zhu, W., Song, Y. and Xiao, Y. (2020) Support Vector Machine Classifier with HUberized Pinball Loss. Engineering Applications of Artificial Intelligence , 91, Article ID: 103635. https://doi.org/10.1016/j.engappai.2020.103635
- Makmuang, D., Ratiphaphongthon, W. and Wangkeeree, R. (2023) Smooth Support Vector Machine with Generalized Pinball Loss for Pattern Classification. The Journal of Supercomputing , 79, 11684-11706. https://doi.org/10.1007/s11227-023-05082-w
- Wu, Y. and Liu, Y. (2007) Robust Truncated Hinge Loss Support Vector Machines. Journal of the American Statistical Association , 102, 974-983. https://doi.org/10.1198/016214507000000617
- Zhu, W., Song, Y. and Xiao, Y. (2022) Robust Support Vector Machine Classifier with Truncated Loss Function by Gradient Algorithm. Computers & Industrial Engineering , 172, Article ID: 108630. https://doi.org/10.1016/j.cie.2022.108630
- Wang, L.M., Liu, Z.Y. and Liu, C.G. (2024) The Bregman Modified Second APG Method for DC Optimization Problems.
- Becker, N., Toedt, G., Lichter, P. and Benner, A. (2011) Elastic SCAD as a Novel Penalization Method for SVM Classification Tasks in High-Dimensional Data. BMC Bioinformatics , 12, Article No. 138. https://doi.org/10.1186/1471-2105-12-138
- Zou, H. and Hastie, T. (2005) Addendum: Regularization and Variable Selection via the Elastic Net. Journal of the Royal Statistical Society Series B : Statistical Methodology , 67, 768-768. https://doi.org/10.1111/j.1467-9868.2005.00527.x