Cross Entropy Based Sparse Logistic Regression to Identify Phenotype-Related Mutations in Methicillin-Resistant <i>Staphylococcus aureus</i>
- 1 Graduate School of Natural Science and Technology, Kanazawa University, Kanazawa, Japan
- 2 Graduate School of Natural Science and Technology, Kanazawa University, Kanazawa, Japan
- 3 Graduate School of Natural Science and Technology, Kanazawa University, Kanazawa, Japan
- 4 Graduate School of Natural Science and Technology, Kanazawa University, Kanazawa, Japan
- 5 Graduate School of Natural Science and Technology, Kanazawa University, Kanazawa, Japan
- 6 Graduate School of Natural Science and Technology, Kanazawa University, Kanazawa, Japan
- 7 Graduate School of Natural Science and Technology, Kanazawa University, Kanazawa, Japan
- 8 Institute of Science and Engineering, Kanazawa University, Kanazawa, Japan
- 9 Institute of Science and Engineering, Kanazawa University, Kanazawa, Japan
Abstract
Emergence of drug resistant bacteria is one of the serious problems in today’s public health. However, the relationship between genomic mutation of bacteria and the phenotypic difference of them is still unclear. In this paper, based on the mutation information in whole genome sequences of 96 MRSA strains, two kinds of phenotypes (pathogenicity and drug resistance) were learnt and predicted by machine learning algorithms. As a result of effective feature selection by cross entropy based sparse logistic regression, these phenotypes could be predicted in sufficiently high accuracy (100% and 97.87%, respectively) with less than 10 features. It means that we could develop a novel rapid test method in the future for checking MRSA phenotypes.
- Lustig, M., Donoho, D. and Pauly, J.M. (2007) Sparse MRI: The Application of Compressed Sensing for Rapid MR Imaging. Resonance in Medicine, 58, 1182-1195. https://doi.org/10.1002/mrm.21391
- Liang, Y., Liu, C., Luan, X.-Z., Leung, K.-S., Chan, T.-M., Xu, Z.-B. and Zhang, H. (2013) Sparse Logistic Regression with a L1/2 Penalty for Gene Selection in Cancer Classification. BMC Bioinformatics, 14, 198-210. https://doi.org/10.1186/1471-2105-14-198
- Rasmussen, M.A. and Bro, R. (2012) A Tutorial on the Lasso Approach to Sparse Modeling. Chemometrics and Intelligent Laboratory Systems, 119, 21-31. https://doi.org/10.1016/j.chemolab.2012.10.003
- Ma, S. and Huang, J. (2008) Penalized Feature Selection and Classification in Bioinformatics. Briefings in Bioinformatics, 9, 392-403. https://doi.org/10.1093/bib/bbn027
- Liu, Z., et al. (2007) Sparse Logistic Regression with Lp Penalty for Biomarker Identification. Statistical Applications in Genetics and Molecular Biology, 6, Article 6. https://doi.org/10.2202/1544-6115.1248
- Zhu, J. and Hastie, T. (2004) Classification of Gene Microarrays by Penalized Logistic Regression. Biostatistics, 5, 427-443. https://doi.org/10.1093/biostatistics/kxg046
- Tibshirani, R. (1996) Regression Shrinkage and Selection via the Lasso. Journal of the Royal Statistical Society. Series B (Methodological), 58, 267-288. https://doi.org/10.1111/j.2517-6161.1996.tb02080.x
- Zou, H. (2006) The Adaptive Lasso and Its Oracle Properties. Journal of the American Statistical Association, 101, 1418-1429. https://doi.org/10.1198/016214506000000735
- Rubinstein, R.Y. (1997) Optimization of Computer Simulation Models with Rare Events. European Journal of Operation Research, 99, 89-112. https://doi.org/10.1016/S0377-2217(96)00385-2
- Rubinstein, R.Y. (1999) The Cross-Entropy Method for Combinatorial and Continuous Optimization. Methodology and Computing in Applied Probability, 1, 127-190. https://doi.org/10.1023/A:1010091220143
- Kroese, D.P., Porotsky, S. and Rubinstein, R.Y. (2006) The Cross-Entropy Method for Continuous Multi-Extremal Optimization. Methodology and Computing in Applied Probability, 8, 383-407. https://doi.org/10.1007/s11009-006-9753-0
- Kroese, D.P., Rubinstein, R.Y. and Taimre, T. (2007) Application of the Cross-Entropy Method to Clustering and Vector Quantization. Journal of Global Optimization, 37, 137-157. https://doi.org/10.1007/s10898-006-9041-0