Lung cancer is one of the greatest threats to human health. It is a very effective way to detect lung cancer by pathological pictures of lung cancer cells. Therefore, improving the accuracy and stability of diagnosis is very important. In this study, we develop an automatic detection scheme for lung cancer cells based on convolutional neural networks and Swin Transformer. Micro scopic images of patients’ lung cells are first segmented using a Mask R-CNN- based network, resulting in a separate image for each cell. Part of the background information is preserved by Gaussian blurring of surrounding cells, while the target cells are highlighted. The classification model based on Swin Transformer not only reduces the computation but also achieves better results than the classical CNN model, ResNet50. The final results show that the accuracy of the method proposed in this paper reaches 96.16%. Therefore, this method is helpful for the detection and classification of lung cancer cells.
KeywordsLung CancerClassificationSwin Transformer
Siegel, R.L., Miller, K.D., Fuchs, H.E., et al. (2022) Cancer Statistics, 2022. CA: A Cancer Journal for Clinicians, 72, 7-33. https://doi.org/10.3322/caac.21708
Asuntha, A. and Srinivasan, A. (2020) Deep Learning for Lung Cancer Detection and Classification. Multimedia Tools and Applications, 79, 7731-7762. https://doi.org/10.1007/s11042-019-08394-3
da Silva, G.L.F., de Carvalho Filho, A.O., Silva, A.C., de Paiva, A.C. and Gattass, M. (2016) Taxonomic Indexes for Differentiating Malignancy of Lung Nodules on CT Images. Research on Biomedical Engineering, 32, 263-272. https://doi.org/10.1590/2446-4740.04615
VanderLaan, P.A. (2018) Updates in Lung Cancer Cytopathology. Surgical Pathology Clinics, 11, 515-522. https://doi.org/10.1016/j.path.2018.04.004
Fernandes, K., Chicco, D., Cardoso, J.S., et al. (2018) Supervised Deep Learning Embeddings for the Prediction of Cervical Cancer Diagnosis. PeerJ Computer Science, 4, e154. https://doi.org/10.7717/peerj-cs.154
Kann, B.H., Hosny, A. and Aerts, H.J.W.L. (2021) Artificial Intelligence for Clinical Oncology. Cancer Cell, 39, 916-927. https://doi.org/10.1016/j.ccell.2021.04.002
Han, F.J., Yu, L. and Jiang, Y. (2020) Computer-Aided Diagnosis System of Lung Carcinoma Using Convolutional Neural Networks. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, Seattle, 14-19 June 2020, 690-691. https://doi.org/10.1109/CVPRW50498.2020.00353
Bera, K., Schalper, K.A., Rimm, D.L., Velcheti, V. and Madabhushi, A. (2019) Artificial Intelligence in Digital Pathology—New Tools for Diagnosis and Precision Oncology. Nat Rev Clin Oncol, 16, 703-715. https://doi.org/10.1038/s41571-019-0252-y
Campanella, G., Hanna, M.G., Geneslaw, L., Miraflor, A., Silva, V.W.K., Busam, K.J., Brogi, E., Reuter, V.E., Klimstra, D.S. and Fuchs, T.J. (2019) Clinical-Grade Computational Pathology Using Weakly Supervised Deep Learning on Whole Slide Images. Nature Medicine, 25, 1301-1309. https://doi.org/10.1038/s41591-019-0508-1
Fourcade, A. and Khonsari, R.H. (2019) Deep Learning in Medical Image Analysis: A Third Eye for Doctors. Journal of Stomatology, Oral and Maxillofacial Surgery, 120, 279-288. https://doi.org/10.1016/j.jormas.2019.06.002
Zhao, J., Liang, L.K., He, Y.J., et al. (2019) Cervical Nucleus Segmentation Method in Complex Background. Journal of Harbin University of Science and Technology, 24, 25-31.
Sun, H.F., Yang, J.H., Fan, R.B., et al. (2020) Stepwise Local Stitching Ultrasound Image Algorithms Based on Adaptive Iterative Threshold Harris Corner Features. Medicine, 99, e22189. https://doi.org/10.1097/MD.0000000000022189
Feng, F., Liu, P.X., Li, L., et al. (2018) Research on GSA Algorithm Improved by FCM Fusion in Medical Image Segmentation. Computer Science, 45, 252-254.
Bai, X.Z., Sun, C.X. and Sun, C.M. (2019) Cell Segmentation Based on FOPSO Combined with Shape Information Improved Intuitionistic FCM. IEEE Journal of Biomedical and Health Informatics, 23, 449-459. https://doi.org/10.1109/JBHI.2018.2803020
Gamarra, M., Zurek, E., Escalante, H.J., et al. (2019) Split and Merge Watershed: A Two-Step Method for Cell Segmentation in Fluorescence Microscopy Images. Biomedical Signal Processing and Control, 53, Article ID: 101575. https://doi.org/10.1016/j.bspc.2019.101575
He, A.L., Cheng, X.B., Liao, L.C., et al. (2020) A Watershed Remote Sensing Image Segmentation Method Coupled with H-Minima and Mathematical Morphology. Journal of East China University of Science and Technology (Natural Science Edition), 43, 396-400.
Hsu, W.Y., Lu, C.C. and Hsu, Y.Y. (2020) Improving Segmentation Accuracy of CT Kidney Cancer Images Using Adaptive Active Contour Model. Medicine, 99, e23083. https://doi.org/10.1097/MD.0000000000023083
Liu, Y.M. (2019) Nucleus Segmentation of Cervical Cancer Images Based on Deep Learning and Conditional Random Fields. North Central University, Minneapolis.
Cai, S., Tian, Y., Lu, I.H., et al. (2020) Dense-Unet: A Novel Multiphoton in Vivo Cellular Image Segmentation Model Based on a Convolutional Neural Network. Quantitative Imaging in Medicine and Surgery, 10, 1275-1285. https://doi.org/10.21037/qims-19-1090
Liu, Z. (2021) Construction and Verification of Color Fundus Image Retinal Vessels Segmentation Algorithm under BP Neural Network. The Journal of Supercomputing, 77, 7171-7183. https://doi.org/10.1007/s11227-020-03551-0
Martínez-Mása, J., Bueno-Crespob, A. and Martínez-España, R. (2020) Classifying Papanicolaou Cervical Smears through a Cell Merger Approach by Deep Learning Technique. Expert Systems with Applications, 160, Article ID: 113707. https://doi.org/10.1016/j.eswa.2020.113707
Simonyan, K. and Zisserman, A. (2014) Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv:1409.1556.
He, K., Zhang, X., Ren, S., et al. (2016) Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, 27-30 June 2016, 770-778. https://doi.org/10.1109/CVPR.2016.90
Huang, G., Liu, Z., Van Der Maaten, L., et al. (2017) Densely Connected Convolutional Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, 21-26 July 2017, 4700-4708. https://doi.org/10.1109/CVPR.2017.243
Teramoto, A., Tsukamoto, T., Kiriyama, Y., et al. (2017) Automated Classification of Lung Cancer Types from Cytological Images Using Deep Convolutional Neural Networks. BioMed Research International, 2017, Article ID: 4067832. https://doi.org/10.1155/2017/4067832
Gonzalez, D., Dietz, R.L. and Pantanowitz, L. (2020) Feasibility of a Deep Learning Algorithm to Distinguish Large Cell Neuroendocrine from Small Cell Lung Carcinoma in Cytology Specimens. Cytopathology, 31, 426-431. https://doi.org/10.1111/cyt.12829
Vaswani, A., Shazeer, N., Parmar, N., et al. (2017) Attention Is All You Need. Advances in Neural Information Processing Systems, Long Beach, 4-9 December 2017, 5998-6008.
Dosovitskiy, A., Beyer, L., Kolesnikov, A., et al. (2020) An Image Is Worth 16x16 Words: Transformers for Image Recognition at Scale. arXiv:2010.11929.
Liu, Z., Lin, Y., Cao, Y., et al. (2021) Swin Transformer: Hierarchical Vision Transformer Using Shifted Windows. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, 10-17 October 2021, 10012-10022. https://doi.org/10.1109/ICCV48922.2021.00986
Costa, G.S.S., Paiva, A.C., Junior, G.B. and Ferreira, M.M. (2021) Covid-19 Automatic Diagnosis with CT Images Using the Novel Transformer Architecture. Anais do XXI Simpósio Brasileiro de Computação Aplicada à Saúde, Virtual Event, 15-18 June 2021, 293-301.
van Tulder, G., Tong, Y. and Marchiori, E. (2021) Multi-View Analysis of Unregistered Medical Images Using Cross-View Transformers. International Conference on Medical Image Computing and Computer-Assisted Intervention, Virtual Event, 27 September-1 October 2021, 104-113. https://doi.org/10.1007/978-3-030-87199-4_10
Hollandi, R., Szkalisity, A., Toth, T., et al. (2020) NucleAIzer: A Parameter-Free Deep Learning Framework for Nucleus Segmentation Using Image Style Transfer. Cell Systems, 10, 453-458.E6. https://doi.org/10.1016/j.cels.2020.04.003