Brain tumor segmentation is a vital step in diagnosis, treatment planning, and prognosis in neuro-oncology. In recent years, deep learning approaches have revolutionized this field, evolving from the foundational 3D U-Net architecture widely regarded as a benchmark for volumetric medical image segmentation to more advanced transformer-based models such as Swin UNET Transformers. Despite the success of 3D U-Net, challenges remain due to its reliance on local dependencies, which limit its ability to capture global context. Additional difficulties include accurately delineating complex tumor boundaries, addressing class imbalance across tumor subregions, and ensuring stable training of deep networks. This review comprehensively surveys the evolution of brain tumor segmentation techniques, emphasizing the transition from conventional U-Net models to cutting-edge Swin UNET transformer architectures. We discuss the impact of novel activation functions on improving gradient stability and segmentation accuracy. Furthermore, we explore complementary advancements, including weakly supervised learning, transformer-based frameworks for enhanced global context modeling, generative models for data augmentation, explainable AI for increased interpretability, and federated learning approaches for privacy-preserving collaboration. Key public datasets, such as BraTS, and standard evaluation metrics are reviewed to contextualize model performance. Lastly, we address ongoing challenges such as data heterogeneity, real-time clinical applicability, and integration barriers, and propose future directions for developing robust, interpretable, and scalable brain tumor segmentation systems. This review aims to provide researchers with a clear perspective on the next-generation evolution of deep learning methods that are shaping the future of brain tumor segmentation.
Hanif, F., Muzaffar, K., Perveen, K., Malhi, S.M. and Simjee, S.U. (2017) Glioblastoma Multiforme: A Review of its Epidemiology and Pathogenesis through Clinical Presentation and Treatment. Asian Pacific Journal of Cancer Prevention , 18, 3-9.
Louis, D.N., Perry, A., Wesseling, P., Brat, D.J., Cree, I.A., Figarella-Branger, D., et al. (2021) The 2021 WHO Classification of Tumors of the Central Nervous System: A Summary. Neuro - Oncology , 23, 1231-1251. https://doi.org/10.1093/neuonc/noab106
Menze, B.H., Jakab, A., Bauer, S., Kalpathy-Cramer, J., Farahani, K., Kirby, J., et al. (2015) The Multimodal Brain Tumor Image Segmentation Benchmark (Brats). IEEE Transactions on Medical Imaging , 34, 1993-2024. https://doi.org/10.1109/tmi.2014.2377694
Isensee, F., Kickingereder, P., Wick, W., Bendszus, M. and Maier-Hein, K.H. (2018) Brain Tumor Segmentation and Radiomics Survival Prediction: Contribution to the BRATS 2017 Challenge. In: Crimi, A., Bakas, S., Kuijf, H., Menze, B. and Reyes, M., Eds., Brainlesion : Glioma , Multiple Sclerosis , Stroke and Traumatic Brain Injuries. BrainLes 2017, Springer, 287-297. https://doi.org/10.1007/978-3-319-75238-9_25
Bakas, S., Akbari, H., Sotiras, A., Bilello, M., Rozycki, M., Kirby, J.S., et al. (2017) Advancing the Cancer Genome Atlas Glioma MRI Collections with Expert Segmentation Labels and Radiomic Features. Scientific Data , 4, Article No. 170117. https://doi.org/10.1038/sdata.2017.117
Myronenko, A. (2019) 3D MRI Brain Tumor Segmentation Using Autoencoder Regularization. In: Crimi, A., Bakas, S., Kuijf, H., Keyvan, F., Reyes, M. and van Walsum, T., Eds., Brainlesion : Glioma , Multiple Sclerosis , Stroke and Traumatic Brain Injuries , Springer, 311-320. https://doi.org/10.1007/978-3-030-11726-9_28
Ronneberger, O., Fischer, P. and Brox, T. (2015) U-Net: Convolutional Networks for Biomedical Image Segmentation. In: Navab, N., Hornegger, J., Wells, W. and Frangi, A., Eds., Medical Image Computing and Computer-Assisted Intervention — MICCAI 2015, Springer, 234-241. https://doi.org/10.1007/978-3-319-24574-4_28
Baid, U., et al. (2021) The RSNA-ASNR-MICCAI BraTS 2021 Benchmark on Brain Tumor Segmentation and Radiogenomic Classification. arXiv: 2107.02314v2. https://arxiv.org/pdf/2107.02314
Isensee, F., Jäger, P.F., Full, P.M., Vollmuth, P. and Maier-Hein, K.H. (2021) Nnu-Net for Brain Tumor Segmentation. In: Crimi, A. and Bakas, S., Eds., Brainlesion : Glioma , Multiple Sclerosis , Stroke and Traumatic Brain Injuries , Springer, 118-132. https://doi.org/10.1007/978-3-030-72087-2_11
Hatamizadeh, A., Tang, Y., Nath, V., Yang, D., Myronenko, A., Landman, B., et al. (2022) UNETR: Transformers for 3D Medical Image Segmentation. 2022 IEEE / CVF Winter Conference on Applications of Computer Vision ( WACV ), Waikoloa, 3-8 January 2022, 1748-1758. https://doi.org/10.1109/wacv51458.2022.00181
Li, X., Jiang, M., Zhang, X., Kamp, M. and Dou, Q. (2021) FedBN: Federated Learning on Non-IID Features via Local Batch Normalization. arXiv: 2102.07623v2. https://arxiv.org/pdf/2102.07623
Zhou, Z. (2017) A Brief Introduction to Weakly Supervised Learning. National Science Review , 5, 44-53. https://doi.org/10.1093/nsr/nwx106
Liu, L., Fieguth, P., Pietikainen, M. and Lao, S. (2015) Median Robust Extended Local Binary Pattern for Texture Classification. 2015 IEEE International Conference on Image Processing ( ICIP ), Quebec City, 27-30 September 2015, 2319-2323. https://doi.org/10.1109/icip.2015.7351216
Almijalli, M., Almusayib, F.A., Albugami, G.F., Aloqalaa, Z., Altwijri, O. and Saad, A.S. (2025) Automatic Active Contour Algorithm for Detecting Early Brain Tumors in Comparison with AI Detection. Processes , 13, Article 867. https://doi.org/10.3390/pr13030867
Verma, O.P., Hanmandlu, M., Susan, S., Kulkarni, M. and Jain, P.K. (2011) A Simple Single Seeded Region Growing Algorithm for Color Image Segmentation Using Adaptive Thresholding. 2011 International Conference on Communication Systems and Network Technologies , Katra, 3-5 June 2011, 500-503. https://doi.org/10.1109/csnt.2011.107
Zhang, X., Zhao, J. and Lecun, Y. (2015) Character-Level Convolutional Networks for Text Classification. arXiv: 1509.01626v3. https://arxiv.org/pdf/1509.01626
Katuwal, R. and Suganthan, P.N. (2018) Enhancing Multi-Class Classification of Random Forest using Random Vector Functional Neural Network and Oblique Decision Surfaces. 2018 International Joint Conference on Neural Networks ( IJCNN ), Rio de Janeiro, 8-13 July 2018, 1-8
Raja, S.G. and Nirmala, K. (2020) Detection of Brain Tumor Using K-Nearest Neighbor (KNN) Based Classification Model and Self Organizing Map (SOM) Algorithm. International Journal of Neural Networks and Advanced Applications , 7, 42-48. https://doi.org/10.46300/91016.2020.7.6
Bhardwaj, M., Khan, N.U., Baghel, V., Vishwakarma, S.K. and Bashar, A. (2023) Brain Tumor Image Segmentation Using K-Means and Fuzzy C-Means Clustering. In: Rajput, S.S., et al. , Eds., Digital Image Enhancement and Reconstruction , Elsevier, 293-316. https://doi.org/10.1016/b978-0-32-398370-9.00020-2
Badrinarayanan, V., Kendall, A. and Cipolla, R. (2017) SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence , 39, 2481-2495. https://doi.org/10.1109/tpami.2016.2644615
Çiçek, Ö., Abdulkadir, A., Lienkamp, S.S., Brox, T. and Ronneberger, O. (2016) 3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation. In: Ourselin, S., Joskowicz, L., Sabuncu, M., Unal, G. and Wells, W., Eds., Medical Image Computing and Computer - Assisted Intervention — MICCAI 2016, Springer, 424-432. https://doi.org/10.1007/978-3-319-46723-8_49
Milletari, F., Navab, N. and Ahmadi, S. (2016) V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation. 2016 Fourth International Conference on 3 D Vision (3 DV ), Stanford, 25-28 October 2016, 565-571. https://doi.org/10.1109/3dv.2016.79
Kamnitsas, K., Ferrante, E., Parisot, S., Ledig, C., Nori, A.V., Criminisi, A., et al. (2016) Deepmedic for Brain Tumor Segmentation. In: Crimi, A., Menze, B., Maier, O., Reyes, M., Winzeck, S. and Handels, H., Eds., Brainlesion : Glioma , Multiple Sclerosis , Stroke and Traumatic Brain Injuries , Springer, 138-149. https://doi.org/10.1007/978-3-319-55524-9_14
Oktay, O., et al. (2018) Attention U-Net: Learning Where to Look for the Pancreas. arXiv: 1804.03999v3. https://arxiv.org/pdf/1804.03999
Hu, J., Shen, L. and Sun, G. (2018) Squeeze-and-Excitation Networks. 2018 IEEE / CVF Conference on Computer Vision and Pattern Recognition , Salt Lake City, 18-23 June 2018, 7132-7141. https://doi.org/10.1109/cvpr.2018.00745
Li, X., Chen, H., Qi, X., Dou, Q., Fu, C. and Heng, P. (2018) H-DenseUNet: Hybrid Densely Connected UNet for Liver and Tumor Segmentation from CT Volumes. IEEE Transactions on Medical Imaging , 37, 2663-2674. https://doi.org/10.1109/tmi.2018.2845918
Zhao, H., Shi, J., Qi, X., Wang, X. and Jia, J. (2017) Pyramid Scene Parsing Network. 2017 IEEE Conference on Computer Vision and Pattern Recognition ( CVPR ), Honolulu, 21-26 July 2017, 6230-6239. https://doi.org/10.1109/cvpr.2017.660
Fred Agarap, A.M. (2018) Deep Learning Using Rectified Linear Units (ReLU). arXiv: 1803.08375v2. https://arxiv.org/abs/1803.08375v2
Lederer, J. (2021) Activation Functions in Artificial Neural Networks: A Systematic Overview. arXiv: 2101.09957v1. https://arxiv.org/abs/2101.09957v1
Ramachandran, P., Zoph, B. and Le Google Brain, Q.V. (2017) Searching for Activation Functions. arXiv: 1710.05941v2. https://arxiv.org/abs/1710.05941v2
Pratiwi, H., Windarto, A.P., Susliansyah, S., Aria, R.R., Susilowati, S., Rahayu, L.K., et al. (2020) Sigmoid Activation Function in Selecting the Best Model of Artificial Neural Networks. Journal of Physics : Conference Series , 1471, Article ID: 012010. https://doi.org/10.1088/1742-6596/1471/1/012010
Xu, J., Li, Z., Du, B., Zhang, M. and Liu, J. (2020) Reluplex Made More Practical: Leaky ReLU. 2020 IEEE Symposium on Computers and Communications ( ISCC ), Rennes, 7-10 July 2020, 1-7. https://doi.org/10.1109/iscc50000.2020.9219587
Basirat, M. and Roth, P.M. (2018) The Quest for the Golden Activation Function. arXiv: 1808.00783v1. http://arxiv.org/abs/1808.00783v1
Misra, D. (2020) Mish: A Self Regularized Non-Monotonic Activation Function. https://github.com/digantamisra98/Mish
Szandała, T. (2020) Review and Comparison of Commonly Used Activation Functions for Deep Neural Networks. arXiv: 2010.09458.
Shen, S., Zhang, N., Zhou, A. and Yin, Z. (2022) Enhancement of Neural Networks with an Alternative Activation Function Tanhlu. Expert Systems with Applications , 199, Article ID: 117181. https://doi.org/10.1016/j.eswa.2022.117181
Salih, M.M., Salih, M.E. and Ahmed, M.A.A. (2019) Enhancement of U-Net Performance in MRI Brain Tumour Segmentation Using HardELiSH Activation Function. 2019 International Conference on Computer , Control , Electrical , and Electronics Engineering ( ICCCEEE ), Khartoum, 21-23 September 2019, 1-5. https://doi.org/10.1109/iccceee46830.2019.9071235
Saleh, M.M., Salih, M.E., Ahmed, M.A.A. and Hussein, A.M. (2025) From Traditional Methods to 3D U-Net: A Comprehensive Review of Brain Tumour Segmentation Techniques. Journal of Biomedical Science and Engineering , 18, 1-32. https://doi.org/10.4236/jbise.2025.181001
Wang, W., Chen, C., Ding, M., Yu, H., Zha, S. and Li, J. (2021) TransBTS: Multimodal Brain Tumor Segmentation Using Transformer. In: de Bruijne, M., et al. , Eds., Medical Image Computing and Computer Assisted Intervention — MICCAI 2021, Springer, 109-119. https://doi.org/10.1007/978-3-030-87193-2_11
Valanarasu, J.M.J., Oza, P., Hacihaliloglu, I. and Patel, V.M. (2021) Medical Transformer: Gated Axial-Attention for Medical Image Segmentation. In: de Bruijne, M., et al. , Eds., Medical Image Computing and Computer Assisted Intervention — MICCAI 2021, Springer, 36-46. https://doi.org/10.1007/978-3-030-87193-2_4
Cai, Y., Long, Y., Han, Z., Liu, M., Zheng, Y., Yang, W., et al. (2023) Swin Unet3D: A Three-Dimensional Medical Image Segmentation Network Combining Vision Transformer and Convolution. BMC Medical Informatics and Decision Making , 23, Article No. 33. https://doi.org/10.1186/s12911-023-02129-z
Cao, H., Wang, Y., Chen, J., Jiang, D., Zhang, X., Tian, Q., et al. (2023) Swin-UNet: UNet-Like Pure Transformer for Medical Image Segmentation. In: Karlinsky, L., Michaeli, T. and Nishino, K., Eds., Computer Vision — ECCV 2022 Workshops , Springer, 205-218. https://doi.org/10.1007/978-3-031-25066-8_9
Xue, Y., Xu, T., Zhang, H., Long, L.R. and Huang, X. (2018) Segan: Adversarial Network with Multi-Scale L1 Loss for Medical Image Segmentation. Neuroinformatics , 16, 383-392. https://doi.org/10.1007/s12021-018-9377-x
Zhu, J., Park, T., Isola, P. and Efros, A.A. (2017) Unpaired Image-To-Image Translation Using Cycle-Consistent Adversarial Networks. 2017 IEEE International Conference on Computer Vision ( ICCV ), Venice, 22-29 October 2017, 2242-2251. https://doi.org/10.1109/iccv.2017.244
Pinaya, W.H.L., Tudosiu, P., Dafflon, J., Da Costa, P.F., Fernandez, V., Nachev, P., et al. (2022) Brain Imaging Generation with Latent Diffusion Models. In: Mukhopadhyay, A., Oksuz, I., Engelhardt, S., Zhu, D. and Yuan, Y., Eds., Deep Generative Models , Springer, 117-126. https://doi.org/10.1007/978-3-031-18576-2_12
Chen, T., Kornblith, S., Norouzi, M. and Hinton, G. (2020) A Simple Framework for Contrastive Learning of Visual Representations. https://proceedings.mlr.press/v119/chen20j.html
Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D. and Batra, D. (2017) Grad-Cam: Visual Explanations from Deep Networks via Gradient-Based Localization. 2017 IEEE International Conference on Computer Vision ( ICCV ), Venice, 22-29 October 2017, 618-626. https://doi.org/10.1109/iccv.2017.74
Santos, M.R., Guedes, A. and Sanchez-Gendriz, I. (2024) Shapley Additive Explanations (SHAP) for Efficient Feature Selection in Rolling Bearing Fault Diagnosis. Machine Learning and Knowledge Extraction , 6, 316-341. https://doi.org/10.3390/make6010016
Howard, A.G., et al. (2017) MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications. arXiv: 1704.04861v1. https://arxiv.org/pdf/1704.04861
Tan, M. and Le, Q.V. (2019) EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks. arXiv: 1905.11946. https://arxiv.org/pdf/1905.11946
Calhoun, V.D. and Sui, J. (2016) Multimodal Fusion of Brain Imaging Data: A Key to Finding the Missing Link(s) in Complex Mental Illness. Biological Psychiatry : Cognitive Neuroscience and Neuroimaging , 1, 230-244. https://doi.org/10.1016/j.bpsc.2015.12.005
Zhou, Y., Guo, J., Sun, H., Song, B. and Yu, F.R. (2023) Attention-Guided Multi-Step Fusion: A Hierarchical Fusion Network for Multimodal Recommendation. Proceedings of the 46 th International ACM SIGIR Conference on Research and Development in Information Retrieval , Chinese Taipei, 23-27 July 2023, 1816-1820. https://doi.org/10.1145/3539618.3591950
Caulier, Y. and Stolz, C. (2011) Optimal Gabor Filters and Haralick Features for the Industrial Polarization Imaging. In: Gagalowicz, A. and Philips, W., Eds., Computer Vision / Computer Graphics Collaboration Techniques. MIRAGE 2011, Springer, 122-132. https://doi.org/10.1007/978-3-642-24136-9_11
Shahvaran, Z., Kazemi, K., Fouladivanda, M., Helfroush, M.S., Godefroy, O. and Aarabi, A. (2021) Morphological Active Contour Model for Automatic Brain Tumor Extraction from Multimodal Magnetic Resonance Images. Journal of Neuroscience Methods , 362, Article ID: 109296. https://doi.org/10.1016/j.jneumeth.2021.109296
Zhang, X. and Song, Q. (2015) A Multi-Label Learning Based Kernel Automatic Recommendation Method for Support Vector Machine. PLOS ONE , 10, e0120455. https://doi.org/10.1371/journal.pone.0120455
Geremia, E., Menze, B.H. and Ayache, N. (2013) Spatially Adaptive Random Forests. 2013 IEEE 10 th International Symposium on Biomedical Imaging , San Francisco, 7-11 April 2013, 1344-1347. https://doi.org/10.1109/isbi.2013.6556781
Thada, V. and Jaglan, V. (2013) Comparison of Jaccard, Dice, Cosine Similarity Coefficient to Find Best Fitness Value for Web Retrieved Documents Using Genetic Algorithm. International Journal of Engineering and Innovative Technology , 2, 202-205.
Aydin, O.U., Taha, A.A., Hilbert, A., Khalil, A.A., Galinovic, I., Fiebach, J.B., et al. (2021) On the Usage of Average Hausdorff Distance for Segmentation Performance Assessment: Hidden Error When Used for Ranking. European Radiology Experimental , 5, Article No. 4. https://doi.org/10.1186/s41747-020-00200-2
Saleh, M., Salih, M., Ahmed, M. and Hussein, A. (2025) From Traditional Methods to 3D U-Net: A Comprehensive Review of Brain Tumour Segmentation Techniques. Journal of Biomedical Science and Engineering , 18, 1-32. https://www.scirp.org/journal/papercitationdetails?PaperID=140886&JournalID=30
(2024) Sensitivity and Specificity. Wikipedia. https://en.wikipedia.org/w/index.php?title=Sensitivity_and_specificity&oldid=1245547015
10.1 Sensitivity and Specificity—Foundations of Biomedical Science: Quantitative Literacy: Theory and Problems. https://oercollective.caul.edu.au/foundations-of-biomedical-science/chapter/10-1-sensitivity-and-specificity/
Precision and Recall. Wikipedia. https://en.wikipedia.org/wiki/Precision_and_recall
Hatamizadeh, A., Nath, V., Tang, Y., Yang, D., Roth, H.R. and Xu, D. (2022) Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Images. arXiv: 2201.01266. https://monai.io/research/swin-unetr
Ayachi, R. and Ben Amor, N. (2009) Brain Tumor Segmentation Using Support Vector Machines. In: Sossai, C. and Chemello, G., Eds., Symbolic and Quantitative Approaches to Reasoning with Uncertainty , Springer, 736-747. https://doi.org/10.1007/978-3-642-02906-6_63
Soltaninejad, M., Zhang, L., Lambrou, T., Yang, G., Allinson, N. and Ye, X. (2019) MRI Brain Tumor Segmentation using Random Forests and Fully Convolutional Networks. arXiv: 1909.06337.
McIntyre, L. and Tuba, E. (2023) Brain Tumor Segmentation and Classification Using Texture Features and Support Vector Machine. 2023 11 th International Symposium on Digital Forensics and Security ( ISDFS ), Chattanooga, 11-12 May 2023, 1-5. https://doi.org/10.1109/isdfs58141.2023.10131719
Khodadadi Shoushtari, F., Sina, S. and Dehkordi, A.N.V. (2022) Automatic Segmentation of Glioblastoma Multiform Brain Tumor in MRI Images: Using Deeplabv3+ with Pre-Trained Resnet18 Weights. Physica Medica , 100, 51-63. https://doi.org/10.1016/j.ejmp.2022.06.007
Mok, T.C.W. and Chung, A.C.S. (2019) Learning Data Augmentation for Brain Tumor Segmentation with Coarse-To-Fine Generative Adversarial Networks. In: Crimi, A., Bakas, S., Kuijf, H., Keyvan, F., Reyes, M. and van Walsum, T., Eds., Brainlesion : Glioma , Multiple Sclerosis , Stroke and Traumatic Brain Injuries , Springer, 70-80. https://doi.org/10.1007/978-3-030-11723-8_7
Mlynarski, P., Delingette, H., Criminisi, A. and Ayache, N. (2019) Deep Learning with Mixed Supervision for Brain Tumor Segmentation. Journal of Medical Imaging , 6, Article ID: 034002. https://doi.org/10.1117/1.jmi.6.3.034002
Sheller, M.J., Edwards, B., Reina, G.A., Martin, J., Pati, S., Kotrotsou, A., et al. (2020) Federated Learning in Medicine: Facilitating Multi-Institutional Collaborations without Sharing Patient Data. Scientific Reports , 10, Article No. 12598. https://doi.org/10.1038/s41598-020-69250-1
Liu, X., Bonner, E.R., Jiang, Z., Roth, H., Packer, R., Bornhorst, M., et al. (2023) From Adult to Pediatric: Deep Learning-Based Automatic Segmentation of Rare Pediatric Brain Tumors. Medical Imaging 2023: Computer-Aided Diagnosis , 12465, Article ID: 1246505. https://doi.org/10.1117/12.2654245
Pacal, I., Celik, O., Bayram, B. and Cunha, A. (2024) Enhancing Efficientnetv2 with Global and Efficient Channel Attention Mechanisms for Accurate MRI-Based Brain Tumor Classification. Cluster Computing , 27, 11187-11212. https://doi.org/10.1007/s10586-024-04532-1
Zhu, Z., He, X., Qi, G., Li, Y., Cong, B. and Liu, Y. (2023) Brain Tumor Segmentation Based on the Fusion of Deep Semantics and Edge Information in Multimodal MRI. Information Fusion , 91, 376-387. https://doi.org/10.1016/j.inffus.2022.10.022
Shi, J., et al. (2023) H-DenseFormer: An Efficient Hybrid Densely Connected Transformer for Multimodal Tumor Segmentation. arXiv: 2307.01486. https://github.com/shijun18/H-DenseFormer
Karani, N., Chaitanya, K., Baumgartner, C. and Konukoglu, E. (2018) A Lifelong Learning Approach to Brain MR Segmentation across Scanners and Protocols. In: Frangi, A., Schnabel, J., Davatzikos, C., Alberola-López, C. and Fichtinger, G., Eds., Medical Image Computing and Computer Assisted Intervention — MICCAI 2018, Springer, 476-484. https://doi.org/10.1007/978-3-030-00928-1_54