Multimodal medical image fusion is a powerful tool for diagnosing diseases in medical field. The main objective is to capture the relevant information from input images into a single output image, which plays an important role in clinical applications. In this paper, an image fusion technique for the fusion of multimodal medical images is proposed based on Non-Subsampled Contourlet Transform. The proposed technique uses the Non-Subsampled Contourlet Transform (NSCT) to decompose the images into lowpass and highpass subbands. The lowpass and highpass subbands are fused by using mean based and variance based fusion rules. The reconstructed image is obtained by taking Inverse Non-Subsampled Contourlet Transform (INSCT) on fused subbands. The experimental results on six pairs of medical images are compared in terms of entropy, mean, standard deviation, Q AB/F as performance parameters. It reveals that the proposed image fusion technique outperforms the existing image fusion techniques in terms of quantitative and qualitative outcomes of the images. The percentage improvement in entropy is 0% - 40%, mean is 3% - 42%, standard deviation is 1% - 42%, Q AB/F is 0.4% - 48% in proposed method comparing to conventional methods for six pairs of medical images.
Wang, A., Sun, H. and Guan, Y. (2006) The Application of Wavelet Transform to Multi-modality Medical Image Fusion. IEEE International Conference on Networking, Sensing and Control, Ft. Lauderdale, 270-274. http://dx.doi.org/10.1109/icnsc.2006.1673156
Yang, Y., Dong Sun Park, D.S., Huang, S. and Rao, N. (2010) Medical Image Fusion via an Effective Wavelet-Based Approach. EURASIP Journal on Advances in Signal Processing, 2010, Article ID: 579341.
Wang, A., Qi, C., Dong, J., Meng, S. and Li, D. (2013) Multimodal Medical Image Fusion in Non-Subsampled Contourlet Transform Domain. IEEE International Conference on ICMIC, Harbin, 16-18 August 2013, 169-172.
Al-Azzawi, N. and Abdullah, W.A.K.W. (2011) Medical Image Fusion Schemes Using Contourlet Transform and PCA Based. In: Zheng, Y., Ed., Image Fusion and Its Applications, InTech, 93-110.
James, A. P. and Dasarathy, B V. (2014) Medical Image Fusion: A Survey of the State of The art. Information Fusion, 19, 4-19. http://dx.doi.org/10.1016/j.inffus.2013.12.002
Wang, L., Li, B. and Tian, L. (2014) Multi-Modal Medical Image Fusion Using the Inter-Scale and intra-scale dependencies between image shift-invariant shearlet coefficients. Information Fusion, 19, 20-28. http://dx.doi.org/10.1016/j.inffus.2012.03.002
Liu, Z., Yin, H., Chai, Y. and Yang, S. X. (2014) A Novel Approach for Multimodal Medical Image Fusion. Expert systems with applications, 41, 7425-7435. http://dx.doi.org/10.1016/j.eswa.2014.05.043
Xu, Z. (2014) Medical Image Fusion Using Multi-Level Local Extrema. Information Fusion, 19, 38-48. http://dx.doi.org/10.1016/j.inffus.2013.01.001
Daneshvar, S. and Ghassemian, H. (2010) MRI and PET Image Fusion by Combining HIS and Retina-Inspired Models. Information Fusion, 11, 114-123. http://dx.doi.org/10.1016/j.inffus.2009.05.003
Singh, R., Vatsa, M. and Noore, A. (2009) Multimodal Medical Image Fusion Using Redundant Discrete Wavelet Transform. Seventh International Conference on Advances in Pattern Recognition, Kolkata, 4-6 February 2009, 232- 235. http://dx.doi.org/10.1109/icapr.2009.97
Shivappa, S.T., Rao, B.D. and Trivedi, M.M. (2008) An Iterative Decoding Algorithm for Fusion of Multimodal Information. EURASIP Journal on Advances in Signal Processing, 2008, Article ID: 478396.
Redondo, R., Sroubek, F., Fischer, S. and Cristobal, G. (2009) Multifocus Image Fusion Using the Log-Gabor Transform and a Multisize Windows Technique. Information Fusion, 10, 163-171. http://dx.doi.org/10.1016/j.inffus.2008.08.006
Li, S. and Yang, B. (2008) Multifocus Image Fusion Using Region Segmentation and Spatial Frequency. Image and Vision Computing, 26, 971-979. http://dx.doi.org/10.1016/j.imavis.2007.10.012
Yonghong, J. (1998) Fusion of Landsat TM and SAR Images Based on Principal Component Analysis. Remote Sensing Technology and Application, 13, 46-49.
Petrovic, V S. and Xydeas, C.S. (2004) Gradient-Based Multiresolution Image Fusion. IEEE Transaction on Image Processing, 13, 228-237. http://dx.doi.org/10.1109/TIP.2004.823821
Burt, P.J. and Adelson, E.H. (1983) The Laplacian Pyramid as a Compact Image Code. IEEE Transaction on Communications, 31, 532-540. http://dx.doi.org/10.1109/TCOM.1983.1095851
Toet, A. (1989) Image Fusion by a Ratio of Low-Pass Pyramid. Pattern Recognition Letters, 9, 245-253. http://dx.doi.org/10.1016/0167-8655(89)90003-2
Pu, T. and Ni, G. (2000) Contrast-Based Image Fusion Using the Discrete Wavelet Transform. Optical Engineering, 39, 2075-2082. http://dx.doi.org/10.1117/1.1303728
Toet, A. (1989) A Morphological Pyramidal Image Decomposition. Pattern Recognition Letters, 9, 255-261. http://dx.doi.org/10.1016/0167-8655(89)90004-4
Ehlers, M. (1991) Multisensor Image Fusion Techniques in Remote Sensing. ISPRS Journal of Photogrammetry & Remote Sensing, 51, 311-316. http://dx.doi.org/10.1016/0924-2716(91)90003-e
Bhatnagar, G., Wu, Q.M.J. and Liu, Z. (2013) Directive Contrast Based Multimodal Medical Image Fusion in NSCT Domain. IEEE Transactions on Multimedia, 15, 1014-1024. http://dx.doi.org/10.1109/TMM.2013.2244870
Bhatnagar, G., Wu, Q.M.J. and Liu, Z. (2015) A New Contrast Based Multimodal Medical Image Fusion Framework. Neurocomputing, 157, 143-152. http://dx.doi.org/10.1016/j.neucom.2015.01.025
Yang, L., Guo, B.L. and Ni, W. (2008) Multimodality Medical Image Fusion Based on Multiscale Geometric Analysis of Contourlet Transform. Neurocomputing, 72, 203-211. http://dx.doi.org/10.1016/j.neucom.2008.02.025
Li, S., Yang, B. and Hu, J. (2011) Performance Comparison of Different Multi-Resolution Transforms for Image Fusion. Information Fusion, 12, 74-84. http://dx.doi.org/10.1016/j.inffus.2010.03.002
Das, S. and Kundu, M.K. (2012) NSCT-Based Multimodal Medical Image Fusion Using Pulse-Coupled Neural Network and Modified Spatial Frequency. Medical & Biological Engineering & Computing, 50, 1105-1114. http://dx.doi.org/10.1007/s11517-012-0943-3
Li, T. and Wang, Y. (2011) Biological Image Fusion Using a NSCT Based Variable-Weight Method. Information Fusion, 12, 85-92. http://dx.doi.org/10.1016/j.inffus.2010.03.007
Zhang, Q. and Guo, B.L. (2009) Multi-Focus Image Fusion Using the Nonsubsampled Contourlet Transform. Signal Process, 89, 1334-1346. http://dx.doi.org/10.1016/j.sigpro.2009.01.012
Yang, Y., Tong, S., Huang, S. and Lin, P. (2014) Log-Gabor Energy Based Multimodal Medical Image Fusion in NSCT Domain. Computational and Mathematical Methods in Medicine, 2014, Article ID: 835481. http://dx.doi.org/10.1155/2014/835481
Qu, X.B., Yan, J.W., Xiao, H.Z. and Zhu, Z.Q. (2008) Image Fusion Algorithm Based on Spatial Frequency-Motivated Pulse Coupled Neural Networks in Nonsubsampled Contourlet Transform Domain. Acta Automatica Sinica, 34, 1508- 1514. http://dx.doi.org/10.1016/S1874-1029(08)60174-3
Ali, F.E., El-Dokany, I.M., Saad, A.A. and Abd El-Samie, F.E. (2008) Curvelet Fusion of MR and CT Images. Pro- gress in Electromagnetics Research C, 3, 215-224. http://dx.doi.org/10.2528/PIERC08041305
Do, M.N. and Vetterli, M. (2005) The Contourlet Transform: An Efficient Directional Multiresolution Image Representation. IEEE Transactions on Image Processing, 14, 2091-2106. http://dx.doi.org/10.1109/TIP.2005.859376
Qu, X.B., Yan, J.W. and Yang, G.D. (2009) Multifocus Image Fusion Method of Sharp Frequency Localized Contourlet Transform Domain Based on Sum-Modified-Laplacian. Optics and Precision Engineering, 17, 1203-1212.
Cunha, A.L., Zhou, J. and Do, M.N. (2006) The Nonsubsampled Contourlet Transform: Theory, Design, and Applications. IEEE Transactions on Image Processing, 15, 3089-3101. http://dx.doi.org/10.1109/TIP.2006.877507
Do, M.N. and Vetterli, M. (2005) The Contourlet Transform: An Efficient Directional Multiresolution Image Representation. IEEE Transactions on Image Processing, 14, 2091-2106. http://dx.doi.org/10.1109/TIP.2005.859376
Blum, R.S., Xue, Z. and Zhang, Z. (2005) Overview of Image Fusion. In: Blum, R.S. and Liu, Z., Eds., Multi-Sensor Image Fusion and Its Applications, CRC Press, Boca Raton, FL, 1-35.
Maintz, J.B.A. and Viergever, M.A. (1998) A Survey of Medical Image Registration. Medical Image Analysis, 2, 1-36. http://dx.doi.org/10.1016/S1361-8415(01)80026-8
Zitova, B. and Flusser, J. (2003) Image Registration Methods: A Survey. Image and Vision Computing, 21, 977-1000. http://dx.doi.org/10.1016/S0262-8856(03)00137-9
Arce, G.R. (2005) Nonlinear Signal Processing: A Statistical Approach. John Wiley & Sons, New Jersey.
Arias-Castro, E. and Donoho, D.L. (2009) Does Median Filtering Truly Preserve Edges Better than Linear Filtering? Annals of Statistics, 37, 1172-1206. http://dx.doi.org/10.1214/08-AOS604
Guixi, L., Chunhu, L. and Wenjie, L. (2004) A New Fusion Arithmetic Based on Small Wavelet Multi-Resolution Decomposition. Journal of Optoelectronics—Laser, 18, 344-347.
Zanxia, Q., Jiaxiong, P. and Hongqun, W. (2003) Remote Sensing Image Fusion Based on Small Wavelet Transform’s Local Variance. Journal of Huazhong University of Science and Technology: Natural Science, 6, 89-91.
Mitianoudis, N. and Stathaki, T. (2007) Pixel-Based and Region-Based Image Fusion Schemes Using ICA Bases. Information Fusion, 8, 131-142. http://dx.doi.org/10.1016/j.inffus.2005.09.001
Chipman, L.J., Orr, T.M. and Graham, L.N. (1995) Wavelets and Image Fusion. Proceedings of the IEEE International Conference on Image Processing, Vol. 3, Washington DC, 23-26 October 1995, 248-251. http://dx.doi.org/10.1109/icip.1995.537627
Liu, G.X. and Yang, W.H. (2002) A Wavelet-Decomposition-Based Image Fusion Scheme and Its Performance Evaluation. Acta Automatica Sinica, 28, 927-934.
Li, M., Zhang, X.Y. and Mao, J. (2008) Neighboring Region Variance Weighted Mean Image Fusion Based on Wavelet Transform. Foreign Electronic Measurement Technology, 27, 5-6.