Skip to content
Licensed Unlicensed Requires Authentication Published by De Gruyter May 29, 2018

Wavelet-enhanced convolutional neural network: a new idea in a deep learning paradigm

  • Behrouz Alizadeh Savareh , Hassan Emami , Mohamadreza Hajiabadi EMAIL logo , Seyed Majid Azimi and Mahyar Ghafoori

Abstract

Purpose:

Manual brain tumor segmentation is a challenging task that requires the use of machine learning techniques. One of the machine learning techniques that has been given much attention is the convolutional neural network (CNN). The performance of the CNN can be enhanced by combining other data analysis tools such as wavelet transform.

Materials and methods:

In this study, one of the famous implementations of CNN, a fully convolutional network (FCN), was used in brain tumor segmentation and its architecture was enhanced by wavelet transform. In this combination, a wavelet transform was used as a complementary and enhancing tool for CNN in brain tumor segmentation.

Results:

Comparing the performance of basic FCN architecture against the wavelet-enhanced form revealed a remarkable superiority of enhanced architecture in brain tumor segmentation tasks.

Conclusion:

Using mathematical functions and enhancing tools such as wavelet transform and other mathematical functions can improve the performance of CNN in any image processing task such as segmentation and classification.

Acknowledgments

The authors are grateful to School of Computer Science, Institute for Research in Fundamental Science (IPM), Tehran, Iran, for professional technical assistance.

  1. Author Statement

  2. Conflict of interest: Authors state no conflict of interest.

References

[1] Charutha S, Jayashree MJ. An efficient brain tumor detection by integrating modified texture based region growing and cellular automata edge detection. In: Control, Instrumentation, Communication and Computational Technologies (ICCICCT), 2014 International Conference on, USA; 2014.10.1109/ICCICCT.2014.6993142Search in Google Scholar

[2] Idrissi N, Ajmi FE. A hybrid segmentation approach for brain tumor extraction and detection. In: Multimedia Computing and Systems (ICMCS), 2014 International Conference on, Morocco; 2014.10.1109/ICMCS.2014.6911131Search in Google Scholar

[3] Chandra S, Bhat R, Singh H. A PSO based method for detection of brain tumors from MRI. In: Nature & Biologically Inspired Computing, 2009. NaBIC 2009. World Congress on, India; 2009.10.1109/NABIC.2009.5393455Search in Google Scholar

[4] Logeswari T, Karnan M. An improved implementation of brain tumor detection using soft computing. In: Communication Software and Networks, 2010. ICCSN ’10. Second International Conference on, Singapore; 2010.10.1109/ICCSN.2010.10Search in Google Scholar

[5] Cancer Council Australlia. Adult gliomas: a guide for patients, their families and carers. Sydney, Australia: Cancer Council Australia/Clinical Oncology Society of Australia; 2011.Search in Google Scholar

[6] Damodharan S, Raghavan D. Combining tissue segmentation and neural network for brain tumor detection. Int Arab J Inf Technol 2015;12:42–52.Search in Google Scholar

[7] American Brain Tumor Association. About brain tumors: a primer for patients and caregivers. Chicago, IL, USA: American Brain Tumor Association; 2015.Search in Google Scholar

[8] Bauer S. Medical Image Analysis and Image-based Modeling for Brain Tumor Studies. Switzerland: ETH Zürich; 2013.Search in Google Scholar

[9] Wein W, Brunke S, Khamene A, Callstrom MR, Navab N. Automatic CT-ultrasound registration for diagnostic imaging and image-guided intervention. Med Image Anal 2008;12:577–85.10.1016/j.media.2008.06.006Search in Google Scholar PubMed

[10] Maiti I, Chakraborty M. A new method for brain tumor segmentation based on watershed and edge detection algorithms in HSV colour model. In: Computing and Communication Systems (NCCCS), 2012 National Conference on, India; 2012.10.1109/NCCCS.2012.6413020Search in Google Scholar

[11] Roy S, Bandyopadhyay SK. Abnormal regions detection and quantification with accuracy estimation from MRI of brain. In: Instrumentation and Measurement, Sensor Network and Automation (IMSNA), 2013 2nd International Symposium on, Canada; 2013.10.1109/IMSNA.2013.6743351Search in Google Scholar

[12] Wang G, Wang D. Segmentation of brain MRI image with GVF snake model. In: Pervasive Computing Signal Processing and Applications (PCSPA), 2010 First International Conference on, China; 2010.Search in Google Scholar

[13] Ming-Ni W, Chia-Chen L, Chin-Chen C. Brain tumor detection using color-based K-means clustering segmentation. In: Intelligent Information Hiding and Multimedia Signal Processing, 2007. IIHMSP 2007. Third International Conference on, Taiwan; 2007.Search in Google Scholar

[14] Jude Hemanth D, Selvanth D, Anitha J. Effective fuzzy clustering algorithm for abnormal MR brain image segmentation. In: IEEE International Advance Computing Conference (IACC 2009), Patiala, India; 2009;6:609–14.10.1109/IADCC.2009.4809081Search in Google Scholar

[15] Wang Y, Ma S. Automatic detection and segmentation of brain tumor using fuzzy classification and deformable models. In: Biomedical Engineering and Informatics (BMEI), 2011 4th International Conference on, China; 2011.10.1109/BMEI.2011.6098610Search in Google Scholar

[16] Heiss WD, Raab P, Lanfermann H. Multimodality assessment of brain tumors and tumor recurrence. J Nucl Med 2011;52:1585–600.10.2967/jnumed.110.084210Search in Google Scholar PubMed

[17] Moon N, Bullitt E, Van Leemput K, Gerig G. Automatic brain and tumor segmentation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention. Berlin, Heidelberg: Springer; 2002:372–9.10.1007/3-540-45786-0_46Search in Google Scholar

[18] Bara S, Maia HE, Hammouch A, Aboutajdine D. A robust approach for the detection of brain tumors by variational b-spline level-set method and brain extraction. In: Multimedia Computing and Systems (ICMCS), 2014 International Conference on, Morocco; 2014.10.1109/ICMCS.2014.6911406Search in Google Scholar

[19] Costin H. Recent trends in medical image processing. Comput Sci 2014;22:65.Search in Google Scholar

[20] Prastawa M, Bullitt E, Ho S, Gerig G. A brain tumor segmentation framework based on outlier detection. Med Image Anal 2004;8:275–83.10.1016/j.media.2004.06.007Search in Google Scholar PubMed

[21] El-Melegy MT, Mokhtar HM. Tumor segmentation in brain MRI using a fuzzy approach with class center priors. EURASIP J Image Video Process 2014;2014:1–14.10.1186/1687-5281-2014-21Search in Google Scholar

[22] Amsaveni V, Singh NA. Detection of brain tumor using neural network. In: Computing, Communications and Networking Technologies (ICCCNT), 2013 Fourth International Conference on, India; 2013.10.1109/ICCCNT.2013.6726524Search in Google Scholar

[23] Schmidt M, Levner I, Greiner R, Murtha A, Bistritz A. Segmenting brain tumors using alignment-based features. In: Machine Learning and Applications, 2005. Proceedings. Fourth International Conference on, USA; 2005.10.1109/ICMLA.2005.56Search in Google Scholar

[24] Prajapati SJ, Jadhav KR. Brain tumor detection by various image segmentation techniques with introduction to non negative matrix factorization. Brain 2015;4:600–3.Search in Google Scholar

[25] Al-Ashwal RH, Supriyanto E, Anati N. Digital processing for computed tomography images: brain tumor extraction and histogram analysis. In: Math Comput Contemp Sci. 14th International Conference on Mathematical Methods and Computational Techniques in Electrical Engineering (MMACTEE13), Singapore; 2012.Search in Google Scholar

[26] Kang J, Lu C, Cai M, Zhang W-Q, Liu J. Neuron sparseness versus connection sparseness in deep neural network for large vocabulary speech recognition. In: 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, Australia; 2015.Search in Google Scholar

[27] Kleć M, Koržinek D. Pre-trained deep neural network using sparse autoencoders and scattering wavelet transform for musical genre recognition. Comput Sci 2015;16:133–44.10.7494/csci.2015.16.2.133Search in Google Scholar

[28] Oyallon E, Mallat S, Sifre L. Generic deep networks with wavelet scattering. arXiv preprint arXiv:1312.5940; 2013.Search in Google Scholar

[29] Hassairi S, Ejbali R, Zaied M. Supervised image classification using deep convolutional wavelets network. In: Tools with Artificial Intelligence (ICTAI), 2015 IEEE 27th International Conference on. IEEE, Italy; 2015.10.1109/ICTAI.2015.49Search in Google Scholar

[30] Casamitjana A, Puch S, Aduriz A, Sayrol E, Vilaplana V. 3D convolutional networks for brain tumor segmentation. In: Proceedings of the MICCAI Challenge on Multimodal Brain Tumor Image Segmentation (BRATS), Greece; 2016:65–8.Search in Google Scholar

[31] Rao V, Shari Sarabi M, Jaiswal A. Brain tumor segmentation with deep learning. In: MICCAI Multimodal Brain Tumor Segmentation Challenge (BraTS); 2015:56–9.Search in Google Scholar

[32] Lyksborg M, Puonti O, Agn M, Larsen R. An ensemble of 2D convolutional neural networks for tumor segmentation. In: Scandinavian Conference on Image Analysis. Berlin: Springer; 2015.10.1007/978-3-319-19665-7_17Search in Google Scholar

[33] Yi D, Zhou M, Chen Z, Gevaert O. 3-D convolutional neural networks for glioblastoma segmentation. arXiv preprint arXiv:1611.04534; 2016.Search in Google Scholar

[34] Vo DM, Le TH. Deep generic features and SVM for facial expression recognition. In: Information and Computer Science (NICS), 2016 3rd National Foundation for Science and Technology Development Conference on. Vietnam: IEEE; 2016.10.1109/NICS.2016.7725672Search in Google Scholar

[35] Zhou X, Zhang Y, Bai X, Zhu J, Zhu L, Quian X. Product image search with deep attribute mining and re-ranking. In: Pacific Rim Conference on Multimedia. China: Springer; 2016.10.1007/978-3-319-48896-7_55Search in Google Scholar

[36] Withey D, Koles Z. A review of medical image segmentation: methods and available software. Int J Bioelectromagn 2008;10:125–48.Search in Google Scholar

[37] Sachin N, Khairnar V. Brain tumor detection based on symmetry information. Int J Eng Res Appl 2013;3:430–2.Search in Google Scholar

[38] Constantin AA, Bajcsy BR, Nelson CS. Unsupervised segmentation of brain tissue in multivariate MRI. In: Biomedical Imaging: From Nano to Macro, 2010 IEEE International Symposium on, Netherlands; 2010.Search in Google Scholar

[39] Kobashi S, Matsui M, Inoue N, Kondo K, Sawada T, Hata Y. Adaptive brain tissue classification with fuzzy spatial modeling in 3T IR-FSPGR MR images. In: Automation Congress, 2006. WAC ’06. World; 2006.10.1109/WAC.2006.375748Search in Google Scholar

[40] Pereira S, Pinto A, Alves V, Silva CA. Brain tumor segmentation using convolutional neural networks in MRI images. IEEE Trans Med Imaging 2016;35:1240–51.10.1109/TMI.2016.2538465Search in Google Scholar PubMed

[41] Havaei M, Davy A, Warde-Farley D, Biard A, Courville A, Bengio Y, et al. Brain tumor segmentation with deep neural networks. Med Image Anal 2017;35:18–31.10.1016/j.media.2016.05.004Search in Google Scholar PubMed

[42] Zikic D, Ioannou Y, Criminisi A, Brown M. Segmentation of brain tumor tissues with convolutional neural networks. In: Proceedings MICCAI-BRATS; 2014:36–9.Search in Google Scholar

[43] Agn M, Puonti O, Law I, af Rosenschöld PM, van Leemput K. Brain tumor segmentation by a generative model with a prior on tumor shape. In: Proceeding of the Multimodal Brain Tumor Image Segmentation Challenge; 2015:1–4.10.1007/978-3-319-30858-6_15Search in Google Scholar

[44] Dvorak P, Menze B. Structured prediction with convolutional neural networks for multimodal brain tumor segmentation. In: Proceeding of the Multimodal Brain Tumor Image Segmentation Challenge; 2015:13–24.Search in Google Scholar

[45] Rewari R. Automatic tumor segmentation from MRI scans. Available from: http://cs231n.stanford.edu/reports/2016/pdfs/328_Report.pdf.Search in Google Scholar

[46] Zhao X, Wu Y, Song G, Li Z, Zhang Y, Fan Y. A deep learning model integrating FCNNs and CRFs for brain tumor segmentation. arXiv preprint arXiv:1702.04528; 2017.10.1016/j.media.2017.10.002Search in Google Scholar PubMed PubMed Central

[47] Pan Y, Huang W, Lin Z, Zhu W, Zhou J, Wong J, et al. Brain tumor grading based on neural networks and convolutional neural networks. In: 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). Italy: IEEE; 2015.10.1109/EMBC.2015.7318458Search in Google Scholar PubMed

[48] Chen H, Dou C, Yu L, Heng P-A. VoxResNet: deep voxelwise residual networks for volumetric brain segmentation. arXiv preprint arXiv:1608.05895; 2016.Search in Google Scholar

[49] Lun T, Hsu W. Brain tumor segmentation using deep convolutional neural network. In: Proceedings of BRATS-MICCAI; 2016.Search in Google Scholar

[50] Kamnitsas K, Ferrante E, Parisot S, Ledig C, Nori AV, Criminisi A, et al. DeepMedic on Brain Tumor Segmentation. Athens, Greece Proc. BRATS-MICCAI; 2016.10.1007/978-3-319-55524-9_14Search in Google Scholar

[51] Zhao L, Jia K. Deep feature learning with discrimination mechanism for brain tumor segmentation and diagnosis. In: 2015 International Conference on Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP). Australia: IEEE; 2015.10.1109/IIH-MSP.2015.41Search in Google Scholar

[52] Chang PD. Fully convolutional deep residual neural networks for brain tumor segmentation. In: International Workshop on Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries. Cham: Springer; 2016:108–18.10.1007/978-3-319-55524-9_11Search in Google Scholar

[53] Ghafoorian M, Karssemeijer N, Heskes T, van Uden I, Sanchez C, Litjens G, et al. Location sensitive deep convolutional neural networks for segmentation of white matter hyperintensities. arXiv preprint arXiv:1610.04834; 2016.10.1038/s41598-017-05300-5Search in Google Scholar PubMed PubMed Central

[54] Yu C-P, Ruppert G, Collins R, Nguyen D, Falcao A, Liu Y. 3D blob based brain tumor detection and segmentation in MR images. In: Biomedical Imaging (ISBI), 2014 IEEE 11th International Symposium on, China; 2014.10.1109/ISBI.2014.6868089Search in Google Scholar

[55] Karnan M, Selvanayaki K. Improved implementation of brain MR image segmentation using meta heuristic algorithms. In: Computational Intelligence and Computing Research (ICCIC), 2010 IEEE International Conference on, India; 2010.10.1109/ICCIC.2010.5705892Search in Google Scholar

[56] Vijay J, Subhashini J. An efficient brain tumor detection methodology using K-means clustering algoriftnn. In: Communications and Signal Processing (ICCSP), 2013 International Conference on, India; 2013.10.1109/iccsp.2013.6577136Search in Google Scholar

[57] Fazli S, Nadirkhanlou P. A novel method for automatic segmentation of brain tumors in MRI images. arxiv; 2013.Search in Google Scholar

[58] Kumar M, Mehta KK. A texture based tumor detection and automatic segmentation using seeded region growing method. Int J Comp Tech Appl 2011;2.Search in Google Scholar

[59] Mustaqeem A, Javed A, Fatima T. An efficient brain tumor detection algorithm using watershed & thresholding based segmentation. Int J Image Graph Signal Process 2012;4:34.10.5815/ijigsp.2012.10.05Search in Google Scholar

[60] Cuadra MB, Pollo C, Bardera A, Cuisenaire O, Villemure JG, Thiran JP. Atlas-based segmentation of pathological MR brain images using a model of lesion growth. IEEE Trans Med Imaging 2004;23:1301–4.10.1109/TMI.2004.834618Search in Google Scholar PubMed

[61] Shen S, Sandham W, Granat M, Sterr A. MRI fuzzy segmentation of brain tissue using neighborhood attraction with neural-network optimization. IEEE Trans Inf Technol Biomed 2005;9:459–67.10.1109/TITB.2005.847500Search in Google Scholar

[62] Corso JJ, Sharon E, Dube S, El-Saden S, Sinha U, Yuille A. Efficient multilevel brain tumor segmentation with integrated bayesian model classification. IEEE Trans Med Imaging 2008;27:629–40.10.1109/TMI.2007.912817Search in Google Scholar PubMed

[63] Hall LO, Bensaid AM, Clarke LP, Velthuizen RP, Silbiger MS, Bezdek JC. A comparison of neural network and fuzzy clustering techniques in segmenting magnetic resonance images of the brain. IEEE Trans Neural Netw 1992;3:672–82.10.1109/72.159057Search in Google Scholar PubMed

[64] Bauer S, Nolte L-P, Reyes M. Fully automatic segmentation of brain tumor images using support vector machine classification in combination with hierarchical conditional random field regularization. In: Medical Image Computing and Computer-Assisted Intervention – MICCAI, vol 11; 2011:354–61.10.1007/978-3-642-23626-6_44Search in Google Scholar PubMed

[65] Aslan Ö, Cheng H, Zhang X, Schuurmans D. Convex two-layer modeling. In: Advances in Neural Information Processing Systems; 2013. Available from: https://papers.nips.cc/paper/4867-convex-two-layer-modeling.pdf.Search in Google Scholar

[66] Cho Y, Saul LK. Kernel methods for deep learning. In: Advances in Neural Information Processing Systems; 2009.Search in Google Scholar

[67] Deng L, Tur G, He X, Hakkani-Tur D. Use of kernel deep convex networks and end-to-end learning for spoken language understanding. In: Spoken Language Technology Workshop (SLT), 2012 IEEE. USA: IEEE; 2012.10.1109/SLT.2012.6424224Search in Google Scholar

[68] Vinyals O, Jia Y, Deng L, Darrell T. Learning with recursive perceptual representations. In: Advances in Neural Information Processing Systems, USA; 2012.Search in Google Scholar

[69] Huertas-Company M, Gravet R, Cabrera-Vives G, Pérez-González PG, Kartaltepe JS, Barro G, et al. A catalog of visual-like morphologies in the 5 CANDELS fields using deep-learning. arXiv preprint arXiv:1509.05429; 2015.10.1088/0067-0049/221/1/8Search in Google Scholar

[70] Bauer S, Seiler C, Bardyn T, Buechler P, Reyes M. Atlas-based segmentation of brain tumor images using a Markov random field-based tumor growth model and non-rigid registration. In: Engineering in Medicine and Biology Society (EMBC), 2010 Annual International Conference of the IEEE. Argentina: IEEE; 2010.10.1109/IEMBS.2010.5627302Search in Google Scholar PubMed

[71] Hinton GE, Osindero S, Teh Y-W. A fast learning algorithm for deep belief nets. Neural Comput 2006;18:1527–54.10.1162/neco.2006.18.7.1527Search in Google Scholar PubMed

[72] Mohamed A-R, Hinton GE. Phone recognition using restricted Boltzmann machines. In: ICASSP; 2010.10.1109/ICASSP.2010.5495651Search in Google Scholar

[73] Le QV, Zou WY, Yeung SY, Ng AY. Learning hierarchical invariant spatio-temporal features for action recognition with independent subspace analysis. In: Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on. USA: IEEE; 2011.10.1109/CVPR.2011.5995496Search in Google Scholar

[74] Vincent P, Larochelle H, Lajoie I, Bengio Y, Manzagol P-A. Stacked denoising autoencoders: learning useful representations in a deep network with a local denoising criterion. J Mach Learn Res 2010;11:3371–408.Search in Google Scholar

[75] Andén J, Mallat S. Deep scattering spectrum. IEEE Trans Signal Process 2014;62:4114–28.10.1109/TSP.2014.2326991Search in Google Scholar

[76] MICCAI. About MICCAI. 2016 [cited 2016]. Available from: http://www.miccai.org/organization.Search in Google Scholar

[77] Misale C, Drocco M, Aldinucci M, Tremblay G. A comparison of big data frameworks on a layered dataflow model. Parallel Process Lett 2017;27:1740003.10.1142/S0129626417400035Search in Google Scholar

[78] Zhu W, Xie X. Adversarial deep structural networks for mammographic mass segmentation. arXiv preprint arXiv:1612.05970; 2016.10.1101/095786Search in Google Scholar

[79] Singh B, Singh J. Classification of brain MRI in wavelet domain. Int J Electron Comput Sci Eng 2011:2277–1956.Search in Google Scholar

[80] Cogswell M. Understanding Representations and Reducing their Redundancy in Deep Networks. Blacksburg, VA: Virginia Polytechnic Institute and State University; 2016.Search in Google Scholar

[81] Chen J, Kang X, Liu Y, Wang ZJ. Median filtering forensics based on convolutional neural networks. IEEE Signal Process Lett 2015;22:1849–53.10.1109/LSP.2015.2438008Search in Google Scholar

[82] Arel I, Rose DC, Karnowski TP. Deep machine learning – a new frontier in artificial intelligence research [research frontier]. IEEE Comput Intell Mag 2010;5:13–8.10.1109/MCI.2010.938364Search in Google Scholar

[83] LeCun Y, Bengio Y, Hinton G. Deep learning. Nature 2015;521:436–44.10.1038/nature14539Search in Google Scholar PubMed

[84] Boussion N, Hatt M, Lamare F, Bizais Y, Turzo A, Cheze-Le Rest C, et al. A multiresolution image based approach for correction of partial volume effects in emission tomography. Phys Med Biol 2006;51:1857.10.1088/0031-9155/51/7/016Search in Google Scholar PubMed

[85] Sun J, Yao M, Xu B, Bel P. Fabric wrinkle characterization and classification using modified wavelet coefficients and support-vector-machine classifiers. Text Res J 2011;81:902–13.10.1177/0040517510391702Search in Google Scholar

[86] Srivastava R. Research Developments in Computer Vision and Image Processing: Methodologies and Applications: Methodologies and Applications. Iran: IGI Global; 2013.Search in Google Scholar

[87] Shekkizhar S. Tensorflow Implementation of Fully Convolutional Networks for Semantic Segmentation. 2016 [cited 2016]. Available from: https://github.com/shekkizh/FCN.tensorflow.Search in Google Scholar

[88] Long J, Shelhamer E, Darrell T. Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, USA; 2015.10.1109/CVPR.2015.7298965Search in Google Scholar

[89] Pu R, Gong P. Wavelet transform applied to EO-1 hyperspectral data for forest LAI and crown closure mapping. Remote Sens Environ 2004;91:212–24.10.1016/j.rse.2004.03.006Search in Google Scholar

[90] Satiyan M, Hariharan M, Nagarajan R. Comparison of performance using Daubechies wavelet family for facial expression recognition. In: Signal Processing and its Applications (CSPA), 2010 6th International Colloquium on. Malaysia: IEEE; 2010.10.1109/CSPA.2010.5545262Search in Google Scholar

Received: 2017-10-13
Accepted: 2018-02-19
Published Online: 2018-05-29
Published in Print: 2019-04-24

©2019 Walter de Gruyter GmbH, Berlin/Boston

Downloaded on 28.4.2024 from https://www.degruyter.com/document/doi/10.1515/bmt-2017-0178/html
Scroll to top button