Skip to main content
Top

2021 | OriginalPaper | Chapter

Hyperparameter Optimization of Deep Neural Network in Multimodality Fused Medical Image Classification for Medical and Industrial IoT

Authors : Velmurugan Subbiah Parvathy, Sivakumar Pothiraj, Jenyfal Sampson

Published in: Smart Sensors for Industrial Internet of Things

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Industrial Internet of Things (IIoT) refers to the extension and utilization of the Internet of Things (IoT) in industrial sectors and applications. Medical image fusion and classification has been utilized to get valuable significant multimodality medical image data. Recently, deep learning methods offer an effective way to design an end-to-end model that can determine the final classification labels. This chapter introduces a Multimodality Image Fusion Classification (MMIFC) by the incorporation of image fusion, feature extraction, and classification techniques. Initially, the input medical images were fused by the use of optimal shearlet transform where the coefficients of shearlets are optimized by the use of Enhanced Monarch Butterfly Optimization (EMBO) algorithm. In the next stage, the fused images were classified based on the feature extractor and deep learning model to check the test image is malignant and benign. To further optimize the performance of the deep learning model, hyperparameter tuning process takes place by the use of Bayesian optimization model to optimize the weights of structure. Finally, this ODNN model classifies the MMFI as class 1 or 0. A detailed simulation result takes place to ensure the effective performance of the proposed method. From the experimental results, the proposed strategy accomplishes better fusion rate and classification results compared with other supervised and non-supervised learning techniques.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Constantinos, S.P., Pattichis, M.S., Micheli-Tzanakou, E.: Medical imaging fusion applications: an overview. In: Conference Record of Thirty-Fifth Asilomar Conference on Signals, Systems and Computers (Cat. No. 01CH37256), vol. 2, pp. 1263–1267. IEEE, Washington, DC (2001)CrossRef Constantinos, S.P., Pattichis, M.S., Micheli-Tzanakou, E.: Medical imaging fusion applications: an overview. In: Conference Record of Thirty-Fifth Asilomar Conference on Signals, Systems and Computers (Cat. No. 01CH37256), vol. 2, pp. 1263–1267. IEEE, Washington, DC (2001)CrossRef
2.
go back to reference Zong, J.J., Qiu, T.S.: Medical image fusion based on sparse representation of classified image patches. Biomed. Signal Process. Control. 34, 195–205 (2017)CrossRef Zong, J.J., Qiu, T.S.: Medical image fusion based on sparse representation of classified image patches. Biomed. Signal Process. Control. 34, 195–205 (2017)CrossRef
3.
go back to reference Xu, X., Wang, Y., Chen, S.: Medical image fusion using discrete fractional wavelet transform. Biomed. Signal Process. Control. 27, 103–111 (2016)CrossRef Xu, X., Wang, Y., Chen, S.: Medical image fusion using discrete fractional wavelet transform. Biomed. Signal Process. Control. 27, 103–111 (2016)CrossRef
4.
go back to reference Sreeja, G., Saraniya, O.: Image fusion through deep convolutional neural network. In: Deep learning and parallel computing environment for bioengineering systems, pp. 37–52. Academic Press, Cambridge (2019)CrossRef Sreeja, G., Saraniya, O.: Image fusion through deep convolutional neural network. In: Deep learning and parallel computing environment for bioengineering systems, pp. 37–52. Academic Press, Cambridge (2019)CrossRef
5.
go back to reference Manchanda, M., Sharma, R.: A novel method of multimodal medical image fusion using fuzzy transform. J. Vis. Commun. Image Represent. 40, 197–217 (2016)CrossRef Manchanda, M., Sharma, R.: A novel method of multimodal medical image fusion using fuzzy transform. J. Vis. Commun. Image Represent. 40, 197–217 (2016)CrossRef
6.
go back to reference Daniel, E., Anitha, J., Kamaleshwaran, K.K., Rani, I.: Optimum spectrum mask based medical image fusion using Gray Wolf Optimization. Biomed. Signal Process. Control. 34, 36–43 (2017)CrossRef Daniel, E., Anitha, J., Kamaleshwaran, K.K., Rani, I.: Optimum spectrum mask based medical image fusion using Gray Wolf Optimization. Biomed. Signal Process. Control. 34, 36–43 (2017)CrossRef
7.
go back to reference Zhao, G., Liu, G., Fang, L., Tu, B., Ghamisi, P.: Multiple convolutional layers fusion framework for hyperspectral image classification. Neurocomputing. 339, 149–160 (2019)CrossRef Zhao, G., Liu, G., Fang, L., Tu, B., Ghamisi, P.: Multiple convolutional layers fusion framework for hyperspectral image classification. Neurocomputing. 339, 149–160 (2019)CrossRef
8.
go back to reference Elkholy, M., Hosny, M.M., El-Habrouk, H.M.F.: Studying the effect of lossy compression and image fusion on image classification. Alex. Eng. J. 58(1), 143–149 (2019)CrossRef Elkholy, M., Hosny, M.M., El-Habrouk, H.M.F.: Studying the effect of lossy compression and image fusion on image classification. Alex. Eng. J. 58(1), 143–149 (2019)CrossRef
9.
go back to reference Razzak, M.I., Naz, S., Zaib, A.: Deep learning for medical image processing: overview, challenges and the future. In: Classification in BioApps, pp. 323–350. Springer, Cham (2018)CrossRef Razzak, M.I., Naz, S., Zaib, A.: Deep learning for medical image processing: overview, challenges and the future. In: Classification in BioApps, pp. 323–350. Springer, Cham (2018)CrossRef
10.
go back to reference Yang, W., Liu, J.R.: Research and development of medical image fusion. In: 2013 IEEE International Conference on Medical Imaging Physics and Engineering, pp. 307–309. IEEE, Washington, DC (2013)CrossRef Yang, W., Liu, J.R.: Research and development of medical image fusion. In: 2013 IEEE International Conference on Medical Imaging Physics and Engineering, pp. 307–309. IEEE, Washington, DC (2013)CrossRef
11.
go back to reference Padmavathi, N.B.: Fusion of multimodal abdominal cancerous images and classification using support vector machine. In: 2017 International Conference on Intelligent Sustainable Systems (ICISS), pp. 266–269. IEEE, Washington, DC (2017) Padmavathi, N.B.: Fusion of multimodal abdominal cancerous images and classification using support vector machine. In: 2017 International Conference on Intelligent Sustainable Systems (ICISS), pp. 266–269. IEEE, Washington, DC (2017)
12.
go back to reference Liu, Y., Yang, J., Sun, J.: PET/CT medical image fusion algorithm based on multiwavelet transform. In: 2010 2nd International Conference on Advanced Computer Control, vol. 2, pp. 264–268. IEEE, Washington, DC (2010)CrossRef Liu, Y., Yang, J., Sun, J.: PET/CT medical image fusion algorithm based on multiwavelet transform. In: 2010 2nd International Conference on Advanced Computer Control, vol. 2, pp. 264–268. IEEE, Washington, DC (2010)CrossRef
13.
go back to reference Song, Y., Cai, W., Huang, H., Zhou, Y., Feng, D.D., Wang, Y., Fulham, M.J., Chen, M.: Large margin local estimate with applications to medical image classification. IEEE Trans. Med. Imaging. 34(6), 1362–1377 (2015)CrossRef Song, Y., Cai, W., Huang, H., Zhou, Y., Feng, D.D., Wang, Y., Fulham, M.J., Chen, M.: Large margin local estimate with applications to medical image classification. IEEE Trans. Med. Imaging. 34(6), 1362–1377 (2015)CrossRef
14.
go back to reference Valavanis, L., Stathopoulos, S., Kalamboukis, T.: Fusion of bag-of-words models for image classification in the medical domain. In: European Conference on Information Retrieval, pp. 134–145. Springer, Cham (2017, April) Valavanis, L., Stathopoulos, S., Kalamboukis, T.: Fusion of bag-of-words models for image classification in the medical domain. In: European Conference on Information Retrieval, pp. 134–145. Springer, Cham (2017, April)
15.
go back to reference Rahman, M.M., You, D., Simpson, M.S., Antani, S.K., Demner-Fushman, D., Thoma, G.R.: Multimodal biomedical image retrieval using hierarchical classification and modality fusion. Int. J. Multimed. Inf. Retr. 2(3), 159–173 (2013)CrossRef Rahman, M.M., You, D., Simpson, M.S., Antani, S.K., Demner-Fushman, D., Thoma, G.R.: Multimodal biomedical image retrieval using hierarchical classification and modality fusion. Int. J. Multimed. Inf. Retr. 2(3), 159–173 (2013)CrossRef
16.
go back to reference Bhatnagar, G., Wu, Q.J., Liu, Z.: Directive contrast based multimodal medical image fusion in NSCT domain. IEEE Trans. Multimed. 15(5), 1014–1024 (2013)CrossRef Bhatnagar, G., Wu, Q.J., Liu, Z.: Directive contrast based multimodal medical image fusion in NSCT domain. IEEE Trans. Multimed. 15(5), 1014–1024 (2013)CrossRef
17.
go back to reference Shahdoosti, H.R., Mehrabi, A.: Multimodal image fusion using sparse representation classification in tetrolet domain. Digit. Signal Process. 79, 9–22 (2018)MathSciNetCrossRef Shahdoosti, H.R., Mehrabi, A.: Multimodal image fusion using sparse representation classification in tetrolet domain. Digit. Signal Process. 79, 9–22 (2018)MathSciNetCrossRef
18.
go back to reference Feng-Ping, A., Zhi-Wen, L.: Medical image segmentation algorithm based on feedback mechanism convolutional neural network. Biomed. Signal Process. Control. 53, 101589 (2019)CrossRef Feng-Ping, A., Zhi-Wen, L.: Medical image segmentation algorithm based on feedback mechanism convolutional neural network. Biomed. Signal Process. Control. 53, 101589 (2019)CrossRef
19.
go back to reference El-Hoseny, H.M., El-Rahman, W.A., El-Rabaie, E.S.M., El-Samie, F.E.A., Faragallah, O.S.: An efficient DT-CWT medical image fusion system based on modified central force optimization and histogram matching. Infrared Phys. Technol. 94, 223–231 (2018)CrossRef El-Hoseny, H.M., El-Rahman, W.A., El-Rabaie, E.S.M., El-Samie, F.E.A., Faragallah, O.S.: An efficient DT-CWT medical image fusion system based on modified central force optimization and histogram matching. Infrared Phys. Technol. 94, 223–231 (2018)CrossRef
20.
go back to reference Zhang, J., Xie, Y., Wu, Q., Xia, Y.: Medical image classification using synergic deep learning. Med. Image Anal. 54, 10–19 (2019)CrossRef Zhang, J., Xie, Y., Wu, Q., Xia, Y.: Medical image classification using synergic deep learning. Med. Image Anal. 54, 10–19 (2019)CrossRef
21.
go back to reference Ahn, E., Kumar, A., Fulham, M., Feng, D., Kim, J.: Convolutional sparse kernel network for unsupervised medical image analysis. Med. Image Anal. 56, 140–151 (2019)CrossRef Ahn, E., Kumar, A., Fulham, M., Feng, D., Kim, J.: Convolutional sparse kernel network for unsupervised medical image analysis. Med. Image Anal. 56, 140–151 (2019)CrossRef
22.
go back to reference Oo, M.M., Oo, L.L.: Fusion of Log-Mel Spectrogram and GLCM feature in acoustic scene classification. In: International Conference on Software Engineering Research, Management and Applications, pp. 175–187. Springer, Cham (2019) Oo, M.M., Oo, L.L.: Fusion of Log-Mel Spectrogram and GLCM feature in acoustic scene classification. In: International Conference on Software Engineering Research, Management and Applications, pp. 175–187. Springer, Cham (2019)
23.
go back to reference Chaitanya, S.M.K., Kumar, P.R.: Oppositional gravitational search algorithm and artificial neural network-based classification of kidney images. J. Intell. Syst. 29(1), 485–496 (2018)CrossRef Chaitanya, S.M.K., Kumar, P.R.: Oppositional gravitational search algorithm and artificial neural network-based classification of kidney images. J. Intell. Syst. 29(1), 485–496 (2018)CrossRef
24.
go back to reference Kumar, R., Quan, C.: Asymmetric multi-user optical cryptosystem based on polar decomposition and Shearlet transform. Opt. Lasers Eng. 120, 118–126 (2019)CrossRef Kumar, R., Quan, C.: Asymmetric multi-user optical cryptosystem based on polar decomposition and Shearlet transform. Opt. Lasers Eng. 120, 118–126 (2019)CrossRef
25.
go back to reference Shankar, K., Elhoseny, M., Lakshmanaprabu, S.K., Ilayaraja, M., Vidhyavathi, R.M., Elsoud, M.A., Alkhambashi, M.: Optimal feature level fusion based ANFIS classifier for brain MRI image classification. Concurr. Comput. Pract. Exp. (2018, First Online: 27 Aug 2018). https://doi.org/10.1002/cpe.4887 Shankar, K., Elhoseny, M., Lakshmanaprabu, S.K., Ilayaraja, M., Vidhyavathi, R.M., Elsoud, M.A., Alkhambashi, M.: Optimal feature level fusion based ANFIS classifier for brain MRI image classification. Concurr. Comput. Pract. Exp. (2018, First Online: 27 Aug 2018). https://​doi.​org/​10.​1002/​cpe.​4887
27.
go back to reference Shankar, K., Lakshmanaprabu, S.K., Khanna, A., Tanwar, S., Rodrigues, J.J.P.C., Roy, N.R.: Alzheimer detection using Group Grey Wolf Optimization based features with convolutional classifier. Comput. Electr. Eng. 77, 230–243 (2019)CrossRef Shankar, K., Lakshmanaprabu, S.K., Khanna, A., Tanwar, S., Rodrigues, J.J.P.C., Roy, N.R.: Alzheimer detection using Group Grey Wolf Optimization based features with convolutional classifier. Comput. Electr. Eng. 77, 230–243 (2019)CrossRef
28.
go back to reference Elhoseny, M., Bian, G.-B., Lakshmanaprabu, S.K., Shankar, K., Singh, A.K., Wu, W.: Effective features to classify ovarian cancer data in internet of medical things. Comput. Netw. 159, 147–156 (2019)CrossRef Elhoseny, M., Bian, G.-B., Lakshmanaprabu, S.K., Shankar, K., Singh, A.K., Wu, W.: Effective features to classify ovarian cancer data in internet of medical things. Comput. Netw. 159, 147–156 (2019)CrossRef
29.
go back to reference Elhoseny, M., Shankar, K.: Optimal bilateral filter and convolutional neural network based denoising method of medical image measurements. Measurement. 143, 125–135 (2019)CrossRef Elhoseny, M., Shankar, K.: Optimal bilateral filter and convolutional neural network based denoising method of medical image measurements. Measurement. 143, 125–135 (2019)CrossRef
30.
go back to reference Malegori, C., Franzetti, L., Guidetti, R., Casiraghi, E., Rossi, R.: GLCM, an image analysis technique for early detection of biofilm. J. Food Eng. 185, 48–55 (2016)CrossRef Malegori, C., Franzetti, L., Guidetti, R., Casiraghi, E., Rossi, R.: GLCM, an image analysis technique for early detection of biofilm. J. Food Eng. 185, 48–55 (2016)CrossRef
31.
go back to reference Liu, C., Gardner, S.J., Wen, N., Elshaikh, M.A., Siddiqui, F., Movsas, B., Chetty, I.J.: Automatic segmentation of the prostate on CT images using deep neural networks (DNN). Int. J. Radiat. Oncol. Biol. Phys. 104(4), 924–932 (2019)CrossRef Liu, C., Gardner, S.J., Wen, N., Elshaikh, M.A., Siddiqui, F., Movsas, B., Chetty, I.J.: Automatic segmentation of the prostate on CT images using deep neural networks (DNN). Int. J. Radiat. Oncol. Biol. Phys. 104(4), 924–932 (2019)CrossRef
32.
go back to reference de Moura Oliveira, P.B., Oliveira, J., Cunha, J.B.: Trends in gravitational search algorithm. In: International Symposium on Distributed Computing and Artificial Intelligence, pp. 270–277. Springer, Cham (2017) de Moura Oliveira, P.B., Oliveira, J., Cunha, J.B.: Trends in gravitational search algorithm. In: International Symposium on Distributed Computing and Artificial Intelligence, pp. 270–277. Springer, Cham (2017)
33.
go back to reference Velmurugan, S.P., Sivakumar, P., Rajasekaran, M.P.: Multimodality image fusion using centre-based genetic algorithm and fuzzy logic. Int. J. Biomed. Eng. Technol. 28, 322–348 (2018)CrossRef Velmurugan, S.P., Sivakumar, P., Rajasekaran, M.P.: Multimodality image fusion using centre-based genetic algorithm and fuzzy logic. Int. J. Biomed. Eng. Technol. 28, 322–348 (2018)CrossRef
Metadata
Title
Hyperparameter Optimization of Deep Neural Network in Multimodality Fused Medical Image Classification for Medical and Industrial IoT
Authors
Velmurugan Subbiah Parvathy
Sivakumar Pothiraj
Jenyfal Sampson
Copyright Year
2021
DOI
https://doi.org/10.1007/978-3-030-52624-5_9

Premium Partner