Skip to main content
Erschienen in: International Journal of Multimedia Information Retrieval 1/2022

04.09.2021 | Regular Paper

A review on deep learning in medical image analysis

verfasst von: S. Suganyadevi, V. Seethalakshmi, K. Balasamy

Erschienen in: International Journal of Multimedia Information Retrieval | Ausgabe 1/2022

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Ongoing improvements in AI, particularly concerning deep learning techniques, are assisting to identify, classify, and quantify patterns in clinical images. Deep learning is the quickest developing field in artificial intelligence and is effectively utilized lately in numerous areas, including medication. A brief outline is given on studies carried out on the region of application: neuro, brain, retinal, pneumonic, computerized pathology, bosom, heart, breast, bone, stomach, and musculoskeletal. For information exploration, knowledge deployment, and knowledge-based prediction, deep learning networks can be successfully applied to big data. In the field of medical image processing methods and analysis, fundamental information and state-of-the-art approaches with deep learning are presented in this paper. The primary goals of this paper are to present research on medical image processing as well as to define and implement the key guidelines that are identified and addressed.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
23.
Zurück zum Zitat Szegedy C, Liu W, Jia Y, Sermanet P, Reed S et al (2015) Going deeper with convolutions. In: Proceedings of the IEEE Computer Society conference on computer vision and pattern recognition; IEEE Computer Society, 7(12), pp 1–9 Szegedy C, Liu W, Jia Y, Sermanet P, Reed S et al (2015) Going deeper with convolutions. In: Proceedings of the IEEE Computer Society conference on computer vision and pattern recognition; IEEE Computer Society, 7(12), pp 1–9
41.
42.
43.
Zurück zum Zitat Ballin A, Karlinsky L, Alpert S, Hasoul S, Ari R, Barkan E (2016) A region based convolutional network for tumor detection and classification in breast mammography. In: Proceedings of the deep learning in medical image analysis (DLMIA). Lecture Notes in Computer Science, 10 0 08, pp 197–205. https://doi.org/10.1007/978-3-319-46976-8_21 Ballin A, Karlinsky L, Alpert S, Hasoul S, Ari R, Barkan E (2016) A region based convolutional network for tumor detection and classification in breast mammography. In: Proceedings of the deep learning in medical image analysis (DLMIA). Lecture Notes in Computer Science, 10 0 08, pp 197–205. https://​doi.​org/​10.​1007/​978-3-319-46976-8_​21
44.
46.
Zurück zum Zitat Anavi Y, Kogan I, Gelbart E, Geva O, Greenspan H (2015) A comparative study for chest radiograph image retrieval using binary texture and deep learning classification. In: Proceedings of the IEEE engineering in Medicine and Biology Society, pp 2940–2943. https://doi.org/10.1109/EMBC.2015.7319008 Anavi Y, Kogan I, Gelbart E, Geva O, Greenspan H (2015) A comparative study for chest radiograph image retrieval using binary texture and deep learning classification. In: Proceedings of the IEEE engineering in Medicine and Biology Society, pp 2940–2943. https://​doi.​org/​10.​1109/​EMBC.​2015.​7319008
47.
Zurück zum Zitat Anavi Y, Kogan I, Gelbart E, Geva O, Greenspan H (2016) Visualizing and enhancing a deep learning framework using patients age and gender for chest X-ray IMAGE Retrieval. In: Proceedings of the SPIE on medical imaging, 9785, 978510 Anavi Y, Kogan I, Gelbart E, Geva O, Greenspan H (2016) Visualizing and enhancing a deep learning framework using patients age and gender for chest X-ray IMAGE Retrieval. In: Proceedings of the SPIE on medical imaging, 9785, 978510
48.
Zurück zum Zitat Andermatt S, Pezold S, Cattin P (2016) Multi-dimensional gated recurrent units for the segmentation of biomedical 3D-data. In: Proceedings of the deep learning in medical image analysis (DLMIA). Lecture Notes in Computer Science, 10 0 08, pp 142–151 Andermatt S, Pezold S, Cattin P (2016) Multi-dimensional gated recurrent units for the segmentation of biomedical 3D-data. In: Proceedings of the deep learning in medical image analysis (DLMIA). Lecture Notes in Computer Science, 10 0 08, pp 142–151
50.
Zurück zum Zitat Antony J, McGuinness K, Connor NEO, Moran K (2016) Quantifying radio graphic knee osteoarthritis severity using deep convolutional neural networks. arxiv: 1609.02469 Antony J, McGuinness K, Connor NEO, Moran K (2016) Quantifying radio graphic knee osteoarthritis severity using deep convolutional neural networks. arxiv: 1609.02469
53.
Zurück zum Zitat Baumgartner CF, Kamnitsas K, Matthew J, Smith S, Kainz B, Rueckert D (2016) Real-time standard scan plane detection and localisation in fetal ultrasound using fully convolutional neural networks. In: Proceedings of the medical image computing and computer-assisted intervention. Lecture Notes in Computer Science, 9901, pp 203–211. https://doi.org/10.1007/978-3-319-46723-8_24 Baumgartner CF, Kamnitsas K, Matthew J, Smith S, Kainz B, Rueckert D (2016) Real-time standard scan plane detection and localisation in fetal ultrasound using fully convolutional neural networks. In: Proceedings of the medical image computing and computer-assisted intervention. Lecture Notes in Computer Science, 9901, pp 203–211. https://​doi.​org/​10.​1007/​978-3-319-46723-8_​24
57.
Zurück zum Zitat Bengio Y, Lamblin P, Popovici D, Larochelle H (2007) Greedy layer-wise training of deep networks. In: Proceedings of the advances in neural information processing systems, pp 153–160 Bengio Y, Lamblin P, Popovici D, Larochelle H (2007) Greedy layer-wise training of deep networks. In: Proceedings of the advances in neural information processing systems, pp 153–160
59.
60.
62.
Zurück zum Zitat Bergstra J, Bengio Y (2012) Random search for hyper-parameter optimization. J Mach Learn Res 13(10):281–305MathSciNetMATH Bergstra J, Bengio Y (2012) Random search for hyper-parameter optimization. J Mach Learn Res 13(10):281–305MathSciNetMATH
63.
Zurück zum Zitat Birenbaum A, Greenspan H (2016) Longitudinal multiple sclerosis lesion segmentation using multi-view convolutional neural networks. In: Proceedings of the deep learning in medical image analysis (DLMIA). Lecture Notes in Computer Science, 10 0 08, pp 58–67. https://doi.org/10.1007/978-3-319-46976-8_7 Birenbaum A, Greenspan H (2016) Longitudinal multiple sclerosis lesion segmentation using multi-view convolutional neural networks. In: Proceedings of the deep learning in medical image analysis (DLMIA). Lecture Notes in Computer Science, 10 0 08, pp 58–67. https://​doi.​org/​10.​1007/​978-3-319-46976-8_​7
66.
Zurück zum Zitat Ertosun MG, Rubin DL Automated grading of Gliomas using deep learning in digital pathology images: a modular approach with ensemble of convolutional neural networks. In: AMIA annual symposium proceedings, pp 1899–908 Ertosun MG, Rubin DL Automated grading of Gliomas using deep learning in digital pathology images: a modular approach with ensemble of convolutional neural networks. In: AMIA annual symposium proceedings, pp 1899–908
68.
Zurück zum Zitat Guo Y, Wu G, Commander LA, Szary S, Jewells V, Lin W, Shen D (2014) Segmenting Hippocampus from infant brains by sparse patch matching with deep-learned features. In: Proceedings of the medical image computing and computer-assisted intervention. Lecture Notes in Computer Science, 8674, pp 308–315. https://doi.org/10.1007/978-3-319-10470-6_39 Guo Y, Wu G, Commander LA, Szary S, Jewells V, Lin W, Shen D (2014) Segmenting Hippocampus from infant brains by sparse patch matching with deep-learned features. In: Proceedings of the medical image computing and computer-assisted intervention. Lecture Notes in Computer Science, 8674, pp 308–315. https://​doi.​org/​10.​1007/​978-3-319-10470-6_​39
70.
Zurück zum Zitat Haugeland J (1985) Artificial intelligence: the very idea. The MIT Press, Cambridge. ISBN: 0262081539 Haugeland J (1985) Artificial intelligence: the very idea. The MIT Press, Cambridge. ISBN: 0262081539
73.
Zurück zum Zitat He K, Zhang X, Ren S, Sun J (2015) Deep residual learning for image recognition. arxiv: 1512.03385 He K, Zhang X, Ren S, Sun J (2015) Deep residual learning for image recognition. arxiv: 1512.03385
75.
Zurück zum Zitat Jia Y, Shelhamer E, Donahue J, Karayev S, Long J, Girshick R, Guadarrama S, Darrell T (2014) Caffe: convolutional architecture for fast feature embedding. In: Proceedings of the twenty-second ACM international conference on multi-media, pp 675–678. https://doi.org/10.1145/2647868.2654.889 Jia Y, Shelhamer E, Donahue J, Karayev S, Long J, Girshick R, Guadarrama S, Darrell T (2014) Caffe: convolutional architecture for fast feature embedding. In: Proceedings of the twenty-second ACM international conference on multi-media, pp 675–678. https://​doi.​org/​10.​1145/​2647868.​2654.​889
76.
Zurück zum Zitat Kainz P, Pfeiffer M, Urschler M (2015) Semantic segmentation of colon glands with deep convolutional neural networks and total variation segmentation. arxiv: 1511.06919 Kainz P, Pfeiffer M, Urschler M (2015) Semantic segmentation of colon glands with deep convolutional neural networks and total variation segmentation. arxiv: 1511.06919
77.
79.
Zurück zum Zitat Lekadir K, Galimzianova A, Betriu A, Vila MDM, Igual L, Rubin, DL, Fernandez E, Radeva P, Napel S (2017) A convolutional neural network for automatic characterization of plaque composition in carotid ultrasound. IEEE J Biomed Health Inform 21(1):48–55. https://doi.org/10.1109/JBHI.2016.2631401 Lekadir K, Galimzianova A, Betriu A, Vila MDM, Igual L, Rubin, DL, Fernandez E, Radeva P, Napel S (2017) A convolutional neural network for automatic characterization of plaque composition in carotid ultrasound. IEEE J Biomed Health Inform 21(1):48–55. https://​doi.​org/​10.​1109/​JBHI.​2016.​2631401
81.
Zurück zum Zitat Li W, Manivannan S, Akbar S, Zhang J, Trucco E, McKenna SJ (2016) Gland segmentation in colon histology images using hand-crafted features and convolutional neural networks. In: Proceedings of the IEEE international symposium on biomedical imaging, pp 1405–1408. https://doi.org/10.1109/ISBI.2016.7493530 Li W, Manivannan S, Akbar S, Zhang J, Trucco E, McKenna SJ (2016) Gland segmentation in colon histology images using hand-crafted features and convolutional neural networks. In: Proceedings of the IEEE international symposium on biomedical imaging, pp 1405–1408. https://​doi.​org/​10.​1109/​ISBI.​2016.​7493530
84.
86.
Zurück zum Zitat Poudel RPK, Lamata P, Montana G (2016) Recurrent fully convolutional neural networks for multi-slice MRI cardiac segmentation. arxiv: 1608.03974 Poudel RPK, Lamata P, Montana G (2016) Recurrent fully convolutional neural networks for multi-slice MRI cardiac segmentation. arxiv: 1608.03974
87.
Zurück zum Zitat Prasoon A, Petersen K, Igel C, Lauze F, Dam E, Nielsen M (2013) Deep feature learning for knee cartilage segmentation using a triplanar convolutional neural network. In: Proceedings of the medical image computing and computer-assisted intervention. Lecture Notes in Computer Science, 8150, pp 246–253. https://doi.org/10.1007/978-3-642-40763-5_31 Prasoon A, Petersen K, Igel C, Lauze F, Dam E, Nielsen M (2013) Deep feature learning for knee cartilage segmentation using a triplanar convolutional neural network. In: Proceedings of the medical image computing and computer-assisted intervention. Lecture Notes in Computer Science, 8150, pp 246–253. https://​doi.​org/​10.​1007/​978-3-642-40763-5_​31
90.
Zurück zum Zitat Ravishankar H, Prabhu SM, Vaidya V, Singhal N (2016) Hybrid approach for automatic segmentation of fetal abdomen from ultrasound images using deep learning. In: Proceedings of the IEEE international symposium on biomedical imaging, pp 779–782. https://doi.org/10.1109/ISBI.2016.7493382 Ravishankar H, Prabhu SM, Vaidya V, Singhal N (2016) Hybrid approach for automatic segmentation of fetal abdomen from ultrasound images using deep learning. In: Proceedings of the IEEE international symposium on biomedical imaging, pp 779–782. https://​doi.​org/​10.​1109/​ISBI.​2016.​7493382
91.
Zurück zum Zitat Sahiner B, Chan HP, Petrick N, Wei D, Helvie MA, Adler DD, Goodsitt MM (1996) Classification of mass and normal breast tissue: a convolution neural network classifier with spatial domain and texture images. IEEE Trans Med Imaging 15(5):598–610. https://doi.org/10.1109/42.538937CrossRef Sahiner B, Chan HP, Petrick N, Wei D, Helvie MA, Adler DD, Goodsitt MM (1996) Classification of mass and normal breast tissue: a convolution neural network classifier with spatial domain and texture images. IEEE Trans Med Imaging 15(5):598–610. https://​doi.​org/​10.​1109/​42.​538937CrossRef
92.
Zurück zum Zitat Samala RK, Chan HP, Hadjiiski LM, Cha K, Helvie MA (2016) Deep-learning convolution neural network for computer-aided detection of microcalcifications in digital breast tomosynthesis. In: Proceedings 9785, medical imaging, computer-aided diagnosis, 97850Y. https://doi.org/10.1117/12.2217092 Samala RK, Chan HP, Hadjiiski LM, Cha K, Helvie MA (2016) Deep-learning convolution neural network for computer-aided detection of microcalcifications in digital breast tomosynthesis. In: Proceedings 9785, medical imaging, computer-aided diagnosis, 97850Y. https://​doi.​org/​10.​1117/​12.​2217092
93.
Zurück zum Zitat Samala RK, Chan HP, Hadjiiski L, Helvie MA, Wei J, Cha K (2016) Mass detection in digital breast tomosynthesis: deep convolutional neural network with transfer learning from mammography. Med Phys 43(12):6654. https://doi.org/10.1118/1.4967345. Samala RK, Chan HP, Hadjiiski L, Helvie MA, Wei J, Cha K (2016) Mass detection in digital breast tomosynthesis: deep convolutional neural network with transfer learning from mammography. Med Phys 43(12):6654. https://​doi.​org/​10.​1118/​1.​4967345.
94.
Zurück zum Zitat Sarraf S, Tofighi G (2016) Classification of Alzheimer’s disease using fMRI data and deep learning convolutional neural networks. arxiv: 1603.08631 Sarraf S, Tofighi G (2016) Classification of Alzheimer’s disease using fMRI data and deep learning convolutional neural networks. arxiv: 1603.08631
99.
Zurück zum Zitat Stern D, Payer C, Lepetit V, Urschler M (2016) Automated age estimation from hand MRI volumes using deep learning. In: Proceedings of the medical image computing and computer-assisted intervention. Lecture Notes in Computer Science, 9901, pp 194–202.https://doi.org/10.1007/978-3-319-46723-8_23 Stern D, Payer C, Lepetit V, Urschler M (2016) Automated age estimation from hand MRI volumes using deep learning. In: Proceedings of the medical image computing and computer-assisted intervention. Lecture Notes in Computer Science, 9901, pp 194–202.https://​doi.​org/​10.​1007/​978-3-319-46723-8_​23
103.
Zurück zum Zitat Teikari P, Santos M, Poon C, Hynynen K (2016) Deep learning convolutional networks for multiphoton microscopy vasculature segmentation. arxiv: 1606.02382 Teikari P, Santos M, Poon C, Hynynen K (2016) Deep learning convolutional networks for multiphoton microscopy vasculature segmentation. arxiv: 1606.02382
104.
Zurück zum Zitat Tran PV (2016) A fully convolutional neural network for cardiac segmentation in short axis MRI. arxiv: 1604.00494.abs/1604.00494 Tran PV (2016) A fully convolutional neural network for cardiac segmentation in short axis MRI. arxiv: 1604.00494.abs/1604.00494
105.
Zurück zum Zitat Xie Y, Xing F, Kong X, Su H, Yang L (2015) Beyond classification: structured regression for robust cell detection using convolutional neural network. In: Proceedings of the medical image computing and computer-assisted intervention. Lecture Notes in Computer Science, 9351, pp 358–365. https://doi.org/10.1007/978-3-319-24574-4_43 Xie Y, Xing F, Kong X, Su H, Yang L (2015) Beyond classification: structured regression for robust cell detection using convolutional neural network. In: Proceedings of the medical image computing and computer-assisted intervention. Lecture Notes in Computer Science, 9351, pp 358–365. https://​doi.​org/​10.​1007/​978-3-319-24574-4_​43
106.
Zurück zum Zitat Xie Y, Zhang Z, Sapkota M, Yang L (2016) Spatial clockwork recurrent neural network for muscle perimysium segmentation. In: Proceedings of the international conference on medical image computing and computer-assisted intervention. Lecture Notes in Computer Science, 9901. Springer, pp 185–193. https://doi.org/10.1007/978-3-319-46723-8_22 Xie Y, Zhang Z, Sapkota M, Yang L (2016) Spatial clockwork recurrent neural network for muscle perimysium segmentation. In: Proceedings of the international conference on medical image computing and computer-assisted intervention. Lecture Notes in Computer Science, 9901. Springer, pp 185–193. https://​doi.​org/​10.​1007/​978-3-319-46723-8_​22
107.
108.
Zurück zum Zitat Krishnasamy B, Balakrishnan M, Christopher A (2021) A genetic algorithm based medical image watermarking for improving robustness and fidelity in wavelet domain. Intelligent data engineering and analytics. Advances in intelligent systems and computing, 1177. Springer, Singapore. https://doi.org/10.1007/978-981-15-679-1_27 Krishnasamy B, Balakrishnan M, Christopher A (2021) A genetic algorithm based medical image watermarking for improving robustness and fidelity in wavelet domain. Intelligent data engineering and analytics. Advances in intelligent systems and computing, 1177. Springer, Singapore. https://​doi.​org/​10.​1007/​978-981-15-679-1_​27
110.
111.
Zurück zum Zitat Yang H, Sun J, Li, H, Wang L, Xu Z (2016) Deep fusion net for multi-atlas segmentation: Application to cardiac MR images. In: Proceedings of the medical image computing and computer assisted intervention. Lecture Notes in Computer Science, 9901, pp 521–528. https://doi.org/10.1007/978-3-319-46723-8_60 Yang H, Sun J, Li, H, Wang L, Xu Z (2016) Deep fusion net for multi-atlas segmentation: Application to cardiac MR images. In: Proceedings of the medical image computing and computer assisted intervention. Lecture Notes in Computer Science, 9901, pp 521–528. https://​doi.​org/​10.​1007/​978-3-319-46723-8_​60
112.
Zurück zum Zitat Wang S, Yao J, Xu Z, Huang J (2016) Subtype cell detection with an accelerated deep convolution neural network. In: Proceedings of the medical image computing and computer-assisted intervention. In: Lecture Notes in Computer Science, 9901, pp 640–648.https://doi.org/10.1007/978-3-319-46723-8_74 Wang S, Yao J, Xu Z, Huang J (2016) Subtype cell detection with an accelerated deep convolution neural network. In: Proceedings of the medical image computing and computer-assisted intervention. In: Lecture Notes in Computer Science, 9901, pp 640–648.https://​doi.​org/​10.​1007/​978-3-319-46723-8_​74
113.
Zurück zum Zitat Xu Y, Mo T, Feng Q, Zhong P, Lai M, Chang E (2014) Deep learning of feature representation with multiple instance learning for medical image analysis. In: Proceedings of the IEEE international conference on acoustics, speech and signal processing (ICASSP), pp 1626–1630. https://doi.org/10.1109/ICASSP.2014.6853873 Xu Y, Mo T, Feng Q, Zhong P, Lai M, Chang E (2014) Deep learning of feature representation with multiple instance learning for medical image analysis. In: Proceedings of the IEEE international conference on acoustics, speech and signal processing (ICASSP), pp 1626–1630. https://​doi.​org/​10.​1109/​ICASSP.​2014.​6853873
115.
118.
Zurück zum Zitat Zhang H, Li L, Qiao K, Wang L, Yan B, Li L, Hu G (2016) Image prediction for limited-angle tomography via deep learning with convolutional neural network. arxiv: 1607.08707 Zhang H, Li L, Qiao K, Wang L, Yan B, Li L, Hu G (2016) Image prediction for limited-angle tomography via deep learning with convolutional neural network. arxiv: 1607.08707
119.
Zurück zum Zitat Zeiler MD, Fergus R (2014) Visualizing and understanding convolutional networks. In: Proceedings of the European conference on computer vision, pp 818–833 Zeiler MD, Fergus R (2014) Visualizing and understanding convolutional networks. In: Proceedings of the European conference on computer vision, pp 818–833
120.
Zurück zum Zitat Yu L, Yang X, Chen H, Qin J, Heng P (2017) Volumetric convnets with mixed residual connections for automated prostate segmentation from 3D MR images. In: Proceedings of the thirty-first AAAI conference on artificial intelligence, pp 66–72 Yu L, Yang X, Chen H, Qin J, Heng P (2017) Volumetric convnets with mixed residual connections for automated prostate segmentation from 3D MR images. In: Proceedings of the thirty-first AAAI conference on artificial intelligence, pp 66–72
Metadaten
Titel
A review on deep learning in medical image analysis
verfasst von
S. Suganyadevi
V. Seethalakshmi
K. Balasamy
Publikationsdatum
04.09.2021
Verlag
Springer London
Erschienen in
International Journal of Multimedia Information Retrieval / Ausgabe 1/2022
Print ISSN: 2192-6611
Elektronische ISSN: 2192-662X
DOI
https://doi.org/10.1007/s13735-021-00218-1

Weitere Artikel der Ausgabe 1/2022

International Journal of Multimedia Information Retrieval 1/2022 Zur Ausgabe

Premium Partner