Skip to main content

2019 | OriginalPaper | Buchkapitel

13. Deep Spatial-Temporal Convolutional Neural Networks for Medical Image Restoration

verfasst von : Yao Xiao, Skylar Stolte, Peng Liu, Yun Liang, Pina Sanelli, Ajay Gupta, Jana Ivanidze, Ruogu Fang

Erschienen in: Deep Learning and Convolutional Neural Networks for Medical Imaging and Clinical Informatics

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Computed tomography perfusion (CTP) facilitates low-cost diagnosis and treatment of acute stroke. Cine scanning allows users to visualize brain anatomy and blood flow in virtually live time. However, effective visualization exposes patients to radiocontrast pharmaceuticals and extended scan times. Higher radiation dosage exposes patients to potential risks including hair loss, cataract formation, and cancer. To alleviate these risks, radiation dosage can be reduced along with tube current and/or X-ray radiation exposure time. However, resulting images may lack sufficient information or be affected by noise and/or artifacts. In this chapter, we propose a deep spatial-temporal convolutional neural network to preserve CTP image quality at reduced tube current, low spatial resolution, and shorter exposure time. This network structure extracts multi-directional features from low-dose and low-resolution patches at different cross sections of the spatial-temporal data and reconstructs high-quality CT volumes. We assess the performance of the network concerning image restoration at different tube currents and multiple resolution scales. The results indicate the ability of our network in restoring high-quality scans from data captured at as low as 21% of the standard radiation dose. The proposed network achieves an average improvement of 7% in perfusion maps compared to the state-of-the-art method.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Benjamin EJ, Blaha MJ, Chiuve SE, Cushman M, Das SR, Deo R, Floyd J, Fornage M, Gillespie C, Isasi C et al (2017) Heart disease and stroke statistics-2017 update: a report from the american heart association. Circulation 135(10):e146–e603CrossRef Benjamin EJ, Blaha MJ, Chiuve SE, Cushman M, Das SR, Deo R, Floyd J, Fornage M, Gillespie C, Isasi C et al (2017) Heart disease and stroke statistics-2017 update: a report from the american heart association. Circulation 135(10):e146–e603CrossRef
2.
Zurück zum Zitat Britten A, Crotty M, Kiremidjian H, Grundy A, Adam E (2004) The addition of computer simulated noise to investigate radiation dose and image quality in images with spatial correlation of statistical noise: an example application to X-ray CT of the brain. Br J Radiol 77(916):323–328CrossRef Britten A, Crotty M, Kiremidjian H, Grundy A, Adam E (2004) The addition of computer simulated noise to investigate radiation dose and image quality in images with spatial correlation of statistical noise: an example application to X-ray CT of the brain. Br J Radiol 77(916):323–328CrossRef
3.
Zurück zum Zitat Burger HC, Schuler CJ, Harmeling S (2012) Image denoising: can plain neural networks compete with BM3D? In: IEEE conference on computer vision and pattern recognition. IEEE, pp 2392–2399 Burger HC, Schuler CJ, Harmeling S (2012) Image denoising: can plain neural networks compete with BM3D? In: IEEE conference on computer vision and pattern recognition. IEEE, pp 2392–2399
4.
Zurück zum Zitat Centers for Disease Control and Prevention (2008) Awareness of stroke warning symptoms-13 States and the District of Columbia, 2005. Morb Mortal Wkly Rep 57(18):481 Centers for Disease Control and Prevention (2008) Awareness of stroke warning symptoms-13 States and the District of Columbia, 2005. Morb Mortal Wkly Rep 57(18):481
5.
Zurück zum Zitat Cho G, Kim JH, Park TS, Cho K (2017) Proposing a simple radiation scale for the public: Radiation index. Nucl Eng Technol 49(3):598–608CrossRef Cho G, Kim JH, Park TS, Cho K (2017) Proposing a simple radiation scale for the public: Radiation index. Nucl Eng Technol 49(3):598–608CrossRef
6.
Zurück zum Zitat Chodick G, Bekiroglu N, Hauptmann M, Alexander BH, Freedman DM, Doody MM, Cheung LC, Simon SL, Weinstock RM, Bouville A et al (2008) Risk of cataract after exposure to low doses of ionizing radiation: a 20-year prospective cohort study among US radiologic technologists. Am J Epidemiol 168(6):620–631CrossRef Chodick G, Bekiroglu N, Hauptmann M, Alexander BH, Freedman DM, Doody MM, Cheung LC, Simon SL, Weinstock RM, Bouville A et al (2008) Risk of cataract after exposure to low doses of ionizing radiation: a 20-year prospective cohort study among US radiologic technologists. Am J Epidemiol 168(6):620–631CrossRef
7.
Zurück zum Zitat de González AB, Mahesh M, Kim K-P, Bhargavan M, Lewis R, Mettler F, Land C (2009) Projected cancer risks from computed tomographic scans performed in the United States in 2007. Arch Intern Med 169(22):2071–2077CrossRef de González AB, Mahesh M, Kim K-P, Bhargavan M, Lewis R, Mettler F, Land C (2009) Projected cancer risks from computed tomographic scans performed in the United States in 2007. Arch Intern Med 169(22):2071–2077CrossRef
8.
Zurück zum Zitat Dong C, Loy CC, He K, Tang X (2014) Learning a deep convolutional network for image super-resolution. In: European conference on computer vision. Springer, pp 184–199 Dong C, Loy CC, He K, Tang X (2014) Learning a deep convolutional network for image super-resolution. In: European conference on computer vision. Springer, pp 184–199
9.
Zurück zum Zitat Erhan D, Szegedy C, Toshev A, Anguelov D (2014) Scalable object detection using deep neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2147–2154 Erhan D, Szegedy C, Toshev A, Anguelov D (2014) Scalable object detection using deep neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2147–2154
10.
Zurück zum Zitat Hall MJ, Levant S, DeFrances CJ (2012) Hospitalization for stroke in US hospitals, 1989–2009. Diabetes 18(23):23 Hall MJ, Levant S, DeFrances CJ (2012) Hospitalization for stroke in US hospitals, 1989–2009. Diabetes 18(23):23
11.
Zurück zum Zitat Erhan D, Szegedy C, Toshev A, Anguelov D (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778 Erhan D, Szegedy C, Toshev A, Anguelov D (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778
12.
Zurück zum Zitat Jia Y, Shelhamer E, Donahue J, Karayev S, Long J, Girshick R, Guadarrama S, Darrell T (2014) Caffe: convolutional architecture for fast feature embedding. In: Proceedings of the 22nd ACM international conference on Multimedia. ACM, pp 675–678 Jia Y, Shelhamer E, Donahue J, Karayev S, Long J, Girshick R, Guadarrama S, Darrell T (2014) Caffe: convolutional architecture for fast feature embedding. In: Proceedings of the 22nd ACM international conference on Multimedia. ACM, pp 675–678
13.
Zurück zum Zitat Journy NM, Lee C, Harbron RW, McHugh K, Pearce MS, de González AB (2017) Projected cancer risks potentially related to past, current, and future practices in paediatric CT in the United Kingdom, 1990–2020. Br J Cancer 116(1):109CrossRef Journy NM, Lee C, Harbron RW, McHugh K, Pearce MS, de González AB (2017) Projected cancer risks potentially related to past, current, and future practices in paediatric CT in the United Kingdom, 1990–2020. Br J Cancer 116(1):109CrossRef
14.
Zurück zum Zitat Juluru K, Shih J, Raj A, Comunale J, Delaney H, Greenberg E, Hermann C, Liu Y, Hoelscher A, Al-Khori N et al (2013) Effects of increased image noise on image quality and quantitative interpretation in brain CT perfusion. Am J Neuroradiol 34(8):1506–1512CrossRef Juluru K, Shih J, Raj A, Comunale J, Delaney H, Greenberg E, Hermann C, Liu Y, Hoelscher A, Al-Khori N et al (2013) Effects of increased image noise on image quality and quantitative interpretation in brain CT perfusion. Am J Neuroradiol 34(8):1506–1512CrossRef
15.
Zurück zum Zitat Kim J, Kwon Lee J, Mu Lee K (2016) Accurate image super-resolution using very deep convolutional networks. In: The IEEE conference on computer vision and pattern recognition, June 2016 Kim J, Kwon Lee J, Mu Lee K (2016) Accurate image super-resolution using very deep convolutional networks. In: The IEEE conference on computer vision and pattern recognition, June 2016
16.
Zurück zum Zitat Mao XJ, Shen C, Yang YB (2016) Image restoration using convolutional auto-encoders with symmetric skip connections. arXiv:1606.08921 Mao XJ, Shen C, Yang YB (2016) Image restoration using convolutional auto-encoders with symmetric skip connections. arXiv:​1606.​08921
17.
Zurück zum Zitat Mettler FA Jr, Bhargavan M et al (2009) Radiologic and nuclear medicine studies in the United States and Worldwide: frequency, radiation dose, and comparison with other radiation sources-1950-2007 1. Radiology 253(2):520–531CrossRef Mettler FA Jr, Bhargavan M et al (2009) Radiologic and nuclear medicine studies in the United States and Worldwide: frequency, radiation dose, and comparison with other radiation sources-1950-2007 1. Radiology 253(2):520–531CrossRef
18.
Zurück zum Zitat Murphy A, So A, Lee T-Y, Symons S, Jakubovic R, Zhang L, Aviv RI (2014) Low dose CT perfusion in acute ischemic stroke. Neuroradiology 56(12):1055–1062CrossRef Murphy A, So A, Lee T-Y, Symons S, Jakubovic R, Zhang L, Aviv RI (2014) Low dose CT perfusion in acute ischemic stroke. Neuroradiology 56(12):1055–1062CrossRef
19.
Zurück zum Zitat Oktay O, Bai W, Lee M et al (2016) Multi-input cardiac image super-resolution using convolutional neural networks. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 246–254 Oktay O, Bai W, Lee M et al (2016) Multi-input cardiac image super-resolution using convolutional neural networks. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 246–254
20.
21.
Zurück zum Zitat Shi W et al (2016) Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1874–1883 Shi W et al (2016) Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1874–1883
22.
Zurück zum Zitat Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1–9 Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1–9
23.
Zurück zum Zitat Takei Y, Miyazaki O, Matsubara K, Shimada Y, Muramatsu Y, Akahane K, Fujii K, Suzuki S, Koshida K (2016) Nationwide survey of radiation exposure during pediatric computed tomography examinations and proposal of age-based diagnostic reference levels for Japan. Pediatr Radiol 46(2):280–285CrossRef Takei Y, Miyazaki O, Matsubara K, Shimada Y, Muramatsu Y, Akahane K, Fujii K, Suzuki S, Koshida K (2016) Nationwide survey of radiation exposure during pediatric computed tomography examinations and proposal of age-based diagnostic reference levels for Japan. Pediatr Radiol 46(2):280–285CrossRef
24.
Zurück zum Zitat Thierfelder KM, Sommer WH, Baumann AB, Klotz E, Meinel FG, Strobl FF, Nikolaou K, Reiser MF, von Baumgarten L (2013) Whole-brain CT perfusion: reliability and reproducibility of volumetric perfusion deficit assessment in patients with acute ischemic stroke. Neuroradiology 55(7):827–835CrossRef Thierfelder KM, Sommer WH, Baumann AB, Klotz E, Meinel FG, Strobl FF, Nikolaou K, Reiser MF, von Baumgarten L (2013) Whole-brain CT perfusion: reliability and reproducibility of volumetric perfusion deficit assessment in patients with acute ischemic stroke. Neuroradiology 55(7):827–835CrossRef
25.
Zurück zum Zitat Wintermark M, Lev M (2010) FDA investigates the safety of brain perfusion CT. Am J Neuroradiol 31(1):2–3CrossRef Wintermark M, Lev M (2010) FDA investigates the safety of brain perfusion CT. Am J Neuroradiol 31(1):2–3CrossRef
26.
Zurück zum Zitat Xiao Y, Gupta A, Sanelli PC, Fang R (2017) STAR: spatio-temporal architecture for super-resolution in low-dose CT perfusion. In: International workshop on machine learning in medical imaging. Springer, pp 97–105 Xiao Y, Gupta A, Sanelli PC, Fang R (2017) STAR: spatio-temporal architecture for super-resolution in low-dose CT perfusion. In: International workshop on machine learning in medical imaging. Springer, pp 97–105
27.
Zurück zum Zitat Xie J, Xu L, Chen E (2012) Image denoising and inpainting with deep neural networks. In: Advances in neural information processing systems, pp 341–349 Xie J, Xu L, Chen E (2012) Image denoising and inpainting with deep neural networks. In: Advances in neural information processing systems, pp 341–349
28.
Zurück zum Zitat Yang Q, Tong X, Schieb L, Vaughan A, Gillespie C, Wiltz JL, King SC, Odom E, Merritt R, Hong Y et al (2017) Vital signs: recent trends in stroke death rates-United States, 2000–2015. Morb Mortal Wkly Rep 66(35):933–939CrossRef Yang Q, Tong X, Schieb L, Vaughan A, Gillespie C, Wiltz JL, King SC, Odom E, Merritt R, Hong Y et al (2017) Vital signs: recent trends in stroke death rates-United States, 2000–2015. Morb Mortal Wkly Rep 66(35):933–939CrossRef
29.
Zurück zum Zitat Yu L, Fletcher JG, Shiung M, Thomas KB, Matsumoto JM, Zingula SN, McCollough CH (2015) Radiation dose reduction in pediatric body CT using iterative reconstruction and a novel image-based denoising method. Am J Roentgenol 205(5):1026–1037CrossRef Yu L, Fletcher JG, Shiung M, Thomas KB, Matsumoto JM, Zingula SN, McCollough CH (2015) Radiation dose reduction in pediatric body CT using iterative reconstruction and a novel image-based denoising method. Am J Roentgenol 205(5):1026–1037CrossRef
30.
Zurück zum Zitat Zhang K, Zuo W, Chen Y, Meng D, Zhang L (2017) Beyond a gaussian denoiser: residual learning of deep CNN for image denoising. IEEE Trans Image Process 26(7):3142–3155MathSciNetCrossRef Zhang K, Zuo W, Chen Y, Meng D, Zhang L (2017) Beyond a gaussian denoiser: residual learning of deep CNN for image denoising. IEEE Trans Image Process 26(7):3142–3155MathSciNetCrossRef
Metadaten
Titel
Deep Spatial-Temporal Convolutional Neural Networks for Medical Image Restoration
verfasst von
Yao Xiao
Skylar Stolte
Peng Liu
Yun Liang
Pina Sanelli
Ajay Gupta
Jana Ivanidze
Ruogu Fang
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-13969-8_13

Premium Partner