Skip to main content
Erschienen in: The Journal of Supercomputing 2/2019

01.06.2017

Medical image denoising using convolutional neural network: a residual learning approach

verfasst von: Worku Jifara, Feng Jiang, Seungmin Rho, Maowei Cheng, Shaohui Liu

Erschienen in: The Journal of Supercomputing | Ausgabe 2/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In medical imaging, denoising is very important for analysis of images, diagnosis and treatment of diseases. Currently, image denoising methods based on deep learning are effective, where the methods are however limited for the requirement of training sample size (i.e., not successful enough for small data size). Using small sample size, we design deep feed forward denoising convolutional neural networks by studying the model in deep framework, learning approach and regularization approach for medical image denoising. More specifically, we use residual learning as a learning approach and batch normalization as regularization in the deep model. Unlike most of the other image denoising approaches which directly learn the latent clean images, the residual learning approach learns the noise from the noisy images instead of the latent clean images where the denoised images are obtained by subtracting the learned residual from the noisy image. Moreover, batch normalization is integrated with residual learning to improve model learning accuracy and training time. We compute the quality of the reconstructed or denoised image in standard image quality metrics, peak signal to noise ratio and structural similarity and compare our model performance with some medical image denoising techniques. Experimental results reveal that our approach has better performance than some other methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Gao Q, Olgac N (2016) Determination of the bounds of imaginary spectra of LTI systems with multiple time delays. Automatica 72:235–241CrossRefMATH Gao Q, Olgac N (2016) Determination of the bounds of imaginary spectra of LTI systems with multiple time delays. Automatica 72:235–241CrossRefMATH
2.
Zurück zum Zitat Mondal T, Maitra M (2015) Denoising and compression of medical image in wavelet 2D. Int J Recent Innov Trends Comput Commun 6:173–178 Mondal T, Maitra M (2015) Denoising and compression of medical image in wavelet 2D. Int J Recent Innov Trends Comput Commun 6:173–178
3.
Zurück zum Zitat Mustafa N, Li JP, Khan SA, Giess M (2015) Medical image de-noising schemes using wavelet transform with fixed form thresholding. Int J Adv Comput Sci Appl 6:173–178 Mustafa N, Li JP, Khan SA, Giess M (2015) Medical image de-noising schemes using wavelet transform with fixed form thresholding. Int J Adv Comput Sci Appl 6:173–178
4.
Zurück zum Zitat Bahendwar YS, Sinh GR (2012) Efficient algorithm for denoising of medical images using discrete wavelet transforms. Math Methods Syst Sci Eng 142:158–162 Bahendwar YS, Sinh GR (2012) Efficient algorithm for denoising of medical images using discrete wavelet transforms. Math Methods Syst Sci Eng 142:158–162
5.
Zurück zum Zitat Zhang X (2015) Image denoising using shearlet transform and nonlinear diffusion. Proc Sci 20:033016 Zhang X (2015) Image denoising using shearlet transform and nonlinear diffusion. Proc Sci 20:033016
6.
7.
Zurück zum Zitat Hu J, Pu Y, Wu X, Zhang Y, Zhou J (2012) Improved DCT-based nonlocal means filter for MR images denoising. Comput Math Methods Med 2012:85–91 Hu J, Pu Y, Wu X, Zhang Y, Zhou J (2012) Improved DCT-based nonlocal means filter for MR images denoising. Comput Math Methods Med 2012:85–91
8.
Zurück zum Zitat Sameh Arif A, Mansor S, Logeswaran R (2011) Combined bilateral and anisotropic-diffusion filters for medical image de-noising. IEEE Student Conf Res Dev SCOReD 2:420–424 Sameh Arif A, Mansor S, Logeswaran R (2011) Combined bilateral and anisotropic-diffusion filters for medical image de-noising. IEEE Student Conf Res Dev SCOReD 2:420–424
9.
Zurück zum Zitat Bhonsle D, Chandra V, Sinha GR (2012) Medical image denoising using bilateral filter. Int J Image Gr Signal Process 4:36–43CrossRef Bhonsle D, Chandra V, Sinha GR (2012) Medical image denoising using bilateral filter. Int J Image Gr Signal Process 4:36–43CrossRef
10.
Zurück zum Zitat Dabov K, Foi A, Katkovnik V, Katkovnik V, Egiazarian K (2007) Image denoising by sparse 3-D transform-domain collaborative filtering. IEEE Trans Image Process 16:2080–2095MathSciNetCrossRef Dabov K, Foi A, Katkovnik V, Katkovnik V, Egiazarian K (2007) Image denoising by sparse 3-D transform-domain collaborative filtering. IEEE Trans Image Process 16:2080–2095MathSciNetCrossRef
11.
Zurück zum Zitat Elad M, Aharon M (2006) Image Denoising via learned dictionaries and sparse representation. Comput Vis Pattern Recogn 1:1063–6919 Elad M, Aharon M (2006) Image Denoising via learned dictionaries and sparse representation. Comput Vis Pattern Recogn 1:1063–6919
12.
Zurück zum Zitat Bengio Y, Lamblin P, Popovici D, Larochelle H (2007) Greedy Layer-Wise training of deep networks. Adv Neural Inf Process Syst 19:153 Bengio Y, Lamblin P, Popovici D, Larochelle H (2007) Greedy Layer-Wise training of deep networks. Adv Neural Inf Process Syst 19:153
13.
Zurück zum Zitat Schmidhuber J (2014) Deep learning in neural networks: an overview. J Neural Netw 61:85–117CrossRef Schmidhuber J (2014) Deep learning in neural networks: an overview. J Neural Netw 61:85–117CrossRef
14.
Zurück zum Zitat Tan Z, Wei H, Chen Y, Du M, Ye S (2016) Design for medical imaging services platform based on cloud computing. Int J Big Data Intell 3(4):270–278CrossRef Tan Z, Wei H, Chen Y, Du M, Ye S (2016) Design for medical imaging services platform based on cloud computing. Int J Big Data Intell 3(4):270–278CrossRef
15.
Zurück zum Zitat Vincent P, Larochelle H, Bengio Y, Manzagol PA (2011) Extracting and composing robust features with denoising autoencoders. In: IEEE Student Conference on Research and Development, pp 1096–1103 Vincent P, Larochelle H, Bengio Y, Manzagol PA (2011) Extracting and composing robust features with denoising autoencoders. In: IEEE Student Conference on Research and Development, pp 1096–1103
16.
Zurück zum Zitat Gondara L (2016) Medical image denoising using convolutional denoising autoencoders. In: IEEE Conference on Computer Vision and Pattern Recognition Gondara L (2016) Medical image denoising using convolutional denoising autoencoders. In: IEEE Conference on Computer Vision and Pattern Recognition
17.
Zurück zum Zitat Buades A, Coll B, Morel JM (2005) A review of image denoising algorithms with a new one. SIAM J Multiscale Model Simul A SIAM Interdiscip 4:490–530MathSciNetCrossRefMATH Buades A, Coll B, Morel JM (2005) A review of image denoising algorithms with a new one. SIAM J Multiscale Model Simul A SIAM Interdiscip 4:490–530MathSciNetCrossRefMATH
18.
Zurück zum Zitat Agostinelli F, Anderson MR, Lee H (2013) Adaptive multi-column deep neural networks with application to robust image denoising. Adv Neural Inf Process Syst 26:1493–1501 Agostinelli F, Anderson MR, Lee H (2013) Adaptive multi-column deep neural networks with application to robust image denoising. Adv Neural Inf Process Syst 26:1493–1501
19.
Zurück zum Zitat Burger HC, Schuler CJ, Harmeling S (2012) Image denoising: can plain neural networks compete with BM3D? In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp 2392–2399 Burger HC, Schuler CJ, Harmeling S (2012) Image denoising: can plain neural networks compete with BM3D? In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp 2392–2399
20.
Zurück zum Zitat Zhang K, Zuo W, Chen Y, Meng D, Zhang L (2016) Beyond a Gaussian denoiser: residual learning of deep CNN for image denoising, Tech report Computer Vision and Pattern Recognition, pp 1–13 Zhang K, Zuo W, Chen Y, Meng D, Zhang L (2016) Beyond a Gaussian denoiser: residual learning of deep CNN for image denoising, Tech report Computer Vision and Pattern Recognition, pp 1–13
22.
Zurück zum Zitat Girshick R, Donahue J, Darrell T, Malik J (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE Computer Society Conference on Computer Vision Pattern Recognition, pp 580–587 Girshick R, Donahue J, Darrell T, Malik J (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE Computer Society Conference on Computer Vision Pattern Recognition, pp 580–587
23.
Zurück zum Zitat Oliveira TP, Barbar JS, Soares Alexsandro Santos (2016) Computer network traffic prediction: a comparison between traditional and deep learning neural networks. Int J Big Data Intell 3(1):28–37CrossRef Oliveira TP, Barbar JS, Soares Alexsandro Santos (2016) Computer network traffic prediction: a comparison between traditional and deep learning neural networks. Int J Big Data Intell 3(1):28–37CrossRef
24.
Zurück zum Zitat Krizhevsky A, Sutskever I, Geoffrey EH (2012) Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 25:1097–1105 Krizhevsky A, Sutskever I, Geoffrey EH (2012) Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 25:1097–1105
25.
Zurück zum Zitat He K, Zhang X, Ren S, Sun J (2014) Spatial pyramid pooling in deep convolutional networks for visual recognition. In: European Conference on Computer Vision, Springer, Berlin He K, Zhang X, Ren S, Sun J (2014) Spatial pyramid pooling in deep convolutional networks for visual recognition. In: European Conference on Computer Vision, Springer, Berlin
26.
Zurück zum Zitat Glorot X, Bengio Y (2010) Understanding the difficulty of training deep feedforward neural networks. In: Proceedings of the International Conference on Artificial Intelligence and Statistics vol. 9, pp 249–256 Glorot X, Bengio Y (2010) Understanding the difficulty of training deep feedforward neural networks. In: Proceedings of the International Conference on Artificial Intelligence and Statistics vol. 9, pp 249–256
27.
Zurück zum Zitat Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift. In: Proceedings of the 32nd International Conference on Machine Learning, pp 448–456 Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift. In: Proceedings of the 32nd International Conference on Machine Learning, pp 448–456
28.
Zurück zum Zitat He K, Zhang X, Ren Sh, Sun J (2015) Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision Pattern Recognition, pp 770–778 (arXiv preprint arXiv:1512.03385) He K, Zhang X, Ren Sh, Sun J (2015) Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision Pattern Recognition, pp 770–778 (arXiv preprint arXiv:​1512.​03385)
29.
Zurück zum Zitat Xing C, Ma L, Yang X (2016) Stacked denoise autoencoder based feature extraction and classification for hyperspectral images. J Sens 2016:1–10. doi:10.1155/2016/3632943 Xing C, Ma L, Yang X (2016) Stacked denoise autoencoder based feature extraction and classification for hyperspectral images. J Sens 2016:1–10. doi:10.​1155/​2016/​3632943
30.
Zurück zum Zitat Masci J, Meier U, Ciresan D, Schmidhuber J (2011) Stacked convolutional auto-encoders for hierarchical feature extraction. Springer, BerlinCrossRef Masci J, Meier U, Ciresan D, Schmidhuber J (2011) Stacked convolutional auto-encoders for hierarchical feature extraction. Springer, BerlinCrossRef
31.
Zurück zum Zitat Jiang F, Rho S, Chen B, Du X, Zhao D (2015) Face hallucination and recognition in social network services. J Supercomput 71(6):2035–2049CrossRef Jiang F, Rho S, Chen B, Du X, Zhao D (2015) Face hallucination and recognition in social network services. J Supercomput 71(6):2035–2049CrossRef
32.
Zurück zum Zitat Jiang F, Chen B, Li K, Zhao D (2014) Big data driven decision making and multi-prior models collaboration for media restoration. Multimedia Tools Appl 75:12967–12982 Jiang F, Chen B, Li K, Zhao D (2014) Big data driven decision making and multi-prior models collaboration for media restoration. Multimedia Tools Appl 75:12967–12982
33.
Zurück zum Zitat Jiang F, Chen BW, Rho S et al (2016) Optimal filter based on scale-invariance generation of natural images. J Supercomput 72(1):5–23CrossRef Jiang F, Chen BW, Rho S et al (2016) Optimal filter based on scale-invariance generation of natural images. J Supercomput 72(1):5–23CrossRef
34.
Zurück zum Zitat Jiang F, Ji X, Hu C, Liu S, Zhao D (2014) Compressed vision information restoration based on cloud prior and local prior. IEEE 2:1117–1127 Jiang F, Ji X, Hu C, Liu S, Zhao D (2014) Compressed vision information restoration based on cloud prior and local prior. IEEE 2:1117–1127
35.
Zurück zum Zitat He K, Zhang X, Ren S, Sun J (2015) Delving deep into rectifiers: surpassing human-level performance on imagenet classification. In: IEEE International Conference on Computer Vision pp 1026–1034 He K, Zhang X, Ren S, Sun J (2015) Delving deep into rectifiers: surpassing human-level performance on imagenet classification. In: IEEE International Conference on Computer Vision pp 1026–1034
36.
Zurück zum Zitat Kingma D, Ba J (2015) Adam: a method for stochastic optimization. Paper at the 3rd International Conference for Learning Representations Kingma D, Ba J (2015) Adam: a method for stochastic optimization. Paper at the 3rd International Conference for Learning Representations
37.
Zurück zum Zitat Vedaldi A, Lenc K (2015) Matconvnet: convolutional neural networks for matlab. In: Proceedings of the 23rd Annual ACM Conference on Multimedia Conference, pp 689–692 Vedaldi A, Lenc K (2015) Matconvnet: convolutional neural networks for matlab. In: Proceedings of the 23rd Annual ACM Conference on Multimedia Conference, pp 689–692
38.
Zurück zum Zitat Chen BW, Wang JC, Wang JF (2009) A novel video summarization based on mining the story-structure and semantic relations among concept entities. IEEE Trans Multimed 11(2):295–312CrossRef Chen BW, Wang JC, Wang JF (2009) A novel video summarization based on mining the story-structure and semantic relations among concept entities. IEEE Trans Multimed 11(2):295–312CrossRef
39.
Zurück zum Zitat Chen BW, Chen CY, Wang JF (2013) Smart homecare surveillance system: behavior identification based on state transition support vector machines and sound directivity pattern analysis. IEEE Trans Syst Man Cybern Syst 43(6):1279–1289CrossRef Chen BW, Chen CY, Wang JF (2013) Smart homecare surveillance system: behavior identification based on state transition support vector machines and sound directivity pattern analysis. IEEE Trans Syst Man Cybern Syst 43(6):1279–1289CrossRef
Metadaten
Titel
Medical image denoising using convolutional neural network: a residual learning approach
verfasst von
Worku Jifara
Feng Jiang
Seungmin Rho
Maowei Cheng
Shaohui Liu
Publikationsdatum
01.06.2017
Verlag
Springer US
Erschienen in
The Journal of Supercomputing / Ausgabe 2/2019
Print ISSN: 0920-8542
Elektronische ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-017-2080-0

Weitere Artikel der Ausgabe 2/2019

The Journal of Supercomputing 2/2019 Zur Ausgabe

Premium Partner