Skip to main content
Erschienen in: Neural Computing and Applications 9/2019

12.01.2019 | Original Article

Removing ring artifacts in CBCT images via generative adversarial networks with unidirectional relative total variation loss

verfasst von: Zheng Wang, Jianwu Li, Mogendi Enoh

Erschienen in: Neural Computing and Applications | Ausgabe 9/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Cone beam computed tomography (CBCT) is an important tool for clinical diagnosis and many industrial applications. However, ring artifacts usually appear in CBCT images, due to device responding inconsistence. This paper designs a generative adversarial network (GAN) to remove ring artifacts and meanwhile to retain important texture details in CBCT images. This method firstly transforms ring artifacts in Cartesian coordinates to stripe artifacts in polar coordinates, which is very helpful for removing ring artifacts. Then, we design a new loss function for GAN, including three parts: unidirectional relative total variation loss, perceptual loss and adversarial loss. Further, inspired by super-resolution generative adversarial networks, we use very deep residual networks for both generator and discriminator. Experimental results show that the proposed method is more effective for ring artifacts removal, compared to our baseline and some traditional methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Fox EC, Nixon O, Agwani MS, Dykaar DR, Mantell TJ, Sabila RW (1998) High-speed linear CCD sensor with pinned photodiode photosite for low-lag and low-noise imaging. In: Solid state sensor arrays: development and applications II, vol 3301, pp 17–27, International Society for Optics and Photonics Fox EC, Nixon O, Agwani MS, Dykaar DR, Mantell TJ, Sabila RW (1998) High-speed linear CCD sensor with pinned photodiode photosite for low-lag and low-noise imaging. In: Solid state sensor arrays: development and applications II, vol 3301, pp 17–27, International Society for Optics and Photonics
2.
Zurück zum Zitat Seibert JA, Boone JM (2015) Flat-field correction technique for digital detectors. In: Proceedings of SPIE, vol 3336, pp 348–354 Seibert JA, Boone JM (2015) Flat-field correction technique for digital detectors. In: Proceedings of SPIE, vol 3336, pp 348–354
3.
Zurück zum Zitat Liang Lihong L H (2004) The corrected research of flat-panel detector imaging system. Acta Photonica Sin 33(10):1277–1280 Liang Lihong L H (2004) The corrected research of flat-panel detector imaging system. Acta Photonica Sin 33(10):1277–1280
4.
Zurück zum Zitat Jiang XG, Zhang KZ, Li CG, Wang Y (2007) Extended applications of image flat-field correction method. Acta Photonica Sin 36(9):1587–1590 Jiang XG, Zhang KZ, Li CG, Wang Y (2007) Extended applications of image flat-field correction method. Acta Photonica Sin 36(9):1587–1590
5.
Zurück zum Zitat Tang X, Ning R, Yu R, Conover D (2001) Cone beam volume CT image artifacts caused by defective cells in X-ray flat panel imagers and the artifact removal using a wavelet-analysis-based algorithm. Med Phys 28(5):812–825CrossRef Tang X, Ning R, Yu R, Conover D (2001) Cone beam volume CT image artifacts caused by defective cells in X-ray flat panel imagers and the artifact removal using a wavelet-analysis-based algorithm. Med Phys 28(5):812–825CrossRef
6.
Zurück zum Zitat Kowalski G (1978) Suppression of ring artefacts in CT fan-beam scanners. IEEE Trans Nucl Sci 25(5):1111–1116CrossRef Kowalski G (1978) Suppression of ring artefacts in CT fan-beam scanners. IEEE Trans Nucl Sci 25(5):1111–1116CrossRef
7.
Zurück zum Zitat Raven C (1998) Numerical removal of ring artifacts in microtomography. Rev Sci Instrum 69(8):2978–2980CrossRef Raven C (1998) Numerical removal of ring artifacts in microtomography. Rev Sci Instrum 69(8):2978–2980CrossRef
8.
Zurück zum Zitat Münch B, Trtik P, Marone F, Stampanoni M (2009) Stripe and ring artifact removal with combined wavelet fourier filtering. Opt Express 17(10):8567–8591CrossRef Münch B, Trtik P, Marone F, Stampanoni M (2009) Stripe and ring artifact removal with combined wavelet fourier filtering. Opt Express 17(10):8567–8591CrossRef
9.
Zurück zum Zitat Haibel A, Boin M (2006) Compensation of ring artefacts in synchrotron tomographic images. Opt Express 14(25):12071–12075CrossRef Haibel A, Boin M (2006) Compensation of ring artefacts in synchrotron tomographic images. Opt Express 14(25):12071–12075CrossRef
10.
Zurück zum Zitat Ashrafuzzaman ANM, Lee SY, Hasan MK (2011) A self-adaptive approach for the detection and correction of stripes in the sinogram: suppression of ring artifacts in CT imaging. Eurasip J Adv Signal Process 2011(1):1–13CrossRef Ashrafuzzaman ANM, Lee SY, Hasan MK (2011) A self-adaptive approach for the detection and correction of stripes in the sinogram: suppression of ring artifacts in CT imaging. Eurasip J Adv Signal Process 2011(1):1–13CrossRef
11.
Zurück zum Zitat Titarenko S, Titarenko V, Kyrieleis A, Withers PJ, Carlo FD (2011) Suppression of ring artefacts when tomographing anisotropically attenuating samples. J Synchrotron Radiat 18(3):427–435CrossRef Titarenko S, Titarenko V, Kyrieleis A, Withers PJ, Carlo FD (2011) Suppression of ring artefacts when tomographing anisotropically attenuating samples. J Synchrotron Radiat 18(3):427–435CrossRef
12.
Zurück zum Zitat Miqueles EX, Rinkel J, O’Dowd F, Bermdez JSV (2014) Generalized Titarenko’s algorithm for ring artefacts reduction. J Synchrotron Radiat 21(6):1333–1346CrossRef Miqueles EX, Rinkel J, O’Dowd F, Bermdez JSV (2014) Generalized Titarenko’s algorithm for ring artefacts reduction. J Synchrotron Radiat 21(6):1333–1346CrossRef
13.
Zurück zum Zitat Titarenko V (2016) Analytical formula for two-dimensional ring artefact suppression. J Synchrotron Radiat 23(6):1447–1461CrossRef Titarenko V (2016) Analytical formula for two-dimensional ring artefact suppression. J Synchrotron Radiat 23(6):1447–1461CrossRef
14.
Zurück zum Zitat Mohan KA, Venkatakrishnan SV, Drummy LF, Simmons J (2014) Model-based iterative reconstruction for synchrotron X-ray tomography. In: IEEE international conference on acoustics, speech and signal processing, pp 6909–6913 Mohan KA, Venkatakrishnan SV, Drummy LF, Simmons J (2014) Model-based iterative reconstruction for synchrotron X-ray tomography. In: IEEE international conference on acoustics, speech and signal processing, pp 6909–6913
15.
Zurück zum Zitat Pierre P, Alessandro M (2015) Ring artifacts correction in compressed sensing tomographic reconstruction. J Synchrotron Radiat 22(Pt 5):1268–1278 Pierre P, Alessandro M (2015) Ring artifacts correction in compressed sensing tomographic reconstruction. J Synchrotron Radiat 22(Pt 5):1268–1278
16.
Zurück zum Zitat Kyriakou Y, Prell D, Kalender WA (2009) Ring artifact correction for high-resolution micro CT. Phys Med Biol 54(17):N385CrossRef Kyriakou Y, Prell D, Kalender WA (2009) Ring artifact correction for high-resolution micro CT. Phys Med Biol 54(17):N385CrossRef
17.
Zurück zum Zitat Prell D, Kyriakou YKalender W A (2009) Comparison of ring artifact correction methods for flat-detector CT. Phys Med Biol 54(12):3881CrossRef Prell D, Kyriakou YKalender W A (2009) Comparison of ring artifact correction methods for flat-detector CT. Phys Med Biol 54(12):3881CrossRef
18.
Zurück zum Zitat Chen YW, Duan G, Fujita A, Hirooka K, Ueno Y (2009) Ring artifacts reduction in cone-beam CT images based on independent component analysis. In: Instrumentation and measurement technology conference, 2009. I2MTC ’09. IEEE, pp 1734–1737 Chen YW, Duan G, Fujita A, Hirooka K, Ueno Y (2009) Ring artifacts reduction in cone-beam CT images based on independent component analysis. In: Instrumentation and measurement technology conference, 2009. I2MTC ’09. IEEE, pp 1734–1737
19.
Zurück zum Zitat Chen YW, Duan G (2009) Independent component analysis based ring artifact reduction in cone-beam CT images. In: IEEE international conference on image processing, pp 4137–4140 Chen YW, Duan G (2009) Independent component analysis based ring artifact reduction in cone-beam CT images. In: IEEE international conference on image processing, pp 4137–4140
20.
Zurück zum Zitat Yan L, Wu T, Zhong S, Zhang Q (2016) A variation-based ring artifact correction method with sparse constraint for flat-detector CT. Phys Med Biol 61(3):1278CrossRef Yan L, Wu T, Zhong S, Zhang Q (2016) A variation-based ring artifact correction method with sparse constraint for flat-detector CT. Phys Med Biol 61(3):1278CrossRef
21.
Zurück zum Zitat Sijbers J, Postnov A (2004) Reduction of ring artefacts in high resolution micro-CT reconstructions. Phys Med Biol 49(14):N247CrossRef Sijbers J, Postnov A (2004) Reduction of ring artefacts in high resolution micro-CT reconstructions. Phys Med Biol 49(14):N247CrossRef
22.
Zurück zum Zitat Brun F, Kourousias G, Dreossi D, Mancini L (2009) An improved method for ring artifacts removing in reconstructed tomographic images. Springer, BerlinCrossRef Brun F, Kourousias G, Dreossi D, Mancini L (2009) An improved method for ring artifacts removing in reconstructed tomographic images. Springer, BerlinCrossRef
23.
Zurück zum Zitat Wei Z, Wiebe S, Chapman D (2013) Ring artifacts removal from synchrotron CT image slices. J Instrum 8(6):C06006CrossRef Wei Z, Wiebe S, Chapman D (2013) Ring artifacts removal from synchrotron CT image slices. J Instrum 8(6):C06006CrossRef
24.
Zurück zum Zitat Bouali M, Ladjal S (2011) Toward optimal destriping of modis data using a unidirectional variational model. IEEE Trans Geosci Remote Sens 49(8):2924–2935CrossRef Bouali M, Ladjal S (2011) Toward optimal destriping of modis data using a unidirectional variational model. IEEE Trans Geosci Remote Sens 49(8):2924–2935CrossRef
25.
Zurück zum Zitat Xu L, Yan Q, Xia Y, Jia J (2012) Structure extraction from texture via relative total variation. ACM Trans Graph 31(6):139 Xu L, Yan Q, Xia Y, Jia J (2012) Structure extraction from texture via relative total variation. ACM Trans Graph 31(6):139
26.
Zurück zum Zitat Green M, Marom EM, Kiryati N, Konen E, Mayer A (2016) Efficient low-dose CT denoising by locally-consistent non-local means (LC-NLM). In: International conference on medical image computing and computer-assisted intervention, pp 423–431, Springer Green M, Marom EM, Kiryati N, Konen E, Mayer A (2016) Efficient low-dose CT denoising by locally-consistent non-local means (LC-NLM). In: International conference on medical image computing and computer-assisted intervention, pp 423–431, Springer
27.
Zurück zum Zitat Liu Y, Zhang Y (2018) Low-dose CT restoration via stacked sparse denoising autoencoders. Neurocomputing 284:80–89CrossRef Liu Y, Zhang Y (2018) Low-dose CT restoration via stacked sparse denoising autoencoders. Neurocomputing 284:80–89CrossRef
28.
Zurück zum Zitat Ronneberger O (2017) Invited talk: U-Net convolutional networks for biomedical image segmentation. In: Bildverarbeitung für die Medizin 2017, p 3, Springer Ronneberger O (2017) Invited talk: U-Net convolutional networks for biomedical image segmentation. In: Bildverarbeitung für die Medizin 2017, p 3, Springer
29.
Zurück zum Zitat Deng Y, Bao F, Deng X, Wang R, Dai Q (2016) Deep and structured robust information theoretic learning for image analysis. IEEE Trans Image Process 25:4209–4221MathSciNetMATHCrossRef Deng Y, Bao F, Deng X, Wang R, Dai Q (2016) Deep and structured robust information theoretic learning for image analysis. IEEE Trans Image Process 25:4209–4221MathSciNetMATHCrossRef
30.
Zurück zum Zitat He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778 He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778
31.
Zurück zum Zitat Deng Y, Ren Z, Kong Y, Bao F, Dai Q (2017) A hierarchical fused fuzzy deep neural network for data classification. IEEE Trans Fuzzy Syst 25(4):1006–1012CrossRef Deng Y, Ren Z, Kong Y, Bao F, Dai Q (2017) A hierarchical fused fuzzy deep neural network for data classification. IEEE Trans Fuzzy Syst 25(4):1006–1012CrossRef
32.
Zurück zum Zitat Ledig C, Theis L, Huszar F, Caballero J, Cunningham A, Acosta A, Aitken A, Tejani A, Totz J, Wang Z et al (2017) Photo-realistic single image super-resolution using a generative adversarial network, In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4681–4690 Ledig C, Theis L, Huszar F, Caballero J, Cunningham A, Acosta A, Aitken A, Tejani A, Totz J, Wang Z et al (2017) Photo-realistic single image super-resolution using a generative adversarial network, In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4681–4690
33.
Zurück zum Zitat Gulrajani I, Ahmed F, Arjovsky M, Dumoulin V, Courville AC (2017) Improved training of Wasserstein GANs. In: International conference on neural information processing systems, pp 5769–5779 Gulrajani I, Ahmed F, Arjovsky M, Dumoulin V, Courville AC (2017) Improved training of Wasserstein GANs. In: International conference on neural information processing systems, pp 5769–5779
34.
Zurück zum Zitat Ji Y, Zhang H, Wu QJ (2018) Saliency detection via conditional adversarial image-to-image network. Neurocomputing 316:357–368CrossRef Ji Y, Zhang H, Wu QJ (2018) Saliency detection via conditional adversarial image-to-image network. Neurocomputing 316:357–368CrossRef
36.
Zurück zum Zitat Brock A, Lim T, Ritchie JM, Weston N (2016) Neural photo editing with introspective adversarial networks. ArXiv preprint arXiv:1609.07093 Brock A, Lim T, Ritchie JM, Weston N (2016) Neural photo editing with introspective adversarial networks. ArXiv preprint arXiv:​1609.​07093
37.
Zurück zum Zitat Deng Y, Shen Y, Jin H (2017) Disguise adversarial networks for click-through rate prediction. In: Proceedings of the 26th international joint conference on artificial intelligence, AAAI Press, pp 1589-1595 Deng Y, Shen Y, Jin H (2017) Disguise adversarial networks for click-through rate prediction. In: Proceedings of the 26th international joint conference on artificial intelligence, AAAI Press, pp 1589-1595
38.
Zurück zum Zitat Deng Y, Chen KW, Shen Y, Jin H (2018) Adversarial active learning for sequences labeling and generation. In: Proceedings of the twenty-seventh international joint conference on artificial intelligence, pp 4012–4018, International Joint Conferences on Artificial Intelligence Organization Deng Y, Chen KW, Shen Y, Jin H (2018) Adversarial active learning for sequences labeling and generation. In: Proceedings of the twenty-seventh international joint conference on artificial intelligence, pp 4012–4018, International Joint Conferences on Artificial Intelligence Organization
39.
Zurück zum Zitat Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. ArXiv preprint arXiv:1409.1556 Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. ArXiv preprint arXiv:​1409.​1556
40.
Zurück zum Zitat Yang Q, Yan P, Zhang Y, Yu H, Shi Y, Mou X, Kalra MK, Zhang Y, Sun L, Wang G (2017) Low dose CT image denoising using a generative adversarial network with Wasserstein distance and perceptual loss. IEEE Trans Med Imaging PP(99):1–1 Yang Q, Yan P, Zhang Y, Yu H, Shi Y, Mou X, Kalra MK, Zhang Y, Sun L, Wang G (2017) Low dose CT image denoising using a generative adversarial network with Wasserstein distance and perceptual loss. IEEE Trans Med Imaging PP(99):1–1
41.
Zurück zum Zitat Zhang H, Sindagi V, Patel VM (2017) Image de-raining using a conditional generative adversarial network. ArXiv preprint arXiv:1701.05957 Zhang H, Sindagi V, Patel VM (2017) Image de-raining using a conditional generative adversarial network. ArXiv preprint arXiv:​1701.​05957
42.
Zurück zum Zitat Kupyn O, Budzan V, Mykhailych M, Mishkin D, Matas J (2017) Deblurgan: blind motion deblurring using conditional adversarial networks. ArXiv preprint arXiv:1711.07064 Kupyn O, Budzan V, Mykhailych M, Mishkin D, Matas J (2017) Deblurgan: blind motion deblurring using conditional adversarial networks. ArXiv preprint arXiv:​1711.​07064
43.
Zurück zum Zitat Goodfellow IJ, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. In: International conference on neural information processing systems, pp 2672–2680 Goodfellow IJ, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. In: International conference on neural information processing systems, pp 2672–2680
44.
Zurück zum Zitat Creswell A, White T, Dumoulin V, Kai A, Sengupta B, Bharath AA (2018) Generative adversarial networks: an overview. IEEE Sig Process Mag 35(1):53–65CrossRef Creswell A, White T, Dumoulin V, Kai A, Sengupta B, Bharath AA (2018) Generative adversarial networks: an overview. IEEE Sig Process Mag 35(1):53–65CrossRef
45.
Zurück zum Zitat Li J, J-h Cheng, J-y Shi, Huang F (2012) Brief introduction of back propagation (BP) neural network algorithm and its improvement. In: Jin D, Lin S (eds) Advances in computer science and information engineering. Springer, Berlin, pp 553–558CrossRef Li J, J-h Cheng, J-y Shi, Huang F (2012) Brief introduction of back propagation (BP) neural network algorithm and its improvement. In: Jin D, Lin S (eds) Advances in computer science and information engineering. Springer, Berlin, pp 553–558CrossRef
46.
Zurück zum Zitat Gribbon KT, Bailey DG (2004) A novel approach to real-time bilinear interpolation. In: IEEE international conference on field-programmable technology, pp 126–131 Gribbon KT, Bailey DG (2004) A novel approach to real-time bilinear interpolation. In: IEEE international conference on field-programmable technology, pp 126–131
47.
Zurück zum Zitat Huo Q, Li J, Lu Y (2016) Removing ring artefacts in CT images via unidirectional relative variation model. Electron Lett 52(22):1838–1839CrossRef Huo Q, Li J, Lu Y (2016) Removing ring artefacts in CT images via unidirectional relative variation model. Electron Lett 52(22):1838–1839CrossRef
48.
Zurück zum Zitat Dong C, Loy CC, He K, Tang X (2016) Image super-resolution using deep convolutional networks. IEEE Trans Pattern Anal Mach Intell 38(2):295–307CrossRef Dong C, Loy CC, He K, Tang X (2016) Image super-resolution using deep convolutional networks. IEEE Trans Pattern Anal Mach Intell 38(2):295–307CrossRef
49.
Zurück zum Zitat Shi W, Caballero J, Huszár F, Totz J, Aitken AP, Bishop R, Rueckert D, Wang Z (2016) Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1874–1883 Shi W, Caballero J, Huszár F, Totz J, Aitken AP, Bishop R, Rueckert D, Wang Z (2016) Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1874–1883
50.
Zurück zum Zitat Johnson J, Alahi A, Li FF (2016) Perceptual losses for real-time style transfer and super-resolution. In: European conference on computer vision, pp 694–711CrossRef Johnson J, Alahi A, Li FF (2016) Perceptual losses for real-time style transfer and super-resolution. In: European conference on computer vision, pp 694–711CrossRef
51.
Zurück zum Zitat Bruna J, Sprechmann P, LeCun Y (2015) Super-resolution with deep convolutional sufficient statistics. ArXiv preprint arXiv:1511.05666 Bruna J, Sprechmann P, LeCun Y (2015) Super-resolution with deep convolutional sufficient statistics. ArXiv preprint arXiv:​1511.​05666
Metadaten
Titel
Removing ring artifacts in CBCT images via generative adversarial networks with unidirectional relative total variation loss
verfasst von
Zheng Wang
Jianwu Li
Mogendi Enoh
Publikationsdatum
12.01.2019
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 9/2019
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-018-04007-6

Weitere Artikel der Ausgabe 9/2019

Neural Computing and Applications 9/2019 Zur Ausgabe

S.I. : Emergence in Human-like Intelligence towards Cyber-Physical Systems

A new method of online extreme learning machine based on hybrid kernel function