Skip to main content

2018 | OriginalPaper | Buchkapitel

GDL-FIRE\(^\text {4D}\): Deep Learning-Based Fast 4D CT Image Registration

verfasst von : Thilo Sentker, Frederic Madesta, René Werner

Erschienen in: Medical Image Computing and Computer Assisted Intervention – MICCAI 2018

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Deformable image registration (DIR) in thoracic 4D CT image data is integral for, e.g., radiotherapy treatment planning, but time consuming. Deep learning (DL)-based DIR promises speed-up, but present solutions are limited to small image sizes. In this paper, we propose a General Deep Learning-based Fast Image Registration framework suitable for application to clinical 4D CT data (GDL-FIRE\(^\text {4D}\)). Open source DIR frameworks are selected to build GDL-FIRE\(^\text {4D}\) variants. In-house-acquired 4D CT images serve as training and open 4D CT data repositories as external evaluation cohorts. Taking up current attempts to DIR uncertainty estimation, dropout-based uncertainty maps for GDL-FIRE\(^\text {4D}\) variants are analyzed. We show that (1) registration accuracy of GDL-FIRE\(^\text {4D}\) and standard DIR are in the same order; (2) computation time is reduced to a few seconds (here: 60-fold speed-up); and (3) dropout-based uncertainty maps do not correlate to across-DIR vector field differences, raising doubts about applicability in the given context.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Yamamoto, T., et al.: The first patient treatment of computed tomography ventilation functional image-guided radiotherapy for lung cancer. Radiother Oncol. 118, 227–31 (2016)CrossRef Yamamoto, T., et al.: The first patient treatment of computed tomography ventilation functional image-guided radiotherapy for lung cancer. Radiother Oncol. 118, 227–31 (2016)CrossRef
2.
Zurück zum Zitat Rosu, M., Hugo, G.D.: Advances in 4D radiation therapy for managing respiration: part II - 4D treatment planning. Z Med. Phys. 22, 272–80 (2012)CrossRef Rosu, M., Hugo, G.D.: Advances in 4D radiation therapy for managing respiration: part II - 4D treatment planning. Z Med. Phys. 22, 272–80 (2012)CrossRef
4.
Zurück zum Zitat Dosovitskiy, A., et al.: FlowNet: learning optical flow with convolutional networks. In: 2015 IEEE International Conference on Computer Vision (ICCV), vol. 2015 Inter., pp. 2758–2766. IEEE (2015) Dosovitskiy, A., et al.: FlowNet: learning optical flow with convolutional networks. In: 2015 IEEE International Conference on Computer Vision (ICCV), vol. 2015 Inter., pp. 2758–2766. IEEE (2015)
5.
Zurück zum Zitat Yang, X., Kwitt, R., Styner, M., Niethammer, M.: Quicksilver: fast predictive image registration - a deep learning approach. Neuroimage 158, 378–396 (2017)CrossRef Yang, X., Kwitt, R., Styner, M., Niethammer, M.: Quicksilver: fast predictive image registration - a deep learning approach. Neuroimage 158, 378–396 (2017)CrossRef
8.
Zurück zum Zitat Amir-Khalili, A., Hamarneh, G., Zakariaee, R., Spadinger, I., Abugharbieh, R.: Propagation of registration uncertainty during multi-fraction cervical cancer brachytherapy. Phys. Med. Biol. 62, 8116–8135 (2017)CrossRef Amir-Khalili, A., Hamarneh, G., Zakariaee, R., Spadinger, I., Abugharbieh, R.: Propagation of registration uncertainty during multi-fraction cervical cancer brachytherapy. Phys. Med. Biol. 62, 8116–8135 (2017)CrossRef
9.
Zurück zum Zitat Murphy, K., van Ginneken, B., Reinhardt, J.M.: Evaluation of registration methods on thoracic CT: the EMPIRE10 challenge. IEEE Trans. Med. Imaging 30, 1901–20 (2011)CrossRef Murphy, K., van Ginneken, B., Reinhardt, J.M.: Evaluation of registration methods on thoracic CT: the EMPIRE10 challenge. IEEE Trans. Med. Imaging 30, 1901–20 (2011)CrossRef
11.
Zurück zum Zitat Szegedy, C., Ioffe, S., Vanhoucke, V., Alemi, A.A.: Inception-v4, Inception-Resnet and the impact of residual connections on learning. In: Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence (AAAI-17), pp. 4278–4284 (2017) Szegedy, C., Ioffe, S., Vanhoucke, V., Alemi, A.A.: Inception-v4, Inception-Resnet and the impact of residual connections on learning. In: Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence (AAAI-17), pp. 4278–4284 (2017)
12.
Zurück zum Zitat Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15, 1929–58 (2014)MathSciNetMATH Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15, 1929–58 (2014)MathSciNetMATH
13.
Zurück zum Zitat Castillo, R., Castillo, E., Guerra, R.: A framework for evaluation of deformable image registration spatial accuracy using large landmark point sets. Phys. Med. Biol. 54, 1849–70 (2009)CrossRef Castillo, R., Castillo, E., Guerra, R.: A framework for evaluation of deformable image registration spatial accuracy using large landmark point sets. Phys. Med. Biol. 54, 1849–70 (2009)CrossRef
14.
Zurück zum Zitat Vandemeulebroucke, J., Rit, S., Kybic, J., Clarysse, P., Sarrut, D.: Spatiotemporal motion estimation for respiratory-correlated imaging of the lungs. Med. Phys. 38, 166–78 (2011)CrossRef Vandemeulebroucke, J., Rit, S., Kybic, J., Clarysse, P., Sarrut, D.: Spatiotemporal motion estimation for respiratory-correlated imaging of the lungs. Med. Phys. 38, 166–78 (2011)CrossRef
15.
Zurück zum Zitat Modat, M., et al.: Fast free-form deformation using graphics processing units. Comput. Methods Programs Biomed. 98, 278–84 (2010)CrossRef Modat, M., et al.: Fast free-form deformation using graphics processing units. Comput. Methods Programs Biomed. 98, 278–84 (2010)CrossRef
16.
Zurück zum Zitat Shackleford, J.A., Kandasamy, N., Sharp, G.C.: On developing B-spline registration algorithms for multi-core processors. Phys. Med. Biol. 55, 6329–51 (2010)CrossRef Shackleford, J.A., Kandasamy, N., Sharp, G.C.: On developing B-spline registration algorithms for multi-core processors. Phys. Med. Biol. 55, 6329–51 (2010)CrossRef
17.
Zurück zum Zitat Werner, R., Schmidt-Richberg, A., Handels, H., et al.: Estimation of lung motion fields in 4D CT data by variational non-linear intensity-based registration: a comparison and evaluation study. Phys. Med. Biol. 59, 4247–4260 (2014)CrossRef Werner, R., Schmidt-Richberg, A., Handels, H., et al.: Estimation of lung motion fields in 4D CT data by variational non-linear intensity-based registration: a comparison and evaluation study. Phys. Med. Biol. 59, 4247–4260 (2014)CrossRef
Metadaten
Titel
GDL-FIRE: Deep Learning-Based Fast 4D CT Image Registration
verfasst von
Thilo Sentker
Frederic Madesta
René Werner
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-030-00928-1_86