Skip to main content

2020 | OriginalPaper | Buchkapitel

An Unsupervised Deep Learning Method for Diffeomorphic Mono-and Multi-modal Image Registration

verfasst von : Anis Theljani, Ke Chen

Erschienen in: Medical Image Understanding and Analysis

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Different from image segmentation, developing a deep learning network for image registration is less straightforward because training data cannot be prepared or supervised by humans unless they are trivial. In this paper we present an unsupervised deep leaning model in which the deformation fields are self-trained by an image similarity metric and a regularization term. The latter consists of a smoothing constraint on the derivatives and a constraint on the determinant of the transformation in order to obtain spatially smooth and plausible solution.
The proposed algorithm is first trained and tested on synthetic and real mono-modal images. The results show how it deals with large deformation registration problems and leads to a real time solution with no folding. It is then generalised to multi-modal images. Although any variational model may be used to work with our the deep learning algorithm, we present a new model using the reproducing Kernel Hilbert space theory, where an initial given pair of images, which are assumed non-linearly correlated, are first processed and optimized to serve the purpose of “intensity or edge correction” and to yield intermediate new images which are more strongly correlated and will be used for training the model. Experiments and comparisons with learning and non-learning models demonstrate that this approach can deliver good performance and simultaneously generate an accurate diffeomorphic transformation.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Burger, M., Modersitzki, J., Ruthotto, L.: A hyperelastic regularization energy for image registration. SIAM J. Sci. Comput. 35, 132–148 (2013)MathSciNetCrossRef Burger, M., Modersitzki, J., Ruthotto, L.: A hyperelastic regularization energy for image registration. SIAM J. Sci. Comput. 35, 132–148 (2013)MathSciNetCrossRef
4.
Zurück zum Zitat de Vos, B.D., Berendsen, F.F., Viergever, M.A., Sokooti, H., Staring, M., Isgum, I.: A deep learning framework for unsupervised affine and deformable image registration. Med. Image Anal. 52, 128–143 (2019)CrossRef de Vos, B.D., Berendsen, F.F., Viergever, M.A., Sokooti, H., Staring, M., Isgum, I.: A deep learning framework for unsupervised affine and deformable image registration. Med. Image Anal. 52, 128–143 (2019)CrossRef
5.
Zurück zum Zitat Droske, M., Ring, W.: A mumford-shah level-set approach for geometric image registration. SIAM J. Appl. Math. 66, 2127–2148 (2006)MathSciNetCrossRef Droske, M., Ring, W.: A mumford-shah level-set approach for geometric image registration. SIAM J. Appl. Math. 66, 2127–2148 (2006)MathSciNetCrossRef
6.
Zurück zum Zitat Droske, M., Rumpf, M.: A variational approach to nonrigid morphological image registration. SIAM J. Appl. Math. 64, 668–687 (2004)MathSciNetCrossRef Droske, M., Rumpf, M.: A variational approach to nonrigid morphological image registration. SIAM J. Appl. Math. 64, 668–687 (2004)MathSciNetCrossRef
7.
Zurück zum Zitat Fischer, B., Modersitzki, J.: Ill-posed medicine - an introduction to image registration. Inverse Prob. 24, 034008 (2008)MathSciNetCrossRef Fischer, B., Modersitzki, J.: Ill-posed medicine - an introduction to image registration. Inverse Prob. 24, 034008 (2008)MathSciNetCrossRef
8.
Zurück zum Zitat Gigengack, F., Ruthotto, L., Burger, M., Wolters, C.H., Jiang, X., Schafers, K.P.: Motion correction in dual gated cardiac pet using mass-preserving image registration. IEEE Trans. Med. Imaging 31, 698–712 (2012)CrossRef Gigengack, F., Ruthotto, L., Burger, M., Wolters, C.H., Jiang, X., Schafers, K.P.: Motion correction in dual gated cardiac pet using mass-preserving image registration. IEEE Trans. Med. Imaging 31, 698–712 (2012)CrossRef
9.
10.
Zurück zum Zitat Henn, S.: A multigrid method for a fourth-order diffusion equation with application to image processing. SIAM J. Sci. Comput. 27, 831–849 (2005)MathSciNetCrossRef Henn, S.: A multigrid method for a fourth-order diffusion equation with application to image processing. SIAM J. Sci. Comput. 27, 831–849 (2005)MathSciNetCrossRef
11.
Zurück zum Zitat Jaderberg, M., Simonyan, K., Zisserman, A., et al.: Spatial transformer networks. In: Advances in Neural Information Processing Systems, pp. 2017–2025 (2015) Jaderberg, M., Simonyan, K., Zisserman, A., et al.: Spatial transformer networks. In: Advances in Neural Information Processing Systems, pp. 2017–2025 (2015)
12.
Zurück zum Zitat Li, H., Fan, Y.: Non-rigid image registration using fully convolutional networks with deep self-supervision. arXiv preprint arXiv:1709.00799 (2017) Li, H., Fan, Y.: Non-rigid image registration using fully convolutional networks with deep self-supervision. arXiv preprint arXiv:​1709.​00799 (2017)
13.
Zurück zum Zitat Mang, A., Biros, G.: Constrained \(h^1\)-regularization schemes for diffeomorphic image registration. SIAM J. Imaging Sci. 9, 1154–1194 (2016)MathSciNetCrossRef Mang, A., Biros, G.: Constrained \(h^1\)-regularization schemes for diffeomorphic image registration. SIAM J. Imaging Sci. 9, 1154–1194 (2016)MathSciNetCrossRef
14.
Zurück zum Zitat Modersitzki, J.: FAIR: Flexible Algorithms for Image Registration. SIAM, Philadelphia (2009)CrossRef Modersitzki, J.: FAIR: Flexible Algorithms for Image Registration. SIAM, Philadelphia (2009)CrossRef
15.
Zurück zum Zitat Oliveira, F., Tavares, J.M.: Medical image registration: a review. Comput. Methods Biomech. Biomed. Eng. 17, 73–93 (2014)CrossRef Oliveira, F., Tavares, J.M.: Medical image registration: a review. Comput. Methods Biomech. Biomed. Eng. 17, 73–93 (2014)CrossRef
16.
Zurück zum Zitat Sotiras, A., Davatzikos, C., Paragios, N.: Deformable medical image registration: a survey. IEEE Trans. Med. Imaging 32, 1153–1190 (2013)CrossRef Sotiras, A., Davatzikos, C., Paragios, N.: Deformable medical image registration: a survey. IEEE Trans. Med. Imaging 32, 1153–1190 (2013)CrossRef
17.
Zurück zum Zitat Theljani, A., Chen, K.: An augmented Lagrangian method for solving a new variational model based on gradients similarity measures and high order regulariation for multimodality registration. Inverse Prob. Imaging 13, 309–335 (2019)CrossRef Theljani, A., Chen, K.: An augmented Lagrangian method for solving a new variational model based on gradients similarity measures and high order regulariation for multimodality registration. Inverse Prob. Imaging 13, 309–335 (2019)CrossRef
18.
Zurück zum Zitat Zhang, J., Chen, K., Yu, B.: A novel high-order functional based image registration model with inequality constraint. Comput. Math. Appl. 72, 2887–2899 (2016)MathSciNetCrossRef Zhang, J., Chen, K., Yu, B.: A novel high-order functional based image registration model with inequality constraint. Comput. Math. Appl. 72, 2887–2899 (2016)MathSciNetCrossRef
Metadaten
Titel
An Unsupervised Deep Learning Method for Diffeomorphic Mono-and Multi-modal Image Registration
verfasst von
Anis Theljani
Ke Chen
Copyright-Jahr
2020
DOI
https://doi.org/10.1007/978-3-030-39343-4_27