Skip to main content

2017 | Supplement | Buchkapitel

Temporal Interpolation of Abdominal MRIs Acquired During Free-Breathing

verfasst von : Neerav Karani, Christine Tanner, Sebastian Kozerke, Ender Konukoglu

Erschienen in: Medical Image Computing and Computer-Assisted Intervention − MICCAI 2017

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We propose a convolutional neural network (CNN) based solution for temporal image interpolation in navigated 2D multi-slice dynamic MRI acquisitions. Such acquisitions can achieve high contrast time-resolved volumetric images without the need for breath-holding, which makes them essential for quantifying breathing induced motion for MR guided therapies. Reducing the number of navigator slices needed in these acquisitions would allow increasing through-plane resolution and reducing overall acquisition time. The proposed CNN achieves this by interpolating between successive navigator slices. The method is an end-to-end learning based approach and avoids the determination of the motion field between the input images. We evaluate the method on a dataset of abdominal MRI sequences acquired from 14 subjects during free-breathing, which exhibit pseudo-periodic motion and sliding motion interfaces. Compared to an interpolation-by-registration approach, the method achieves higher interpolation accuracy on average, quantified in terms of intensity RMSE and residual motion errors. Further, we analyze the differences between the two methods, showing the CNN’s advantages in peak inhale and exhale positions.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Von Siebenthal, M., Székely, G., Gamper, U., Boesiger, P., Lomax, A., Cattin, P.: 4D MR imaging of respiratory organ motion and its variability. Phys. Med. Biol. 52, 1547 (2007)CrossRef Von Siebenthal, M., Székely, G., Gamper, U., Boesiger, P., Lomax, A., Cattin, P.: 4D MR imaging of respiratory organ motion and its variability. Phys. Med. Biol. 52, 1547 (2007)CrossRef
2.
Zurück zum Zitat Bert, C., Durante, M.: Motion in radiotherapy: particle therapy. Phys. Med. Biol. 56(16), R113 (2011)CrossRef Bert, C., Durante, M.: Motion in radiotherapy: particle therapy. Phys. Med. Biol. 56(16), R113 (2011)CrossRef
3.
Zurück zum Zitat Arnold, P., Preiswerk, F., Fasel, B., Salomir, R., Scheffler, K., Cattin, P.C.: 3D organ motion prediction for MR-guided high intensity focused ultrasound. In: Fichtinger, G., Martel, A., Peters, T. (eds.) MICCAI 2011 Part II. LNCS, vol. 6892, pp. 623–630. Springer, Heidelberg (2011). doi:10.1007/978-3-642-23629-7_76CrossRef Arnold, P., Preiswerk, F., Fasel, B., Salomir, R., Scheffler, K., Cattin, P.C.: 3D organ motion prediction for MR-guided high intensity focused ultrasound. In: Fichtinger, G., Martel, A., Peters, T. (eds.) MICCAI 2011 Part II. LNCS, vol. 6892, pp. 623–630. Springer, Heidelberg (2011). doi:10.​1007/​978-3-642-23629-7_​76CrossRef
4.
Zurück zum Zitat Tsao, J., Kozerke, S.: MRI temporal acceleration techniques. J. Magn. Reson. Imaging 36(3), 543 (2012)CrossRef Tsao, J., Kozerke, S.: MRI temporal acceleration techniques. J. Magn. Reson. Imaging 36(3), 543 (2012)CrossRef
5.
Zurück zum Zitat Uecker, M., Zhang, S., Voit, D., Karaus, A., Merboldt, K.-D., Frahm, J.: Real-time MRI at a resolution of 20 ms. NMR Biomed. 23(8), 986 (2010)CrossRef Uecker, M., Zhang, S., Voit, D., Karaus, A., Merboldt, K.-D., Frahm, J.: Real-time MRI at a resolution of 20 ms. NMR Biomed. 23(8), 986 (2010)CrossRef
6.
Zurück zum Zitat Tryggestad, E., Flammang, A., Han-Oh, S., Hales, R., Herman, J., McNutt, T., Roland, T., Shea, S.M., Wong, J.: Respiration-based sorting of dynamic MRI to derive representative 4D-MRI for radiotherapy planning. Med. Phys. 40(5), 051909 (2013)CrossRef Tryggestad, E., Flammang, A., Han-Oh, S., Hales, R., Herman, J., McNutt, T., Roland, T., Shea, S.M., Wong, J.: Respiration-based sorting of dynamic MRI to derive representative 4D-MRI for radiotherapy planning. Med. Phys. 40(5), 051909 (2013)CrossRef
7.
Zurück zum Zitat Baumgartner, C.F., Kolbitsch, C., McClelland, J.R., Rueckert, D., King, A.P.: Groupwise simultaneous manifold alignment for high-resolution dynamic MR imaging of respiratory motion. In: Gee, J.C., Joshi, S., Pohl, K.M., Wells, W.M., Zöllei, L. (eds.) IPMI 2013. LNCS, vol. 7917, pp. 232–243. Springer, Heidelberg (2013). doi:10.1007/978-3-642-38868-2_20CrossRef Baumgartner, C.F., Kolbitsch, C., McClelland, J.R., Rueckert, D., King, A.P.: Groupwise simultaneous manifold alignment for high-resolution dynamic MR imaging of respiratory motion. In: Gee, J.C., Joshi, S., Pohl, K.M., Wells, W.M., Zöllei, L. (eds.) IPMI 2013. LNCS, vol. 7917, pp. 232–243. Springer, Heidelberg (2013). doi:10.​1007/​978-3-642-38868-2_​20CrossRef
8.
Zurück zum Zitat Nam, T.-J., Park, R.-H., Yun, J.-H.: Optical flow based frame interpolation of ultrasound images. In: Campilho, A., Kamel, M.S. (eds.) ICIAR 2006 Part I. LNCS, vol. 4141, pp. 792–803. Springer, Heidelberg (2006). doi:10.1007/11867586_72CrossRef Nam, T.-J., Park, R.-H., Yun, J.-H.: Optical flow based frame interpolation of ultrasound images. In: Campilho, A., Kamel, M.S. (eds.) ICIAR 2006 Part I. LNCS, vol. 4141, pp. 792–803. Springer, Heidelberg (2006). doi:10.​1007/​11867586_​72CrossRef
9.
Zurück zum Zitat Penney, G.P., Schnabel, J.A., Rueckert, D., Viergever, M.A., Niessen, W.J.: Registration-based interpolation. IEEE Trans. Med. Imaging 23(7), 922 (2004)CrossRef Penney, G.P., Schnabel, J.A., Rueckert, D., Viergever, M.A., Niessen, W.J.: Registration-based interpolation. IEEE Trans. Med. Imaging 23(7), 922 (2004)CrossRef
10.
Zurück zum Zitat Zhang, W., Brady, J.M., Becher, H., Noble, J.A.: Spatio-temporal (2D+T) non-rigid registration of real-time 3D echocardiography and cardiovascular MR image sequences. Phys. Med. Biol. 56(5), 1341 (2011)CrossRef Zhang, W., Brady, J.M., Becher, H., Noble, J.A.: Spatio-temporal (2D+T) non-rigid registration of real-time 3D echocardiography and cardiovascular MR image sequences. Phys. Med. Biol. 56(5), 1341 (2011)CrossRef
11.
Zurück zum Zitat Lee, G.-I., Park, R.-H., Song, Y.-S., Kim, C.-A., Hwang, J.-S.: Real-time 3D ultrasound fetal image enhancment techniques using motion-compensated frame rate up-conversion. In: Medical Imaging, p. 375 (2003) Lee, G.-I., Park, R.-H., Song, Y.-S., Kim, C.-A., Hwang, J.-S.: Real-time 3D ultrasound fetal image enhancment techniques using motion-compensated frame rate up-conversion. In: Medical Imaging, p. 375 (2003)
12.
Zurück zum Zitat Gifani, P., Behnam, H., Haddadi, F., Sani, Z.A., Shojaeifard, M.: Temporal super resolution enhancement of echocardiographic images based on sparse representation. IEEE Trans. Ultrason. Ferroelectr. 63(1), 6 (2016)CrossRef Gifani, P., Behnam, H., Haddadi, F., Sani, Z.A., Shojaeifard, M.: Temporal super resolution enhancement of echocardiographic images based on sparse representation. IEEE Trans. Ultrason. Ferroelectr. 63(1), 6 (2016)CrossRef
13.
Zurück zum Zitat Long, G., Kneip, L., Alvarez, J.M., Li, H., Zhang, X., Yu, Q.: Learning image matching by simply watching video. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9910, pp. 434–450. Springer, Cham (2016). doi:10.1007/978-3-319-46466-4_26CrossRef Long, G., Kneip, L., Alvarez, J.M., Li, H., Zhang, X., Yu, Q.: Learning image matching by simply watching video. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9910, pp. 434–450. Springer, Cham (2016). doi:10.​1007/​978-3-319-46466-4_​26CrossRef
14.
Zurück zum Zitat Fischer, P., Dosovitskiy, A., Ilg, E., Häusser, P., Hazırbaş, C., Golkov, V., van der Smagt, P., Cremers, D., Brox, T.: Flownet: learning optical flow with convolutional networks. arXiv:1504.06852 (2015) Fischer, P., Dosovitskiy, A., Ilg, E., Häusser, P., Hazırbaş, C., Golkov, V., van der Smagt, P., Cremers, D., Brox, T.: Flownet: learning optical flow with convolutional networks. arXiv:​1504.​06852 (2015)
15.
Zurück zum Zitat Srivastava, N., Mansimov, E., Salakhutdinov, R.: Unsupervised learning of video representations using LSTMs. In: ICML, p. 843 (2015) Srivastava, N., Mansimov, E., Salakhutdinov, R.: Unsupervised learning of video representations using LSTMs. In: ICML, p. 843 (2015)
16.
Zurück zum Zitat Goroshin, R., Mathieu, M.F., LeCun, Y.: Learning to linearize under uncertainty. In: Advances in Neural Information Processing Systems, p. 1234 (2015) Goroshin, R., Mathieu, M.F., LeCun, Y.: Learning to linearize under uncertainty. In: Advances in Neural Information Processing Systems, p. 1234 (2015)
17.
18.
Zurück zum Zitat Yeh, R., Liu, Z., Goldman, D.B., Agarwala, A.: Semantic facial expression editing using autoencoded flow. arXiv:1611.09961 (2016) Yeh, R., Liu, Z., Goldman, D.B., Agarwala, A.: Semantic facial expression editing using autoencoded flow. arXiv:​1611.​09961 (2016)
19.
Zurück zum Zitat Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., Bengio, Y.: Generative adversarial nets. In: Advances in Neural Information Processing Systems, p. 2672 (2014) Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., Bengio, Y.: Generative adversarial nets. In: Advances in Neural Information Processing Systems, p. 2672 (2014)
21.
Zurück zum Zitat Vishnevskiy, V., Gass, T., Szekely, G., Tanner, C., Goksel, O.: Isotropic total variation regularization of displacements in parametric image registration. IEEE Trans. Med. Imaging 36(2), 385 (2016)CrossRef Vishnevskiy, V., Gass, T., Szekely, G., Tanner, C., Goksel, O.: Isotropic total variation regularization of displacements in parametric image registration. IEEE Trans. Med. Imaging 36(2), 385 (2016)CrossRef
22.
Zurück zum Zitat Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., Devin, M., et al.: Tensorflow: large-scale machine learning on heterogeneous distributed systems. arXiv:1603.04467 (2016) Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., Devin, M., et al.: Tensorflow: large-scale machine learning on heterogeneous distributed systems. arXiv:​1603.​04467 (2016)
23.
Zurück zum Zitat He, K., Zhang, X., Ren, S., Sun, J.: Delving deep into rectifiers: surpassing human-level performance on imagenet classification. In: ICCV, p. 1026 (2015) He, K., Zhang, X., Ren, S., Sun, J.: Delving deep into rectifiers: surpassing human-level performance on imagenet classification. In: ICCV, p. 1026 (2015)
Metadaten
Titel
Temporal Interpolation of Abdominal MRIs Acquired During Free-Breathing
verfasst von
Neerav Karani
Christine Tanner
Sebastian Kozerke
Ender Konukoglu
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-66185-8_41

Premium Partner