Skip to main content

2020 | OriginalPaper | Buchkapitel

Automatic Probe Movement Guidance for Freehand Obstetric Ultrasound

verfasst von : Richard Droste, Lior Drukker, Aris T. Papageorghiou, J. Alison Noble

Erschienen in: Medical Image Computing and Computer Assisted Intervention – MICCAI 2020

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We present the first system that provides real-time probe movement guidance for acquiring standard planes in routine freehand obstetric ultrasound scanning. Such a system can contribute to the worldwide deployment of obstetric ultrasound scanning by lowering the required level of operator expertise. The system employs an artificial neural network that receives the ultrasound video signal and the motion signal of an inertial measurement unit (IMU) that is attached to the probe, and predicts a guidance signal. The network termed US-GuideNet predicts either the movement towards the standard plane position (goal prediction), or the next movement that an expert sonographer would perform (action prediction). While existing models for other ultrasound applications are trained with simulations or phantoms, we train our model with real-world ultrasound video and probe motion data from 464 routine clinical scans by 17 accredited sonographers. Evaluations for 3 standard plane types show that the model provides a useful guidance signal with an accuracy of 88.8% for goal prediction and 90.9% for action prediction.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Bahner, D.P., et al.: Language of transducer manipulation. J. Ultrasound Med. 35(1), 183–188 (2016)CrossRef Bahner, D.P., et al.: Language of transducer manipulation. J. Ultrasound Med. 35(1), 183–188 (2016)CrossRef
2.
Zurück zum Zitat Baumgartner, C.F., et al.: SonoNet: real-time detection and localisation of fetal standard scan planes in freehand ultrasound. IEEE Trans. Med. Imag. 36(11), 2204–2215 (2017)CrossRef Baumgartner, C.F., et al.: SonoNet: real-time detection and localisation of fetal standard scan planes in freehand ultrasound. IEEE Trans. Med. Imag. 36(11), 2204–2215 (2017)CrossRef
3.
Zurück zum Zitat Britton, N., Miller, M.A., Safadi, S., Siegel, A., Levine, A.R., McCurdy, M.T.: Tele-ultrasound in resource-limited settings: a systematic review. Front. Public Health 7, 244 (2019)CrossRef Britton, N., Miller, M.A., Safadi, S., Siegel, A., Levine, A.R., McCurdy, M.T.: Tele-ultrasound in resource-limited settings: a systematic review. Front. Public Health 7, 244 (2019)CrossRef
4.
Zurück zum Zitat Cho, K., van Merrienboer, B., Bahdanau, D., Bengio, Y.: On the properties of neural machine translation: encoder-decoder approaches. In: Eighth Workshop on Syntax, Semantics and Structure in Statistical Translation (SSST-8), pp. 103–111 (2014) Cho, K., van Merrienboer, B., Bahdanau, D., Bengio, Y.: On the properties of neural machine translation: encoder-decoder approaches. In: Eighth Workshop on Syntax, Semantics and Structure in Statistical Translation (SSST-8), pp. 103–111 (2014)
5.
Zurück zum Zitat Housden, R., Treece, G.M., Gee, A.H., Prager, R.W.: Calibration of an orientation sensor for freehand 3D ultrasound and its use in a hybrid acquisition system. BioMed. Eng. OnLine 7(1), 5 (2008)CrossRef Housden, R., Treece, G.M., Gee, A.H., Prager, R.W.: Calibration of an orientation sensor for freehand 3D ultrasound and its use in a hybrid acquisition system. BioMed. Eng. OnLine 7(1), 5 (2008)CrossRef
6.
Zurück zum Zitat Jarosik, P., Lewandowski, M.: Automatic ultrasound guidance based on deep reinforcement learning. In: IEEE International Ultrasonics Symposium (IUS), pp. 475–478 (2019) Jarosik, P., Lewandowski, M.: Automatic ultrasound guidance based on deep reinforcement learning. In: IEEE International Ultrasonics Symposium (IUS), pp. 475–478 (2019)
8.
Zurück zum Zitat Liang, K., Rogers, A.J., Light, E.D., von Allmen, D., Smith, S.W.: Three-dimensional ultrasound guidance of autonomous robotic breast biopsy: feasibility study. Ultrasound Med. Biol. 36(1), 173–177 (2010)CrossRef Liang, K., Rogers, A.J., Light, E.D., von Allmen, D., Smith, S.W.: Three-dimensional ultrasound guidance of autonomous robotic breast biopsy: feasibility study. Ultrasound Med. Biol. 36(1), 173–177 (2010)CrossRef
9.
Zurück zum Zitat Loshchilov, I., Hutter, F.: Decoupled weight decay regularization. In: International Conference on Learning Representations (ICLR) (2019) Loshchilov, I., Hutter, F.: Decoupled weight decay regularization. In: International Conference on Learning Representations (ICLR) (2019)
10.
Zurück zum Zitat Maraci, M.A., Bridge, C.P., Napolitano, R., Papageorghiou, A., Noble, J.A.: A framework for analysis of linear ultrasound videos to detect fetal presentation and heartbeat. Med. Image Anal. 37, 22–36 (2017)CrossRef Maraci, M.A., Bridge, C.P., Napolitano, R., Papageorghiou, A., Noble, J.A.: A framework for analysis of linear ultrasound videos to detect fetal presentation and heartbeat. Med. Image Anal. 37, 22–36 (2017)CrossRef
11.
Zurück zum Zitat Mebarki, R., Krupa, A., Chaumette, F.: 2-D ultrasound probe complete guidance by visual servoing using image moments. IEEE Trans. Robot. 26(2), 296–306 (2010)CrossRef Mebarki, R., Krupa, A., Chaumette, F.: 2-D ultrasound probe complete guidance by visual servoing using image moments. IEEE Trans. Robot. 26(2), 296–306 (2010)CrossRef
13.
Zurück zum Zitat Mustafa, A.S.B., et al.: Development of robotic system for autonomous liver screening using ultrasound scanning device. In: IEEE International Conference on Robotics and Biomimetics (ROBIO), pp. 804–809 (2013) Mustafa, A.S.B., et al.: Development of robotic system for autonomous liver screening using ultrasound scanning device. In: IEEE International Conference on Robotics and Biomimetics (ROBIO), pp. 804–809 (2013)
14.
Zurück zum Zitat Pan, Y., et al.: Agile autonomous driving using end-to-end deep imitation learning. In: Robotics: Science and Systems (RSS) (2019) Pan, Y., et al.: Agile autonomous driving using end-to-end deep imitation learning. In: Robotics: Science and Systems (RSS) (2019)
15.
Zurück zum Zitat Pavllo, D., Feichtenhofer, C., Auli, M., Grangier, D.: Modeling human motion with quaternion-based neural networks. Int. J. Comput. Vis. 128, 855–872 (2020)CrossRef Pavllo, D., Feichtenhofer, C., Auli, M., Grangier, D.: Modeling human motion with quaternion-based neural networks. Int. J. Comput. Vis. 128, 855–872 (2020)CrossRef
16.
Zurück zum Zitat Prevost, R., et al.: 3D freehand ultrasound without external tracking using deep learning. Med. Image Anal. 48, 187–202 (2018)CrossRef Prevost, R., et al.: 3D freehand ultrasound without external tracking using deep learning. Med. Image Anal. 48, 187–202 (2018)CrossRef
18.
Zurück zum Zitat Salomon, L.J., et al.: Practice guidelines for performance of the routine mid-trimester fetal ultrasound scan. Ultrasound Obstet. Gynecol. 37(1), 116–126 (2011)CrossRef Salomon, L.J., et al.: Practice guidelines for performance of the routine mid-trimester fetal ultrasound scan. Ultrasound Obstet. Gynecol. 37(1), 116–126 (2011)CrossRef
19.
Zurück zum Zitat Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., Chen, L.C.: MobileNetV2: inverted residuals and linear bottlenecks. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4510–4520 (2018) Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., Chen, L.C.: MobileNetV2: inverted residuals and linear bottlenecks. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4510–4520 (2018)
21.
Zurück zum Zitat Toporek, G., Wang, H., Balicki, M., Xie, H.: Autonomous image-based ultrasound probe positioning via deep learning. In: Hamlyn Symposium on Medical Robotics (2018) Toporek, G., Wang, H., Balicki, M., Xie, H.: Autonomous image-based ultrasound probe positioning via deep learning. In: Hamlyn Symposium on Medical Robotics (2018)
22.
Zurück zum Zitat Vilchis, A., Troccaz, J., Cinquin, P., Masuda, K., Pellissier, F.: A new robot architecture for tele-echography. IEEE Trans. Robot. Autom. 19(5), 922–926 (2003)CrossRef Vilchis, A., Troccaz, J., Cinquin, P., Masuda, K., Pellissier, F.: A new robot architecture for tele-echography. IEEE Trans. Robot. Autom. 19(5), 922–926 (2003)CrossRef
24.
Zurück zum Zitat Yaqub, M., Kelly, B., Papageorghiou, A.T., Noble, J.A.: A deep learning solution for automatic fetal neurosonographic diagnostic plane verification using clinical standard constraints. Ultrasound Med. Biol. 43(12), 2925–2933 (2017)CrossRef Yaqub, M., Kelly, B., Papageorghiou, A.T., Noble, J.A.: A deep learning solution for automatic fetal neurosonographic diagnostic plane verification using clinical standard constraints. Ultrasound Med. Biol. 43(12), 2925–2933 (2017)CrossRef
Metadaten
Titel
Automatic Probe Movement Guidance for Freehand Obstetric Ultrasound
verfasst von
Richard Droste
Lior Drukker
Aris T. Papageorghiou
J. Alison Noble
Copyright-Jahr
2020
DOI
https://doi.org/10.1007/978-3-030-59716-0_56

Premium Partner