Skip to main content

2020 | OriginalPaper | Buchkapitel

Surgical Video Motion Magnification with Suppression of Instrument Artefacts

verfasst von : Mirek Janatka, Hani J. Marcus, Neil L. Dorward, Danail Stoyanov

Erschienen in: Medical Image Computing and Computer Assisted Intervention – MICCAI 2020

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Video motion magnification can make blood vessels in surgical video more apparent by exaggerating their pulsatile motion and could prevent inadvertent damage and bleeding due to their increased prominence. It could also indicate the success of restricting blood supply to an organ when using a vessel clamp. However, the direct application to surgical video could result in aberration artefacts caused by its sensitivity to residual motion from the surgical instruments and would impede its practical usage in the operating theatre. By storing the previously obtained jerk filter response of each spatial component of each image frame - both prior to surgical instrument introduction and adhering to a Eulerian frame of reference - it is possible to prevent such aberrations from occurring. The comparison of the current readings to the prior readings of a single cardiac cycle at the corresponding cycle point, are used to determine if motion magnification should be active for each spatial component of the surgical video at that given point in time. In this paper, we demonstrate this technique and incorporate a scaling variable to loosen the effect which accounts for variabilities and misalignments in the temporal domain. We present promising results on endoscopic transnasal transsphenoidal pituitary surgery with a quantitative comparison to recent methods using Structural Similarity (SSIM), as well as qualitative analysis by comparing spatio-temporal cross sections of the videos and individual frames.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Feldman, S.A., Marks, V.: The problem of haemorrhage during anaesthesia and surgery. Anaesthesia 16(4), 410–431 (1961)CrossRef Feldman, S.A., Marks, V.: The problem of haemorrhage during anaesthesia and surgery. Anaesthesia 16(4), 410–431 (1961)CrossRef
2.
Zurück zum Zitat Marietta, M., Facchini, L., Pedrazzi, P., Busani, S., Torelli, G.: Pathophysiology of bleeding in surgery. In: Transplantation Proceedings, vol. 38, pp. 812–814. Elsevier (2006) Marietta, M., Facchini, L., Pedrazzi, P., Busani, S., Torelli, G.: Pathophysiology of bleeding in surgery. In: Transplantation Proceedings, vol. 38, pp. 812–814. Elsevier (2006)
4.
Zurück zum Zitat Clancy, N.T., Jones, G., Maier-Hein, L., Elson, D.S., Stoyanov, D.: Surgical spectral imaging. Med. Image Anal. 63, 101699 (2020)CrossRef Clancy, N.T., Jones, G., Maier-Hein, L., Elson, D.S., Stoyanov, D.: Surgical spectral imaging. Med. Image Anal. 63, 101699 (2020)CrossRef
5.
Zurück zum Zitat Cleary, K., Peters, T.M.: Image-guided interventions: technology review and clinical applications. Ann. Rev. Biomed. Eng. 12, 119–142 (2010)CrossRef Cleary, K., Peters, T.M.: Image-guided interventions: technology review and clinical applications. Ann. Rev. Biomed. Eng. 12, 119–142 (2010)CrossRef
6.
Zurück zum Zitat Norat, P., et al.: Application of indocyanine green videoangiography in aneurysm surgery: evidence, techniques, practical tips. Fount. Surg. 6, 34 (2019) Norat, P., et al.: Application of indocyanine green videoangiography in aneurysm surgery: evidence, techniques, practical tips. Fount. Surg. 6, 34 (2019)
7.
Zurück zum Zitat Bernays, R.L.: Intraoperative imaging: current trends, technology and future directions. In: Transsphenoidal Surgery, pp. 56–69. Saunders, Philadelphia (2010) Bernays, R.L.: Intraoperative imaging: current trends, technology and future directions. In: Transsphenoidal Surgery, pp. 56–69. Saunders, Philadelphia (2010)
8.
Zurück zum Zitat Shander, A.: Financial and clinical outcomes associated with surgical bleeding complications. Surgery 142(4), 20–25 (2007)CrossRef Shander, A.: Financial and clinical outcomes associated with surgical bleeding complications. Surgery 142(4), 20–25 (2007)CrossRef
9.
Zurück zum Zitat Wadhwa, N., Rubinstein, M., Durand, F., Freeman, W.T.: Phase-based video motion processing. ACM Trans. Graph. 32(4), 1–10 (2013)CrossRef Wadhwa, N., Rubinstein, M., Durand, F., Freeman, W.T.: Phase-based video motion processing. ACM Trans. Graph. 32(4), 1–10 (2013)CrossRef
10.
Zurück zum Zitat Wu, H.-Y., Rubinstein, M., Shih, E., Guttag, J., Durand, F., Freeman, W.: Eulerian video magnification for revealing subtle changes in the world. ACM Trans. Graph. 31(4), 1–8 (2012)CrossRef Wu, H.-Y., Rubinstein, M., Shih, E., Guttag, J., Durand, F., Freeman, W.: Eulerian video magnification for revealing subtle changes in the world. ACM Trans. Graph. 31(4), 1–8 (2012)CrossRef
11.
Zurück zum Zitat Ngo, A.C.L., Phan, R.C.-W.: Seeing the invisible: survey of video motion magnification and small motion analysis. ACM Comput. Surv. (CSUR) 52(6), 1–20 (2019)CrossRef Ngo, A.C.L., Phan, R.C.-W.: Seeing the invisible: survey of video motion magnification and small motion analysis. ACM Comput. Surv. (CSUR) 52(6), 1–20 (2019)CrossRef
12.
Zurück zum Zitat McLeod, J.A., Baxter, J.S.H., de Ribaupierre, S., Peters, T.M.: Motion magnification for endoscopic surgery. In: Medical Imaging 2014: Image-Guided Procedures, Robotic Interventions, and Modeling, vol. 9036, p. 90360C. International Society for Optics and Photonics (2014) McLeod, J.A., Baxter, J.S.H., de Ribaupierre, S., Peters, T.M.: Motion magnification for endoscopic surgery. In: Medical Imaging 2014: Image-Guided Procedures, Robotic Interventions, and Modeling, vol. 9036, p. 90360C. International Society for Optics and Photonics (2014)
13.
Zurück zum Zitat Janatka, M., Ramdoo, K.S., Tatle, T., Pachtrachai, K., Elson, D.S., Stoyanov, D.: Examining in vivo tympanic membrane mobility using smart phone video-otoscopy and phase-based Eulerian video magnification. In: Medical Imaging 2017: Computer-Aided Diagnosis, vol. 10134, p. 101341Y. International Society for Optics and Photonics (2017) Janatka, M., Ramdoo, K.S., Tatle, T., Pachtrachai, K., Elson, D.S., Stoyanov, D.: Examining in vivo tympanic membrane mobility using smart phone video-otoscopy and phase-based Eulerian video magnification. In: Medical Imaging 2017: Computer-Aided Diagnosis, vol. 10134, p. 101341Y. International Society for Optics and Photonics (2017)
14.
Zurück zum Zitat Amir-Khalili, A., et al.: Automatic segmentation of occluded vasculature via pulsatile motion analysis in endoscopic robot-assisted partial nephrectomy video. Med. Image Anal. 25(1), 103–110 (2015)CrossRef Amir-Khalili, A., et al.: Automatic segmentation of occluded vasculature via pulsatile motion analysis in endoscopic robot-assisted partial nephrectomy video. Med. Image Anal. 25(1), 103–110 (2015)CrossRef
15.
Zurück zum Zitat Janatka, M., Sridhar, A., Kelly, J., Stoyanov, D.: Higher order of motion magnification for vessel localisation in surgical video. In: Frangi, A.F., Schnabel, J.A., Davatzikos, C., Alberola-López, C., Fichtinger, G. (eds.) MICCAI 2018. LNCS, vol. 11073, pp. 307–314. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00937-3_36CrossRef Janatka, M., Sridhar, A., Kelly, J., Stoyanov, D.: Higher order of motion magnification for vessel localisation in surgical video. In: Frangi, A.F., Schnabel, J.A., Davatzikos, C., Alberola-López, C., Fichtinger, G. (eds.) MICCAI 2018. LNCS, vol. 11073, pp. 307–314. Springer, Cham (2018). https://​doi.​org/​10.​1007/​978-3-030-00937-3_​36CrossRef
16.
Zurück zum Zitat Zhang, Y., Pintea, S.L., Van Gemert, J.C.: Video acceleration magnification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 529–537 (2017) Zhang, Y., Pintea, S.L., Van Gemert, J.C.: Video acceleration magnification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 529–537 (2017)
17.
Zurück zum Zitat Takeda, S., Okami, K., Mikami, D., Isogai, M., Kimata, H.: Jerk-aware video acceleration magnification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1769–1777 (2018) Takeda, S., Okami, K., Mikami, D., Isogai, M., Kimata, H.: Jerk-aware video acceleration magnification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1769–1777 (2018)
18.
Zurück zum Zitat Takeda, S., Akagi, Y., Okami, K., Isogai, M., Kimata, H.: Video magnification in the wild using fractional anisotropy in temporal distribution. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1614–1622 (2019) Takeda, S., Akagi, Y., Okami, K., Isogai, M., Kimata, H.: Video magnification in the wild using fractional anisotropy in temporal distribution. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1614–1622 (2019)
19.
Zurück zum Zitat Elgharib, M., Hefeeda, M., Durand, F., Freeman, W.T.: Video magnification in presence of large motions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4119–4127 (2015) Elgharib, M., Hefeeda, M., Durand, F., Freeman, W.T.: Video magnification in presence of large motions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4119–4127 (2015)
22.
Zurück zum Zitat Freeman, W.T., Adelson, E.H.: Steerable filters. In: Optical Society of America Conference on Image Understanding and Machine Vision, pp. 114–117 (1989) Freeman, W.T., Adelson, E.H.: Steerable filters. In: Optical Society of America Conference on Image Understanding and Machine Vision, pp. 114–117 (1989)
23.
Zurück zum Zitat Lindeberg, T.: Scale-space for discrete signals. IEEE Trans. Pattern Anal. Mach. Intell. 12(3), 234–254 (1990)CrossRef Lindeberg, T.: Scale-space for discrete signals. IEEE Trans. Pattern Anal. Mach. Intell. 12(3), 234–254 (1990)CrossRef
24.
Zurück zum Zitat Willemet, M., Chowienczyk, P., Alastruey, J.: A database of virtual healthy subjects to assess the accuracy of foot-to-foot pulse wave velocities for estimation of aortic stiffness. Am. J. Physiol.-Heart Circ. Physiol. 309(4), 663–675 (2015)CrossRef Willemet, M., Chowienczyk, P., Alastruey, J.: A database of virtual healthy subjects to assess the accuracy of foot-to-foot pulse wave velocities for estimation of aortic stiffness. Am. J. Physiol.-Heart Circ. Physiol. 309(4), 663–675 (2015)CrossRef
25.
Zurück zum Zitat Sedrakyan, A., Campbell, B., Merino, J.-G., Kuntz, R., Hirst, A., McCulloch, P.: IDEAL-D: a rational framework for evaluating and regulating the use of medical devices. BMJ 353, i2372 (2016)CrossRef Sedrakyan, A., Campbell, B., Merino, J.-G., Kuntz, R., Hirst, A., McCulloch, P.: IDEAL-D: a rational framework for evaluating and regulating the use of medical devices. BMJ 353, i2372 (2016)CrossRef
26.
Zurück zum Zitat Marcus, H.J., et al.: Comparative effectiveness and safety of image guidance systems in neurosurgery: a preclinical randomized study. J. Neurosurg. 123(2), 307–313 (2015)CrossRef Marcus, H.J., et al.: Comparative effectiveness and safety of image guidance systems in neurosurgery: a preclinical randomized study. J. Neurosurg. 123(2), 307–313 (2015)CrossRef
Metadaten
Titel
Surgical Video Motion Magnification with Suppression of Instrument Artefacts
verfasst von
Mirek Janatka
Hani J. Marcus
Neil L. Dorward
Danail Stoyanov
Copyright-Jahr
2020
DOI
https://doi.org/10.1007/978-3-030-59716-0_34

Premium Partner