Skip to main content
Fachgebiete
Automobil + Motoren Bauwesen + Immobilien Business IT + Informatik Elektrotechnik + Elektronik Energie + Nachhaltigkeit Finance + Banking Management + Führung Marketing + Vertrieb Maschinenbau + Werkstoffe Versicherung + Risiko
DE
EN
Bücher
Zeitschriften
Themenseiten
Organisationspsychologie Projektmanagement Marketing Smart Manufacturing
Weitere Formate
Podcasts Webinare Technik Webinare Wirtschaft Kongresse Veranstaltungskalender Awards
Jetzt Einzelzugang starten
Zugang für Unternehmen
Referenzkunden
SLX-Digitalkonferenz: Zukunftswerkstatt 2024

Mehr Umsatz mit Top-Kontakten

Am 7. Mai erfahren Sie, wie Vertriebsteams Leadgenerierung, Leadnurturing und Leadstrategien effizient steuern können.
Erweiterte Suche
Anmelden
nach oben
International Journal of Computer Assisted Radiology and Surgery
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 4/2013

01.07.2013 | Original Article

A robust method to track colonoscopy videos with non-informative images

verfasst von: Jianfei Liu, Kalpathi R. Subramanian, Terry S. Yoo

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 4/2013

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Purpose

Continuously, optical and virtual image alignment can significantly supplement the clinical value of colonoscopy. However, the co-alignment process is frequently interrupted by non-informative images. A video tracking framework to continuously track optical colonoscopy images was developed and tested.

Methods

A video tracking framework with immunity to non-informative images was developed with three essential components: temporal volume flow, region flow, and incremental egomotion estimation. Temporal volume flow selects two similar images interrupted by non-informative images; region flow measures large visual motion between selected images; and incremental egomotion processing estimates significant camera motion by decomposing each large visual motion vector into a sequence of small optical flow vectors. The framework was extensively evaluated via phantom and colonoscopy image sequences. We constructed two colon-like phantoms, a straight phantom and a curved phantom, to measure actual colonoscopy motion.

Results

In the straight phantom, after 48 frames were excluded, the tracking error was \(<\)3 mm of 16 mm traveled. In the curved phantom, the error was \(<\)4 mm of 23.88 mm traveled after 72 frames were excluded. Through evaluations with clinical sequences, the robustness of the tracking framework was demonstrated on 30 colonoscopy image sequences from 22 different patients. Four specific sequences among these were chosen to illustrate the algorithm’s decreased sensitivity to (1) fluid immersion, (2) wall contact, (3) surgery-induced colon deformation, and (4) multiple non-informative image sequences.

Conclusion

A robust tracking framework for real-time colonoscopy was developed that facilitates continuous alignment of optical and virtual images, immune to non-informative images that enter the video stream. The system was validated in phantom testing and achieved success with clinical image sequences.
Vorheriger Artikel An evaluation of image descriptors combined with clinical data for breast cancer diagnosis
Nächster Artikel Discriminative generalized Hough transform for object localization in medical images

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Jetzt informieren
Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
1
Part of the Walter Reed Army Medical Center training dataset archive from the National Cancer Institute.
 
Literatur
1.
2.
Baxter N, Rabeneck L (2010) Is the effectiveness of colonoscopy “good enough” for population-based screening? J Natl Cancer Inst 102:70–71PubMedCrossRef
3.
Summers RM, Swift JA, Dwyer AJ, Choi JR, Pickhardt PJ (2009) Normalized distance along the colon centerline: a method for correlating polyp location on ct colonography and optical colonoscopy. AJR Am J Roentgenol 193(1):1296–1304PubMedCrossRef
4.
Duncan JE, McNally MP, Sweeney WB, Gentry AB, Barlow DS, Jensen DW, Cash BD (2009) Ct colonography predictably overestimates colonic length and distance to polyps compared with optical colonoscopy. AJR Am J Roentgenol 193(5):1291–1295PubMedCrossRef
5.
Liu J (2011) From pixel to region to temporal volume: a robust motion processing framework for visually-guided navigation. Ph.D. thesis, University of North Carolina at Charlotte
6.
Hwang S, Oh J, Lee J, Tavanapong W, de Groen PC, Wong J (2007) Informative frame classification for endoscopy video. Med Image Anal 11–2:110–127
7.
Oh J, Hwang S, Cao Y, Tavanapong W, Liu D, Wong J, de Groen P (2009) Measuring objective quality of colonoscopy. IEEE Trans Biomed Eng 56:2190–2196PubMedCrossRef
8.
Mori K, Deguchi D, Akiyama K, Kitasaka T, Maurer CR Jr, Suenaga Y, Takabatake H, Mori M, Natori H (2005) Hybrid bronchoscope tracking using a magnetic tracking sensor and image registration. In: Proceedings of 8th MICCAI, pp 543–555
9.
Deligianni F, Chung A, Yang GZ (2006) Non-rigid 2d–3d registration with catheter tip em tracking for patient specific bronchoscope simulation. In: Proceedings of 9th MICCAI, pp 281–288
10.
Rai L, Helferty J, Higgins W (2008) Combined video tracking and image-video registration for continuous bronchoscopic guidance. Int J Comput Assist Radiol Surg 3(3–4):315–329CrossRef
11.
Mori K, Deguchi D, Sugiyama J, Suenaga Y, Toriwaki J Jr, Maurer CM, Takabatake H, Natori H (2002) Tracking of a bronchoscope using epipolar geometry analysis and intensity-based image registration of real and virtual endoscopic images. Med Image Anal 6(3):321–336PubMedCrossRef
12.
Bricault I, Ferretti G, Cinquin P (1998) Multi-level strategy for computer-assisted transbronchial biopsy. In: Proceedings of 1th MICCAI, pp 161–268
13.
Helferty JP, Sherbondy AJ, Kiraly AP, Higgins WE (2005) System for live virtual-endoscopic guidance of bronchoscopy. In: Proceedings of IEEE CVPR, p 68
14.
Helferty JP, Higgins WE (2002) Combined endoscopic video tracking and virtual 3d ct registration for surgical guidance. In: Proceedings of IEEE ICIP, pp 961–964
15.
Rai L, Merritt SA, Higgins WE (2006) Real-time image-based guidance method for lung-cancer assessment. In: Proceedings of IEEE CVPR, pp 2437–2444
16.
Deguchi D, Mori K, Suenaga Y, Hasegawa J, Toriwaki J, Batake HT, Natori H (2003) New image similarity measure for bronchoscope tracking based on image registration. In: Proceedings of 6th MICCAI, pp 399–406
17.
Nagao J, Mori K, Enjouji T, Deguchi D (2004) Fast and accurate bronchoscope tracking using image registration and motion prediction. In: Proceedings of 7th MICCAI, pp 551–558
18.
Higgins WE, Helferty JP, Lu K, Merritt SA, Rai L, Yu KC (2007) 3d ct-video fusion for image-guided bronchoscopy. Comput Med Imaging Graph 32:159–173PubMedCrossRef
19.
Helferty JP, Sherbondy AJ, Kiraly AP, Higgins WE (2007) Computer-based system for the virtual-endoscopic guidance of bronchoscopy. Comput Vis Image Underst 108(1–2):171–187PubMedCrossRef
20.
Deligianni F, Chung A, Yang GZ (2004) Patient-specific bronchoscope simulation with pq-space-based 2d/3d registration. Comput Aided Surg 9(5):215–226PubMed
21.
Deligianni F, Chung A, Yang GZ (2006) Non-rigid 2d/3d registration for patient specific bronchoscopy simulation with statistical shape modelling. IEEE Trans Med Imaging 25(11):1462–1471PubMedCrossRef
22.
Lowe D (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110CrossRef
23.
Tuytelaars T, Gool LV (2004) Matching widely separated views based on affine invariant regions. Int J Comput Vis 59(1):61–85CrossRef
24.
Matas J, Chum O, Urban M, Pajdla T (2002) Robust wide baseline stereo from maximally stable extremal regions. In: Proceedings of the British machine vision conference, pp 384–393
25.
Mikolajczyk K, Schmid C (2004) Scale and affine invariant interest point detectors. Int J Comput Vis 60(1):63–86CrossRef
26.
Liu R, Li Z, Jia J (2008) Image partial blur detection and classification. In: Proceedings of the IEEE CVPR (2008) June 27–28. Anchorage, Alaska
27.
Brox T, Bregler C, Malik J (2009) Large displacement optical flow. In: Proceedings of the IEEE CVPR, pp 41–48
28.
Brox T, Bruhn A, Papenberg N, Weickert J (2004) High accuracy optical flow estimation based on a theory for warping. In: Proceedings of 8th ECCV, vol 4, pp 25–36
29.
Brox T, Malik J (2010) Large displacement optical flow: descriptor matching in variational motion estimation. IEEE Trans Pattern Anal Mach Intell 33(3):500–513
30.
Lindeberg T (1993) Scale-space theory in computer vision, 1st edn. Springer, Berlin
31.
Young DM (1971) Iterative solution of large linear systems (Computer science and applied mathematics), 1st edn. Academic Press, London
32.
Tuytelaars T, Mikolajczyk K (2008) Local invariant feature detectors: a survey, 1st edn. Now Publishers Inc, Hanover
33.
Kadir T, Zisserman A, Brady M (2004) An affine invariant salient region detector. In: Proceedings of the European conference on computer vision, pp 404–416
34.
Horn B, Schunck B (1981) Determining optical flow. Artif Intell 17(3):185–203CrossRef
35.
Lucas BD, Kanade T (1981) An iterative image registration technique with an application to stereo vision. In: Proceedings of international joint conference on artificial intelligence, pp 281–288
36.
Papenberg N, Bruhn A, Brox T, Didas S, Weickert J (2006) Highly accurate optic flow computation with theoretically justified warping. Int J Comput Vis 67(2):141–158
37.
Ryan TW (1981) The prediction of cross-correlation accuracy in digital stereo-pair images. Ph.D. thesis, University of Arizona
38.
Li SZ (2001) Markov random field modeling in image analysis, 2nd edn. Springer, BerlinCrossRef
39.
Felzenszwalb PF, Huttenlocher DP (2006) Efficient belief propagation for early vision. Int J Comput Vis 70(1):41–54CrossRef
40.
Liu C, Yuen J, Torralba A (2011) Sift flow: dense correspondence across different scenes and its applications. IEEE Trans Pattern Anal Mach Intell 33(5):978–994PubMedCrossRef
41.
Bruss AR, Horn BKP (1983) Passive navigation. Comput Vis Graph Image Process 21:3–20CrossRef
42.
Reiger J, Lawton D (1985) Processing differential image motion. J Opt Soc Am A 2(2):354–359
43.
Heeger D, Jepson A (1992) Subspace methods for recovering rigid motion 1: algorithm and implementation. Int J Comput Vis 7(2):95–117
44.
Lim J, Barnes N (2009) Estimation of the epipole using optical flow at antipodal points. Comput Vis Image Underst 114(2):245–253CrossRef
45.
46.
Zalis ME, Barish MA, Choi JR, Dachman AH, Fenlon HM, Ferrucci JT, Glick SN, Laghi A, Macari M, McFarland EG, Morrin MM, Pickhardt PJ, Soto J, Yee J (2005) Ct colonography reporting and data system: a consensus proposal. Radiology 236:3–9PubMedCrossRef
47.
Weickert J, ter Haar Romeny BM, Viergever MA (1998) Efficient and reliable schemes for nonlinear diffusion filtering. IEEE Trans Image Process 7:398–410PubMedCrossRef
48.
Luo J, Konofagou E (2010) A fast normalized cross-correlation calculation method for motion estimation. IEEE Trans Ultrason Ferroelectr Freq Control 57:1347–1357PubMedCrossRef
49.
Nister D, Naroditsky O, Bergen J (2004) Visual odometry. In: Proceedings of IEEE CVPR, pp 652–659
Metadaten
Titel
A robust method to track colonoscopy videos with non-informative images
verfasst von
Jianfei Liu
Kalpathi R. Subramanian
Terry S. Yoo
Publikationsdatum
01.07.2013
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 4/2013
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-013-0814-x

Weitere Artikel der Ausgabe 4/2013

International Journal of Computer Assisted Radiology and Surgery 4/2013 Zur Ausgabe

Original Article

Computer-aided focal liver lesion detection

Original Article

Discriminative generalized Hough transform for object localization in medical images

Original Article

Phantom-based comparison of conventional versus phase-contrast mammography for LCD soft-copy diagnosis

Original Article

Three-dimensional histological specimen preparation for accurate imaging and spatial reconstruction of the middle and inner ear

Original Article

Comparative exploration of whole-body MR through locally rigid transforms

Original Article

Measures of divergence of oriented patterns for the detection of architectural distortion in prior mammograms