Skip to main content
Erschienen in: International Journal of Machine Learning and Cybernetics 6/2018

03.01.2017 | Original Article

Arrow detection in biomedical images using sequential classifier

verfasst von: K. C. Santosh, Partha Pratim Roy

Erschienen in: International Journal of Machine Learning and Cybernetics | Ausgabe 6/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Biomedical images are often complex, and contain several regions that are annotated using arrows. Annotated arrow detection is a critical precursor to region-of-interest (ROI) labeling, which is useful in content-based image retrieval (CBIR). In this paper, we propose a sequential classifier comprising of bidirectional long short-term memory (BLSTM) classifier followed by convexity defect-based arrowhead detection. Different image layers are first segmented via fuzzy binarization. Candidate regions are then checked whether they are arrows by using BLSTM classifier, where Npen++ features are used. In case of low confidence score (i.e., BLSTM classifier score), we take convexity defect-based arrowhead detection technique into account. Our test results on biomedical images from imageCLEF 2010 collection outperforms the existing state-of-the-art arrow detection techniques, by approximately more than 3% in precision, 12% in recall, and therefore 8% in \(\text{F}_1\) score.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Literatur
1.
Zurück zum Zitat Demner-Fushman D, Antani S, Simpson M, Rahman M (2010) Combining text and visual features for biomedical information retrieval and ontologies. Tech. rep, LHNCBC Board of Scientific Counselors, National Institutes of Health, Bethesda Demner-Fushman D, Antani S, Simpson M, Rahman M (2010) Combining text and visual features for biomedical information retrieval and ontologies. Tech. rep, LHNCBC Board of Scientific Counselors, National Institutes of Health, Bethesda
2.
Zurück zum Zitat Demner-Fushman D, Antani S, Simpson MS, Thoma GR (2012) Design and development of a multimodal biomedical information retrieval system. J Comput Sci Eng 6(2):168–177CrossRef Demner-Fushman D, Antani S, Simpson MS, Thoma GR (2012) Design and development of a multimodal biomedical information retrieval system. J Comput Sci Eng 6(2):168–177CrossRef
3.
Zurück zum Zitat Dori D, Wenyin L (1999) Automated cad conversion with the machine drawing understanding system: concepts, algorithms, and performance. IEEE Trans Syst Man Cybern Part A Syst Humans 29:411–416CrossRef Dori D, Wenyin L (1999) Automated cad conversion with the machine drawing understanding system: concepts, algorithms, and performance. IEEE Trans Syst Man Cybern Part A Syst Humans 29:411–416CrossRef
4.
Zurück zum Zitat Dori D, Member S, Liu W (1999) Sparse pixel vectorization: An algorithm and its performance evaluation. IEEE Trans Pattern Anal Mach Intell 21:202–215CrossRef Dori D, Member S, Liu W (1999) Sparse pixel vectorization: An algorithm and its performance evaluation. IEEE Trans Pattern Anal Mach Intell 21:202–215CrossRef
5.
Zurück zum Zitat Park J, Rasheed W, Beak J (2008) Robot navigation using camera by identifying arrow signs. In: International Conference on Grid and Pervasive Computing—Workshops, pp 382–386 Park J, Rasheed W, Beak J (2008) Robot navigation using camera by identifying arrow signs. In: International Conference on Grid and Pervasive Computing—Workshops, pp 382–386
6.
Zurück zum Zitat Cheng B, Stanley RJ, De S, Antani S, Thoma GR (2011) Automatic detection of arrow annotation overlays in biomedical images. Int J Healthc Inf Syst Inf 6(4):23–41CrossRef Cheng B, Stanley RJ, De S, Antani S, Thoma GR (2011) Automatic detection of arrow annotation overlays in biomedical images. Int J Healthc Inf Syst Inf 6(4):23–41CrossRef
7.
Zurück zum Zitat You D, Simpson MS, Antani S, Demner-Fushman D, Thoma GR (2013) A robust pointer segmentation in biomedical images toward building a visual ontology for biomedical article retrieval. In: Zanibbi R, Coüasnon B (eds) Document recognition and retrieval, vol 8658 of SPIE Proceedings. SPIE You D, Simpson MS, Antani S, Demner-Fushman D, Thoma GR (2013) A robust pointer segmentation in biomedical images toward building a visual ontology for biomedical article retrieval. In: Zanibbi R, Coüasnon B (eds) Document recognition and retrieval, vol 8658 of SPIE Proceedings. SPIE
8.
Zurück zum Zitat You D, Apostolova E, Antani S, Demner-Fushman D, Thoma GR (2009) Figure content analysis for improved biomedical article retrieval. In: Berkner K, Likforman-Sulem L (eds) Document recognition and retrieval, vol 7247 of SPIE Proceedings, SPIE, pp 1–10 You D, Apostolova E, Antani S, Demner-Fushman D, Thoma GR (2009) Figure content analysis for improved biomedical article retrieval. In: Berkner K, Likforman-Sulem L (eds) Document recognition and retrieval, vol 7247 of SPIE Proceedings, SPIE, pp 1–10
9.
Zurück zum Zitat You D, Antani S, Demner-Fushman D, Rahman MM, Govindaraju V, Thoma GR (2010) Biomedical article retrieval using multimodal features and image annotations in region-based cbir. In: Likforman-Sulem L, Agam G (eds) Document recognition and retrieval, vol 7534 of SPIE Proceedings. SPIE, pp 1–10 You D, Antani S, Demner-Fushman D, Rahman MM, Govindaraju V, Thoma GR (2010) Biomedical article retrieval using multimodal features and image annotations in region-based cbir. In: Likforman-Sulem L, Agam G (eds) Document recognition and retrieval, vol 7534 of SPIE Proceedings. SPIE, pp 1–10
10.
Zurück zum Zitat Hori O, Doermann DS (1995) Robust table-form structure analysis based on box-driven reasoning. Int Conf Document Anal Recogn 1:218–221CrossRef Hori O, Doermann DS (1995) Robust table-form structure analysis based on box-driven reasoning. Int Conf Document Anal Recogn 1:218–221CrossRef
11.
Zurück zum Zitat Santosh KC, Wendling L, Antani S, Thoma G (2014) Scalable arrow detection in biomedical images. In: International Conference on Pattern Recognition. IEEE Computer Society, Stockholm, pp 3257–3262 Santosh KC, Wendling L, Antani S, Thoma G (2014) Scalable arrow detection in biomedical images. In: International Conference on Pattern Recognition. IEEE Computer Society, Stockholm, pp 3257–3262
12.
Zurück zum Zitat Cheng H, Chen Y-H (1999) Fuzzy partition of two dimensional histogram and its application to thresholding. Pattern Recogn 32:825–843CrossRef Cheng H, Chen Y-H (1999) Fuzzy partition of two dimensional histogram and its application to thresholding. Pattern Recogn 32:825–843CrossRef
13.
Zurück zum Zitat Jaeger S, Manke S, Reichert J, Waibel A (2001) Online handwriting recognition: the npen++ recognizer. Int J Document Anal Recogn 3(3):169–180CrossRef Jaeger S, Manke S, Reichert J, Waibel A (2001) Online handwriting recognition: the npen++ recognizer. Int J Document Anal Recogn 3(3):169–180CrossRef
14.
Zurück zum Zitat Deans SR (1983) The Radon transform and some of its applications. A Wiley-Interscience publication, Wiley, New YorkMATH Deans SR (1983) The Radon transform and some of its applications. A Wiley-Interscience publication, Wiley, New YorkMATH
15.
Zurück zum Zitat Graves A, Liwicki M, Fernández S, Bertolami R, Bunke H, Schmidhuber J (2009) A novel connectionist system for unconstrained handwriting recognition. Pattern Anal Mach Intell IEEE Trans 31(5):855–868CrossRef Graves A, Liwicki M, Fernández S, Bertolami R, Bunke H, Schmidhuber J (2009) A novel connectionist system for unconstrained handwriting recognition. Pattern Anal Mach Intell IEEE Trans 31(5):855–868CrossRef
16.
Zurück zum Zitat Liwicki M, Graves A, Bunke H, Schmidhuber J (2007) A novel approach to on-line handwriting recognition based on bidirectional long short-term memory networks. In: Proc. 9th Int. Conf. on Document Analysis and Recognition, vol 1, pp 367–371 Liwicki M, Graves A, Bunke H, Schmidhuber J (2007) A novel approach to on-line handwriting recognition based on bidirectional long short-term memory networks. In: Proc. 9th Int. Conf. on Document Analysis and Recognition, vol 1, pp 367–371
17.
Zurück zum Zitat Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780CrossRef Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780CrossRef
18.
Zurück zum Zitat Santosh KC, Wendling L, Antani SK, Thoma GR (2016) Overlaid arrow detection for labeling regions of interest in biomedical images. IEEE Intell Syst 31(3):66–75CrossRef Santosh KC, Wendling L, Antani SK, Thoma GR (2016) Overlaid arrow detection for labeling regions of interest in biomedical images. IEEE Intell Syst 31(3):66–75CrossRef
19.
Zurück zum Zitat Santosh KC, Alam N, Roy PP, Wendling L, Antani S, Thoma G (2016) Arrowhead detection in biomedical images. In: Electronic imaging, document recognition and retrieval XXIII, vol 7. Society for Imaging Science and Technology, pp 1–7 Santosh KC, Alam N, Roy PP, Wendling L, Antani S, Thoma G (2016) Arrowhead detection in biomedical images. In: Electronic imaging, document recognition and retrieval XXIII, vol 7. Society for Imaging Science and Technology, pp 1–7
20.
Zurück zum Zitat Santosh KC, Alam N, Roy PP, Wendling L, Antani SK, Thoma GR (2016) A simple and efficient arrowhead detection technique in biomedical images. Int J Pattern Recogn Artif Intell 30(5):1–16CrossRef Santosh KC, Alam N, Roy PP, Wendling L, Antani SK, Thoma GR (2016) A simple and efficient arrowhead detection technique in biomedical images. Int J Pattern Recogn Artif Intell 30(5):1–16CrossRef
21.
Zurück zum Zitat Ramer U (1972) An iterative procedure for the polygonal approximation of plane curves. Comput Gr Image Process 1(3):244–256CrossRef Ramer U (1972) An iterative procedure for the polygonal approximation of plane curves. Comput Gr Image Process 1(3):244–256CrossRef
22.
Zurück zum Zitat Douglas DH, Peucker TK (1973) Algorithms for the reduction of the number of points required to represent a digitized line or its caricature. Can Cartogr 10(2):112–122CrossRef Douglas DH, Peucker TK (1973) Algorithms for the reduction of the number of points required to represent a digitized line or its caricature. Can Cartogr 10(2):112–122CrossRef
23.
Zurück zum Zitat Prasad DK, Leung MK, Quek C, Cho S-Y (2012) A novel framework for making dominant point detection methods non-parametric. Image Vision Comput 30(11):843–859CrossRef Prasad DK, Leung MK, Quek C, Cho S-Y (2012) A novel framework for making dominant point detection methods non-parametric. Image Vision Comput 30(11):843–859CrossRef
24.
Zurück zum Zitat Sakoe H (1978) Dynamic programming algorithm optimization for spoken word recognition. IEEE Trans Acoust Speech Signal Process 26:43–49CrossRefMATH Sakoe H (1978) Dynamic programming algorithm optimization for spoken word recognition. IEEE Trans Acoust Speech Signal Process 26:43–49CrossRefMATH
25.
Zurück zum Zitat Keogh EJ, Pazzani MJ (1999) Scaling up dynamic time warping to massive dataset. In: European PKDD, pp 1–11 Keogh EJ, Pazzani MJ (1999) Scaling up dynamic time warping to massive dataset. In: European PKDD, pp 1–11
26.
Zurück zum Zitat Müller H, Kalpathy-Cramer J, Eggel I, Bedrick S, Radhouani S, Bakke B, Kahn CE Jr, Hersh W (2010) Overview of the clef 2009 medical image retrieval track. Multilingual information access evaluation II. Multimedia Experiments. Springer, New York, pp 72–84 Müller H, Kalpathy-Cramer J, Eggel I, Bedrick S, Radhouani S, Bakke B, Kahn CE Jr, Hersh W (2010) Overview of the clef 2009 medical image retrieval track. Multilingual information access evaluation II. Multimedia Experiments. Springer, New York, pp 72–84
27.
Zurück zum Zitat Zhang D, Lu G (2002) Shape-based image retrieval using generic fourier descriptor. Signal Process Image Commun 17:825–848CrossRef Zhang D, Lu G (2002) Shape-based image retrieval using generic fourier descriptor. Signal Process Image Commun 17:825–848CrossRef
28.
Zurück zum Zitat Belongie S, Malik J, Puzicha J (2002) Shape matching and object recognition using shape contexts. IEEE Trans Pattern Anal Mach Intell 24(4):509–522CrossRef Belongie S, Malik J, Puzicha J (2002) Shape matching and object recognition using shape contexts. IEEE Trans Pattern Anal Mach Intell 24(4):509–522CrossRef
29.
Zurück zum Zitat Kim W-Y, Kim Y-S (2000) A region-based shape descriptor using zernike moments. Signal Process Image Commun 16(1–2):95–102CrossRef Kim W-Y, Kim Y-S (2000) A region-based shape descriptor using zernike moments. Signal Process Image Commun 16(1–2):95–102CrossRef
30.
Zurück zum Zitat Hoang TV, Tabbone S (2012) The generalization of the r-transform for invariant pattern representation. Pattern Recogn 45(6):2145–2163CrossRefMATH Hoang TV, Tabbone S (2012) The generalization of the r-transform for invariant pattern representation. Pattern Recogn 45(6):2145–2163CrossRefMATH
31.
Zurück zum Zitat Santosh KC, Lamiroy B, Wendling L (2013) Dtw-radon-based shape descriptor for pattern recognition. Int J Pattern Recogn Artif Intell 27(3):33MathSciNetCrossRef Santosh KC, Lamiroy B, Wendling L (2013) Dtw-radon-based shape descriptor for pattern recognition. Int J Pattern Recogn Artif Intell 27(3):33MathSciNetCrossRef
Metadaten
Titel
Arrow detection in biomedical images using sequential classifier
verfasst von
K. C. Santosh
Partha Pratim Roy
Publikationsdatum
03.01.2017
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Machine Learning and Cybernetics / Ausgabe 6/2018
Print ISSN: 1868-8071
Elektronische ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-016-0623-y

Weitere Artikel der Ausgabe 6/2018

International Journal of Machine Learning and Cybernetics 6/2018 Zur Ausgabe

Neuer Inhalt