Skip to main content
Top
Published in: International Journal of Machine Learning and Cybernetics 6/2018

03-01-2017 | Original Article

Arrow detection in biomedical images using sequential classifier

Authors: K. C. Santosh, Partha Pratim Roy

Published in: International Journal of Machine Learning and Cybernetics | Issue 6/2018

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Biomedical images are often complex, and contain several regions that are annotated using arrows. Annotated arrow detection is a critical precursor to region-of-interest (ROI) labeling, which is useful in content-based image retrieval (CBIR). In this paper, we propose a sequential classifier comprising of bidirectional long short-term memory (BLSTM) classifier followed by convexity defect-based arrowhead detection. Different image layers are first segmented via fuzzy binarization. Candidate regions are then checked whether they are arrows by using BLSTM classifier, where Npen++ features are used. In case of low confidence score (i.e., BLSTM classifier score), we take convexity defect-based arrowhead detection technique into account. Our test results on biomedical images from imageCLEF 2010 collection outperforms the existing state-of-the-art arrow detection techniques, by approximately more than 3% in precision, 12% in recall, and therefore 8% in \(\text{F}_1\) score.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Show more products
Literature
1.
go back to reference Demner-Fushman D, Antani S, Simpson M, Rahman M (2010) Combining text and visual features for biomedical information retrieval and ontologies. Tech. rep, LHNCBC Board of Scientific Counselors, National Institutes of Health, Bethesda Demner-Fushman D, Antani S, Simpson M, Rahman M (2010) Combining text and visual features for biomedical information retrieval and ontologies. Tech. rep, LHNCBC Board of Scientific Counselors, National Institutes of Health, Bethesda
2.
go back to reference Demner-Fushman D, Antani S, Simpson MS, Thoma GR (2012) Design and development of a multimodal biomedical information retrieval system. J Comput Sci Eng 6(2):168–177CrossRef Demner-Fushman D, Antani S, Simpson MS, Thoma GR (2012) Design and development of a multimodal biomedical information retrieval system. J Comput Sci Eng 6(2):168–177CrossRef
3.
go back to reference Dori D, Wenyin L (1999) Automated cad conversion with the machine drawing understanding system: concepts, algorithms, and performance. IEEE Trans Syst Man Cybern Part A Syst Humans 29:411–416CrossRef Dori D, Wenyin L (1999) Automated cad conversion with the machine drawing understanding system: concepts, algorithms, and performance. IEEE Trans Syst Man Cybern Part A Syst Humans 29:411–416CrossRef
4.
go back to reference Dori D, Member S, Liu W (1999) Sparse pixel vectorization: An algorithm and its performance evaluation. IEEE Trans Pattern Anal Mach Intell 21:202–215CrossRef Dori D, Member S, Liu W (1999) Sparse pixel vectorization: An algorithm and its performance evaluation. IEEE Trans Pattern Anal Mach Intell 21:202–215CrossRef
5.
go back to reference Park J, Rasheed W, Beak J (2008) Robot navigation using camera by identifying arrow signs. In: International Conference on Grid and Pervasive Computing—Workshops, pp 382–386 Park J, Rasheed W, Beak J (2008) Robot navigation using camera by identifying arrow signs. In: International Conference on Grid and Pervasive Computing—Workshops, pp 382–386
6.
go back to reference Cheng B, Stanley RJ, De S, Antani S, Thoma GR (2011) Automatic detection of arrow annotation overlays in biomedical images. Int J Healthc Inf Syst Inf 6(4):23–41CrossRef Cheng B, Stanley RJ, De S, Antani S, Thoma GR (2011) Automatic detection of arrow annotation overlays in biomedical images. Int J Healthc Inf Syst Inf 6(4):23–41CrossRef
7.
go back to reference You D, Simpson MS, Antani S, Demner-Fushman D, Thoma GR (2013) A robust pointer segmentation in biomedical images toward building a visual ontology for biomedical article retrieval. In: Zanibbi R, Coüasnon B (eds) Document recognition and retrieval, vol 8658 of SPIE Proceedings. SPIE You D, Simpson MS, Antani S, Demner-Fushman D, Thoma GR (2013) A robust pointer segmentation in biomedical images toward building a visual ontology for biomedical article retrieval. In: Zanibbi R, Coüasnon B (eds) Document recognition and retrieval, vol 8658 of SPIE Proceedings. SPIE
8.
go back to reference You D, Apostolova E, Antani S, Demner-Fushman D, Thoma GR (2009) Figure content analysis for improved biomedical article retrieval. In: Berkner K, Likforman-Sulem L (eds) Document recognition and retrieval, vol 7247 of SPIE Proceedings, SPIE, pp 1–10 You D, Apostolova E, Antani S, Demner-Fushman D, Thoma GR (2009) Figure content analysis for improved biomedical article retrieval. In: Berkner K, Likforman-Sulem L (eds) Document recognition and retrieval, vol 7247 of SPIE Proceedings, SPIE, pp 1–10
9.
go back to reference You D, Antani S, Demner-Fushman D, Rahman MM, Govindaraju V, Thoma GR (2010) Biomedical article retrieval using multimodal features and image annotations in region-based cbir. In: Likforman-Sulem L, Agam G (eds) Document recognition and retrieval, vol 7534 of SPIE Proceedings. SPIE, pp 1–10 You D, Antani S, Demner-Fushman D, Rahman MM, Govindaraju V, Thoma GR (2010) Biomedical article retrieval using multimodal features and image annotations in region-based cbir. In: Likforman-Sulem L, Agam G (eds) Document recognition and retrieval, vol 7534 of SPIE Proceedings. SPIE, pp 1–10
10.
go back to reference Hori O, Doermann DS (1995) Robust table-form structure analysis based on box-driven reasoning. Int Conf Document Anal Recogn 1:218–221CrossRef Hori O, Doermann DS (1995) Robust table-form structure analysis based on box-driven reasoning. Int Conf Document Anal Recogn 1:218–221CrossRef
11.
go back to reference Santosh KC, Wendling L, Antani S, Thoma G (2014) Scalable arrow detection in biomedical images. In: International Conference on Pattern Recognition. IEEE Computer Society, Stockholm, pp 3257–3262 Santosh KC, Wendling L, Antani S, Thoma G (2014) Scalable arrow detection in biomedical images. In: International Conference on Pattern Recognition. IEEE Computer Society, Stockholm, pp 3257–3262
12.
go back to reference Cheng H, Chen Y-H (1999) Fuzzy partition of two dimensional histogram and its application to thresholding. Pattern Recogn 32:825–843CrossRef Cheng H, Chen Y-H (1999) Fuzzy partition of two dimensional histogram and its application to thresholding. Pattern Recogn 32:825–843CrossRef
13.
go back to reference Jaeger S, Manke S, Reichert J, Waibel A (2001) Online handwriting recognition: the npen++ recognizer. Int J Document Anal Recogn 3(3):169–180CrossRef Jaeger S, Manke S, Reichert J, Waibel A (2001) Online handwriting recognition: the npen++ recognizer. Int J Document Anal Recogn 3(3):169–180CrossRef
14.
go back to reference Deans SR (1983) The Radon transform and some of its applications. A Wiley-Interscience publication, Wiley, New YorkMATH Deans SR (1983) The Radon transform and some of its applications. A Wiley-Interscience publication, Wiley, New YorkMATH
15.
go back to reference Graves A, Liwicki M, Fernández S, Bertolami R, Bunke H, Schmidhuber J (2009) A novel connectionist system for unconstrained handwriting recognition. Pattern Anal Mach Intell IEEE Trans 31(5):855–868CrossRef Graves A, Liwicki M, Fernández S, Bertolami R, Bunke H, Schmidhuber J (2009) A novel connectionist system for unconstrained handwriting recognition. Pattern Anal Mach Intell IEEE Trans 31(5):855–868CrossRef
16.
go back to reference Liwicki M, Graves A, Bunke H, Schmidhuber J (2007) A novel approach to on-line handwriting recognition based on bidirectional long short-term memory networks. In: Proc. 9th Int. Conf. on Document Analysis and Recognition, vol 1, pp 367–371 Liwicki M, Graves A, Bunke H, Schmidhuber J (2007) A novel approach to on-line handwriting recognition based on bidirectional long short-term memory networks. In: Proc. 9th Int. Conf. on Document Analysis and Recognition, vol 1, pp 367–371
17.
go back to reference Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780CrossRef Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780CrossRef
18.
go back to reference Santosh KC, Wendling L, Antani SK, Thoma GR (2016) Overlaid arrow detection for labeling regions of interest in biomedical images. IEEE Intell Syst 31(3):66–75CrossRef Santosh KC, Wendling L, Antani SK, Thoma GR (2016) Overlaid arrow detection for labeling regions of interest in biomedical images. IEEE Intell Syst 31(3):66–75CrossRef
19.
go back to reference Santosh KC, Alam N, Roy PP, Wendling L, Antani S, Thoma G (2016) Arrowhead detection in biomedical images. In: Electronic imaging, document recognition and retrieval XXIII, vol 7. Society for Imaging Science and Technology, pp 1–7 Santosh KC, Alam N, Roy PP, Wendling L, Antani S, Thoma G (2016) Arrowhead detection in biomedical images. In: Electronic imaging, document recognition and retrieval XXIII, vol 7. Society for Imaging Science and Technology, pp 1–7
20.
go back to reference Santosh KC, Alam N, Roy PP, Wendling L, Antani SK, Thoma GR (2016) A simple and efficient arrowhead detection technique in biomedical images. Int J Pattern Recogn Artif Intell 30(5):1–16CrossRef Santosh KC, Alam N, Roy PP, Wendling L, Antani SK, Thoma GR (2016) A simple and efficient arrowhead detection technique in biomedical images. Int J Pattern Recogn Artif Intell 30(5):1–16CrossRef
21.
go back to reference Ramer U (1972) An iterative procedure for the polygonal approximation of plane curves. Comput Gr Image Process 1(3):244–256CrossRef Ramer U (1972) An iterative procedure for the polygonal approximation of plane curves. Comput Gr Image Process 1(3):244–256CrossRef
22.
go back to reference Douglas DH, Peucker TK (1973) Algorithms for the reduction of the number of points required to represent a digitized line or its caricature. Can Cartogr 10(2):112–122CrossRef Douglas DH, Peucker TK (1973) Algorithms for the reduction of the number of points required to represent a digitized line or its caricature. Can Cartogr 10(2):112–122CrossRef
23.
go back to reference Prasad DK, Leung MK, Quek C, Cho S-Y (2012) A novel framework for making dominant point detection methods non-parametric. Image Vision Comput 30(11):843–859CrossRef Prasad DK, Leung MK, Quek C, Cho S-Y (2012) A novel framework for making dominant point detection methods non-parametric. Image Vision Comput 30(11):843–859CrossRef
24.
go back to reference Sakoe H (1978) Dynamic programming algorithm optimization for spoken word recognition. IEEE Trans Acoust Speech Signal Process 26:43–49CrossRefMATH Sakoe H (1978) Dynamic programming algorithm optimization for spoken word recognition. IEEE Trans Acoust Speech Signal Process 26:43–49CrossRefMATH
25.
go back to reference Keogh EJ, Pazzani MJ (1999) Scaling up dynamic time warping to massive dataset. In: European PKDD, pp 1–11 Keogh EJ, Pazzani MJ (1999) Scaling up dynamic time warping to massive dataset. In: European PKDD, pp 1–11
26.
go back to reference Müller H, Kalpathy-Cramer J, Eggel I, Bedrick S, Radhouani S, Bakke B, Kahn CE Jr, Hersh W (2010) Overview of the clef 2009 medical image retrieval track. Multilingual information access evaluation II. Multimedia Experiments. Springer, New York, pp 72–84 Müller H, Kalpathy-Cramer J, Eggel I, Bedrick S, Radhouani S, Bakke B, Kahn CE Jr, Hersh W (2010) Overview of the clef 2009 medical image retrieval track. Multilingual information access evaluation II. Multimedia Experiments. Springer, New York, pp 72–84
27.
go back to reference Zhang D, Lu G (2002) Shape-based image retrieval using generic fourier descriptor. Signal Process Image Commun 17:825–848CrossRef Zhang D, Lu G (2002) Shape-based image retrieval using generic fourier descriptor. Signal Process Image Commun 17:825–848CrossRef
28.
go back to reference Belongie S, Malik J, Puzicha J (2002) Shape matching and object recognition using shape contexts. IEEE Trans Pattern Anal Mach Intell 24(4):509–522CrossRef Belongie S, Malik J, Puzicha J (2002) Shape matching and object recognition using shape contexts. IEEE Trans Pattern Anal Mach Intell 24(4):509–522CrossRef
29.
go back to reference Kim W-Y, Kim Y-S (2000) A region-based shape descriptor using zernike moments. Signal Process Image Commun 16(1–2):95–102CrossRef Kim W-Y, Kim Y-S (2000) A region-based shape descriptor using zernike moments. Signal Process Image Commun 16(1–2):95–102CrossRef
30.
go back to reference Hoang TV, Tabbone S (2012) The generalization of the r-transform for invariant pattern representation. Pattern Recogn 45(6):2145–2163CrossRefMATH Hoang TV, Tabbone S (2012) The generalization of the r-transform for invariant pattern representation. Pattern Recogn 45(6):2145–2163CrossRefMATH
31.
go back to reference Santosh KC, Lamiroy B, Wendling L (2013) Dtw-radon-based shape descriptor for pattern recognition. Int J Pattern Recogn Artif Intell 27(3):33MathSciNetCrossRef Santosh KC, Lamiroy B, Wendling L (2013) Dtw-radon-based shape descriptor for pattern recognition. Int J Pattern Recogn Artif Intell 27(3):33MathSciNetCrossRef
Metadata
Title
Arrow detection in biomedical images using sequential classifier
Authors
K. C. Santosh
Partha Pratim Roy
Publication date
03-01-2017
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Machine Learning and Cybernetics / Issue 6/2018
Print ISSN: 1868-8071
Electronic ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-016-0623-y

Other articles of this Issue 6/2018

International Journal of Machine Learning and Cybernetics 6/2018 Go to the issue