Skip to main content
Top
Published in: International Journal of Computer Assisted Radiology and Surgery 10/2021

01-09-2021 | Original Article

Binary polyp-size classification based on deep-learned spatial information

Authors: Hayato Itoh, Masahiro Oda, Kai Jiang, Yuichi Mori, Masashi Misawa, Shin-Ei Kudo, Kenichiro Imai, Sayo Ito, Kinichi Hotta, Kensaku Mori

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 10/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Purpose

The size information of detected polyps is an essential factor for diagnosis in colon cancer screening. For example, adenomas and sessile serrated polyps that are \(\ge 10\) mm are considered advanced, and shorter surveillance intervals are recommended for smaller polyps. However, sometimes the subjective estimations of endoscopists are incorrect and overestimate the sizes. To circumvent these difficulties, we developed a method for automatic binary polyp-size classification between two polyp sizes: from 1 to 9 mm and \(\ge 10\) mm.

Method

We introduce a binary polyp-size classification method that estimates a polyp’s three-dimensional spatial information. This estimation is comprised of polyp localisation and depth estimation. The combination of location and depth information expresses a polyp’s three-dimensional shape. In experiments, we quantitatively and qualitatively evaluate the proposed method using 787 polyps of both protruded and flat types.

Results

The proposed method’s best classification accuracy outperformed the fine-tuned state-of-the-art image classification methods. Post-processing of sequential voting increased the classification accuracy and achieved classification accuracy of 0.81 and 0.88 for polyps ranging from 1 to 9 mm and others that are \(\ge 10\) mm. Qualitative analysis revealed the importance of polyp localisation even in polyp-size classification.

Conclusions

We developed a binary polyp-size classification method by utilising the estimated three-dimensional shape of a polyp. Experiments demonstrated accurate classification for both protruded- and flat-type polyps, even though the flat type have ambiguous boundary between a polyp and colon wall.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Hassan C, Repici A, Rex D (2016) Addressing bias in polyp size measurement. Endoscopy 48(10):881–883CrossRef Hassan C, Repici A, Rex D (2016) Addressing bias in polyp size measurement. Endoscopy 48(10):881–883CrossRef
2.
go back to reference Lieberman DA, Rex DK, Winawer SJ, Giardiello FM, Johnson DA, Levin TR (2012) Guidelines for colonoscopy surveillance after screening and polypectomy: a consensus update by the US Multi-Society Task Force on Colorectal Cancer. Gastroenterology 143(3):844–857CrossRef Lieberman DA, Rex DK, Winawer SJ, Giardiello FM, Johnson DA, Levin TR (2012) Guidelines for colonoscopy surveillance after screening and polypectomy: a consensus update by the US Multi-Society Task Force on Colorectal Cancer. Gastroenterology 143(3):844–857CrossRef
3.
go back to reference Hassan C, Quintero E, Dumonceau J-M, Regula J, Brandão C, Chaussade S, Dekker E, Dinis-Ribeiro M, Ferlitsch M, Gimeno-García A, Hazewinkel Y, Jover R, Kalager M, Loberg L, Pox C, Rembacken B, Lieberman D (2013) Post-polypectomy colonoscopy surveillance: European Society of Gastrointestinal Endoscopy (ESGE) Guideline. Endoscopy 45(10):842–864CrossRef Hassan C, Quintero E, Dumonceau J-M, Regula J, Brandão C, Chaussade S, Dekker E, Dinis-Ribeiro M, Ferlitsch M, Gimeno-García A, Hazewinkel Y, Jover R, Kalager M, Loberg L, Pox C, Rembacken B, Lieberman D (2013) Post-polypectomy colonoscopy surveillance: European Society of Gastrointestinal Endoscopy (ESGE) Guideline. Endoscopy 45(10):842–864CrossRef
4.
go back to reference Anderson B, Smyrk T, Anderson K, Mahoney D, Dovens M, Sweetser S, Kisiel J, Ahlquist D (2015) Endoscopic overestimation of colorectal polyp size. Gastrointestinal Endoscopy 83(1):201–208CrossRef Anderson B, Smyrk T, Anderson K, Mahoney D, Dovens M, Sweetser S, Kisiel J, Ahlquist D (2015) Endoscopic overestimation of colorectal polyp size. Gastrointestinal Endoscopy 83(1):201–208CrossRef
5.
go back to reference Rex DK, Rabinovitz R (2014) Variable interpretation of polyp size by using open forceps by experienced colonoscopists. Gastrointestinal Endoscopy 79(3):402–407CrossRef Rex DK, Rabinovitz R (2014) Variable interpretation of polyp size by using open forceps by experienced colonoscopists. Gastrointestinal Endoscopy 79(3):402–407CrossRef
6.
go back to reference Hyun YS, Han DS, Bae JH, Park HS, Eun CS (2011) Graduated injection needles and snares for polypectomy are useful for measuring colorectal polyp size. Digestive and Liver Disease 43(5):391–394CrossRef Hyun YS, Han DS, Bae JH, Park HS, Eun CS (2011) Graduated injection needles and snares for polypectomy are useful for measuring colorectal polyp size. Digestive and Liver Disease 43(5):391–394CrossRef
7.
go back to reference Kaz AM, Anwar A, O’Neill DR, Dominitz JA (2016) Use of a novel polyp “ruler snare’’ improves estimation of colon polyp size. Gastrointest Endoscopy 83(4):812–816CrossRef Kaz AM, Anwar A, O’Neill DR, Dominitz JA (2016) Use of a novel polyp “ruler snare’’ improves estimation of colon polyp size. Gastrointest Endoscopy 83(4):812–816CrossRef
8.
go back to reference Plumb A, Nickerson C, Wooldrage K, Bassett P, Taylor S, Altman D, Atkin W, Halligan S (2016) Terminal digit preference biases polyp size measurements at endoscopy, computed tomographic colonography, and histopathology. Endoscopy 48:899–908CrossRef Plumb A, Nickerson C, Wooldrage K, Bassett P, Taylor S, Altman D, Atkin W, Halligan S (2016) Terminal digit preference biases polyp size measurements at endoscopy, computed tomographic colonography, and histopathology. Endoscopy 48:899–908CrossRef
9.
go back to reference Itoh H, Roth HR, Lu L, Oda M, Misawa M, Mori Y, Kudo S-E, Mori K (2018) Towards Automated Colonoscopy Diagnosis: Binary Polyp Size Estimation via Unsupervised Depth Learning. Proc. Medical Image Computing and Computer Assisted Intervention LNCS 11071:611–619 Itoh H, Roth HR, Lu L, Oda M, Misawa M, Mori Y, Kudo S-E, Mori K (2018) Towards Automated Colonoscopy Diagnosis: Binary Polyp Size Estimation via Unsupervised Depth Learning. Proc. Medical Image Computing and Computer Assisted Intervention LNCS 11071:611–619
10.
go back to reference Itoh Oda M, Mori Y, Misawa M, Kudo S-E, Imai K, Ito S, Hotta K, Takabatake H, Mori M, Natori H, Mori K (2021) Unsupervised Colonoscopic Depth Estimation with a Lambertian-Reflection Keeping Auxiliary Task. International Journal of Computer Assisted Radiology and Surgery 16:989–1001CrossRef Itoh Oda M, Mori Y, Misawa M, Kudo S-E, Imai K, Ito S, Hotta K, Takabatake H, Mori M, Natori H, Mori K (2021) Unsupervised Colonoscopic Depth Estimation with a Lambertian-Reflection Keeping Auxiliary Task. International Journal of Computer Assisted Radiology and Surgery 16:989–1001CrossRef
12.
go back to reference Mori K, Suenaga Y, Toriwaki J (2003) Fast Software-based Volume Rendering Using Multimedia Instructions on PC Platforms and Its Application to Virtual Endoscopy. Proc SPIE Medical Imaging 5031:111–122CrossRef Mori K, Suenaga Y, Toriwaki J (2003) Fast Software-based Volume Rendering Using Multimedia Instructions on PC Platforms and Its Application to Virtual Endoscopy. Proc SPIE Medical Imaging 5031:111–122CrossRef
13.
go back to reference Misawa M, Kudo S-E, Mori Y, Hotta K, Ohtsuka K, Matsuda T, Saito S, Kudo T, BaBa T, Ishida F, Itoh H, Oda M, Mori K (2021) Development of a computer-aided detection system for colonoscopy and a publicly accessible large colonoscopy video database (with video). Gastrointestinal Endoscopy 93(4):960–967CrossRef Misawa M, Kudo S-E, Mori Y, Hotta K, Ohtsuka K, Matsuda T, Saito S, Kudo T, BaBa T, Ishida F, Itoh H, Oda M, Mori K (2021) Development of a computer-aided detection system for colonoscopy and a publicly accessible large colonoscopy video database (with video). Gastrointestinal Endoscopy 93(4):960–967CrossRef
16.
go back to reference Zoph B, Vasudevan V, Shlens J, Le QV (2018) Learning transferable architectures for scalable image recognition. In: Proceedings of IEEE international conference on computer vision, pp 8697–8710 Zoph B, Vasudevan V, Shlens J, Le QV (2018) Learning transferable architectures for scalable image recognition. In: Proceedings of IEEE international conference on computer vision, pp 8697–8710
17.
go back to reference Szegedy C, Ioffe S, Vanhoucke V, Alemi A (2017) Inception-v4, Inception-ResNet and the impact of residual connections on learning. In: Proceedings of thirty-first AAAI conference on artificial intelligence, pp 4278–4284 Szegedy C, Ioffe S, Vanhoucke V, Alemi A (2017) Inception-v4, Inception-ResNet and the impact of residual connections on learning. In: Proceedings of thirty-first AAAI conference on artificial intelligence, pp 4278–4284
18.
go back to reference Chollet F (2017) Xception: deep learning with depthwise separable convolutions. In: Proceedings of IEEE international conference on computer vision, pp 1800–1807 Chollet F (2017) Xception: deep learning with depthwise separable convolutions. In: Proceedings of IEEE international conference on computer vision, pp 1800–1807
Metadata
Title
Binary polyp-size classification based on deep-learned spatial information
Authors
Hayato Itoh
Masahiro Oda
Kai Jiang
Yuichi Mori
Masashi Misawa
Shin-Ei Kudo
Kenichiro Imai
Sayo Ito
Kinichi Hotta
Kensaku Mori
Publication date
01-09-2021
Publisher
Springer International Publishing
Published in
International Journal of Computer Assisted Radiology and Surgery / Issue 10/2021
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-021-02477-z

Other articles of this Issue 10/2021

International Journal of Computer Assisted Radiology and Surgery 10/2021 Go to the issue

Premium Partner