Skip to main content
Top
Published in: Medical & Biological Engineering & Computing 7-8/2021

14-07-2021 | Original Article

Deep neural network approaches for detecting gastric polyps in endoscopic images

Authors: Serdar Durak, Bülent Bayram, Tolga Bakırman, Murat Erkut, Metehan Doğan, Mert Gürtürk, Burak Akpınar

Published in: Medical & Biological Engineering & Computing | Issue 7-8/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Gastrointestinal endoscopy is the primary method used for the diagnosis and treatment of gastric polyps. The early detection and removal of polyps is vitally important in preventing cancer development. Many studies indicate that a high workload can contribute to misdiagnosing gastric polyps, even for experienced physicians. In this study, we aimed to establish a deep learning–based computer-aided diagnosis system for automatic gastric polyp detection. A private gastric polyp dataset was generated for this purpose consisting of 2195 endoscopic images and 3031 polyp labels. Retrospective gastrointestinal endoscopy data from the Karadeniz Technical University, Farabi Hospital, were used in the study. YOLOv4, CenterNet, EfficientNet, Cross Stage ResNext50-SPP, YOLOv3, YOLOv3-SPP, Single Shot Detection, and Faster Regional CNN deep learning models were implemented and assessed to determine the most efficient model for precancerous gastric polyp detection. The dataset was split 70% and 30% for training and testing all the implemented models. YOLOv4 was determined to be the most accurate model, with an 87.95% mean average precision. We also evaluated all the deep learning models using a public gastric polyp dataset as the test data. The results show that YOLOv4 has significant potential applicability in detecting gastric polyps and can be used effectively in gastrointestinal CAD systems.

Graphical abstract

Gastric Polyp Detection Process using Deep Learning with Private Dataset

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
2.
go back to reference Billah M, Waheed S, Rahman MM (2017) An automatic gastrointestinal polyp detection system in video endoscopy using fusion of color wavelet and convolutional neural network features. Int J Biomed Imaging 2017:9545920CrossRef Billah M, Waheed S, Rahman MM (2017) An automatic gastrointestinal polyp detection system in video endoscopy using fusion of color wavelet and convolutional neural network features. Int J Biomed Imaging 2017:9545920CrossRef
3.
go back to reference Gotoda T (2006 Sep) Endoscopic resection of early gastric cancer: the Japanese perspective. Curr Opin Gastroenterol 22(5):561–569CrossRef Gotoda T (2006 Sep) Endoscopic resection of early gastric cancer: the Japanese perspective. Curr Opin Gastroenterol 22(5):561–569CrossRef
4.
go back to reference Katai H, Ishikawa T, Akazawa K, Isobe Y, Miyashiro I, Oda I et al (2018) Five-year survival analysis of surgically resected gastric cancer cases in Japan: a retrospective analysis of more than 100,000 patients from the nationwide registry of the Japanese Gastric Cancer Association (2001–2007). Gastric Cancer 21(1):144–154CrossRef Katai H, Ishikawa T, Akazawa K, Isobe Y, Miyashiro I, Oda I et al (2018) Five-year survival analysis of surgically resected gastric cancer cases in Japan: a retrospective analysis of more than 100,000 patients from the nationwide registry of the Japanese Gastric Cancer Association (2001–2007). Gastric Cancer 21(1):144–154CrossRef
5.
go back to reference Byrne MF, Chapados N, Soudan F, Oertel C, Pérez ML, Kelly R et al (2019) Real-time differentiation of adenomatous and hyperplastic diminutive colorectal polyps during analysis of unaltered videos of standard colonoscopy using a deep learning model. Gut 68(1):94–100CrossRef Byrne MF, Chapados N, Soudan F, Oertel C, Pérez ML, Kelly R et al (2019) Real-time differentiation of adenomatous and hyperplastic diminutive colorectal polyps during analysis of unaltered videos of standard colonoscopy using a deep learning model. Gut 68(1):94–100CrossRef
6.
go back to reference Ladabaum U, Fioritto A, Mitani A, Desai M, Kim JP, Rex DK et al (2013) Real-time optical biopsy of colon polyps with narrow band imaging in community practice does not yet meet key thresholds for clinical decisions. Gastroenterology 144(1):81–91CrossRef Ladabaum U, Fioritto A, Mitani A, Desai M, Kim JP, Rex DK et al (2013) Real-time optical biopsy of colon polyps with narrow band imaging in community practice does not yet meet key thresholds for clinical decisions. Gastroenterology 144(1):81–91CrossRef
7.
go back to reference Laddha M, Jindal S, Wojciechowski J (eds) (2019) Gastric polyp detection using deep convolutional neural network. Proceedings of the 2019 4th International Conference on Biomedical Imaging, Signal Processing, Nagoya Japan, 17–19 October 2019, pp 55–59. https://doi.org/10.1145/3366174.3366185 Laddha M, Jindal S, Wojciechowski J (eds) (2019) Gastric polyp detection using deep convolutional neural network. Proceedings of the 2019 4th International Conference on Biomedical Imaging, Signal Processing, Nagoya Japan, 17–19 October 2019, pp 55–59. https://​doi.​org/​10.​1145/​3366174.​3366185
9.
go back to reference Yanase J, Triantaphyllou E (2019) A systematic survey of computer-aided diagnosis in medicine: past and present developments. Expert Syst Appl 138:112821CrossRef Yanase J, Triantaphyllou E (2019) A systematic survey of computer-aided diagnosis in medicine: past and present developments. Expert Syst Appl 138:112821CrossRef
12.
go back to reference Lundervold AS, Lundervold A (2019) An overview of deep learning in medical imaging focusing on MRI. Z Med Phys 29(2):102–127CrossRef Lundervold AS, Lundervold A (2019) An overview of deep learning in medical imaging focusing on MRI. Z Med Phys 29(2):102–127CrossRef
13.
go back to reference Abadir AP, Ali MF, Karnes W, Samarasena JB (2020) Artificial intelligence in gastrointestinal endoscopy. Clinical endoscopy 53(2):132CrossRef Abadir AP, Ali MF, Karnes W, Samarasena JB (2020) Artificial intelligence in gastrointestinal endoscopy. Clinical endoscopy 53(2):132CrossRef
14.
go back to reference Choi J, Shin K, Jung J, Bae H-J, Kim DH, Byeon J-S et al (2020) Convolutional neural network technology in endoscopic imaging: artificial intelligence for endoscopy. Clin Endosc 53(2):117CrossRef Choi J, Shin K, Jung J, Bae H-J, Kim DH, Byeon J-S et al (2020) Convolutional neural network technology in endoscopic imaging: artificial intelligence for endoscopy. Clin Endosc 53(2):117CrossRef
15.
go back to reference Hirasawa T, Aoyama K, Tanimoto T, Ishihara S, Shichijo S, Ozawa T, Ohnishi T, Fujishiro M, Matsuo K, Fujisaki J, Tada T (2018) Application of artificial intelligence using a convolutional neural network for detecting gastric cancer in endoscopic images. Gastric Cancer 21:653–660CrossRef Hirasawa T, Aoyama K, Tanimoto T, Ishihara S, Shichijo S, Ozawa T, Ohnishi T, Fujishiro M, Matsuo K, Fujisaki J, Tada T (2018) Application of artificial intelligence using a convolutional neural network for detecting gastric cancer in endoscopic images. Gastric Cancer 21:653–660CrossRef
16.
go back to reference Wang R, Zhang W, Nie W, Yu Y (2019) Gastric polyps detection by improved Faster R-CNN. ICCPR '19, October 23–25, 2019, Beijing, China Wang R, Zhang W, Nie W, Yu Y (2019) Gastric polyps detection by improved Faster R-CNN. ICCPR '19, October 23–25, 2019, Beijing, China
17.
go back to reference Zhang X, Chen F, Yu T, An J, Huang Z, Liu J et al (2019) Real-time gastric polyp detection using convolutional neural networks. PloS one 14(3):e0214133CrossRef Zhang X, Chen F, Yu T, An J, Huang Z, Liu J et al (2019) Real-time gastric polyp detection using convolutional neural networks. PloS one 14(3):e0214133CrossRef
19.
go back to reference Cao C, Wang R, Yu Y, Zhang H, Yu Y, Sun C (2021) Gastric polyp detection in gastroscopic images using deep neural network. PLoS ONE 16(4):e0250632CrossRef Cao C, Wang R, Yu Y, Zhang H, Yu Y, Sun C (2021) Gastric polyp detection in gastroscopic images using deep neural network. PLoS ONE 16(4):e0250632CrossRef
20.
go back to reference Nogueira-Rodríguez A, Domínguez-Carbajales R, López-Fernández H, Iglesias A, Cubiella J, Fdez-Riverola F, Reboiro-Jato M, Glez-Pena D (2021) Deep neural networks approaches for detecting and classifying colorectal polyps. Neurocomputing 423:721–734CrossRef Nogueira-Rodríguez A, Domínguez-Carbajales R, López-Fernández H, Iglesias A, Cubiella J, Fdez-Riverola F, Reboiro-Jato M, Glez-Pena D (2021) Deep neural networks approaches for detecting and classifying colorectal polyps. Neurocomputing 423:721–734CrossRef
21.
go back to reference Sánchez-Peralta LF, Bote-Curiel L, Picon A, Sánchez-Margallo FM, Pagador JB (2020) Deep learning to find colorectal polyps in colonoscopy: a systematic literature review. Artif Intell Med 108:101923CrossRef Sánchez-Peralta LF, Bote-Curiel L, Picon A, Sánchez-Margallo FM, Pagador JB (2020) Deep learning to find colorectal polyps in colonoscopy: a systematic literature review. Artif Intell Med 108:101923CrossRef
22.
go back to reference Pacal I, Karaboga D, Basturk A, Akay B, Nalbantoglu U (2020) A comprehensive review of deep learning in colon cancer. J Comput Biol Med 126:104003CrossRef Pacal I, Karaboga D, Basturk A, Akay B, Nalbantoglu U (2020) A comprehensive review of deep learning in colon cancer. J Comput Biol Med 126:104003CrossRef
23.
go back to reference Bochkovskiy A, Wang C-Y, Liao H-YM (2020) YOLOv4: optimal speed and accuracy of object detection. arXiv preprint Bochkovskiy A, Wang C-Y, Liao H-YM (2020) YOLOv4: optimal speed and accuracy of object detection. arXiv preprint
24.
go back to reference Wang C-Y, Mark Liao H-Y, Wu Y-H, Chen P-Y, Hsieh J-W, Yeh I-H, (editors) (2020) CSPNet: a new backbone that can enhance learning capability of cnn. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Seattle, WA, USA, 14–19 June 2020, pp 1571–1580. https://doi.org/10.1109/CVPRW50498.2020.00203 Wang C-Y, Mark Liao H-Y, Wu Y-H, Chen P-Y, Hsieh J-W, Yeh I-H, (editors) (2020) CSPNet: a new backbone that can enhance learning capability of cnn. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Seattle, WA, USA, 14–19 June 2020, pp 1571–1580. https://​doi.​org/​10.​1109/​CVPRW50498.​2020.​00203
25.
26.
go back to reference Ren S, He K, Girshick R, Sun J, (eds) (2015) Faster r-cnn: towards real-time object detection with region proposal networks. Advances in neural information processing systems 28 (NIPS 2015), Montreal, Quebec, Canada, December 8–13, 2014 Ren S, He K, Girshick R, Sun J, (eds) (2015) Faster r-cnn: towards real-time object detection with region proposal networks. Advances in neural information processing systems 28 (NIPS 2015), Montreal, Quebec, Canada, December 8–13, 2014
28.
go back to reference Redmon J, Farhadi A (2018) YOLOv3: An incremental improvement. arXiv:1804.02767 Redmon J, Farhadi A (2018) YOLOv3: An incremental improvement. arXiv:1804.02767
30.
go back to reference Tan M, Le QV (2019) Efficientnet: rethinking model scaling for convolutional neural networks. arXiv: 1905.11946 Tan M, Le QV (2019) Efficientnet: rethinking model scaling for convolutional neural networks. arXiv: 1905.11946
31.
go back to reference Dirschmid K, Platz-Baudin C, Stolte M (2006) Why is the hyperplastic polyp a marker for the precancerous condition of the gastric mucosa? Virchows Arch 448(1):80–84CrossRef Dirschmid K, Platz-Baudin C, Stolte M (2006) Why is the hyperplastic polyp a marker for the precancerous condition of the gastric mucosa? Virchows Arch 448(1):80–84CrossRef
32.
go back to reference Lynch HT, Smyrk T, McGinn T, Lanspa S, Cavalieri J, Lynch J et al (1995) Attenuated familial adenomatous polyposis (AFAP) a phenotypically and genotypically distinctive variant of FAP. Cancer 76(12):2427–2433CrossRef Lynch HT, Smyrk T, McGinn T, Lanspa S, Cavalieri J, Lynch J et al (1995) Attenuated familial adenomatous polyposis (AFAP) a phenotypically and genotypically distinctive variant of FAP. Cancer 76(12):2427–2433CrossRef
33.
go back to reference Worthley D, Phillips K, Wayte N, Schrader K, Healey S, Kaurah P et al (2012) Gastric adenocarcinoma and proximal polyposis of the stomach (GAPPS): a new autosomal dominant syndrome. Gut 61(5):774–779CrossRef Worthley D, Phillips K, Wayte N, Schrader K, Healey S, Kaurah P et al (2012) Gastric adenocarcinoma and proximal polyposis of the stomach (GAPPS): a new autosomal dominant syndrome. Gut 61(5):774–779CrossRef
34.
go back to reference Vogt S, Jones N, Christian D, Engel C, Nielsen M, Kaufmann A et al (2009) Expanded extracolonic tumor spectrum in MUTYH-associated polyposis. Gastroenterology 137(6):1976–85. e10CrossRef Vogt S, Jones N, Christian D, Engel C, Nielsen M, Kaufmann A et al (2009) Expanded extracolonic tumor spectrum in MUTYH-associated polyposis. Gastroenterology 137(6):1976–85. e10CrossRef
35.
go back to reference Voutilainen M, Mäntynen T, Kunnamo I et al (2003) Impact of clinical symptoms and referral volume on endoscopy for detecting. Scand J Gastroenterol 38:109–113CrossRef Voutilainen M, Mäntynen T, Kunnamo I et al (2003) Impact of clinical symptoms and referral volume on endoscopy for detecting. Scand J Gastroenterol 38:109–113CrossRef
36.
go back to reference Burt RW (2003) Gastric fundic gland polyps. Gastroenterology 125:1462–1469CrossRef Burt RW (2003) Gastric fundic gland polyps. Gastroenterology 125:1462–1469CrossRef
37.
go back to reference Borch K, Skarsgård J, Franzén L et al (2003) Benign gastric polyps: morphological and functional origin. Dig Dis Sci 48:1292–1297CrossRef Borch K, Skarsgård J, Franzén L et al (2003) Benign gastric polyps: morphological and functional origin. Dig Dis Sci 48:1292–1297CrossRef
38.
go back to reference Xie S, Girshick R, Dollár P, Tu Z, He K (2017) Aggregated residual transformations for deep neural networks. arXiv:1611.05431 Xie S, Girshick R, Dollár P, Tu Z, He K (2017) Aggregated residual transformations for deep neural networks. arXiv:1611.05431
40.
go back to reference He K, Zhang X, Ren S, Sun J (2015) Spatial pyramid pooling in deep convolutional networks for visual recognition. IEEE Trans Pattern Anal Mach Intell 37(9):1904–1916CrossRef He K, Zhang X, Ren S, Sun J (2015) Spatial pyramid pooling in deep convolutional networks for visual recognition. IEEE Trans Pattern Anal Mach Intell 37(9):1904–1916CrossRef
43.
go back to reference Newell A, Yang K, Deng J (2016) Stacked hourglass networks for human pose estimation. arXiv:1603.06937 Newell A, Yang K, Deng J (2016) Stacked hourglass networks for human pose estimation. arXiv:1603.06937
44.
go back to reference Lin TY, Maire M, Belongie S, Bourdev L, Girshick R, Hays J, Perona P, Ramanan D, Zitnick CL, Dollar P (2015) Microsoft COCO: common objects in context. arXiv:1405.0312 Lin TY, Maire M, Belongie S, Bourdev L, Girshick R, Hays J, Perona P, Ramanan D, Zitnick CL, Dollar P (2015) Microsoft COCO: common objects in context. arXiv:1405.0312
45.
go back to reference Pham MT, Kim J-M, Kim CH (2020) Intelligent fault diagnosis method using acoustic emission signals for bearings under complex working conditions. Appl Sci 10(20):7068CrossRef Pham MT, Kim J-M, Kim CH (2020) Intelligent fault diagnosis method using acoustic emission signals for bearings under complex working conditions. Appl Sci 10(20):7068CrossRef
46.
go back to reference Tan M, Chen B, Pang R, Vasudevan V, Sandler M, Howard A et al (eds) (2019) Mnasnet: platform-aware neural architecture search for mobile. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019, pp 2820–2828 Tan M, Chen B, Pang R, Vasudevan V, Sandler M, Howard A et al (eds) (2019) Mnasnet: platform-aware neural architecture search for mobile. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019, pp 2820–2828
47.
go back to reference Le Duy Huynh NB. A U-NET++ with pre-trained EfficientNet backbone for segmentation of diseases and artifacts in endoscopy images and videos, CEUR Workshop Proceedings 2595, 13–17 Le Duy Huynh NB. A U-NET++ with pre-trained EfficientNet backbone for segmentation of diseases and artifacts in endoscopy images and videos, CEUR Workshop Proceedings 2595, 13–17
Metadata
Title
Deep neural network approaches for detecting gastric polyps in endoscopic images
Authors
Serdar Durak
Bülent Bayram
Tolga Bakırman
Murat Erkut
Metehan Doğan
Mert Gürtürk
Burak Akpınar
Publication date
14-07-2021
Publisher
Springer Berlin Heidelberg
Published in
Medical & Biological Engineering & Computing / Issue 7-8/2021
Print ISSN: 0140-0118
Electronic ISSN: 1741-0444
DOI
https://doi.org/10.1007/s11517-021-02398-8

Other articles of this Issue 7-8/2021

Medical & Biological Engineering & Computing 7-8/2021 Go to the issue

Premium Partner