Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 4/2024

11.01.2024 | Original Article

Endoscopic sleeve gastroplasty: stomach location and task classification for evaluation using artificial intelligence

verfasst von: James Dials, Doga Demirel, Reinaldo Sanchez-Arias, Tansel Halic, Suvranu De, Mark A. Gromski

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 4/2024

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Purpose

We have previously developed grading metrics to objectively measure endoscopist performance in endoscopic sleeve gastroplasty (ESG). One of our primary goals is to automate the process of measuring performance. To achieve this goal, the repeated task being performed (grasping or suturing) and the location of the endoscopic suturing device in the stomach (Incisura, Anterior Wall, Greater Curvature, or Posterior Wall) need to be accurately recorded.

Methods

For this study, we populated our dataset using screenshots and video clips from experts carrying out the ESG procedure on ex vivo porcine specimens. Data augmentation was used to enlarge our dataset, and synthetic minority oversampling (SMOTE) to balance it. We performed stomach localization for parts of the stomach and task classification using deep learning for images and computer vision for videos.

Results

Classifying the stomach’s location from the endoscope without SMOTE for images resulted in 89% and 84% testing and validation accuracy, respectively. For classifying the location of the stomach from the endoscope with SMOTE, the accuracies were 97% and 90% for images, while for videos, the accuracies were 99% and 98% for testing and validation, respectively. For task classification, the accuracies were 97% and 89% for images, while for videos, the accuracies were 100% for both testing and validation, respectively.

Conclusion

We classified the four different stomach parts manipulated during the ESG procedure with 97% training accuracy and classified two repeated tasks with 99% training accuracy with images. We also classified the four parts of the stomach with a 99% training accuracy and two repeated tasks with a 100% training accuracy with video frames. This work will be essential in automating feedback mechanisms for learners in ESG.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Dials J, Demirel D, Halic T, De S, Ryason A, Kundumadam S, Al-Haddad M, Gromski MA (2021) Hierarchical task analysis of endoscopic sleeve gastroplasty. Surg Endosc 1–16 Dials J, Demirel D, Halic T, De S, Ryason A, Kundumadam S, Al-Haddad M, Gromski MA (2021) Hierarchical task analysis of endoscopic sleeve gastroplasty. Surg Endosc 1–16
4.
Zurück zum Zitat Farha J, McGowan C, Hedjoudje A, Itani MI, Abbarh S, Simsek C, Ichkhanian Y, Vulpis T, James TW, Fayad L, Khashab MA, Oberbach A, Badurdeen D, Kumbhari V (2021) Endoscopic sleeve gastroplasty: suturing the gastric fundus does not confer benefit. Endoscopy 53:727–731. https://doi.org/10.1055/a-1236-9347CrossRefPubMed Farha J, McGowan C, Hedjoudje A, Itani MI, Abbarh S, Simsek C, Ichkhanian Y, Vulpis T, James TW, Fayad L, Khashab MA, Oberbach A, Badurdeen D, Kumbhari V (2021) Endoscopic sleeve gastroplasty: suturing the gastric fundus does not confer benefit. Endoscopy 53:727–731. https://​doi.​org/​10.​1055/​a-1236-9347CrossRefPubMed
5.
Zurück zum Zitat Wang J, Perez L (2017) The effectiveness of data augmentation in image classification using deep learning. Convolut Neural Netw Vis Recognit 11:1–8 Wang J, Perez L (2017) The effectiveness of data augmentation in image classification using deep learning. Convolut Neural Netw Vis Recognit 11:1–8
7.
Zurück zum Zitat Albawi S, Mohammed TA, Al-Zawi S (2017) Understanding of a convolutional neural network. In: 2017 international conference on engineering and technology (ICET), pp 1–6 Albawi S, Mohammed TA, Al-Zawi S (2017) Understanding of a convolutional neural network. In: 2017 international conference on engineering and technology (ICET), pp 1–6
8.
Zurück zum Zitat Cetinsaya B, Dials J, Demirel D, Halic T, De S, Gromski M, Rex D (2020) Comparison study of deep learning models for colorectal lesions classification. In: Proceedings of the 2020 the 4th international conference on information system and data mining. Association for Computing Machinery, New York, pp 84–88 Cetinsaya B, Dials J, Demirel D, Halic T, De S, Gromski M, Rex D (2020) Comparison study of deep learning models for colorectal lesions classification. In: Proceedings of the 2020 the 4th international conference on information system and data mining. Association for Computing Machinery, New York, pp 84–88
9.
Zurück zum Zitat Hussain Z, Gimenez F, Yi D, Rubin D (2018) Differential data augmentation techniques for medical imaging classification tasks. AMIA Annu Symp Proc 2017:979–984PubMedPubMedCentral Hussain Z, Gimenez F, Yi D, Rubin D (2018) Differential data augmentation techniques for medical imaging classification tasks. AMIA Annu Symp Proc 2017:979–984PubMedPubMedCentral
10.
Zurück zum Zitat Mikolajczyk A, Grochowski M (2018) Data augmentation for improving deep learning in image classification problem. In: 2018 international interdisciplinary PhD workshop (IIPhDW). IEEE, Swinoujście, pp 117–122 Mikolajczyk A, Grochowski M (2018) Data augmentation for improving deep learning in image classification problem. In: 2018 international interdisciplinary PhD workshop (IIPhDW). IEEE, Swinoujście, pp 117–122
11.
Zurück zum Zitat Taylor L, Nitschke G (2018) Improving deep learning with generic data augmentation. In: 2018 IEEE symposium series on computational intelligence (SSCI). IEEE, pp 1542–1547 Taylor L, Nitschke G (2018) Improving deep learning with generic data augmentation. In: 2018 IEEE symposium series on computational intelligence (SSCI). IEEE, pp 1542–1547
13.
Zurück zum Zitat Li Q, Cai W, Wang X, Zhou Y, Feng DD, Chen M (2014) Medical image classification with convolutional neural network. In: 2014 13th international conference on control automation robotics vision (ICARCV), pp 844–848 Li Q, Cai W, Wang X, Zhou Y, Feng DD, Chen M (2014) Medical image classification with convolutional neural network. In: 2014 13th international conference on control automation robotics vision (ICARCV), pp 844–848
14.
Zurück zum Zitat Mirza S, Mittal S, Zaman M (2018) Decision support predictive model for prognosis of diabetes using SMOTE and decision tree. Int J Appl Eng Res 13:9277–9282 Mirza S, Mittal S, Zaman M (2018) Decision support predictive model for prognosis of diabetes using SMOTE and decision tree. Int J Appl Eng Res 13:9277–9282
15.
Zurück zum Zitat Bellinger C, Drummond C, Japkowicz N (2016) Beyond the boundaries of SMOTE. In: Frasconi P, Landwehr N, Manco G, Vreeken J (eds) Machine learning and knowledge discovery in databases. Springer, Cham, pp 248–263CrossRef Bellinger C, Drummond C, Japkowicz N (2016) Beyond the boundaries of SMOTE. In: Frasconi P, Landwehr N, Manco G, Vreeken J (eds) Machine learning and knowledge discovery in databases. Springer, Cham, pp 248–263CrossRef
16.
Zurück zum Zitat Abeysinghe W, Hung C-C, Bechikh S, Wang X, Rattani A (2018) Clustering algorithms on imbalanced data using the SMOTE technique for image segmentation. In: Proceedings of the 2018 conference on research in adaptive and convergent systems. ACM, Honolulu Hawaii, pp 17–22 Abeysinghe W, Hung C-C, Bechikh S, Wang X, Rattani A (2018) Clustering algorithms on imbalanced data using the SMOTE technique for image segmentation. In: Proceedings of the 2018 conference on research in adaptive and convergent systems. ACM, Honolulu Hawaii, pp 17–22
17.
Zurück zum Zitat Dials J, Demirel D, Sanchez-Arias R, Halic T, Kruger U, De S, Gromski MA (2023) Skill-level classification and performance evaluation for endoscopic sleeve gastroplasty. Surg Endosc 1–12 Dials J, Demirel D, Sanchez-Arias R, Halic T, Kruger U, De S, Gromski MA (2023) Skill-level classification and performance evaluation for endoscopic sleeve gastroplasty. Surg Endosc 1–12
Metadaten
Titel
Endoscopic sleeve gastroplasty: stomach location and task classification for evaluation using artificial intelligence
verfasst von
James Dials
Doga Demirel
Reinaldo Sanchez-Arias
Tansel Halic
Suvranu De
Mark A. Gromski
Publikationsdatum
11.01.2024
Verlag
Springer International Publishing
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 4/2024
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-023-03054-2

Weitere Artikel der Ausgabe 4/2024

International Journal of Computer Assisted Radiology and Surgery 4/2024 Zur Ausgabe

Premium Partner