Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 10/2021

21.07.2021 | Original Article

Automatic mandible segmentation from CT image using 3D fully convolutional neural network based on DenseASPP and attention gates

verfasst von: Jiangchang Xu, Jiannan Liu, Dingzhong Zhang, Zijie Zhou, Xiaoyi Jiang, Chenping Zhang, Xiaojun Chen

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 10/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Purpose

In cranio-maxillofacial surgery, it is of great clinical significance to segment mandible accurately and automatically from CT images. However, the connected region and blurred boundary in teeth and condyles make the process challenging. At present, the mandible is commonly segmented by experienced doctors using manually or semi-automatic methods, which is time-consuming and has poor segmentation consistency. In addition, existing automatic segmentation methods still have problems such as region misjudgment, low accuracy, and time-consuming.

Methods

For these issues, an automatic mandibular segmentation method using 3d fully convolutional neural network based on densely connected atrous spatial pyramid pooling (DenseASPP) and attention gates (AG) was proposed in this paper. Firstly, the DenseASPP module was added to the network for extracting dense features at multiple scales. Thereafter, the AG module was applied in each skip connection to diminish irrelevant background information and make the network focus on segmentation regions. Finally, a loss function combining dice coefficient and focal loss was used to solve the imbalance among sample categories.

Results

Test results showed that the proposed network obtained a relatively good segmentation result, with a Dice score of 97.588 ± 0.425%, Intersection over Union of 95.293 ± 0.812%, sensitivity of 96.252 ± 1.106%, average surface distance of 0.065 ± 0.020 mm and 95% Hausdorff distance of 0.491 ± 0.021 mm in segmentation accuracy. The comparison with other segmentation networks showed that our network not only had a relatively high segmentation accuracy but also effectively reduced the network's misjudgment. Meantime, the surface distance error also showed that our segmentation results were relatively close to the ground truth.

Conclusion

The proposed network has better segmentation performance and realizes accurate and automatic segmentation of the mandible. Furthermore, its segmentation time is 50.43 s for one CT scan, which greatly improves the doctor's work efficiency. It will have practical significance in cranio-maxillofacial surgery in the future.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Maschaa F, Winterb K, Pietzkaa S, Heufeldera M, Schramma A, Wilde F (2017) Accuracy of computer-assisted mandibular reconstructions using patient-specific implants in combination with CAD/CAM fabricated transfer keys. J Craniomaxillofac Surg 45(11):1884–1897CrossRef Maschaa F, Winterb K, Pietzkaa S, Heufeldera M, Schramma A, Wilde F (2017) Accuracy of computer-assisted mandibular reconstructions using patient-specific implants in combination with CAD/CAM fabricated transfer keys. J Craniomaxillofac Surg 45(11):1884–1897CrossRef
2.
Zurück zum Zitat Cristoforettia A, Stavolac LD, Fincatoc A, Mase M, Ravellib F, Nolloa G, Tessaroloa F (2019) Assessing the accuracy of computer-planned osteotomy guided by stereolithographic template: a methodological framework applied to the mandibular bone harvesting. Comput Biol Med 114:103435CrossRef Cristoforettia A, Stavolac LD, Fincatoc A, Mase M, Ravellib F, Nolloa G, Tessaroloa F (2019) Assessing the accuracy of computer-planned osteotomy guided by stereolithographic template: a methodological framework applied to the mandibular bone harvesting. Comput Biol Med 114:103435CrossRef
3.
Zurück zum Zitat Chen X, Xu L, Sun Y, Politis C (2016) A review of computer-aided oral and maxillofacial surgery: planning, simulation and navigation. Expert Rev Med Devices 13(11):1043–1051CrossRef Chen X, Xu L, Sun Y, Politis C (2016) A review of computer-aided oral and maxillofacial surgery: planning, simulation and navigation. Expert Rev Med Devices 13(11):1043–1051CrossRef
4.
Zurück zum Zitat Tang H, Chen X, Liu Y, Lu Z, You J, Yang M, Yao S, Zhao G, Xu Y, Chen T, Liu Y, Xie X (2019) Clinically applicable deep learning framework for organs at risk delineation in CT images. Nat Mach Intell 1:480–491CrossRef Tang H, Chen X, Liu Y, Lu Z, You J, Yang M, Yao S, Zhao G, Xu Y, Chen T, Liu Y, Xie X (2019) Clinically applicable deep learning framework for organs at risk delineation in CT images. Nat Mach Intell 1:480–491CrossRef
5.
Zurück zum Zitat Chuang Y, Doherty BM, Adluru N, Chung MK, Vorperian HK (2018) A novel registration-based semiautomatic mandible segmentation pipeline using computed tomography images to study mandibular development. J Comput Assist Tomogr 42:306–316CrossRef Chuang Y, Doherty BM, Adluru N, Chung MK, Vorperian HK (2018) A novel registration-based semiautomatic mandible segmentation pipeline using computed tomography images to study mandibular development. J Comput Assist Tomogr 42:306–316CrossRef
6.
Zurück zum Zitat Wallner J, Hochegger K, Chen X, Mischak I, Reinbacher K, Pau M, Zrnc T, Schwenzer-Zimmerer K, Zemann W, Schmalstieg D, Egger J (2018) Clinical evaluation of semi-automatic open-source algorithmic software segmentation of the mandibular bone: practical feasibility and assessment of a new course of action. PLoS ONE 13(5):e0196378CrossRef Wallner J, Hochegger K, Chen X, Mischak I, Reinbacher K, Pau M, Zrnc T, Schwenzer-Zimmerer K, Zemann W, Schmalstieg D, Egger J (2018) Clinical evaluation of semi-automatic open-source algorithmic software segmentation of the mandibular bone: practical feasibility and assessment of a new course of action. PLoS ONE 13(5):e0196378CrossRef
7.
Zurück zum Zitat Gass T, Szekely G, Goksel O (2014) Simultaneous segmentation and multiresolution nonrigid atlas registration. IEEE Trans Image Process 23(7):2931–2943CrossRef Gass T, Szekely G, Goksel O (2014) Simultaneous segmentation and multiresolution nonrigid atlas registration. IEEE Trans Image Process 23(7):2931–2943CrossRef
8.
Zurück zum Zitat Pei Y, Yi Y, Ma G, Kim T, Guo Y, Xu T, Zha H (2018) Spatially consistent supervoxel correspondences of cone-beam computed tomography images. IEEE Trans Med Imag 37(10):2310–2321CrossRef Pei Y, Yi Y, Ma G, Kim T, Guo Y, Xu T, Zha H (2018) Spatially consistent supervoxel correspondences of cone-beam computed tomography images. IEEE Trans Med Imag 37(10):2310–2321CrossRef
9.
Zurück zum Zitat Fan Y, Beare R, Matthews H, Schneider P, Kilpatrick N, Clement J, Claes P, Penington A, Adamson C (2019) Marker-based watershed transform method for fully automatic mandibular segmentation from CBCT images. Dentomaxillofac Radiol 48(2):20180261CrossRef Fan Y, Beare R, Matthews H, Schneider P, Kilpatrick N, Clement J, Claes P, Penington A, Adamson C (2019) Marker-based watershed transform method for fully automatic mandibular segmentation from CBCT images. Dentomaxillofac Radiol 48(2):20180261CrossRef
10.
Zurück zum Zitat Taghizadeh E, Terrier A, Becce F, Farron A, Büchler P (2019) Automated CT bone segmentation using statistical shape modelling and local template matching. Comput Methods Biomech Biomed Engin 22(16):1303–1310CrossRef Taghizadeh E, Terrier A, Becce F, Farron A, Büchler P (2019) Automated CT bone segmentation using statistical shape modelling and local template matching. Comput Methods Biomech Biomed Engin 22(16):1303–1310CrossRef
11.
Zurück zum Zitat Xu J, Jing M, Wang S, Yang C, Chen X (2019) A review of medical image detection for cancers in digestive system based on artificial intelligence. Expert Rev Med Dev 16(10):877–889CrossRef Xu J, Jing M, Wang S, Yang C, Chen X (2019) A review of medical image detection for cancers in digestive system based on artificial intelligence. Expert Rev Med Dev 16(10):877–889CrossRef
12.
Zurück zum Zitat Ibragimov B, Xing L (2017) Segmentation of organs-at-risks in head and neck CT images using convolutional neural networks. Med Phys 44(2):547–557CrossRef Ibragimov B, Xing L (2017) Segmentation of organs-at-risks in head and neck CT images using convolutional neural networks. Med Phys 44(2):547–557CrossRef
13.
Zurück zum Zitat Yan M, Guo J, Tian W, Yi Z (2018) Symmetric convolutional neural network for mandible segmentation. Knowl Based Syst 159:63–71CrossRef Yan M, Guo J, Tian W, Yi Z (2018) Symmetric convolutional neural network for mandible segmentation. Knowl Based Syst 159:63–71CrossRef
14.
Zurück zum Zitat Qiu B, Guo J, Kraeima J, Glas HH, Borra RJH, Witjes MJH, Ooijen PMAV (2019) Automatic segmentation of the mandible from computed tomography scans for 3D virtual surgical planning using the convolutional neural network. Phys Med Biol 64(17):175020CrossRef Qiu B, Guo J, Kraeima J, Glas HH, Borra RJH, Witjes MJH, Ooijen PMAV (2019) Automatic segmentation of the mandible from computed tomography scans for 3D virtual surgical planning using the convolutional neural network. Phys Med Biol 64(17):175020CrossRef
15.
Zurück zum Zitat Gou S, Tong N, Qi S, Yang S, Chin R, Sheng K (2020) Self-channel-and-spatial-attention neural network for automated multi-organ segmentation on head and neck CT images. Phys Med Biol 65:245034CrossRef Gou S, Tong N, Qi S, Yang S, Chin R, Sheng K (2020) Self-channel-and-spatial-attention neural network for automated multi-organ segmentation on head and neck CT images. Phys Med Biol 65:245034CrossRef
16.
Zurück zum Zitat Yong M, Yu K, Zhang C, Li Z, Yang K (2018) Denseaspp for semantic segmentation in street scenes. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 3684–3692 Yong M, Yu K, Zhang C, Li Z, Yang K (2018) Denseaspp for semantic segmentation in street scenes. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 3684–3692
17.
Zurück zum Zitat Oktay, O, Schlemper J, Folgoc LL, Lee M, Heinrich M, Misawa K, Mori K, McDonagh S, Hammerla NY, Kainz B, Glocker B, Rueckert D (2018) Attention U-Net: learning where to look for the pancreas. arXiv preprint, http://arxiv.org/abs/1804.03999 Oktay, O, Schlemper J, Folgoc LL, Lee M, Heinrich M, Misawa K, Mori K, McDonagh S, Hammerla NY, Kainz B, Glocker B, Rueckert D (2018) Attention U-Net: learning where to look for the pancreas. arXiv preprint, http://​arxiv.​org/​abs/​1804.​03999
18.
Zurück zum Zitat Lin T, Goyal P, Girshick R, He K, Dollar P (2020) Focal loss for dense object detection. IEEE Trans Pattern Anal Mach Intell 42(2):318–327CrossRef Lin T, Goyal P, Girshick R, He K, Dollar P (2020) Focal loss for dense object detection. IEEE Trans Pattern Anal Mach Intell 42(2):318–327CrossRef
19.
Zurück zum Zitat Wu Y, He K (2020) Group normalization. Int J Comput Vision 128(3):742–755CrossRef Wu Y, He K (2020) Group normalization. Int J Comput Vision 128(3):742–755CrossRef
21.
Zurück zum Zitat Shelhamer E, Long J, Darrell T (2015) Fully convolutional networks for semantic segmentation. IEEE Trans Pattern Anal Mach Intell 39(4):640–651CrossRef Shelhamer E, Long J, Darrell T (2015) Fully convolutional networks for semantic segmentation. IEEE Trans Pattern Anal Mach Intell 39(4):640–651CrossRef
22.
Zurück zum Zitat Ronneberger O, Fischer P, Brox T (2015) U-Net: convolutional networks for biomedical image segmentation. In: Proceedings of the international conference on medical image computing and computer-assisted intervention, Springer, Cham, pp 234–241 Ronneberger O, Fischer P, Brox T (2015) U-Net: convolutional networks for biomedical image segmentation. In: Proceedings of the international conference on medical image computing and computer-assisted intervention, Springer, Cham, pp 234–241
23.
Zurück zum Zitat Milletari F, Navab N, Ahmadi SA (2016) V-Net: fully convolutional neural networks for volumetric medical image segmentation. In: Proceedings of the IEEE fourth international conference on 3D vision, pp 565–571 Milletari F, Navab N, Ahmadi SA (2016) V-Net: fully convolutional neural networks for volumetric medical image segmentation. In: Proceedings of the IEEE fourth international conference on 3D vision, pp 565–571
24.
Zurück zum Zitat Raith S, Wolff S, Steiner T, Modabber A, Weber M, Hölzle F, Fischer H (2017) Planning of mandibular reconstructions based on statistical shape models. Int J Comput Assist Radiol Surg 15:1457–1465 Raith S, Wolff S, Steiner T, Modabber A, Weber M, Hölzle F, Fischer H (2017) Planning of mandibular reconstructions based on statistical shape models. Int J Comput Assist Radiol Surg 15:1457–1465
25.
Zurück zum Zitat Zhu X, Han J, Zhou Z, Min X, Zhang Q, Liu J, Zhai G (2019) Improving accuracy of jaw reconstruction based on gender differences. J Oral Maxillofac Surg 78:662.e1-662.e13CrossRef Zhu X, Han J, Zhou Z, Min X, Zhang Q, Liu J, Zhai G (2019) Improving accuracy of jaw reconstruction based on gender differences. J Oral Maxillofac Surg 78:662.e1-662.e13CrossRef
Metadaten
Titel
Automatic mandible segmentation from CT image using 3D fully convolutional neural network based on DenseASPP and attention gates
verfasst von
Jiangchang Xu
Jiannan Liu
Dingzhong Zhang
Zijie Zhou
Xiaoyi Jiang
Chenping Zhang
Xiaojun Chen
Publikationsdatum
21.07.2021
Verlag
Springer International Publishing
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 10/2021
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-021-02447-5

Weitere Artikel der Ausgabe 10/2021

International Journal of Computer Assisted Radiology and Surgery 10/2021 Zur Ausgabe

Premium Partner