Skip to main content
Top
Published in: International Journal of Computer Assisted Radiology and Surgery 10/2021

21-07-2021 | Original Article

Automatic mandible segmentation from CT image using 3D fully convolutional neural network based on DenseASPP and attention gates

Authors: Jiangchang Xu, Jiannan Liu, Dingzhong Zhang, Zijie Zhou, Xiaoyi Jiang, Chenping Zhang, Xiaojun Chen

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 10/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Purpose

In cranio-maxillofacial surgery, it is of great clinical significance to segment mandible accurately and automatically from CT images. However, the connected region and blurred boundary in teeth and condyles make the process challenging. At present, the mandible is commonly segmented by experienced doctors using manually or semi-automatic methods, which is time-consuming and has poor segmentation consistency. In addition, existing automatic segmentation methods still have problems such as region misjudgment, low accuracy, and time-consuming.

Methods

For these issues, an automatic mandibular segmentation method using 3d fully convolutional neural network based on densely connected atrous spatial pyramid pooling (DenseASPP) and attention gates (AG) was proposed in this paper. Firstly, the DenseASPP module was added to the network for extracting dense features at multiple scales. Thereafter, the AG module was applied in each skip connection to diminish irrelevant background information and make the network focus on segmentation regions. Finally, a loss function combining dice coefficient and focal loss was used to solve the imbalance among sample categories.

Results

Test results showed that the proposed network obtained a relatively good segmentation result, with a Dice score of 97.588 ± 0.425%, Intersection over Union of 95.293 ± 0.812%, sensitivity of 96.252 ± 1.106%, average surface distance of 0.065 ± 0.020 mm and 95% Hausdorff distance of 0.491 ± 0.021 mm in segmentation accuracy. The comparison with other segmentation networks showed that our network not only had a relatively high segmentation accuracy but also effectively reduced the network's misjudgment. Meantime, the surface distance error also showed that our segmentation results were relatively close to the ground truth.

Conclusion

The proposed network has better segmentation performance and realizes accurate and automatic segmentation of the mandible. Furthermore, its segmentation time is 50.43 s for one CT scan, which greatly improves the doctor's work efficiency. It will have practical significance in cranio-maxillofacial surgery in the future.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Maschaa F, Winterb K, Pietzkaa S, Heufeldera M, Schramma A, Wilde F (2017) Accuracy of computer-assisted mandibular reconstructions using patient-specific implants in combination with CAD/CAM fabricated transfer keys. J Craniomaxillofac Surg 45(11):1884–1897CrossRef Maschaa F, Winterb K, Pietzkaa S, Heufeldera M, Schramma A, Wilde F (2017) Accuracy of computer-assisted mandibular reconstructions using patient-specific implants in combination with CAD/CAM fabricated transfer keys. J Craniomaxillofac Surg 45(11):1884–1897CrossRef
2.
go back to reference Cristoforettia A, Stavolac LD, Fincatoc A, Mase M, Ravellib F, Nolloa G, Tessaroloa F (2019) Assessing the accuracy of computer-planned osteotomy guided by stereolithographic template: a methodological framework applied to the mandibular bone harvesting. Comput Biol Med 114:103435CrossRef Cristoforettia A, Stavolac LD, Fincatoc A, Mase M, Ravellib F, Nolloa G, Tessaroloa F (2019) Assessing the accuracy of computer-planned osteotomy guided by stereolithographic template: a methodological framework applied to the mandibular bone harvesting. Comput Biol Med 114:103435CrossRef
3.
go back to reference Chen X, Xu L, Sun Y, Politis C (2016) A review of computer-aided oral and maxillofacial surgery: planning, simulation and navigation. Expert Rev Med Devices 13(11):1043–1051CrossRef Chen X, Xu L, Sun Y, Politis C (2016) A review of computer-aided oral and maxillofacial surgery: planning, simulation and navigation. Expert Rev Med Devices 13(11):1043–1051CrossRef
4.
go back to reference Tang H, Chen X, Liu Y, Lu Z, You J, Yang M, Yao S, Zhao G, Xu Y, Chen T, Liu Y, Xie X (2019) Clinically applicable deep learning framework for organs at risk delineation in CT images. Nat Mach Intell 1:480–491CrossRef Tang H, Chen X, Liu Y, Lu Z, You J, Yang M, Yao S, Zhao G, Xu Y, Chen T, Liu Y, Xie X (2019) Clinically applicable deep learning framework for organs at risk delineation in CT images. Nat Mach Intell 1:480–491CrossRef
5.
go back to reference Chuang Y, Doherty BM, Adluru N, Chung MK, Vorperian HK (2018) A novel registration-based semiautomatic mandible segmentation pipeline using computed tomography images to study mandibular development. J Comput Assist Tomogr 42:306–316CrossRef Chuang Y, Doherty BM, Adluru N, Chung MK, Vorperian HK (2018) A novel registration-based semiautomatic mandible segmentation pipeline using computed tomography images to study mandibular development. J Comput Assist Tomogr 42:306–316CrossRef
6.
go back to reference Wallner J, Hochegger K, Chen X, Mischak I, Reinbacher K, Pau M, Zrnc T, Schwenzer-Zimmerer K, Zemann W, Schmalstieg D, Egger J (2018) Clinical evaluation of semi-automatic open-source algorithmic software segmentation of the mandibular bone: practical feasibility and assessment of a new course of action. PLoS ONE 13(5):e0196378CrossRef Wallner J, Hochegger K, Chen X, Mischak I, Reinbacher K, Pau M, Zrnc T, Schwenzer-Zimmerer K, Zemann W, Schmalstieg D, Egger J (2018) Clinical evaluation of semi-automatic open-source algorithmic software segmentation of the mandibular bone: practical feasibility and assessment of a new course of action. PLoS ONE 13(5):e0196378CrossRef
7.
go back to reference Gass T, Szekely G, Goksel O (2014) Simultaneous segmentation and multiresolution nonrigid atlas registration. IEEE Trans Image Process 23(7):2931–2943CrossRef Gass T, Szekely G, Goksel O (2014) Simultaneous segmentation and multiresolution nonrigid atlas registration. IEEE Trans Image Process 23(7):2931–2943CrossRef
8.
go back to reference Pei Y, Yi Y, Ma G, Kim T, Guo Y, Xu T, Zha H (2018) Spatially consistent supervoxel correspondences of cone-beam computed tomography images. IEEE Trans Med Imag 37(10):2310–2321CrossRef Pei Y, Yi Y, Ma G, Kim T, Guo Y, Xu T, Zha H (2018) Spatially consistent supervoxel correspondences of cone-beam computed tomography images. IEEE Trans Med Imag 37(10):2310–2321CrossRef
9.
go back to reference Fan Y, Beare R, Matthews H, Schneider P, Kilpatrick N, Clement J, Claes P, Penington A, Adamson C (2019) Marker-based watershed transform method for fully automatic mandibular segmentation from CBCT images. Dentomaxillofac Radiol 48(2):20180261CrossRef Fan Y, Beare R, Matthews H, Schneider P, Kilpatrick N, Clement J, Claes P, Penington A, Adamson C (2019) Marker-based watershed transform method for fully automatic mandibular segmentation from CBCT images. Dentomaxillofac Radiol 48(2):20180261CrossRef
10.
go back to reference Taghizadeh E, Terrier A, Becce F, Farron A, Büchler P (2019) Automated CT bone segmentation using statistical shape modelling and local template matching. Comput Methods Biomech Biomed Engin 22(16):1303–1310CrossRef Taghizadeh E, Terrier A, Becce F, Farron A, Büchler P (2019) Automated CT bone segmentation using statistical shape modelling and local template matching. Comput Methods Biomech Biomed Engin 22(16):1303–1310CrossRef
11.
go back to reference Xu J, Jing M, Wang S, Yang C, Chen X (2019) A review of medical image detection for cancers in digestive system based on artificial intelligence. Expert Rev Med Dev 16(10):877–889CrossRef Xu J, Jing M, Wang S, Yang C, Chen X (2019) A review of medical image detection for cancers in digestive system based on artificial intelligence. Expert Rev Med Dev 16(10):877–889CrossRef
12.
go back to reference Ibragimov B, Xing L (2017) Segmentation of organs-at-risks in head and neck CT images using convolutional neural networks. Med Phys 44(2):547–557CrossRef Ibragimov B, Xing L (2017) Segmentation of organs-at-risks in head and neck CT images using convolutional neural networks. Med Phys 44(2):547–557CrossRef
13.
go back to reference Yan M, Guo J, Tian W, Yi Z (2018) Symmetric convolutional neural network for mandible segmentation. Knowl Based Syst 159:63–71CrossRef Yan M, Guo J, Tian W, Yi Z (2018) Symmetric convolutional neural network for mandible segmentation. Knowl Based Syst 159:63–71CrossRef
14.
go back to reference Qiu B, Guo J, Kraeima J, Glas HH, Borra RJH, Witjes MJH, Ooijen PMAV (2019) Automatic segmentation of the mandible from computed tomography scans for 3D virtual surgical planning using the convolutional neural network. Phys Med Biol 64(17):175020CrossRef Qiu B, Guo J, Kraeima J, Glas HH, Borra RJH, Witjes MJH, Ooijen PMAV (2019) Automatic segmentation of the mandible from computed tomography scans for 3D virtual surgical planning using the convolutional neural network. Phys Med Biol 64(17):175020CrossRef
15.
go back to reference Gou S, Tong N, Qi S, Yang S, Chin R, Sheng K (2020) Self-channel-and-spatial-attention neural network for automated multi-organ segmentation on head and neck CT images. Phys Med Biol 65:245034CrossRef Gou S, Tong N, Qi S, Yang S, Chin R, Sheng K (2020) Self-channel-and-spatial-attention neural network for automated multi-organ segmentation on head and neck CT images. Phys Med Biol 65:245034CrossRef
16.
go back to reference Yong M, Yu K, Zhang C, Li Z, Yang K (2018) Denseaspp for semantic segmentation in street scenes. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 3684–3692 Yong M, Yu K, Zhang C, Li Z, Yang K (2018) Denseaspp for semantic segmentation in street scenes. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 3684–3692
17.
go back to reference Oktay, O, Schlemper J, Folgoc LL, Lee M, Heinrich M, Misawa K, Mori K, McDonagh S, Hammerla NY, Kainz B, Glocker B, Rueckert D (2018) Attention U-Net: learning where to look for the pancreas. arXiv preprint, http://arxiv.org/abs/1804.03999 Oktay, O, Schlemper J, Folgoc LL, Lee M, Heinrich M, Misawa K, Mori K, McDonagh S, Hammerla NY, Kainz B, Glocker B, Rueckert D (2018) Attention U-Net: learning where to look for the pancreas. arXiv preprint, http://​arxiv.​org/​abs/​1804.​03999
18.
go back to reference Lin T, Goyal P, Girshick R, He K, Dollar P (2020) Focal loss for dense object detection. IEEE Trans Pattern Anal Mach Intell 42(2):318–327CrossRef Lin T, Goyal P, Girshick R, He K, Dollar P (2020) Focal loss for dense object detection. IEEE Trans Pattern Anal Mach Intell 42(2):318–327CrossRef
19.
go back to reference Wu Y, He K (2020) Group normalization. Int J Comput Vision 128(3):742–755CrossRef Wu Y, He K (2020) Group normalization. Int J Comput Vision 128(3):742–755CrossRef
21.
go back to reference Shelhamer E, Long J, Darrell T (2015) Fully convolutional networks for semantic segmentation. IEEE Trans Pattern Anal Mach Intell 39(4):640–651CrossRef Shelhamer E, Long J, Darrell T (2015) Fully convolutional networks for semantic segmentation. IEEE Trans Pattern Anal Mach Intell 39(4):640–651CrossRef
22.
go back to reference Ronneberger O, Fischer P, Brox T (2015) U-Net: convolutional networks for biomedical image segmentation. In: Proceedings of the international conference on medical image computing and computer-assisted intervention, Springer, Cham, pp 234–241 Ronneberger O, Fischer P, Brox T (2015) U-Net: convolutional networks for biomedical image segmentation. In: Proceedings of the international conference on medical image computing and computer-assisted intervention, Springer, Cham, pp 234–241
23.
go back to reference Milletari F, Navab N, Ahmadi SA (2016) V-Net: fully convolutional neural networks for volumetric medical image segmentation. In: Proceedings of the IEEE fourth international conference on 3D vision, pp 565–571 Milletari F, Navab N, Ahmadi SA (2016) V-Net: fully convolutional neural networks for volumetric medical image segmentation. In: Proceedings of the IEEE fourth international conference on 3D vision, pp 565–571
24.
go back to reference Raith S, Wolff S, Steiner T, Modabber A, Weber M, Hölzle F, Fischer H (2017) Planning of mandibular reconstructions based on statistical shape models. Int J Comput Assist Radiol Surg 15:1457–1465 Raith S, Wolff S, Steiner T, Modabber A, Weber M, Hölzle F, Fischer H (2017) Planning of mandibular reconstructions based on statistical shape models. Int J Comput Assist Radiol Surg 15:1457–1465
25.
go back to reference Zhu X, Han J, Zhou Z, Min X, Zhang Q, Liu J, Zhai G (2019) Improving accuracy of jaw reconstruction based on gender differences. J Oral Maxillofac Surg 78:662.e1-662.e13CrossRef Zhu X, Han J, Zhou Z, Min X, Zhang Q, Liu J, Zhai G (2019) Improving accuracy of jaw reconstruction based on gender differences. J Oral Maxillofac Surg 78:662.e1-662.e13CrossRef
Metadata
Title
Automatic mandible segmentation from CT image using 3D fully convolutional neural network based on DenseASPP and attention gates
Authors
Jiangchang Xu
Jiannan Liu
Dingzhong Zhang
Zijie Zhou
Xiaoyi Jiang
Chenping Zhang
Xiaojun Chen
Publication date
21-07-2021
Publisher
Springer International Publishing
Published in
International Journal of Computer Assisted Radiology and Surgery / Issue 10/2021
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-021-02447-5

Other articles of this Issue 10/2021

International Journal of Computer Assisted Radiology and Surgery 10/2021 Go to the issue

Premium Partner