Skip to main content

2019 | OriginalPaper | Buchkapitel

Cephalometric Landmark Detection by Attentive Feature Pyramid Fusion and Regression-Voting

verfasst von : Runnan Chen, Yuexin Ma, Nenglun Chen, Daniel Lee, Wenping Wang

Erschienen in: Medical Image Computing and Computer Assisted Intervention – MICCAI 2019

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Marking anatomical landmarks in cephalometric radiography is a critical operation in cephalometric analysis. Automatically and accurately locating these landmarks is a challenging issue because different landmarks require different levels of resolutions and semantics. Based on this observation, we propose a novel attentive feature pyramid fusion module (AFPF) to explicitly shape high-resolution and semantically enhanced fusion features to achieve significantly higher accuracy than existing deep learning-based methods. We also combine heat maps and offset maps to perform pixel-wise regression-voting to improve detection accuracy. By incorporating the AFPF and regression-voting, we develop an end-to-end deep learning framework that improves detection accuracy by 7%11% for all the evaluation metrics over the state-of-the-art method. We present ablation studies to give more insights into different components of our method and demonstrate its generalization capability and stability for unseen data from diverse devices.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Ricketts, R.M., Roth, R.H., Chaconasand, S.J., Schulhof, R.J., Engel, G.A.: Orthodontic diagnosis and planning, vol. 1, p. 267. RMDS, Denver (1982) Ricketts, R.M., Roth, R.H., Chaconasand, S.J., Schulhof, R.J., Engel, G.A.: Orthodontic diagnosis and planning, vol. 1, p. 267. RMDS, Denver (1982)
2.
Zurück zum Zitat Levy-Mandel, A.D., Venetsanopoulos, A.N., Tsotsos, J.K.: Knowledge-based landmarking of cephalograms. CBR 19(3), 282–309 (1986) Levy-Mandel, A.D., Venetsanopoulos, A.N., Tsotsos, J.K.: Knowledge-based landmarking of cephalograms. CBR 19(3), 282–309 (1986)
3.
Zurück zum Zitat El-Feghi, I., Sid-Ahmed, M.A., Ahmadi, M.: Automatic localization of craniofacial landmarks for assisted cephalometry. Pattern Recogn. 37(3), 609–621 (2004)CrossRef El-Feghi, I., Sid-Ahmed, M.A., Ahmadi, M.: Automatic localization of craniofacial landmarks for assisted cephalometry. Pattern Recogn. 37(3), 609–621 (2004)CrossRef
4.
Zurück zum Zitat Cootes, T.F., Taylor, C.J., Cooper, D.H., Graham, J.: Active shape models-their training and application. CVIU 61(1), 38–59 (1995) Cootes, T.F., Taylor, C.J., Cooper, D.H., Graham, J.: Active shape models-their training and application. CVIU 61(1), 38–59 (1995)
5.
Zurück zum Zitat Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active appearance models. TPAMI 6, 681–685 (2001)CrossRef Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active appearance models. TPAMI 6, 681–685 (2001)CrossRef
6.
Zurück zum Zitat Ibragimov, B., Likar, B., Pernus, F., Vrtovec, T.: Automatic cephalometric x-ray landmark detection by applying game theory and random forests. In: Proceedings of ISBI International Symposium on Biomedical Imaging (2014) Ibragimov, B., Likar, B., Pernus, F., Vrtovec, T.: Automatic cephalometric x-ray landmark detection by applying game theory and random forests. In: Proceedings of ISBI International Symposium on Biomedical Imaging (2014)
7.
Zurück zum Zitat Lindner, C., Cootes, T.F.: Fully automatic cephalometric evaluation using random forest regression-voting. In: ISBI. Citeseer (2015) Lindner, C., Cootes, T.F.: Fully automatic cephalometric evaluation using random forest regression-voting. In: ISBI. Citeseer (2015)
8.
Zurück zum Zitat Wang, C., Huang, C., Hsieh, M., Li, C., et al.: Evaluation and comparison of anatomical landmark detection methods for cephalometric x-ray images: a grand challenge. TMI 34(9), 1890–1900 (2015) Wang, C., Huang, C., Hsieh, M., Li, C., et al.: Evaluation and comparison of anatomical landmark detection methods for cephalometric x-ray images: a grand challenge. TMI 34(9), 1890–1900 (2015)
9.
Zurück zum Zitat Wang, C., Huang, C., Lee, J., Li, C., Chang, S., et al.: A benchmark for comparison of dental radiography analysis algorithms. MIA 31, 63–76 (2016) Wang, C., Huang, C., Lee, J., Li, C., Chang, S., et al.: A benchmark for comparison of dental radiography analysis algorithms. MIA 31, 63–76 (2016)
10.
Zurück zum Zitat Lindner, C., Wang, C., Huang, C., Li, C., et al.: Fully automatic system for accurate localisation and analysis of cephalometric landmarks in lateral cephalograms. Sci. Rep. 6, 33581 (2016) CrossRef Lindner, C., Wang, C., Huang, C., Li, C., et al.: Fully automatic system for accurate localisation and analysis of cephalometric landmarks in lateral cephalograms. Sci. Rep. 6, 33581 (2016) CrossRef
11.
Zurück zum Zitat Arik, S., Ibragimov, B., Xing, L.: Fully automated quantitative cephalometry using convolutional neural networks. J. Med. Imaging 4(1), 014501 (2017)CrossRef Arik, S., Ibragimov, B., Xing, L.: Fully automated quantitative cephalometry using convolutional neural networks. J. Med. Imaging 4(1), 014501 (2017)CrossRef
12.
Zurück zum Zitat Yue, W., Yin, D., Li, C., Wang, G., Xu, T.: Automated 2-D cephalometric analysis on x-ray images by a model-based approach. TBE 53(8), 1615–1623 (2006) Yue, W., Yin, D., Li, C., Wang, G., Xu, T.: Automated 2-D cephalometric analysis on x-ray images by a model-based approach. TBE 53(8), 1615–1623 (2006)
13.
Zurück zum Zitat LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521(7553), 436 (2015)CrossRef LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521(7553), 436 (2015)CrossRef
14.
Zurück zum Zitat Litjens, G., Kooi, T., Bejnordi, B.E., et al.: A survey on deep learning in medical image analysis. MIA 42, 60–88 (2017) Litjens, G., Kooi, T., Bejnordi, B.E., et al.: A survey on deep learning in medical image analysis. MIA 42, 60–88 (2017)
15.
16.
Zurück zum Zitat He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: CVPR, pp. 770–778 (2016) He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: CVPR, pp. 770–778 (2016)
17.
Zurück zum Zitat Szegedy, C., et. al: Going deeper with convolutions. In: CVPR, pp. 1–9 (2015) Szegedy, C., et. al: Going deeper with convolutions. In: CVPR, pp. 1–9 (2015)
19.
Zurück zum Zitat Vaswani, A., Shazeer, N., Parmar, N., et al.: Attention is all you need. In: NIPS, pp. 5998–6008 (2017) Vaswani, A., Shazeer, N., Parmar, N., et al.: Attention is all you need. In: NIPS, pp. 5998–6008 (2017)
20.
Zurück zum Zitat Ibragimov, B., Likar, B., Pernus, F., Vrtovec, T.: Computerized cephalometry by game theory with shape-and appearance-based landmark refinement. In: ISBI (2015) Ibragimov, B., Likar, B., Pernus, F., Vrtovec, T.: Computerized cephalometry by game theory with shape-and appearance-based landmark refinement. In: ISBI (2015)
21.
Zurück zum Zitat Cardillo, J., Sid-Ahmed, M.A.: An image processing system for locating craniofacial landmarks. TMI 13(2), 275–289 (1994) Cardillo, J., Sid-Ahmed, M.A.: An image processing system for locating craniofacial landmarks. TMI 13(2), 275–289 (1994)
22.
Zurück zum Zitat Christian, P., Darko, Š, Horst, B., Martin, U.: Integrating spatial configuration into heatmap regression based CNNs for landmark localization. MIA (2019) Christian, P., Darko, Š, Horst, B., Martin, U.: Integrating spatial configuration into heatmap regression based CNNs for landmark localization. MIA (2019)
23.
Zurück zum Zitat Martin, U., Thomas, E., Darko, Š.: Integrating geometric configuration and appearance information into a unified framework for anatomical landmark localization. MIA 43, 23–36 (2018) Martin, U., Thomas, E., Darko, Š.: Integrating geometric configuration and appearance information into a unified framework for anatomical landmark localization. MIA 43, 23–36 (2018)
24.
Zurück zum Zitat Papandreou, G., Zhu, T., Kanazawa, N., et al.: Towards accurate multi-person pose estimation in the wild. In: CVPR, vol. 3, p. 6 (2017) Papandreou, G., Zhu, T., Kanazawa, N., et al.: Towards accurate multi-person pose estimation in the wild. In: CVPR, vol. 3, p. 6 (2017)
25.
Zurück zum Zitat Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: NIPS, pp. 1097–1105 (2012) Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: NIPS, pp. 1097–1105 (2012)
26.
Zurück zum Zitat Ma, Y., Zhu, X., Zhang, S., Yang, R., Wang, W., Manocha, D.: TrafficPredict: trajectory prediction for heterogeneous traffic-agents. arXiv:1811.02146 (2018) Ma, Y., Zhu, X., Zhang, S., Yang, R., Wang, W., Manocha, D.: TrafficPredict: trajectory prediction for heterogeneous traffic-agents. arXiv:​1811.​02146 (2018)
Metadaten
Titel
Cephalometric Landmark Detection by Attentive Feature Pyramid Fusion and Regression-Voting
verfasst von
Runnan Chen
Yuexin Ma
Nenglun Chen
Daniel Lee
Wenping Wang
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-32248-9_97

Premium Partner