Skip to main content
Top

2022 | OriginalPaper | Chapter

CNN Approach for Monocular Depth Estimation: Ear Case Study

Authors : Roberto Magherini, Michaela Servi, Elisa Mussi, Rocco Furferi, Francesco Buonamici, Yary Volpe

Published in: Design Tools and Methods in Industrial Engineering II

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The realization of medical devices to assist the surgeon in autologous auricular reconstruction (personalized surgical guides) requires the use of depth maps images obtained from 3D scans of the patient's profile. In order to make the process of ear geometry acquisition and depth map realization faster, more comfortable for the patient and easily accessible by hospital staff, this work proposes a system able to create depth maps from a single RGB image. The proposed approach involves the integration of tools based on convolutional neural networks to build a modular system capable of isolating the ear from the profile, creating the corresponding depth map, and refining it to correct inaccuracies. The system was trained and tested using a database of human profile images and corresponding depth maps made available by the University of Notre Dame. To evaluate the result in this preliminary study, standard metrics such as mean square error and structural similarity were used, yielding results suitable for the targeted application.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Dodziuk, H.: Applications of 3D printing in healthcare. Kardiochirurgia i Torakochirurgia Pol. 3, 283–293 (2016) Dodziuk, H.: Applications of 3D printing in healthcare. Kardiochirurgia i Torakochirurgia Pol. 3, 283–293 (2016)
2.
go back to reference AlAli, A.B., Griffin, M.F., Butler, P.E.: Three-dimensional printing surgical applications. Eplasty 15, e37 (2015) AlAli, A.B., Griffin, M.F., Butler, P.E.: Three-dimensional printing surgical applications. Eplasty 15, e37 (2015)
3.
go back to reference Nagata, S.: A new method of total reconstruction of the auricle for microtia. Plast. Reconstr. Surg. 92, 187–201 (1993) Nagata, S.: A new method of total reconstruction of the auricle for microtia. Plast. Reconstr. Surg. 92, 187–201 (1993)
4.
go back to reference Storck, K., et al.: Total reconstruction of the auricle: our experiences on indications and recent techniques. Biomed Res. Int. (2014) Storck, K., et al.: Total reconstruction of the auricle: our experiences on indications and recent techniques. Biomed Res. Int. (2014)
5.
go back to reference Facchini, F., Morabito, A., Buonamici, F., Mussi, E., Servi, M., Volpe, Y.: Autologous ear reconstruction: towards a semiautomatic CAD-based procedure for 3D printable surgical guides. In: CAD Solutions, LLC., pp. 1–5 (2020) Facchini, F., Morabito, A., Buonamici, F., Mussi, E., Servi, M., Volpe, Y.: Autologous ear reconstruction: towards a semiautomatic CAD-based procedure for 3D printable surgical guides. In: CAD Solutions, LLC., pp. 1–5 (2020)
6.
go back to reference Zhu, P., Chen, S.: Clinical outcomes following ear reconstruction with adjuvant 3D template model. Acta Otolaryngol. 136, 1236–1241 (2016) Zhu, P., Chen, S.: Clinical outcomes following ear reconstruction with adjuvant 3D template model. Acta Otolaryngol. 136, 1236–1241 (2016)
8.
go back to reference Mussi, E., Servi, M., Facchini, F., Furferi, R., Governi, L., Volpe, Y.: A novel ear elements segmentation algorithm on depth map images. Comput. Biol. Med. 129, 104–157 (2021) Mussi, E., Servi, M., Facchini, F., Furferi, R., Governi, L., Volpe, Y.: A novel ear elements segmentation algorithm on depth map images. Comput. Biol. Med. 129, 104–157 (2021)
9.
go back to reference Alonso, M.: Y-GAN: a generative adversarial network for depthmap estimation from multi-camera stereo images. In: arXiv (2019) Alonso, M.: Y-GAN: a generative adversarial network for depthmap estimation from multi-camera stereo images. In: arXiv (2019)
10.
go back to reference Lore, K.G., Reddy, K., Giering, M., Bernal, E.A.: Generative adversarial networks for depth map estimation from RGB video. In: IEEE CVPRW, pp. 1258–12588 (2018) Lore, K.G., Reddy, K., Giering, M., Bernal, E.A.: Generative adversarial networks for depth map estimation from RGB video. In: IEEE CVPRW, pp. 1258–12588 (2018)
11.
go back to reference Eigen, D., Puhrsch, C., Fergus, R.: Depth map prediction from a single image using a multi-scale deep network. In: Advances Neural Information Processing System, vol. 3, pp. 2366–2374 (2014) Eigen, D., Puhrsch, C., Fergus, R.: Depth map prediction from a single image using a multi-scale deep network. In: Advances Neural Information Processing System, vol. 3, pp. 2366–2374 (2014)
12.
go back to reference Kwak, D.H., Lee, S.H.: A novel method for estimating monocular depth using cycle gan and segmentation. Sensors (Switzerland) 20 (2020) Kwak, D.H., Lee, S.H.: A novel method for estimating monocular depth using cycle gan and segmentation. Sensors (Switzerland) 20 (2020)
13.
go back to reference Kwon, Y.-H., Park, M.-G.: Predicting future frames using retrospective cycle GAN. In: IEEE/CVF, pp. 1811–1820 (2019) Kwon, Y.-H., Park, M.-G.: Predicting future frames using retrospective cycle GAN. In: IEEE/CVF, pp. 1811–1820 (2019)
14.
go back to reference Niklaus, S., Mai, L., Yang, J., Liu, F.: 3D ken burns effect from a single image, vol. 38, p. 15. In: arXiv (2019) Niklaus, S., Mai, L., Yang, J., Liu, F.: 3D ken burns effect from a single image, vol. 38, p. 15. In: arXiv (2019)
15.
go back to reference Yan., P., Bowyer, K.: Empirical evaluation of advanced ear biometrics. In: IEEE, p. 41 (2006) Yan., P., Bowyer, K.: Empirical evaluation of advanced ear biometrics. In: IEEE, p. 41 (2006)
16.
go back to reference Yan, P., Bowyer, K.W.: An automatic 3D ear recognition system. In: 3DPVT, pp. 326–333 (2006) Yan, P., Bowyer, K.W.: An automatic 3D ear recognition system. In: 3DPVT, pp. 326–333 (2006)
17.
go back to reference Bizjak, M., Peer, P., Emeršic, Ž.: Mask R-CNN for ear detection. In: MIPRO, pp. 1624–1628 (2019) Bizjak, M., Peer, P., Emeršic, Ž.: Mask R-CNN for ear detection. In: MIPRO, pp. 1624–1628 (2019)
18.
go back to reference Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the inception architecture for computer vision. In: IEEE/CVPR, pp. 2818–2826 (2016) Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the inception architecture for computer vision. In: IEEE/CVPR, pp. 2818–2826 (2016)
19.
go back to reference Goodfellow, I.J., et al.: Generative adversarial nets. In: NIPS, vol. 2, pp. 2672–2680 (2014) Goodfellow, I.J., et al.: Generative adversarial nets. In: NIPS, vol. 2, pp. 2672–2680 (2014)
20.
go back to reference Chen, X., Gupta, A.: An implementation of faster RCNN with study for region sampling. In: arXiv (2017) Chen, X., Gupta, A.: An implementation of faster RCNN with study for region sampling. In: arXiv (2017)
23.
go back to reference Shmelkov, K., Schmid, C., Alahari, K.: How good is my GAN? In: arXiv (2018) Shmelkov, K., Schmid, C., Alahari, K.: How good is my GAN? In: arXiv (2018)
24.
go back to reference Zhang, L., Wu, X.: Color demosaicking via directional linear minimum mean square-error estimation. IEEE Trans. Image Process. 14, 2167–2178 (2005) Zhang, L., Wu, X.: Color demosaicking via directional linear minimum mean square-error estimation. IEEE Trans. Image Process. 14, 2167–2178 (2005)
25.
go back to reference Dosselmann, R., Yang, X.D.: A comprehensive assessment of the structural similarity index. Signal Image Video Process 5, 81–91 (2011) Dosselmann, R., Yang, X.D.: A comprehensive assessment of the structural similarity index. Signal Image Video Process 5, 81–91 (2011)
Metadata
Title
CNN Approach for Monocular Depth Estimation: Ear Case Study
Authors
Roberto Magherini
Michaela Servi
Elisa Mussi
Rocco Furferi
Francesco Buonamici
Yary Volpe
Copyright Year
2022
DOI
https://doi.org/10.1007/978-3-030-91234-5_22

Premium Partners