Skip to main content
Top

2019 | OriginalPaper | Chapter

Calibrating TOF Sensor by Fusing Normal Maps

Authors : Hanyu Ni, Yiguang Liu, Zhenyu Xu, Jianyu Heng, Ling Jin

Published in: The Proceedings of the International Conference on Sensing and Imaging

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The time-of-flight (TOF) sensor can capture 3D surfaces very fast. However, it suffers from noises and low resolution, which limits its applications. To improve the resolution of TOF sensor, this paper proposes a novel method to fuse depth images and normal maps with complementary information. Different from traditional methods, which typically use photometric stereo (PS) to obtain normal maps, in our method, one extra light source is added to obtain normal maps via the Kinect sensor. Optimal depth images are then obtained by bilateral filter. Experimental results show that our method can produce more accurate depth images with smoother-looking object surfaces.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Oggier T, Buttgen B, Lustenberger F, Becker G, Ruegg B, Hodac A (2005) Swissranger sr3000 and first experiences based on miniaturized 3D-ToF cameras. In: Proceedings of the first range imaging research day at ETH Zurich Oggier T, Buttgen B, Lustenberger F, Becker G, Ruegg B, Hodac A (2005) Swissranger sr3000 and first experiences based on miniaturized 3D-ToF cameras. In: Proceedings of the first range imaging research day at ETH Zurich
3.
go back to reference Furukawa Y, Ponce J (2007) Accurate, dense, and robust multi-view stereopsis. In: CVPR 07 Furukawa Y, Ponce J (2007) Accurate, dense, and robust multi-view stereopsis. In: CVPR 07
4.
go back to reference Besl PJ, Mckay ND (1992) A method for registration of 3-D shapes. In: Sensor fusion IV: control paradigms and data structures, pp 239–256 Besl PJ, Mckay ND (1992) A method for registration of 3-D shapes. In: Sensor fusion IV: control paradigms and data structures, pp 239–256
5.
go back to reference Cui Y, Schuon S, Chan D et al (2010) 3D shape scanning with a time-of-flight camera. In: Computer vision and pattern recognition, IEEE, pp 1173–1180 Cui Y, Schuon S, Chan D et al (2010) 3D shape scanning with a time-of-flight camera. In: Computer vision and pattern recognition, IEEE, pp 1173–1180
6.
go back to reference Liu JL, Su-Mei LI, Yong-Da LI et al (2016) High-resolution depth maps based on TOF-stereo fusion. Inform Technol Liu JL, Su-Mei LI, Yong-Da LI et al (2016) High-resolution depth maps based on TOF-stereo fusion. Inform Technol
7.
go back to reference Marin G, Zanuttigh P, Mattoccia S (2016) Reliable fusion of ToF and stereo depth drivenby confidence measures. In: Computer vision C ECCV 2016. Springer International Publishing Marin G, Zanuttigh P, Mattoccia S (2016) Reliable fusion of ToF and stereo depth drivenby confidence measures. In: Computer vision C ECCV 2016. Springer International Publishing
8.
go back to reference Nair R, Lenzen F, Meister S et al (2012) High accuracy TOF and stereo sensor fusion at interactive rates. In: International conference on computer vision. Springer, pp 1–11 Nair R, Lenzen F, Meister S et al (2012) High accuracy TOF and stereo sensor fusion at interactive rates. In: International conference on computer vision. Springer, pp 1–11
9.
go back to reference Schwarz S, Sjostrom M, Olsson R (2013) A weighted optimization approach to time-of-flight sensor fusion. IEEE Trans Image Process Publ IEEE Signal Process Soc 23(1):214MathSciNetCrossRef Schwarz S, Sjostrom M, Olsson R (2013) A weighted optimization approach to time-of-flight sensor fusion. IEEE Trans Image Process Publ IEEE Signal Process Soc 23(1):214MathSciNetCrossRef
10.
go back to reference Yu H, Zhao K, Wang Y et al (2013) Registration and fusion for ToF camera and 2D camera reading. In: Chinese automation congress, pp 679–684 Yu H, Zhao K, Wang Y et al (2013) Registration and fusion for ToF camera and 2D camera reading. In: Chinese automation congress, pp 679–684
11.
go back to reference Zhang Y, Xiong Z, Wu F (2015) Fusion of time-of-flight and phase shifting for high-resolution and low-latency depth sensing. In: IEEE international conference on multimedia and expo. IEEE, pp 1–6 Zhang Y, Xiong Z, Wu F (2015) Fusion of time-of-flight and phase shifting for high-resolution and low-latency depth sensing. In: IEEE international conference on multimedia and expo. IEEE, pp 1–6
12.
go back to reference Gandhi V, Cech J, Horaud R (2012) High-resolution depth maps based on TOF-stereo fusion. In: IEEE international conference on robotics and automation. IEEE, pp 4742–4749 Gandhi V, Cech J, Horaud R (2012) High-resolution depth maps based on TOF-stereo fusion. In: IEEE international conference on robotics and automation. IEEE, pp 4742–4749
13.
go back to reference Salinas C, Fernndez R, Montes H et al (2015) A new approach for combining time-of-flight and RGB cameras based on depth-dependent planar projective transformations. Sensors 15(9):24615–24643CrossRef Salinas C, Fernndez R, Montes H et al (2015) A new approach for combining time-of-flight and RGB cameras based on depth-dependent planar projective transformations. Sensors 15(9):24615–24643CrossRef
14.
go back to reference Paris S, Kornprobst P, Tumblin J (2009) Bilateral filtering. Int J Numer Methods Eng 63(13):1911–1938MATH Paris S, Kornprobst P, Tumblin J (2009) Bilateral filtering. Int J Numer Methods Eng 63(13):1911–1938MATH
15.
go back to reference Kopf J, Cohen MF, Lischinski D et al (2007) Joint bilateral upsampling. In: ACM siggraph. ACM, p 96 Kopf J, Cohen MF, Lischinski D et al (2007) Joint bilateral upsampling. In: ACM siggraph. ACM, p 96
16.
go back to reference Woodham RJ (1980) Photometric method for determining surface orientation from multiple images. Opt Eng 19:139–144CrossRef Woodham RJ (1980) Photometric method for determining surface orientation from multiple images. Opt Eng 19:139–144CrossRef
Metadata
Title
Calibrating TOF Sensor by Fusing Normal Maps
Authors
Hanyu Ni
Yiguang Liu
Zhenyu Xu
Jianyu Heng
Ling Jin
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-319-91659-0_11