Skip to main content

2016 | OriginalPaper | Buchkapitel

Efficient Multi-frequency Phase Unwrapping Using Kernel Density Estimation

verfasst von : Felix Järemo Lawin, Per-Erik Forssén, Hannes Ovrén

Erschienen in: Computer Vision – ECCV 2016

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper we introduce an efficient method to unwrap multi-frequency phase estimates for time-of-flight ranging. The algorithm generates multiple depth hypotheses and uses a spatial kernel density estimate (KDE) to rank them. The confidence produced by the KDE is also an effective means to detect outliers. We also introduce a new closed-form expression for phase noise prediction, that better fits real data. The method is applied to depth decoding for the Kinect v2 sensor, and compared to the Microsoft Kinect SDK and to the open source driver libfreenect2. The intended Kinect v2 use case is scenes with less than 8 m range, and for such cases we observe consistent improvements, while maintaining real-time performance. When extending the depth range to the maximal value of 18.75 m, we get about \(52\,\%\) more valid measurements than libfreenect2. The effect is that the sensor can now be used in large depth scenes, where it was previously not a good choice.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
1
RGB-D sensors output both colour (RGB) and depth (D) images.
 
2
Version 2.0.1409.
 
3
As in \(opencl\_depth\_packet\_processor.cl\) Feb 18 2016 commit: 1d06d2db04a9.
 
Literatur
1.
Zurück zum Zitat Trunk, G., Brockett, S.: Range and velocity ambiguity resolution. In: IEEE National Radar Conference, pp. 146–149 (1993) Trunk, G., Brockett, S.: Range and velocity ambiguity resolution. In: IEEE National Radar Conference, pp. 146–149 (1993)
2.
Zurück zum Zitat Sell, J., O’Connor, P.: The Xbox one system on a chip and kinect sensor. IEEE Micro 34(2), 44–53 (2014)CrossRef Sell, J., O’Connor, P.: The Xbox one system on a chip and kinect sensor. IEEE Micro 34(2), 44–53 (2014)CrossRef
3.
Zurück zum Zitat Newcombe, R.A., et al.: KinectFusion: real-time dense surface mapping and tracking. In: IEEE ISMAR 2011, Basel, Switzerland, October 2011 Newcombe, R.A., et al.: KinectFusion: real-time dense surface mapping and tracking. In: IEEE ISMAR 2011, Basel, Switzerland, October 2011
4.
Zurück zum Zitat Jongenelen, A.P.P., Bailey, D.G., Payne, A.D., Dorrington, A.A., Carnegie, D.A.: Analysis of errors in tof range imaging with dual-frequency modulation. IEEE Trans. Instrum. Measur. 60(5), 1861–1868 (2011)CrossRef Jongenelen, A.P.P., Bailey, D.G., Payne, A.D., Dorrington, A.A., Carnegie, D.A.: Analysis of errors in tof range imaging with dual-frequency modulation. IEEE Trans. Instrum. Measur. 60(5), 1861–1868 (2011)CrossRef
5.
Zurück zum Zitat Wang, Z., Du, H., Park, S., Xie, H.: Three-dimensional shape measurement with a fast and accurate approach. Appl. Opt. 48(6), 1052–1061 (2009)CrossRef Wang, Z., Du, H., Park, S., Xie, H.: Three-dimensional shape measurement with a fast and accurate approach. Appl. Opt. 48(6), 1052–1061 (2009)CrossRef
6.
Zurück zum Zitat Gorthi, S.S., Pastogi, P.: Fringe projection techniques: wither we are? Opt. Lasers Eng. 48(2), 133–140 (2010)CrossRef Gorthi, S.S., Pastogi, P.: Fringe projection techniques: wither we are? Opt. Lasers Eng. 48(2), 133–140 (2010)CrossRef
7.
Zurück zum Zitat Hansard, M.: Disambiguation of time-of-flight data. In: Time-of-Flight Cameras, Chap. 2. Springer Briefs in Computer Science, pp. 29–43. Springer, London (2013) Hansard, M.: Disambiguation of time-of-flight data. In: Time-of-Flight Cameras, Chap. 2. Springer Briefs in Computer Science, pp. 29–43. Springer, London (2013)
8.
Zurück zum Zitat Crabb, R., Manduchi, R.: Fast single-frequenct time-of-flight range imaging. In: IEEE International Conference on Computer Vision and Pattern Recognition (CVPR 2015) (2015) Crabb, R., Manduchi, R.: Fast single-frequenct time-of-flight range imaging. In: IEEE International Conference on Computer Vision and Pattern Recognition (CVPR 2015) (2015)
9.
Zurück zum Zitat Droeschel, D., Holz, D., Behnke, S.: Multi-frequency phase unwrapping for time-of-flight cameras. In: IEEE International Conference on Intelligent Robots and Systems (2010) Droeschel, D., Holz, D., Behnke, S.: Multi-frequency phase unwrapping for time-of-flight cameras. In: IEEE International Conference on Intelligent Robots and Systems (2010)
10.
Zurück zum Zitat Kirmani, A., Benedetti, A., Chou, P.A.: SPUMIC: simultaneous phase unwrapping and multipath interference cancellation in time-of-flight cameras using spectral methods. In: IEEE International Conference on Multimedia& Expo (ICME 2013) (2013) Kirmani, A., Benedetti, A., Chou, P.A.: SPUMIC: simultaneous phase unwrapping and multipath interference cancellation in time-of-flight cameras using spectral methods. In: IEEE International Conference on Multimedia& Expo (ICME 2013) (2013)
11.
Zurück zum Zitat Feigin, M., Bhandari, A., Izadi, S., Rhemann, C., Schmidt, M., Raskar, R.: Resolving multipath interference in Kinect: an inverse problem approach. IEEE Sens. J. 16, 3419–3427 (2015)CrossRef Feigin, M., Bhandari, A., Izadi, S., Rhemann, C., Schmidt, M., Raskar, R.: Resolving multipath interference in Kinect: an inverse problem approach. IEEE Sens. J. 16, 3419–3427 (2015)CrossRef
12.
Zurück zum Zitat Mei, J., Kirmani, A., Colaco, A., Goyal, V.K.: Phase unwrapping and denoising for time-of-flight imaging using generalized approximate message passing. In: IEEE International Conference on Image Processing (ICIP 2013) (2013) Mei, J., Kirmani, A., Colaco, A., Goyal, V.K.: Phase unwrapping and denoising for time-of-flight imaging using generalized approximate message passing. In: IEEE International Conference on Image Processing (ICIP 2013) (2013)
13.
Zurück zum Zitat Frank, M., Plaue, M., Rapp, H., Köthe, U., Jähne, B.: Theoretical and experimental error analysis of continuous-wave time-of-flight range cameras. Opt. Eng. 48(1), 013602 (2009)CrossRef Frank, M., Plaue, M., Rapp, H., Köthe, U., Jähne, B.: Theoretical and experimental error analysis of continuous-wave time-of-flight range cameras. Opt. Eng. 48(1), 013602 (2009)CrossRef
14.
Zurück zum Zitat Bamji, C., Charbon, E.: US 6,515,740 B2: methods for CMOS-compatible three-dimensional image sensing using quantum efficiency modulation (2004) Bamji, C., Charbon, E.: US 6,515,740 B2: methods for CMOS-compatible three-dimensional image sensing using quantum efficiency modulation (2004)
15.
Zurück zum Zitat Bamji, C.S., et al.: A 0.13 \(\mu \)m CMOS system-on-chip for a \(512\times 424\) time-of-flight image sensor with multi-frequency photo-demodulation up to 130 MHz and 2 GS/s ADC. IEEE J. Solid-State Circuits 50(1), 303–319 (2015)CrossRef Bamji, C.S., et al.: A 0.13 \(\mu \)m CMOS system-on-chip for a \(512\times 424\) time-of-flight image sensor with multi-frequency photo-demodulation up to 130 MHz and 2 GS/s ADC. IEEE J. Solid-State Circuits 50(1), 303–319 (2015)CrossRef
16.
Zurück zum Zitat Murphy, K.P.: Machine Learning: A Probabilistic Perspective. MIT Press, Cambridge (2012)MATH Murphy, K.P.: Machine Learning: A Probabilistic Perspective. MIT Press, Cambridge (2012)MATH
17.
Zurück zum Zitat Uhlmann, J.: Dynamic map building and localization: new theoretical foundations. Ph.D. thesis, University of Oxford (1995) Uhlmann, J.: Dynamic map building and localization: new theoretical foundations. Ph.D. thesis, University of Oxford (1995)
18.
Zurück zum Zitat Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press, Cambridge (2003)MATH Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press, Cambridge (2003)MATH
19.
Zurück zum Zitat Szeliski, R.: Computer Vision: Algorithms and Applications. Springer-Verlag New York Inc., New York (2010)MATH Szeliski, R.: Computer Vision: Algorithms and Applications. Springer-Verlag New York Inc., New York (2010)MATH
20.
Zurück zum Zitat Forssén, P.E.: Low and medium level vision using channel representations. Ph.D. thesis, Linköping University, Sweden, SE-581 83 Linköping, Sweden, March 2004. Dissertation No. 858, ISBN 91-7373-876-X Forssén, P.E.: Low and medium level vision using channel representations. Ph.D. thesis, Linköping University, Sweden, SE-581 83 Linköping, Sweden, March 2004. Dissertation No. 858, ISBN 91-7373-876-X
21.
Zurück zum Zitat Felsberg, M., Forssén, P.E., Scharr, H.: Channel smoothing: efficient robust smoothing of low-level signal features. IEEE TPAMI 28(2), 209–222 (2006)CrossRef Felsberg, M., Forssén, P.E., Scharr, H.: Channel smoothing: efficient robust smoothing of low-level signal features. IEEE TPAMI 28(2), 209–222 (2006)CrossRef
22.
Zurück zum Zitat Järemo Lawin, F., Forssén, P.E., Ovrén, H.: Efficient multi-frequency phase unwrapping using kernel density estimation, supplemental material. Technical report, Linköing University (2016) Järemo Lawin, F., Forssén, P.E., Ovrén, H.: Efficient multi-frequency phase unwrapping using kernel density estimation, supplemental material. Technical report, Linköing University (2016)
24.
Zurück zum Zitat Rusu, R.B., Cousins, S.: 3D is here: point cloud library (PCL). In: IEEE ICRA, 9–13 May 2011 Rusu, R.B., Cousins, S.: 3D is here: point cloud library (PCL). In: IEEE ICRA, 9–13 May 2011
Metadaten
Titel
Efficient Multi-frequency Phase Unwrapping Using Kernel Density Estimation
verfasst von
Felix Järemo Lawin
Per-Erik Forssén
Hannes Ovrén
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-46493-0_11

Premium Partner