nach oben

International Journal of Computer Vision

Erschienen in:

01.07.2014

Unstructured Light Scanning Robust to Indirect Illumination and Depth Discontinuities

verfasst von: Vincent Couture, Nicolas Martin, Sébastien Roy

Erschienen in: International Journal of Computer Vision | Ausgabe 3/2014

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

Reconstruction from structured light can be greatly affected by indirect illumination such as interreflections between surfaces in the scene and sub-surface scattering. This paper introduces band-pass white noise patterns designed specifically to reduce the effects of indirect illumination, and still be robust to standard challenges in scanning systems such as scene depth discontinuities, defocus and low camera-projector pixel ratio. While this approach uses unstructured light patterns that increase the number of required projected images, it is up to our knowledge the first method that is able to recover scene disparities in the presence of both indirect illumination and scene discontinuities. Furthermore, the method does not require calibration (geometric nor photometric) or post-processing such as phase unwrapping or interpolation from sparse correspondences. We show results for a few challenging scenes and compare them to correspondences obtained with the Phase-shift method and the recently introduced method by Gupta et al., designed specifically to handle indirect illumination.

Vorheriger Artikel Mining Mid-level Features for Image Classification

Nächster Artikel Understanding, Optimising, and Extending Data Compression with Anisotropic Diffusion

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

In the literature, indirect illumination is sometimes called global illumination.

The camera-projector pixel ratio is defined as one camera pixel over the number of projector pixels it can see.

Photometric distortion includes gamma factors, scene albedo and aperture (Caspi et al. 1998).

For a \(800\times 600\) projector resolution, the Gupta et al. method requires 10 patterns for each set of codes, plus an all white and an all black pattern to get a good estimate of the mean gray intensity for decoding purposes (Gupta et al. 2012).

Generating 1D unstructured light patterns reduces the number of required patterns, but the longer vertical strips create more indirect illumination than 2D patterns.

We computed Phase-shift using three 64 cycles per frame patterns and calibrating the nonlinearities related to gamma coefficients of the camera and the projector. We here ignore issues related to the ambiguous periodicity of the signal as we are only interested in how well the phase can be recovered. Thus, we performed phase unwrapping by looking at the reference match and finding the most likely period for each pixel independently.

Andoni, A. (2006). Near-optimal hashing algorithms for approximate nearest neighbor in high dimensions. In: IEEE Symposium on Foundations of Computer Science 2006 (pp. 459–468), IEEE Computer Society.

Andoni, A., & Indyk, P. (2008). Near-optimal hashing algorithms for approximate nearest neighbor in high dimensions. Communications of the ACM, 51(1), 117–122.CrossRef

Boyer, K., & Kak, A. (1987). Color-encoded structured light for rapid active ranging. In: IEEE Transactions on Pattern Analysis and Machine Intelligence PAMI-, 9(1), 14–28.

Bracewell, R. N. (1965). The fourier transform and its applications. New York: McGraw-Hill.MATH

Caspi, D., Kiryati, N., & Shamir, J. (1998). Range imaging with adaptive color structured light. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20, 470–480.CrossRef

Chen, T., Seidel, H.P., Lensch, H.P.A. (2008). Modulated phase-shifting for 3d scanning. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2008.

Couture, V., Martin, N., Roy, S. (2011). Unstructured light scanning to overcome interreflections. In: IEEE International Conference on Computer Vision (ICCV) ((in press) Nov. 2011).

Davis, J., Nehab, D., Ramamoorthi, R., & Rusinkiewicz, S. (2005). Spacetime stereo: A unifying framework for depth from triangulation. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 27(2), 296–302.CrossRef

Gionis, A., Indyk, P., Motwani, R. (1999). Similarity search in high dimensions via hashing. In: VLDB ’99: Proceedings of the 25th International Conference on Very Large Data Bases 1999, (pp. 518–529). San Francisco, USA: Morgan Kaufmann Publishers Inc.,

Goddyn, L., & Gvozdjak, P. (2003). Binary gray codes with long bit runs. Electronic Journal of Combinatorics, 10, 27.MathSciNet

Gortler, S. J., Grzeszczuk, R., Szeliski, R., Cohen, M. F. (1996). The lumigraph. In: Proceedings of the 23rd annual conference on Computer graphics and interactive techniques 1996, (pp. 43–54). SIGGRAPH ’96 New York, NY, USA, ACM.

Gu, J., Kobayashi, T., Gupta, M., Nayar, S.K. (2011). Multiplexed illumination for scene recovery in the presence of global illumination. In: IEEE International Conference on Computer Vision (ICCV) 2011, (pp. 1–8).

Gühring, J. (2001). Dense 3-d surface acquisition by structured light using off-the-shelf components. Videometrics and Optical Methods for 3D Shape Measurement, 4309, 220–231.CrossRef

Gupta, M., Agrawal, A., Veeraraghavan, A., Narasimhan, S.G. (2011) Structured light 3d scanning in the presence of global illumination. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2011, (pp. 713–720). IEEE Computer Society.

Gupta, M., Agrawal, A., Veeraraghavan, A., Narasimhan, S.G. (2012). A practical approach to 3d scanning in the presence of interreflections, subsurface scattering and defocus. In: International Journal of Computer Vision 2012, ( pp. 1–23 ).

Hermans, C., Francken, Y., Cuypers, T., Bekaert, P. (2009). Depth from sliding projections. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2009, ( pp. 1865–1872 ).

Inokuchi, S., Sato, K., Matsuda, F. (1984). Range imaging system for 3-d object recognition. In: ICPR84 1984, (pp. 806–808).

Kushnir, A., Kiryati, N. (2007). Shape from unstructured light. In: 3DTV07 2007, (pp. 1–4).

Levoy, M., Hanrahan, P. (1996). Light field rendering. In: Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’96 New York 1996 (pp. 31–42). NY, USA: ACM.

Minou, M., Kanade, T., & Sakai, T. (1981). A method of time-coded parallel planes of light for depth measurement. Transactions of the Institute of Electronics and Communication Engineers of Japan, E64(8), 521–528.

Nayar, S. K., Krishnan, A., Grossberg, M. D., & Raskar, R. (2006). Fast separation of direct and global components of a scene using high frequency illumination. ACM Transactions on Graphics, 25, 935–944.CrossRef

Peers, P., Mahajan, D. K., Lamond, B., Ghosh, A., Matusik, W., Ramamoorthi, R., et al. (2009). Compressive light transport sensing. New York: ACM.

Posdamer, J., & Altschuler, M. (1982). Surface measurement by space-encoded projected beam systems. Computer Graphics and Image Processing, 18, 1–17.CrossRef

Proesmans, M., Van Gool, L., Oosterlinck, A. (1996). One-shot active 3d shape acquisition. Pattern Recognition, 1996: Proceedings of the 13th International Conference on 3, 1996 (pp.336–340) vol. 3.

Salvi, J., Batlle, J., & Mouaddib, E. (1998). A robust-coded pattern projection for dynamic 3d scene measurement. Pattern Recognition Letters, 19(11), 1055–1065.CrossRef

Salvi, J., Pagès, J., & Batlle, J. (2004). Pattern codification strategies in structured light systems. Pattern Recognition, 37, 827–849.CrossRefMATH

Scharstein, D., Szeliski, R. (2003). High-accuracy stereo depth maps using structured light. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR) 2003, vol. 1, (pp. 195–202).

Vuylsteke, P., & Oosterlinck, A. (1990). Range image acquisition with a single binary-encoded light pattern. IEEE Transactions on Pattern Analysis and Machine Intelligence, 12(2), 148–164.CrossRef

Tardif, J.-P., Roy, S., Trudeau, M. (2003). Multi-projectors for arbitrary surfaces without explicit calibration nor reconstruction. In: International Conference on 3-D Digital Imaging and Modeling 2003, ( pp. 217–224 ).

Wexler, Y., Fitzgibbon, A. W., Zisserman, A. (2003). Learning epipolar geometry from image sequences. Computer Vision and Pattern Recognition. In: IEEE Computer Society Conference on 2, 209, 2003.

Wust, C., & Capson, D. (1991). Surface profile measurement using color fringe projection. Machine Vision and Applications, 4(3), 193–203.CrossRef

Xu, Y., & Aliaga, D. G. (2009). An adaptive correspondence algorithm for modeling scenes with strong interreflections. IEEE Transactions on Visualization and Computer Graphics, 15, 465–480.

Zhang, S., & Yau, S. (2007). High-speed three-dimensional shape measurement system using a modified two-plus-one phase-shifting algorithm. Optical Engineering, 46(11), 113603.CrossRef

Zhang, L., Curless, B., Seitz, S. (2002). Rapid shape acquisition using color structured light and multi-pass dynamic programming. In: International Symposium on 3D Data Processing Visualization and Transmission. 3DPVT 2002, (pp. 24–36).

Titel: Unstructured Light Scanning Robust to Indirect Illumination and Depth Discontinuities
verfasst von: Vincent Couture
Nicolas Martin
Sébastien Roy
Publikationsdatum: 01.07.2014
Verlag: Springer US
Erschienen in: International Journal of Computer Vision / Ausgabe 3/2014
Print ISSN: 0920-5691
Elektronische ISSN: 1573-1405
DOI: https://doi.org/10.1007/s11263-014-0701-0

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Weitere Artikel der Ausgabe 3/2014

Mining Mid-level Features for Image Classification

A New Approach to Two-View Motion Segmentation Using Global Dimension Minimization

A Shape Reconstructability Measure of Object Part Importance with Applications to Object Detection and Localization

Erratum to: Interesting Interest Points

Understanding, Optimising, and Extending Data Compression with Anisotropic Diffusion

Premium Partner