Skip to main content
Erschienen in: Machine Vision and Applications 8/2013

01.11.2013 | Original Paper

Multi-view dense 3D modelling of untextured objects from a moving projector-cameras system

verfasst von: Jacques Harvent, Benjamin Coudrin, Ludovic Brèthes, Jean-José Orteu, Michel Devy

Erschienen in: Machine Vision and Applications | Ausgabe 8/2013

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Structured light methods achieve 3D modelling by observing with a camera system, a known pattern projected on the scene. The main drawback of single projection structured light methods is that moving the projector changes significatively the appearance of the scene at every acquisition time. Classical multi-view stereovision approaches based on the appearance matching are then not useable. The presented work is based on a two-cameras and one single slide projector system embedded in a hand-held device for industrial applications (reverse engineering, dimensional control, etc). We propose a method to achieve multi-view modelling for camera pose and surface reconstruction estimation in a joint process. The proposed method is based on the extension of a stereo-correlation criterion. Acquisitions are linked through a generalized expression of local homographies. The constraints brought by this formulation allow an accurate estimation of the modelling parameters for dense reconstruction of the scene and improve the result when dealing with detailed or sharp objects, compared to pairwise stereovision methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Fußnoten
1
The poses are considered optimal from our method point of view, that is to say that they are fully observed and that no better convergence can be achieved from adding keypoints.
 
Literatur
2.
Zurück zum Zitat Attene, M., Falcidieno, B., Rossignac, J.: Spagnuolo, M. Edge-sharpener: recovering sharp features in triangulations of non-adaptively re-meshed surfaces. In: Proceedings of the ACM symposium on geometry processing, Aachen (2003) Attene, M., Falcidieno, B., Rossignac, J.: Spagnuolo, M. Edge-sharpener: recovering sharp features in triangulations of non-adaptively re-meshed surfaces. In: Proceedings of the ACM symposium on geometry processing, Aachen (2003)
3.
Zurück zum Zitat Beder, C., Bartczak, B., Koch, R.: A comparison of pmd-cameras and stereo-vision for the task of surface reconstruction using patchlets. In: Proceedings of CVPR (2007) Beder, C., Bartczak, B., Koch, R.: A comparison of pmd-cameras and stereo-vision for the task of surface reconstruction using patchlets. In: Proceedings of CVPR (2007)
4.
Zurück zum Zitat Blais, F., Rioux, M.: Real-time numerical peak detector. Signal Process. 11(2), 145–155 (1985)CrossRef Blais, F., Rioux, M.: Real-time numerical peak detector. Signal Process. 11(2), 145–155 (1985)CrossRef
5.
Zurück zum Zitat Carceroni, R.L., Kutulakos, K.N.: Multi-view scene capture by surfel sampling: from video streams to non-rigid 3d motion, shape and reflectance. Int. J. Comput. Vis. 49(2), 175–214 (2002)CrossRefMATH Carceroni, R.L., Kutulakos, K.N.: Multi-view scene capture by surfel sampling: from video streams to non-rigid 3d motion, shape and reflectance. Int. J. Comput. Vis. 49(2), 175–214 (2002)CrossRefMATH
6.
Zurück zum Zitat Chang, J.Y., Lee, K.M., Lee, S.U.: Multiview normal field integration using level set methods. In: Proceedings of computer vision and pattern recognition (CVPR) (2007) Chang, J.Y., Lee, K.M., Lee, S.U.: Multiview normal field integration using level set methods. In: Proceedings of computer vision and pattern recognition (CVPR) (2007)
7.
Zurück zum Zitat Chen, Z., Zheng, Z., Ma, L.: An extended photometric stereo algorithm for recovering specular object shape and its reflectance properties. Comput. Sci. Inf. Syst. 7(1), 1–12 (2010)CrossRefMATH Chen, Z., Zheng, Z., Ma, L.: An extended photometric stereo algorithm for recovering specular object shape and its reflectance properties. Comput. Sci. Inf. Syst. 7(1), 1–12 (2010)CrossRefMATH
8.
Zurück zum Zitat Coudrin, B., Devy, M., Orteu, J.J., Brèthes, L.: Registration strategies of 3d images acquired from a hand-held visual sensor. In: Proceedings of 3D-IMS, conference on 3D-imaging of materials and systems, September (2010) Coudrin, B., Devy, M., Orteu, J.J., Brèthes, L.: Registration strategies of 3d images acquired from a hand-held visual sensor. In: Proceedings of 3D-IMS, conference on 3D-imaging of materials and systems, September (2010)
9.
Zurück zum Zitat Coudrin, B., Devy, M., Orteu, J.J., Brèthes, L.: An innovative hand-held vision-based digitizing system for 3D modelling. Opt. Lasers Eng. 49, 1168–1176 (2011)CrossRef Coudrin, B., Devy, M., Orteu, J.J., Brèthes, L.: An innovative hand-held vision-based digitizing system for 3D modelling. Opt. Lasers Eng. 49, 1168–1176 (2011)CrossRef
10.
Zurück zum Zitat Curless, B., Levoy, M.: A volumetric method for building complex models from range images. In: Proceedings of the 23rd annual conference on computer graphics and interactive techniques, SIGGRAPH, ACM, New York, pp. 303–312 (1996) Curless, B., Levoy, M.: A volumetric method for building complex models from range images. In: Proceedings of the 23rd annual conference on computer graphics and interactive techniques, SIGGRAPH, ACM, New York, pp. 303–312 (1996)
11.
Zurück zum Zitat Davison, A.J.: Real-time simultaneous localisation and mapping with a single camera. In: proceedings of IEEE international conference on computer vision, pp. 1403–1410 (2003) Davison, A.J.: Real-time simultaneous localisation and mapping with a single camera. In: proceedings of IEEE international conference on computer vision, pp. 1403–1410 (2003)
12.
Zurück zum Zitat Davison, A.J., Reid, I.D., Molton, N.D., Stasse, O.: Monoslam: real-time single camera slam. IEEE Trans. Pattern Anal. Mach. Intell. 29, 2007 (2007)CrossRef Davison, A.J., Reid, I.D., Molton, N.D., Stasse, O.: Monoslam: real-time single camera slam. IEEE Trans. Pattern Anal. Mach. Intell. 29, 2007 (2007)CrossRef
13.
Zurück zum Zitat Ferreira, J.F., Lobo, J., Dias, J.: A 3D scanner—three-dimensional reconstruction from multiple images. In: Proceedings of first international symposium on 3D data processing visualization and transmission (3DPVT’02) (2002) Ferreira, J.F., Lobo, J., Dias, J.: A 3D scanner—three-dimensional reconstruction from multiple images. In: Proceedings of first international symposium on 3D data processing visualization and transmission (3DPVT’02) (2002)
15.
Zurück zum Zitat Furukawa, Y., Ponce, J.: Accurate camera calibration from multi-view stereo and bundle adjustment. Int. J. Comput. Vision 84, 257–268 (2009)CrossRef Furukawa, Y., Ponce, J.: Accurate camera calibration from multi-view stereo and bundle adjustment. Int. J. Comput. Vision 84, 257–268 (2009)CrossRef
17.
Zurück zum Zitat Hartley, R.I., Zisserman, A.: Multiple view geometry in computer vision, 2nd edn. Cambridge University Press, Cambridge (2004) Hartley, R.I., Zisserman, A.: Multiple view geometry in computer vision, 2nd edn. Cambridge University Press, Cambridge (2004)
18.
Zurück zum Zitat Hernández, C., Schmitt, F.: Silhouette and stereo fusion for 3d object modeling. Comput. Vis. Image Underst. 96, 367–392 (2004) Hernández, C., Schmitt, F.: Silhouette and stereo fusion for 3d object modeling. Comput. Vis. Image Underst. 96, 367–392 (2004)
19.
Zurück zum Zitat Lourakis, M.: Sparse non-linear least squares optimization for geometric vision. In: Proceedings of the 11th European conference on computer vision (ECCV’10), Heraklion, Greece, 5–11 Sept 2010, vol. 2, pp. 43–56 (2010) Lourakis, M.: Sparse non-linear least squares optimization for geometric vision. In: Proceedings of the 11th European conference on computer vision (ECCV’10), Heraklion, Greece, 5–11 Sept 2010, vol. 2, pp. 43–56 (2010)
20.
Zurück zum Zitat Lu, F., Milios, E.: Globally consistent range scan alignment for environment mapping. Auton. Robots 4, 333–349 (1997)CrossRef Lu, F., Milios, E.: Globally consistent range scan alignment for environment mapping. Auton. Robots 4, 333–349 (1997)CrossRef
21.
Zurück zum Zitat Matabosch Geronès, C.: 3D hand-held sensor for large surface registration. PhD thesis, Universitat de Girona, Girona, Juin (2007) Matabosch Geronès, C.: 3D hand-held sensor for large surface registration. PhD thesis, Universitat de Girona, Girona, Juin (2007)
22.
Zurück zum Zitat Montiel, J.M.M., Civera, J., Davison, A.J.: Unified inverse depth parametrization for monocular slam. In: Proceedings of robotics: sceince and systems (2006) Montiel, J.M.M., Civera, J., Davison, A.J.: Unified inverse depth parametrization for monocular slam. In: Proceedings of robotics: sceince and systems (2006)
23.
Zurück zum Zitat Newcombe, R.A., Davison, A.J. : Live dense reconstruction with a single moving camera. In: Proceedings of computer vision and pattern recognition (CVPR) (2010) Newcombe, R.A., Davison, A.J. : Live dense reconstruction with a single moving camera. In: Proceedings of computer vision and pattern recognition (CVPR) (2010)
24.
Zurück zum Zitat Nieto, J., Bailey, T., Nebot, E.: Scan-slam : Combining ekf-slam and scan correlation. In: Proceedings of the 5th international conference on field and service robotics FSR, Germany, Springer (2005) Nieto, J., Bailey, T., Nebot, E.: Scan-slam : Combining ekf-slam and scan correlation. In: Proceedings of the 5th international conference on field and service robotics FSR, Germany, Springer (2005)
25.
Zurück zum Zitat Nüchter, A., Lingemann, K., Hertzberg, J., Surmann, H.: 6-d slam-3d mapping outdoor environments. J. Field Robot. 24(8–9), 699–722 (2006) Nüchter, A., Lingemann, K., Hertzberg, J., Surmann, H.: 6-d slam-3d mapping outdoor environments. J. Field Robot. 24(8–9), 699–722 (2006)
26.
Zurück zum Zitat Nüchter, A., Surmann, H., Lingemann, K., Hertzberg, J., Thrun, S.: 6d slam with an application in autonomous mine mapping. In: Proceedings of the IEEE international conference on robotics and automation, New Orleans, USA, April 2004, vol. 2, pp. 1998–2003 (2004) Nüchter, A., Surmann, H., Lingemann, K., Hertzberg, J., Thrun, S.: 6d slam with an application in autonomous mine mapping. In: Proceedings of the IEEE international conference on robotics and automation, New Orleans, USA, April 2004, vol. 2, pp. 1998–2003 (2004)
27.
Zurück zum Zitat Olson, C.F., Matthies, L.H., Schoppers, M., Maimone, M.W.: Rover navigation using stereo ego-motion. Robot. Auton. Syst. 43(4), 215–229 (2003)CrossRef Olson, C.F., Matthies, L.H., Schoppers, M., Maimone, M.W.: Rover navigation using stereo ego-motion. Robot. Auton. Syst. 43(4), 215–229 (2003)CrossRef
28.
Zurück zum Zitat Pan, Q., Reitmayr, G., Drummond, T.W.: Interactive model reconstruction with user guidance. In: Proceedings of IEEE/ACM international symposium on mixed and augmented reality, pp. 209–210 (2009) Pan, Q., Reitmayr, G., Drummond, T.W.: Interactive model reconstruction with user guidance. In: Proceedings of IEEE/ACM international symposium on mixed and augmented reality, pp. 209–210 (2009)
29.
Zurück zum Zitat Park, J., Kak, A.C.: Multi-peak range imaging for accurate 3d reconstruction of specular objects. In: Proceedings of 6th Asian conference on computer vision (2004) Park, J., Kak, A.C.: Multi-peak range imaging for accurate 3d reconstruction of specular objects. In: Proceedings of 6th Asian conference on computer vision (2004)
30.
Zurück zum Zitat Paz, L.M., Pinies, P., Tardos, J.D., Neira, J.: Large-scale 6-dof slam with stereo-in-hand. IEEE Trans. Robot. 24(5), 946–957 (2008)CrossRef Paz, L.M., Pinies, P., Tardos, J.D., Neira, J.: Large-scale 6-dof slam with stereo-in-hand. IEEE Trans. Robot. 24(5), 946–957 (2008)CrossRef
31.
Zurück zum Zitat Pollefeys, M., Van Gool, L., Vergauwen, M., Verbiest, F., Cornelis, K., Tops, J., Koch, R.: Visual modeling with a hand-held camera. Int. J. Comput. Vis. 59, 207–232 (2004)CrossRef Pollefeys, M., Van Gool, L., Vergauwen, M., Verbiest, F., Cornelis, K., Tops, J., Koch, R.: Visual modeling with a hand-held camera. Int. J. Comput. Vis. 59, 207–232 (2004)CrossRef
32.
Zurück zum Zitat Pons, J.P., Keriven, R., Faugeras, O.: Modelling dynamic scenes by registering multi-view image sequences. In: Proceedings of computer vision and pattern recognition (CVPR) (2005) Pons, J.P., Keriven, R., Faugeras, O.: Modelling dynamic scenes by registering multi-view image sequences. In: Proceedings of computer vision and pattern recognition (CVPR) (2005)
33.
Zurück zum Zitat Rusinkiewicz, S., Levoy, M.: Efficient variants of the ICP algorithm. In: Proceedings of the 3rd international conference on 3D digital imaging and modeling (3DIM), Québec City, Canada, pp. 83–90 (2001) Rusinkiewicz, S., Levoy, M.: Efficient variants of the ICP algorithm. In: Proceedings of the 3rd international conference on 3D digital imaging and modeling (3DIM), Québec City, Canada, pp. 83–90 (2001)
34.
Zurück zum Zitat Scharstein, D., Szeliski, R.: A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int. J. Comput. Vis. 47, 7–42 (2002)CrossRefMATH Scharstein, D., Szeliski, R.: A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int. J. Comput. Vis. 47, 7–42 (2002)CrossRefMATH
35.
Zurück zum Zitat Seitz, S.M., Curless, B., Diebel, J., Scharstein, D., Szeliski, R.: A comparison and evaluation of multi-view stereo reconstruction algorithms. In: Proceedings of 2006 IEEE computer society conference on computer vision and pattern recognition, vol. 1, pp. 519–528 (2006) Seitz, S.M., Curless, B., Diebel, J., Scharstein, D., Szeliski, R.: A comparison and evaluation of multi-view stereo reconstruction algorithms. In: Proceedings of 2006 IEEE computer society conference on computer vision and pattern recognition, vol. 1, pp. 519–528 (2006)
36.
Zurück zum Zitat Silva, L., Bellon, O.R.P., Boyer, K.L.: Multiview range image registration using the surface interpenetration measure. Image Vis. Comput. 25(1), 114–125 (2007)CrossRef Silva, L., Bellon, O.R.P., Boyer, K.L.: Multiview range image registration using the surface interpenetration measure. Image Vis. Comput. 25(1), 114–125 (2007)CrossRef
37.
Zurück zum Zitat Sola, J., Monin, A., Devy, M.: Bicamslam: two times mono is more than stereo. In: Proceedings of the 2007 IEEE international conference on robotics and automation (ICRA’07), Rome (Italy), pp. 4795–4800 (2007) Sola, J., Monin, A., Devy, M.: Bicamslam: two times mono is more than stereo. In: Proceedings of the 2007 IEEE international conference on robotics and automation (ICRA’07), Rome (Italy), pp. 4795–4800 (2007)
38.
Zurück zum Zitat Strobl, K.H., Mair, E., Bodenmüller, T., Kielhöfer, S., Sepp, W., Suppa, M., Burschka, D., Hirzinger, G.: The self-referenced DLR 3D-modeler. In: Proceedings of IEEE international conference on intelligent robots and systems (IROS’09), October 2009 Strobl, K.H., Mair, E., Bodenmüller, T., Kielhöfer, S., Sepp, W., Suppa, M., Burschka, D., Hirzinger, G.: The self-referenced DLR 3D-modeler. In: Proceedings of IEEE international conference on intelligent robots and systems (IROS’09), October 2009
39.
Zurück zum Zitat Sutton, M.A., Orteu, J.J., Schreier, H.W.: Image correlation for shape, motion and deformation measurements—basic concepts theory and applications. Springer, Berlin (2009) Sutton, M.A., Orteu, J.J., Schreier, H.W.: Image correlation for shape, motion and deformation measurements—basic concepts theory and applications. Springer, Berlin (2009)
40.
Zurück zum Zitat Szeliski, R.: Computer vision: algorithms and applications. Springer, New York (2011)CrossRef Szeliski, R.: Computer vision: algorithms and applications. Springer, New York (2011)CrossRef
41.
Zurück zum Zitat Triggs, B., Mclauchlan, P., Hartley, R., Fitzgibbon, A.: Bundle adjustment—a modern synthesis. Springer, Berlin, pp. 298–375 (2000) Triggs, B., Mclauchlan, P., Hartley, R., Fitzgibbon, A.: Bundle adjustment—a modern synthesis. Springer, Berlin, pp. 298–375 (2000)
42.
Zurück zum Zitat Vu, H.H., Labatut, P., Keriven, R., Pons, J.P.: High accuracy and visibility-consistent dense multi-view stereo. IEEE Trans. Pattern Anal. Mach. Intell. 34(5), 889–901 (2012)CrossRef Vu, H.H., Labatut, P., Keriven, R., Pons, J.P.: High accuracy and visibility-consistent dense multi-view stereo. IEEE Trans. Pattern Anal. Mach. Intell. 34(5), 889–901 (2012)CrossRef
43.
Zurück zum Zitat Wildes, R., Se, S., Jasiobedzki, P.: Stereo-vision based 3d modeling of space structures. In: Proceedings of SPIE on sensors and systems for space applications, vol. 6555, 29 May 2007 Wildes, R., Se, S., Jasiobedzki, P.: Stereo-vision based 3d modeling of space structures. In: Proceedings of SPIE on sensors and systems for space applications, vol. 6555, 29 May 2007
44.
Zurück zum Zitat Wu, C., Wilburn, B., Matsushita, Y., Theobalt, C.: High-quality shape from multi-view stereo and shading under general illumination. In: Proceedings of computer vision and pattern recognition (CVPR) (2011) Wu, C., Wilburn, B., Matsushita, Y., Theobalt, C.: High-quality shape from multi-view stereo and shading under general illumination. In: Proceedings of computer vision and pattern recognition (CVPR) (2011)
45.
Zurück zum Zitat Zaharescu, A., Boyer, E., Horaud, R.P.: Topology-adaptative mesh deformation for surface evolution, morphing, and multi-view reconstruction. IEEE Trans. Pattern Anal. Mach. Intell. 33(4), 823–837 (2011)CrossRef Zaharescu, A., Boyer, E., Horaud, R.P.: Topology-adaptative mesh deformation for surface evolution, morphing, and multi-view reconstruction. IEEE Trans. Pattern Anal. Mach. Intell. 33(4), 823–837 (2011)CrossRef
46.
Zurück zum Zitat Zhang, Z.: A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 22, 1330–1334 (2000)CrossRef Zhang, Z.: A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 22, 1330–1334 (2000)CrossRef
Metadaten
Titel
Multi-view dense 3D modelling of untextured objects from a moving projector-cameras system
verfasst von
Jacques Harvent
Benjamin Coudrin
Ludovic Brèthes
Jean-José Orteu
Michel Devy
Publikationsdatum
01.11.2013
Verlag
Springer Berlin Heidelberg
Erschienen in
Machine Vision and Applications / Ausgabe 8/2013
Print ISSN: 0932-8092
Elektronische ISSN: 1432-1769
DOI
https://doi.org/10.1007/s00138-013-0495-z

Weitere Artikel der Ausgabe 8/2013

Machine Vision and Applications 8/2013 Zur Ausgabe