Skip to main content

2016 | OriginalPaper | Buchkapitel

A Symmetry Prior for Convex Variational 3D Reconstruction

verfasst von : Pablo Speciale, Martin R. Oswald, Andrea Cohen, Marc Pollefeys

Erschienen in: Computer Vision – ECCV 2016

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We propose a novel prior for variational 3D reconstruction that favors symmetric solutions when dealing with noisy or incomplete data. We detect symmetries from incomplete data while explicitly handling unexplored areas to allow for plausible scene completions. The set of detected symmetries is then enforced on their respective support domain within a variational reconstruction framework. This formulation also handles multiple symmetries sharing the same support. The proposed approach is able to denoise and complete surface geometry and even hallucinate large scene parts. We demonstrate in several experiments the benefit of harnessing symmetries when regularizing a surface.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Cohen, A., Sattler, T., Pollefeys, M.: Merging the unmatchable: stitching visually disconnected SFM models. In: ICCV, December 2015 Cohen, A., Sattler, T., Pollefeys, M.: Merging the unmatchable: stitching visually disconnected SFM models. In: ICCV, December 2015
2.
Zurück zum Zitat Cohen, A., Zach, C., Sinha, S., Pollefeys, M.: Discovering and exploiting 3D symmetries in structure from motion. In: CVPR, June 2012 Cohen, A., Zach, C., Sinha, S., Pollefeys, M.: Discovering and exploiting 3D symmetries in structure from motion. In: CVPR, June 2012
3.
Zurück zum Zitat Curless, B., Levoy, M.: A volumetric method for building complex models from range images. In: SIGGRAPH (1996) Curless, B., Levoy, M.: A volumetric method for building complex models from range images. In: SIGGRAPH (1996)
4.
Zurück zum Zitat Golovinskiy, A., Podolak, J., Funkhouser, T.: Symmetry-aware mesh processing. In: Hancock, E.R., Martin, R.R., Sabin, M.A. (eds.) Mathematics of Surfaces XIII. LNCS, vol. 5654, pp. 170–188. Springer, Heidelberg (2009)CrossRef Golovinskiy, A., Podolak, J., Funkhouser, T.: Symmetry-aware mesh processing. In: Hancock, E.R., Martin, R.R., Sabin, M.A. (eds.) Mathematics of Surfaces XIII. LNCS, vol. 5654, pp. 170–188. Springer, Heidelberg (2009)CrossRef
5.
Zurück zum Zitat Häne, C., Zach, C., Cohen, A., Angst, R., Pollefeys, M.: Joint 3D scene reconstruction and class segmentation. In: CVPR, pp. 97–104 (2013) Häne, C., Zach, C., Cohen, A., Angst, R., Pollefeys, M.: Joint 3D scene reconstruction and class segmentation. In: CVPR, pp. 97–104 (2013)
6.
Zurück zum Zitat Hauagge, D.C., Snavely, N.: Image matching using local symmetry features. In: CVPR, pp. 206–213 (2012) Hauagge, D.C., Snavely, N.: Image matching using local symmetry features. In: CVPR, pp. 206–213 (2012)
7.
Zurück zum Zitat Kazhdan, M.M., Chazelle, B., Dobkin, D.P., Funkhouser, T.A., Rusinkiewicz, S.: A reflective symmetry descriptor for 3D models. Algorithmica 38(1), 201–225 (2003)CrossRefMATHMathSciNet Kazhdan, M.M., Chazelle, B., Dobkin, D.P., Funkhouser, T.A., Rusinkiewicz, S.: A reflective symmetry descriptor for 3D models. Algorithmica 38(1), 201–225 (2003)CrossRefMATHMathSciNet
8.
Zurück zum Zitat Kerber, J., Wand, M., Krüger, J.H., Seidel, H.: Partial symmetry detection in volume data. In: Proceedings of the Vision, Modeling, and Visualization Workshop, Berlin, Germany, 4–6 October 2011, pp. 41–48 (2011) Kerber, J., Wand, M., Krüger, J.H., Seidel, H.: Partial symmetry detection in volume data. In: Proceedings of the Vision, Modeling, and Visualization Workshop, Berlin, Germany, 4–6 October 2011, pp. 41–48 (2011)
9.
Zurück zum Zitat Kolev, K., Klodt, M., Brox, T., Cremers, D.: Continuous global optimization in multiview 3D reconstruction. IJCV 84(1), 80–96 (2009)CrossRef Kolev, K., Klodt, M., Brox, T., Cremers, D.: Continuous global optimization in multiview 3D reconstruction. IJCV 84(1), 80–96 (2009)CrossRef
10.
Zurück zum Zitat Kolev, K., Pock, T., Cremers, D.: Anisotropic minimal surfaces integrating photoconsistency and normal information for multiview stereo. In: ECCV, Heraklion, Greece, September 2010 Kolev, K., Pock, T., Cremers, D.: Anisotropic minimal surfaces integrating photoconsistency and normal information for multiview stereo. In: ECCV, Heraklion, Greece, September 2010
11.
Zurück zum Zitat Köser, K., Zach, C., Pollefeys, M.: Dense 3D reconstruction of symmetric scenes from a single image. In: Mester, R., Felsberg, M. (eds.) DAGM 2011. LNCS, vol. 6835, pp. 266–275. Springer, Heidelberg (2011)CrossRef Köser, K., Zach, C., Pollefeys, M.: Dense 3D reconstruction of symmetric scenes from a single image. In: Mester, R., Felsberg, M. (eds.) DAGM 2011. LNCS, vol. 6835, pp. 266–275. Springer, Heidelberg (2011)CrossRef
12.
Zurück zum Zitat Liu, J., Liu, Y.: Curved reflection symmetry detection with self-validation. In: Kimmel, R., Klette, R., Sugimoto, A. (eds.) ACCV 2010, Part IV. LNCS, vol. 6495, pp. 102–114. Springer, Heidelberg (2011)CrossRef Liu, J., Liu, Y.: Curved reflection symmetry detection with self-validation. In: Kimmel, R., Klette, R., Sugimoto, A. (eds.) ACCV 2010, Part IV. LNCS, vol. 6495, pp. 102–114. Springer, Heidelberg (2011)CrossRef
13.
Zurück zum Zitat Liu, Y., Hel-Or, H., Kaplan, C.S., Gool, L.V.: Computational symmetry in computer vision and computer graphics. Found. Trends Comput. Graph. Vis. 5(12), 1–195 (2010)MATH Liu, Y., Hel-Or, H., Kaplan, C.S., Gool, L.V.: Computational symmetry in computer vision and computer graphics. Found. Trends Comput. Graph. Vis. 5(12), 1–195 (2010)MATH
14.
Zurück zum Zitat Lorensen, W.E., Cline, H.E.: Marching cubes: a high resolution 3D surface construction algorithm. SIGGRAPH Comput. Graph. 21, 163–169 (1987)CrossRef Lorensen, W.E., Cline, H.E.: Marching cubes: a high resolution 3D surface construction algorithm. SIGGRAPH Comput. Graph. 21, 163–169 (1987)CrossRef
15.
Zurück zum Zitat Mitra, N.J., Guibas, L.J., Pauly, M.: Symmetrization. ACM Trans. Graph. 26(3), 63 (2007)CrossRef Mitra, N.J., Guibas, L.J., Pauly, M.: Symmetrization. ACM Trans. Graph. 26(3), 63 (2007)CrossRef
16.
Zurück zum Zitat Mitra, N.J., Pauly, M., Wand, M., Ceylan, D.: Symmetry in 3D geometry: extraction and applications. Comput. Graph. Forum 32(6), 1–23 (2013)CrossRef Mitra, N.J., Pauly, M., Wand, M., Ceylan, D.: Symmetry in 3D geometry: extraction and applications. Comput. Graph. Forum 32(6), 1–23 (2013)CrossRef
17.
Zurück zum Zitat Oswald, M.R., Cremers, D.: A convex relaxation approach to space time multi-view 3D reconstruction. In: ICCV - Workshop on Dynamic Shape Capture and Analysis (4DMOD) (2013) Oswald, M.R., Cremers, D.: A convex relaxation approach to space time multi-view 3D reconstruction. In: ICCV - Workshop on Dynamic Shape Capture and Analysis (4DMOD) (2013)
18.
Zurück zum Zitat Oswald, M.R., Cremers, D.: Surface normal integration for convex space-time multi-view reconstruction. In: Proceedings of the British Machine and Vision Conference (BMVC) (2014) Oswald, M.R., Cremers, D.: Surface normal integration for convex space-time multi-view reconstruction. In: Proceedings of the British Machine and Vision Conference (BMVC) (2014)
19.
Zurück zum Zitat Oswald, M.R., Stühmer, J., Cremers, D.: Generalized connectivity constraints for spatio-temporal 3D reconstruction. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014, Part IV. LNCS, vol. 8692, pp. 32–46. Springer, Heidelberg (2014) Oswald, M.R., Stühmer, J., Cremers, D.: Generalized connectivity constraints for spatio-temporal 3D reconstruction. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014, Part IV. LNCS, vol. 8692, pp. 32–46. Springer, Heidelberg (2014)
20.
Zurück zum Zitat Pizlo, Z., Sawada, T., Li, Y., Kropatsch, W.G., Steinman, R.M.: New approach to the perception of 3D shape based on veridicality, complexity, symmetry and volume. Vision. Res. 50, 1–11 (2010)CrossRef Pizlo, Z., Sawada, T., Li, Y., Kropatsch, W.G., Steinman, R.M.: New approach to the perception of 3D shape based on veridicality, complexity, symmetry and volume. Vision. Res. 50, 1–11 (2010)CrossRef
21.
Zurück zum Zitat Pock, T., Chambolle, A.: Diagonal preconditioning for first order primal-dual algorithms in convex optimization. In: ICCV, Washington, DC, USA, pp. 1762–1769 (2011) Pock, T., Chambolle, A.: Diagonal preconditioning for first order primal-dual algorithms in convex optimization. In: ICCV, Washington, DC, USA, pp. 1762–1769 (2011)
22.
Zurück zum Zitat Podolak, J., Golovinskiy, A., Rusinkiewicz, S.: Symmetry-enhanced remeshing of surfaces. In: Proceedings of the Fifth Eurographics Symposium on Geometry Processing, Barcelona, Spain, 4–6 July 2007, pp. 235–242 (2007) Podolak, J., Golovinskiy, A., Rusinkiewicz, S.: Symmetry-enhanced remeshing of surfaces. In: Proceedings of the Fifth Eurographics Symposium on Geometry Processing, Barcelona, Spain, 4–6 July 2007, pp. 235–242 (2007)
23.
Zurück zum Zitat Podolak, J., Shilane, P., Golovinskiy, A., Rusinkiewicz, S., Funkhouser, T.A.: A planar-reflective symmetry transform for 3D shapes. ACM Trans. Graph. 25(3), 549–559 (2006)CrossRef Podolak, J., Shilane, P., Golovinskiy, A., Rusinkiewicz, S., Funkhouser, T.A.: A planar-reflective symmetry transform for 3D shapes. ACM Trans. Graph. 25(3), 549–559 (2006)CrossRef
24.
Zurück zum Zitat Reinbacher, C., Pock, T., Bauer, C., Bischof, H.: Variational segmentation of elongated volumetric structures. In: CVPR (2010) Reinbacher, C., Pock, T., Bauer, C., Bischof, H.: Variational segmentation of elongated volumetric structures. In: CVPR (2010)
25.
Zurück zum Zitat Terzopoulos, D., Witkin, A., Kass, M.: Symmetry-seeking models and 3D object reconstruction. IJCV 1, 211–221 (1987)CrossRef Terzopoulos, D., Witkin, A., Kass, M.: Symmetry-seeking models and 3D object reconstruction. IJCV 1, 211–221 (1987)CrossRef
26.
Zurück zum Zitat Thrun, S., Wegbreit, B.: Shape from symmetry. In: ICCV, Bejing, China. IEEE (2005) Thrun, S., Wegbreit, B.: Shape from symmetry. In: ICCV, Bejing, China. IEEE (2005)
27.
Zurück zum Zitat Ummenhofer, B., Brox, T.: Dense 3D reconstruction with a hand-held camera. In: Pinz, A., Pock, T., Bischof, H., Leberl, F. (eds.) DAGM and OAGM 2012. LNCS, vol. 7476, pp. 103–112. Springer, Heidelberg (2012)CrossRef Ummenhofer, B., Brox, T.: Dense 3D reconstruction with a hand-held camera. In: Pinz, A., Pock, T., Bischof, H., Leberl, F. (eds.) DAGM and OAGM 2012. LNCS, vol. 7476, pp. 103–112. Springer, Heidelberg (2012)CrossRef
28.
Zurück zum Zitat Unger, M., Pock, T., Cremers, D., Bischof, H.: TVSeg - interactive total variation based image segmentation. In: Proceedings of the British Machine and Vision Conference (BMVC), Leeds, UK, September 2008 Unger, M., Pock, T., Cremers, D., Bischof, H.: TVSeg - interactive total variation based image segmentation. In: Proceedings of the British Machine and Vision Conference (BMVC), Leeds, UK, September 2008
29.
Zurück zum Zitat Zach, C., Pock, T., Bischof, H.: A globally optimal algorithm for robust TV-l1 range image integration. In: ICCV, pp. 1–8 (2007) Zach, C., Pock, T., Bischof, H.: A globally optimal algorithm for robust TV-l1 range image integration. In: ICCV, pp. 1–8 (2007)
Metadaten
Titel
A Symmetry Prior for Convex Variational 3D Reconstruction
verfasst von
Pablo Speciale
Martin R. Oswald
Andrea Cohen
Marc Pollefeys
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-46484-8_19

Premium Partner