Skip to main content

2016 | OriginalPaper | Buchkapitel

From Multiview Image Curves to 3D Drawings

verfasst von : Anil Usumezbas, Ricardo Fabbri, Benjamin B. Kimia

Erschienen in: Computer Vision – ECCV 2016

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Reconstructing 3D scenes from multiple views has made impressive strides in recent years, chiefly by correlating isolated feature points, intensity patterns, or curvilinear structures. In the general setting – without controlled acquisition, abundant texture, curves and surfaces following specific models or limiting scene complexity – most methods produce unorganized point clouds, meshes, or voxel representations, with some exceptions producing unorganized clouds of 3D curve fragments. Ideally, many applications require structured representations of curves, surfaces and their spatial relationships. This paper presents a step in this direction by formulating an approach that combines 2D image curves into a collection of 3D curves, with topological connectivity between them represented as a 3D graph. This results in a 3D drawing, which is complementary to surface representations in the same sense as a 3D scaffold complements a tent taut over it. We evaluate our results against truth on synthetic and real datasets.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Abuhashim, T., Sukkarieh, S.: Incorporating geometric information into gaussian process terrain models from monocular images. In: IEEE/RSJ IROS 2012, pp. 4162–4168 (2012) Abuhashim, T., Sukkarieh, S.: Incorporating geometric information into gaussian process terrain models from monocular images. In: IEEE/RSJ IROS 2012, pp. 4162–4168 (2012)
2.
Zurück zum Zitat Baatz, G., Saurer, O., Köser, K., Pollefeys, M.: Large scale visual geo-localization of images in mountainous terrain. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7573, pp. 517–530. Springer, Heidelberg (2012). doi:10.1007/978-3-642-33709-3_37 Baatz, G., Saurer, O., Köser, K., Pollefeys, M.: Large scale visual geo-localization of images in mountainous terrain. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7573, pp. 517–530. Springer, Heidelberg (2012). doi:10.​1007/​978-3-642-33709-3_​37
3.
Zurück zum Zitat Calakli, F., Ulusoy, A.O., Restrepo, M.I., Taubin, G., Mundy, J.L.: High resolution surface reconstruction from multi-view aerial imagery. In: 3DIMPVT 2012, pp. 25–32 (2012) Calakli, F., Ulusoy, A.O., Restrepo, M.I., Taubin, G., Mundy, J.L.: High resolution surface reconstruction from multi-view aerial imagery. In: 3DIMPVT 2012, pp. 25–32 (2012)
4.
Zurück zum Zitat Carlson, F.B., Vuong, N.D., Johansson, R.: Polynomial reconstruction of 3D sampled curves using auxiliary surface data. In: IEEE ICRA 2014, pp. 4411–4416 (2014) Carlson, F.B., Vuong, N.D., Johansson, R.: Polynomial reconstruction of 3D sampled curves using auxiliary surface data. In: IEEE ICRA 2014, pp. 4411–4416 (2014)
5.
6.
Zurück zum Zitat Diskin, Y., Asari, V.: Dense point-cloud representation of a scene using monocular vision. J. Electron. Imaging 24(2), 023003 (2015)CrossRef Diskin, Y., Asari, V.: Dense point-cloud representation of a scene using monocular vision. J. Electron. Imaging 24(2), 023003 (2015)CrossRef
7.
Zurück zum Zitat Fabbri, R.: Multiview differential geometry in application to computer vision. Ph.D. dissertation. Division of Engineering, Brown University (2010) Fabbri, R.: Multiview differential geometry in application to computer vision. Ph.D. dissertation. Division of Engineering, Brown University (2010)
8.
Zurück zum Zitat Fabbri, R., Kimia, B.B., Giblin, P.J.: Camera pose estimation using first-order curve differential geometry. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7575, pp. 231–244. Springer, Heidelberg (2012). doi:10.1007/978-3-642-33765-9_17 Fabbri, R., Kimia, B.B., Giblin, P.J.: Camera pose estimation using first-order curve differential geometry. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7575, pp. 231–244. Springer, Heidelberg (2012). doi:10.​1007/​978-3-642-33765-9_​17
9.
Zurück zum Zitat Fabbri, R., Kimia, B.B.: High-order differential geometry of curves for multiview reconstruction and matching. In: Rangarajan, A., Vemuri, B., Yuille, A.L. (eds.) EMMCVPR 2005. LNCS, vol. 3757, pp. 645–660. Springer, Heidelberg (2005). doi:10.1007/11585978_42 CrossRef Fabbri, R., Kimia, B.B.: High-order differential geometry of curves for multiview reconstruction and matching. In: Rangarajan, A., Vemuri, B., Yuille, A.L. (eds.) EMMCVPR 2005. LNCS, vol. 3757, pp. 645–660. Springer, Heidelberg (2005). doi:10.​1007/​11585978_​42 CrossRef
10.
Zurück zum Zitat Fabbri, R., Kimia, B.B.: 3D curve sketch: flexible curve-based stereo reconstruction and calibration. In: CVPR (2010) Fabbri, R., Kimia, B.B.: 3D curve sketch: flexible curve-based stereo reconstruction and calibration. In: CVPR (2010)
11.
Zurück zum Zitat Fathi, H., Dai, F., Lourakis, M.: Automated as-built 3D reconstruction of civil infrastructure using computer vision. Adv. Eng. Inform. 29, 149–161 (2015)CrossRef Fathi, H., Dai, F., Lourakis, M.: Automated as-built 3D reconstruction of civil infrastructure using computer vision. Adv. Eng. Inform. 29, 149–161 (2015)CrossRef
12.
Zurück zum Zitat Feng, A., Shapiro, A., Ruizhe, W., Bolas, M., Medioni, G., Suma, E.: Rapid avatar capture and simulation using commodity depth sensors. In: SIGGRAPH 2014 (2014) Feng, A., Shapiro, A., Ruizhe, W., Bolas, M., Medioni, G., Suma, E.: Rapid avatar capture and simulation using commodity depth sensors. In: SIGGRAPH 2014 (2014)
13.
Zurück zum Zitat Fleming, R.W., Holtmann-Rice, D., Bülthoff, H.H.: Estimation of 3D shape from image orientations. PNAS 108(51), 20438–20443 (2011)CrossRef Fleming, R.W., Holtmann-Rice, D., Bülthoff, H.H.: Estimation of 3D shape from image orientations. PNAS 108(51), 20438–20443 (2011)CrossRef
14.
Zurück zum Zitat Guo, Y., Kumar, N., Narayanan, M., Kimia, B.: A multi-stage approach to curve extraction. In: CVPR 2014 (2014) Guo, Y., Kumar, N., Narayanan, M., Kimia, B.: A multi-stage approach to curve extraction. In: CVPR 2014 (2014)
15.
Zurück zum Zitat Heinly, J., Schönberger, J.L., Dunn, E., Frahm, J.-M.: Reconstructing the world in six days. In: CVPR 2015 (2015) Heinly, J., Schönberger, J.L., Dunn, E., Frahm, J.-M.: Reconstructing the world in six days. In: CVPR 2015 (2015)
16.
Zurück zum Zitat Jensen, R., Dahl, A., Vogiatzis, G., Tola, E., Aanaes, H.: Large scale multi-view stereopsis evaluation. In: CVPR 2014 (2014) Jensen, R., Dahl, A., Vogiatzis, G., Tola, E., Aanaes, H.: Large scale multi-view stereopsis evaluation. In: CVPR 2014 (2014)
17.
Zurück zum Zitat Koenderink, J., van Doorn, A., Wagemans, J.: SFS? not likely.... i-Perception 4(5), 299 (2013) Koenderink, J., van Doorn, A., Wagemans, J.: SFS? not likely.... i-Perception 4(5), 299 (2013)
18.
Zurück zum Zitat Kowdle, A., Batra, D., Chen, W.-C., Chen, T.: iModel: interactive co-segmentation for object of interest 3D modeling. In: Kutulakos, K.N. (ed.) ECCV 2010. LNCS, vol. 6554, pp. 211–224. Springer, Heidelberg (2012). doi:10.1007/978-3-642-35740-4_17 Kowdle, A., Batra, D., Chen, W.-C., Chen, T.: iModel: interactive co-segmentation for object of interest 3D modeling. In: Kutulakos, K.N. (ed.) ECCV 2010. LNCS, vol. 6554, pp. 211–224. Springer, Heidelberg (2012). doi:10.​1007/​978-3-642-35740-4_​17
19.
Zurück zum Zitat Kunsberg, B., Zucker, S.W.: Why shading matters along contours. In: Citti, G., Sarti, A. (eds.) Neuromathematics of Vision, pp. 107–129. Springer, Heidelberg (2014)CrossRef Kunsberg, B., Zucker, S.W.: Why shading matters along contours. In: Citti, G., Sarti, A. (eds.) Neuromathematics of Vision, pp. 107–129. Springer, Heidelberg (2014)CrossRef
20.
Zurück zum Zitat Lebeda, K., Hadfield, S., Bowden, R.: 2D or not 2D: bridging the gap between tracking and structure from motion. In: Cremers, D., Reid, I., Saito, H., Yang, M.-H. (eds.) ACCV 2014. LNCS, vol. 9006, pp. 642–658. Springer, Heidelberg (2014). doi:10.1007/978-3-319-16817-3_42 Lebeda, K., Hadfield, S., Bowden, R.: 2D or not 2D: bridging the gap between tracking and structure from motion. In: Cremers, D., Reid, I., Saito, H., Yang, M.-H. (eds.) ACCV 2014. LNCS, vol. 9006, pp. 642–658. Springer, Heidelberg (2014). doi:10.​1007/​978-3-319-16817-3_​42
21.
Zurück zum Zitat Litvinov, V., Yu, S., Lhuillier, M.: 2-manifold reconstruction from sparse visual features. In: IEEE IC3D 2012, pp. 1–8 (2012) Litvinov, V., Yu, S., Lhuillier, M.: 2-manifold reconstruction from sparse visual features. In: IEEE IC3D 2012, pp. 1–8 (2012)
22.
Zurück zum Zitat Mattingly, W.A., Chariker, J.H., Paris, R., Chang, D., Pani, J.R.: 3D modeling of branching structures for anatomical instruction. J. Vis. Lang. Comput. 29, 54–62 (2015)CrossRef Mattingly, W.A., Chariker, J.H., Paris, R., Chang, D., Pani, J.R.: 3D modeling of branching structures for anatomical instruction. J. Vis. Lang. Comput. 29, 54–62 (2015)CrossRef
23.
Zurück zum Zitat Pötsch, K., Pinz, A.: 3D geometric shape modeling by ‘3D contour cloud’ reconstruction from stereo videos. In: Computer Vision Winter Workshop, p. 99 (2011) Pötsch, K., Pinz, A.: 3D geometric shape modeling by ‘3D contour cloud’ reconstruction from stereo videos. In: Computer Vision Winter Workshop, p. 99 (2011)
24.
Zurück zum Zitat Rao, D., Chung, S.-J., Hutchinson, S.: CurveSLAM: an approach for vision-based navigation without point features. In: IEEE/RSJ IROS, pp. 4198–4204 (2012) Rao, D., Chung, S.-J., Hutchinson, S.: CurveSLAM: an approach for vision-based navigation without point features. In: IEEE/RSJ IROS, pp. 4198–4204 (2012)
25.
Zurück zum Zitat Restrepo, M., Ulusoy, A., Mundy, J.: Evaluation of feature-based 3-D registration of probabilistic volumetric scenes. J. Photogrammetry Remote Sens. 98, 1–18 (2014)CrossRef Restrepo, M., Ulusoy, A., Mundy, J.: Evaluation of feature-based 3-D registration of probabilistic volumetric scenes. J. Photogrammetry Remote Sens. 98, 1–18 (2014)CrossRef
26.
Zurück zum Zitat Rico Espino, J.G., Gonzalez-Barbosa, J.-J., Gómez Loenzo, R.A., Córdova Esparza, D.M., Gonzalez-Barbosa, R.: Vision system for 3D reconstruction with telecentric lens. In: Carrasco-Ochoa, J.A., Martínez-Trinidad, J.F., Olvera López, J.A., Boyer, K.L. (eds.) MCPR 2012. LNCS, vol. 7329, pp. 127–136. Springer, Heidelberg (2012). doi:10.1007/978-3-642-31149-9_13 Rico Espino, J.G., Gonzalez-Barbosa, J.-J., Gómez Loenzo, R.A., Córdova Esparza, D.M., Gonzalez-Barbosa, R.: Vision system for 3D reconstruction with telecentric lens. In: Carrasco-Ochoa, J.A., Martínez-Trinidad, J.F., Olvera López, J.A., Boyer, K.L. (eds.) MCPR 2012. LNCS, vol. 7329, pp. 127–136. Springer, Heidelberg (2012). doi:10.​1007/​978-3-642-31149-9_​13
27.
Zurück zum Zitat Shinozuka, Y., Saito, H.: Sharing 3D object with multiple clients via networks using vision-based 3D object tracking. In: VRIC 2014, pp. 34:1–34:4 (2014) Shinozuka, Y., Saito, H.: Sharing 3D object with multiple clients via networks using vision-based 3D object tracking. In: VRIC 2014, pp. 34:1–34:4 (2014)
28.
Zurück zum Zitat Simoes, F., Almeida, M., Pinheiro, M., dos Anjos, R.: Challenges in 3D reconstruction from images for difficult large-scale objects. In: SVAR 2014, pp. 74–83 (2014) Simoes, F., Almeida, M., Pinheiro, M., dos Anjos, R.: Challenges in 3D reconstruction from images for difficult large-scale objects. In: SVAR 2014, pp. 74–83 (2014)
29.
Zurück zum Zitat Teney, D., Piater, J.: Sampling-based multiview reconstruction without correspondences for 3D edges. In: 3DIMPVT 2012, pp. 160–167 (2012) Teney, D., Piater, J.: Sampling-based multiview reconstruction without correspondences for 3D edges. In: 3DIMPVT 2012, pp. 160–167 (2012)
30.
Zurück zum Zitat Wang, R., Choi, J., Medioni, G.: 3D modeling from wide baseline range scans using contour coherence. In: CVPR 2014 (2014) Wang, R., Choi, J., Medioni, G.: 3D modeling from wide baseline range scans using contour coherence. In: CVPR 2014 (2014)
31.
Zurück zum Zitat Zhang, L.: Line primitives and their applications in geometric computer vision. Ph.D. thesis (2013) Zhang, L.: Line primitives and their applications in geometric computer vision. Ph.D. thesis (2013)
32.
Zurück zum Zitat Zia, M., Stark, M., Schindler, K.: Towards scene understanding with detailed 3D object representations. IJCV 112(2), 188–203 (2015)MathSciNetCrossRef Zia, M., Stark, M., Schindler, K.: Towards scene understanding with detailed 3D object representations. IJCV 112(2), 188–203 (2015)MathSciNetCrossRef
33.
Zurück zum Zitat Zucker, S.: Stereo, shading, and surfaces: curvature constraints couple neural computations. Proc. IEEE 102(5), 812–829 (2014)CrossRef Zucker, S.: Stereo, shading, and surfaces: curvature constraints couple neural computations. Proc. IEEE 102(5), 812–829 (2014)CrossRef
34.
Zurück zum Zitat Agarwal, S., Snavely, N., Simon, I., Seitz, S.M., Szeliski, R.: Building Rome in a day. In: ICCV 2009 (2009) Agarwal, S., Snavely, N., Simon, I., Seitz, S.M., Szeliski, R.: Building Rome in a day. In: ICCV 2009 (2009)
35.
Zurück zum Zitat Aanæs, H., Dahl, A.L., Pedersen, K.: Interesting interest points. IJCV 97, 18–35 (2012)CrossRef Aanæs, H., Dahl, A.L., Pedersen, K.: Interesting interest points. IJCV 97, 18–35 (2012)CrossRef
36.
Zurück zum Zitat Berthilsson, R., Åström, K., Heyden, A.: Reconstruction of general curves, using factorization and bundle adjustment. IJCV 41(3), 171–182 (2001)CrossRefMATH Berthilsson, R., Åström, K., Heyden, A.: Reconstruction of general curves, using factorization and bundle adjustment. IJCV 41(3), 171–182 (2001)CrossRefMATH
37.
Zurück zum Zitat Cipolla, R., Giblin, P.: Visual Motion of Curves and Surfaces. Cambridge University Press, Cambridge (1999)MATH Cipolla, R., Giblin, P.: Visual Motion of Curves and Surfaces. Cambridge University Press, Cambridge (1999)MATH
38.
Zurück zum Zitat Cole, F., Sanik, K., DeCarlo, D., Finkelstein, A., Funkhouser, T., Rusinkiewicz, S., Singh, M.: How well do line drawings depict shape? In: SIGGRAPH 2009 (2009) Cole, F., Sanik, K., DeCarlo, D., Finkelstein, A., Funkhouser, T., Rusinkiewicz, S., Singh, M.: How well do line drawings depict shape? In: SIGGRAPH 2009 (2009)
39.
40.
Zurück zum Zitat Furukawa, Y., Ponce, J.: Accurate, dense, and robust multi-view stereopsis. In: CVPR 2007 (2007) Furukawa, Y., Ponce, J.: Accurate, dense, and robust multi-view stereopsis. In: CVPR 2007 (2007)
41.
Zurück zum Zitat Goesele, M., Snavely, N., Curless, B., Hoppe, H., Seitz, S.: Multi-view stereo for community photo collections. In: ICCV 2007 (2007) Goesele, M., Snavely, N., Curless, B., Hoppe, H., Seitz, S.: Multi-view stereo for community photo collections. In: ICCV 2007 (2007)
42.
Zurück zum Zitat Habbecke, M., Kobbelt, L.: A surface-growing approach to multi-view stereo reconstruction. In: CVPR 2007 (2007) Habbecke, M., Kobbelt, L.: A surface-growing approach to multi-view stereo reconstruction. In: CVPR 2007 (2007)
43.
Zurück zum Zitat Esteban, C.H., Schmitt, F.: Silhouette and stereo fusion for 3D object modeling. CVIU 96(3), 367–392 (2004) Esteban, C.H., Schmitt, F.: Silhouette and stereo fusion for 3D object modeling. CVIU 96(3), 367–392 (2004)
44.
Zurück zum Zitat Leggitt, J.: Drawing Shortcuts: Developing Quick Drawing Skills Using Today’s Technology. Wiley, New York (2015) Leggitt, J.: Drawing Shortcuts: Developing Quick Drawing Skills Using Today’s Technology. Wiley, New York (2015)
45.
Zurück zum Zitat Liu, S., Kang, K., Tarel, J.-P., Cooper, D.B.: Freeform object reconstruction from silhouettes, occluding edges and texture edges. PAMI 30, 131–146 (2007) Liu, S., Kang, K., Tarel, J.-P., Cooper, D.B.: Freeform object reconstruction from silhouettes, occluding edges and texture edges. PAMI 30, 131–146 (2007)
46.
Zurück zum Zitat Moreels, P., Perona, P.: Evaluation of features detectors and descriptors based on 3D objects. IJCV 73(3), 263–284 (2007)CrossRef Moreels, P., Perona, P.: Evaluation of features detectors and descriptors based on 3D objects. IJCV 73(3), 263–284 (2007)CrossRef
47.
Zurück zum Zitat Pollefeys, M., Gool, L.V., Vergauwen, M., Verbiest, F., Cornelis, K., Tops, J., Koch, R.: Visual modeling with a hand-held camera. IJCV 59(3), 207–232 (2004)CrossRef Pollefeys, M., Gool, L.V., Vergauwen, M., Verbiest, F., Cornelis, K., Tops, J., Koch, R.: Visual modeling with a hand-held camera. IJCV 59(3), 207–232 (2004)CrossRef
48.
Zurück zum Zitat Seitz, S., Curless, B., Diebel, J., Scharstein, D., Szeliski, R.: A comparison and evaluation of multi-view stereo reconstruction algorithms. In: CVPR 2006 (2006) Seitz, S., Curless, B., Diebel, J., Scharstein, D., Szeliski, R.: A comparison and evaluation of multi-view stereo reconstruction algorithms. In: CVPR 2006 (2006)
49.
Zurück zum Zitat Tamrakar, A., Kimia, B.B.: No grouping left behind: from edges to curve fragments. In: ICCV 2007 (2007) Tamrakar, A., Kimia, B.B.: No grouping left behind: from edges to curve fragments. In: ICCV 2007 (2007)
50.
Zurück zum Zitat Yee, R.: Architectural Drawing: A Visual Compendium of Types and Methods. Wiley, New York (2012) Yee, R.: Architectural Drawing: A Visual Compendium of Types and Methods. Wiley, New York (2012)
Metadaten
Titel
From Multiview Image Curves to 3D Drawings
verfasst von
Anil Usumezbas
Ricardo Fabbri
Benjamin B. Kimia
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-46493-0_5