nach oben

Erschienen in:

2017 | OriginalPaper | Buchkapitel

A 3D Reconstruction Method with Color Reproduction from Multi-band and Multi-view Images

verfasst von : Shuya Ito, Koichi Ito, Takafumi Aoki, Masaru Tsuchida

Erschienen in: Computer Vision – ACCV 2016 Workshops

Verlag: Springer International Publishing

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

The purpose of digital archiving is the accurate rendering of authenticated contents in terms of color and shape. This paper proposes a novel 3D reconstruction method with color reproduction from multi-band and multi-view images. The proposed method consists of 5 steps: (i) feature tracking of multi-band and multi-view images, (ii) sparse 3D reconstruction using Structure from Motion (SfM), (iii) mesh generation from the sparse 3D point clouds, (iv) dense 3D reconstruction and (v) color reproduction. We create multi-band and multi-view image datasets of Japanese dolls with Kimono for quantitative performance evaluation. Through a set of experiments using our datasets, we confirm that our proposed method exhibits efficient performance of reconstructing a high-quality 3D model from multi-band and multi-view images compared with conventional methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Vorheriges Kapitel Radiometry Propagation to Large 3D Point Clouds from Sparsely Sampled Ground Truth

Nächstes Kapitel Out of Time: Automated Lip Sync in the Wild

http://www.vision.caltech.edu/bouguetj/calib_doc/.

Hardeberg, J.: Acquisition and Reproduction of Color Images: Colorimetric and Multispectral Approaches. Universal Publishers, Boca Raton (2001)

Szeliski, R.: Computer Vision: Algorithms and Applications. Springer-Verlag New York Inc., New York (2010)MATH

Seitz, S.M., Curless, B., Diebel, J., Scharstein, D., Szeliski, R.: A comparison and evaluation of multi-views stereo reconstruction algorithms. In: Proceedings of the International Conference on Computer Vision and Pattern Recognition, pp. 519–528 (2006)

Strecha, C., von Hansen, W., Gool, L.V., Fua, P., Thoennessen, U.: On benchmarking camera calibration and multi-view stereo for high resolution imagery. In: Proceedings of the International Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2008)

Vrhel, M., Trussell, H.: Color correction using principal components. Color Res. Appl. 17, 328–338 (1992)CrossRef

Furukawa, Y., Curless, B., Seitz, S.M., Szeliski, R.: Towards internet-scale multi-view stereo. In: Proceedings of the International Conference on Computer Vision and Pattern Recognition, pp. 1434–1441 (2010)

Furukawa, Y., Ponce, J.: Accurate, dense, and robust multiview stereopsis. IEEE Trans. Pattern Anal. Mach. Intell. 32, 1362–1376 (2010)CrossRef

Wu, C., Liu, Y., Dai, Q., Wilburn, B.: Fusing multiview and photometric stereo for 3D reconstruction under uncalibrated illumination. IEEE Trans. Vis. Comput. Graph. 17, 1082–1095 (2011)CrossRef

Hartley, R., Zisserman, A.: Multiple View Geometry. Cambridge University Press, Cambridge (2004)CrossRefMATH

10.

Kuglin, C.D., Hines, D.C.: The phase correlation image alignment method. In: Proceedings of the International Conference on Cybernetics and Society, pp. 163–165 (1975)

11.

Takita, K., Aoki, T., Sasaki, Y., Higuchi, T., Kobayashi, K.: High-accuracy subpixel image registration based on phase-only correlation. IEICE Trans. Fundam. E86-A, 1925–1934 (2003)

12.

Tsuchida, M., Sakai, S., Ito, K., Kashino, K., Yamato, J., Aoki, T.: Efficient POC-based correspondence detection method for multi-channel images. In: Proceedings of Color and Imaging Conference, pp. 113–118 (2014)

13.

Sakai, S., Ito, K., Aoki, T., Masuda, T., Unten, H.: An efficient image matching method for multi-view stereo. In: Lee, K.M., Matsushita, Y., Rehg, J.M., Hu, Z. (eds.) ACCV 2012. LNCS, vol. 7727, pp. 283–296. Springer, Heidelberg (2013). doi:10.1007/978-3-642-37447-0_22 CrossRef

14.

Takita, K., Muquit, M.A., Aoki, T., Higuchi, T.: A sub-pixel correspondence search for computer vision applications. IEICE Trans. Fundam. E87-A, 1913–1923 (2004)

15.

Ishii, J., Sakai, S., Ito, K., Aoki, T., Yanagi, T., Ando, T.: 3D reconstruction of urban environments using in-vehicle fisheye camera. In: Proceedings of the IEEE International Conference on Image Processing, pp. 2145–2148 (2013)

16.

Shi, J., Tomasi, C.: Good features to track. In: Proceedings of the International Conference on Computer Vision and Pattern Recognition, pp. 593–600 (1994)

17.

Kneip, L., Scaramuzza, D., Siegwart, R.: A novel parametrization of the perspective-three-point problem for a direct computation of absolute camera position and orientation. In: Proceedings of the International Conference on Computer Vision and Pattern Recognition, pp. 2969–2976. IEEE (2011)

18.

Nistér, D.: An efficient solution to the five-point relative pose problem. IEEE Trans. Pattern Anal. Mach. Intell. 26, 756–770 (2004)CrossRef

19.

Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24, 381–395 (1981)MathSciNetCrossRef

20.

Labatut, P., Pons, J.P., Keriven, R.: Robust and efficient surface reconstruction from range data. Comput. Graph. Forum 28, 2275–2290 (2009)CrossRef

21.

Havel, J., Herout, A.: Yet faster ray-triangle intersection (using SSE4). Trans. Vis. Comput. Graph. 16, 434–438 (2010)CrossRef

22.

Ishii, J., Sakai, S., Ito, K., Aoki, T.: Wide-baseline stereo matching using ASIFT and POC. In: Proceedings of the IEEE International Conference on Image Processing, pp. 2977–2980 (2012)

23.

Tsuchida, M., Sakai, S., Miura, M., Ito, K., Kawanishi, K., Kashino, K., Yamato, J., Aoki, T.: Stereo one-shot six-band camera system for accurate color reproduction. J. Electron. Imaging 23, 033025-1–033025-12 (2013)

24.

Pratt, W.K., Mancill, C.E.: Spectral estimation techniques for the spectral calibration of a color image scanner. Appl. Opt. 15, 73–75 (1976)CrossRef

25.

Wu, C.: VisualSFM: A Visual Structure from Motion System. http://homes.cs.washington.edu/~ccwu/vsfm/

26.

Jensen, R., Dahl, A., Vogiatzis, G., Tola, E., Anæs, H.: Large scale multi-view stereopsis evaluation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 406–413 (2014)

Titel: A 3D Reconstruction Method with Color Reproduction from Multi-band and Multi-view Images
verfasst von: Shuya Ito
Koichi Ito
Takafumi Aoki
Masaru Tsuchida
Verlag: Springer International Publishing
Buch: Computer Vision – ACCV 2016 Workshops
Print ISBN: 978-3-319-54426-7

Electronic ISBN: 978-3-319-54427-4

Copyright-Jahr: 2017
DOI: https://doi.org/10.1007/978-3-319-54427-4_18

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner