Skip to main content

2021 | OriginalPaper | Buchkapitel

Low-Rank Registration of Images Captured Under Unknown, Varying Lighting

verfasst von : Matthieu Pizenberg, Yvain Quéau, Abderrahim Elmoataz

Erschienen in: Scale Space and Variational Methods in Computer Vision

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Photometric stereo infers the 3D-shape of a surface from a sequence of images captured under moving lighting and a static camera. However, in real-world scenarios the viewing angle may slightly vary, due to vibrations induced by the camera shutter, or when the camera is hand-held. In this paper, we put forward a low-rank affine registration technique for images captured under unknown, varying lighting. Optimization is carried out using convex relaxation and the alternating direction method of multipliers. The proposed method is shown to significantly improve 3D-reconstruction by photometric stereo on unaligned real-world data, and an open-source implementation is made available.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Baker, S., Matthews, I.: Lucas-Kanade 20 years on: a unifying framework. IJCV 56(3), 221–255 (2004)CrossRef Baker, S., Matthews, I.: Lucas-Kanade 20 years on: a unifying framework. IJCV 56(3), 221–255 (2004)CrossRef
2.
Zurück zum Zitat Basri, R., Jacobs, D.W.: Lambertian reflectance and linear subspaces. PAMI 25(2), 218–233 (2003)CrossRef Basri, R., Jacobs, D.W.: Lambertian reflectance and linear subspaces. PAMI 25(2), 218–233 (2003)CrossRef
3.
Zurück zum Zitat Basri, R., Jacobs, D.W., Kemelmacher, I.: Photometric stereo with general, unknown lighting. IJCV 72, 239–257 (2007)CrossRef Basri, R., Jacobs, D.W., Kemelmacher, I.: Photometric stereo with general, unknown lighting. IJCV 72, 239–257 (2007)CrossRef
4.
Zurück zum Zitat Berkiten, S., Rusinkiewicz, S.: Alignment of images captured under different light directions. Technical report, TR-974-14 (2014) Berkiten, S., Rusinkiewicz, S.: Alignment of images captured under different light directions. Technical report, TR-974-14 (2014)
5.
Zurück zum Zitat Bouguet, J.Y.: Pyramidal implementation of the affine Lucas-Kanade feature tracker: description of the algorithm. Technical report, Intel corporation (2001) Bouguet, J.Y.: Pyramidal implementation of the affine Lucas-Kanade feature tracker: description of the algorithm. Technical report, Intel corporation (2001)
6.
Zurück zum Zitat Boyd, S., Parikh, N., Chu, E., Peleato, B., Eckstein, J.: Distributed optimization and statistical learning via the alternating direction method of multipliers. Found. Trends Mach. Learn. 3, 1–122 (2010)CrossRef Boyd, S., Parikh, N., Chu, E., Peleato, B., Eckstein, J.: Distributed optimization and statistical learning via the alternating direction method of multipliers. Found. Trends Mach. Learn. 3, 1–122 (2010)CrossRef
7.
Zurück zum Zitat Engel, J., Koltun, V., Cremers, D.: Direct sparse odometry. PAMI 40(3), 611–625 (2017)CrossRef Engel, J., Koltun, V., Cremers, D.: Direct sparse odometry. PAMI 40(3), 611–625 (2017)CrossRef
8.
Zurück zum Zitat Foroosh, H., Zerubia, J., Berthod, M.: Extension of phase correlation to subpixel registration. TIP 11(3), 188–200 (2002) Foroosh, H., Zerubia, J., Berthod, M.: Extension of phase correlation to subpixel registration. TIP 11(3), 188–200 (2002)
9.
Zurück zum Zitat Förstner, W.: A feature based correspondence algorithm for image matching. In: ISPRS ComIII, pp. 150–166 (1986) Förstner, W.: A feature based correspondence algorithm for image matching. In: ISPRS ComIII, pp. 150–166 (1986)
10.
Zurück zum Zitat Harrison, A.P., Joseph, D.: Translational photometric alignment of single-view image sequences. CVIU 116(6), 765–776 (2012) Harrison, A.P., Joseph, D.: Translational photometric alignment of single-view image sequences. CVIU 116(6), 765–776 (2012)
11.
Zurück zum Zitat Ikehata, S., Wipf, D., Matsushita, Y., Aizawa, K.: Robust photometric stereo using sparse regression. In: CVPR, pp. 318–325 (2012) Ikehata, S., Wipf, D., Matsushita, Y., Aizawa, K.: Robust photometric stereo using sparse regression. In: CVPR, pp. 318–325 (2012)
12.
13.
Zurück zum Zitat Quéau, Y., Wu, T., Lauze, F., Durou, J.D., Cremers, D.: A non-convex variational approach to photometric stereo under inaccurate lighting. In: CVPR, pp. 99–108 (2017) Quéau, Y., Wu, T., Lauze, F., Durou, J.D., Cremers, D.: A non-convex variational approach to photometric stereo under inaccurate lighting. In: CVPR, pp. 99–108 (2017)
14.
Zurück zum Zitat Schmitt, C., Donne, S., Riegler, G., Koltun, V., Geiger, A.: On joint estimation of pose, geometry and svBRDF from a handheld scanner. In: CVPR, pp. 3493–3503 (2020) Schmitt, C., Donne, S., Riegler, G., Koltun, V., Geiger, A.: On joint estimation of pose, geometry and svBRDF from a handheld scanner. In: CVPR, pp. 3493–3503 (2020)
15.
Zurück zum Zitat Sengupta, S., Zhou, H., Forkel, W., Basri, R., Goldstein, T., Jacobs, D.: Solving uncalibrated photometric stereo using fewer images by jointly optimizing low-rank matrix completion and integrability. JMIV 60(4), 563–575 (2018)MathSciNetCrossRef Sengupta, S., Zhou, H., Forkel, W., Basri, R., Goldstein, T., Jacobs, D.: Solving uncalibrated photometric stereo using fewer images by jointly optimizing low-rank matrix completion and integrability. JMIV 60(4), 563–575 (2018)MathSciNetCrossRef
16.
Zurück zum Zitat Shi, B., Mo, Z., Wu, Z., Duan, D., Yeung, S., Tan, P.: A benchmark dataset and evaluation for non-Lambertian and uncalibrated photometric stereo. PAMI 41(2), 271–284 (2019)CrossRef Shi, B., Mo, Z., Wu, Z., Duan, D., Yeung, S., Tan, P.: A benchmark dataset and evaluation for non-Lambertian and uncalibrated photometric stereo. PAMI 41(2), 271–284 (2019)CrossRef
17.
Zurück zum Zitat Woodham, R.J.: Photometric method for determining surface orientation from multiple images. Opt. Eng. 19(1), 134–144 (1980)CrossRef Woodham, R.J.: Photometric method for determining surface orientation from multiple images. Opt. Eng. 19(1), 134–144 (1980)CrossRef
18.
Zurück zum Zitat Wu, L., Ganesh, A., Shi, B., Matsushita, Y., Wang, Y., Ma, Y.: Robust photometric stereo via low-rank matrix completion and recovery. In: ACCV, pp. 703–717 (2010) Wu, L., Ganesh, A., Shi, B., Matsushita, Y., Wang, Y., Ma, Y.: Robust photometric stereo via low-rank matrix completion and recovery. In: ACCV, pp. 703–717 (2010)
Metadaten
Titel
Low-Rank Registration of Images Captured Under Unknown, Varying Lighting
verfasst von
Matthieu Pizenberg
Yvain Quéau
Abderrahim Elmoataz
Copyright-Jahr
2021
DOI
https://doi.org/10.1007/978-3-030-75549-2_13