Skip to main content

2017 | Supplement | Buchkapitel

Robust Multi-image HDR Reconstruction for the Modulo Camera

verfasst von : Florian Lang, Tobias Plötz, Stefan Roth

Erschienen in: Pattern Recognition

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Photographing scenes with high dynamic range (HDR) poses great challenges to consumer cameras with their limited sensor bit depth. To address this, Zhao et al. recently proposed a novel sensor concept – the modulo camera – which captures the least significant bits of the recorded scene instead of going into saturation. Similar to conventional pipelines, HDR images can be reconstructed from multiple exposures, but significantly fewer images are needed than with a typical saturating sensor. While the concept is appealing, we show that the original reconstruction approach assumes noise-free measurements and quickly breaks down otherwise. To address this, we propose a novel reconstruction algorithm that is robust to image noise and produces significantly fewer artifacts. We theoretically analyze correctness as well as limitations, and show that our approach significantly outperforms the baseline on real data.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Böhm, M., Blecher, F., Eckhardt, A., Schneider, B., Benthien, S., Keller, H., Lulé, T., Rieve, P., Sommer, M., Lind, R.C., Humm, L., Daniels, M., Wu, N., Yen, H., Efron, U.: High dynamic range image sensors in thin film on ASIC technology for automotive applications. In: Ricken, D.E., Gessner, W. (eds.) Advanced Microsystems for Automotive Applications, pp. 157–172. Springer, Berlin (1998). (Jan) Böhm, M., Blecher, F., Eckhardt, A., Schneider, B., Benthien, S., Keller, H., Lulé, T., Rieve, P., Sommer, M., Lind, R.C., Humm, L., Daniels, M., Wu, N., Yen, H., Efron, U.: High dynamic range image sensors in thin film on ASIC technology for automotive applications. In: Ricken, D.E., Gessner, W. (eds.) Advanced Microsystems for Automotive Applications, pp. 157–172. Springer, Berlin (1998). (Jan)
2.
Zurück zum Zitat Chavez, S., Xiang, Q.S., An, L.: Understanding phase maps in MRI: a new cutline phase unwrapping method. IEEE Trans. Med. Imaging 21, 966–977 (2002)CrossRef Chavez, S., Xiang, Q.S., An, L.: Understanding phase maps in MRI: a new cutline phase unwrapping method. IEEE Trans. Med. Imaging 21, 966–977 (2002)CrossRef
3.
Zurück zum Zitat Cordts, M., Omran, M., Ramos, S., Scharwächter, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., Schiele, B.: The Cityscapes dataset for semantic urban scene understanding. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2016 Cordts, M., Omran, M., Ramos, S., Scharwächter, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., Schiele, B.: The Cityscapes dataset for semantic urban scene understanding. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2016
4.
Zurück zum Zitat Debevec, P.E., Malik, J.: Recovering high dynamic range radiance maps from photographs. In: ACM Transactions Graphics (Proceedings of ACM SIGGRAPH), pp. 369–378, August 1997 Debevec, P.E., Malik, J.: Recovering high dynamic range radiance maps from photographs. In: ACM Transactions Graphics (Proceedings of ACM SIGGRAPH), pp. 369–378, August 1997
5.
Zurück zum Zitat Foi, A., Trimeche, M., Katkovnik, V., Egiazarian, K.: Practical poissonian-Gaussian noise modeling and fitting for single-image raw-data. IEEE Trans. Image Process. 17(10), 1737–1754 (2008)MathSciNetCrossRefMATH Foi, A., Trimeche, M., Katkovnik, V., Egiazarian, K.: Practical poissonian-Gaussian noise modeling and fitting for single-image raw-data. IEEE Trans. Image Process. 17(10), 1737–1754 (2008)MathSciNetCrossRefMATH
7.
Zurück zum Zitat Gallo, O., Gelfand, N., Chen, W., Tico, M., Pulli, K.: Artifact-free high dynamic range imaging. IEEE International Conference on Computer Photography (ICCP), April 2009 Gallo, O., Gelfand, N., Chen, W., Tico, M., Pulli, K.: Artifact-free high dynamic range imaging. IEEE International Conference on Computer Photography (ICCP), April 2009
8.
Zurück zum Zitat Goldstein, R.M., Zebker, H.A., Werner, C.L.: Satellite radar interferometry: two-dimensional phase unwrapping. Radio Sci. 23(4), 713–720 (1988)CrossRef Goldstein, R.M., Zebker, H.A., Werner, C.L.: Satellite radar interferometry: two-dimensional phase unwrapping. Radio Sci. 23(4), 713–720 (1988)CrossRef
9.
Zurück zum Zitat Granados, M., Ajdin, B., Wand, M., Theobalt, C., Seidel, H.P., Lensch, H.P.A.: Optimal HDR reconstruction with linear digital cameras. In: IEEE Conference on Computer Vision and Pattern Recogion (CVPR), pp. 215–222, June 2010 Granados, M., Ajdin, B., Wand, M., Theobalt, C., Seidel, H.P., Lensch, H.P.A.: Optimal HDR reconstruction with linear digital cameras. In: IEEE Conference on Computer Vision and Pattern Recogion (CVPR), pp. 215–222, June 2010
10.
Zurück zum Zitat Grossberg, M.D., Nayar, S.K.: High dynamic range from multiple images: which exposures to combine?. In: ICCV Workshop on Color and Photometric Methods in Computer Vision (CPMCV), October 2003 Grossberg, M.D., Nayar, S.K.: High dynamic range from multiple images: which exposures to combine?. In: ICCV Workshop on Color and Photometric Methods in Computer Vision (CPMCV), October 2003
12.
Zurück zum Zitat Hoefflinger, B. (ed.): High-Dynamic-Range (HDR) Vision. Springer, Heidelberg (2007) Hoefflinger, B. (ed.): High-Dynamic-Range (HDR) Vision. Springer, Heidelberg (2007)
13.
Zurück zum Zitat Jacobs, K., Loscos, C., Ward, G.: Automatic high-dynamic range image generation for dynamic scenes. IEEE Comput. Graph. Appl. 28(2), 84–93 (2008)CrossRef Jacobs, K., Loscos, C., Ward, G.: Automatic high-dynamic range image generation for dynamic scenes. IEEE Comput. Graph. Appl. 28(2), 84–93 (2008)CrossRef
14.
Zurück zum Zitat Loose, M., Meier, K., Schemmel, J.: A self-calibrating single-chip CMOS camera with logarithmic response. IEEE J. Solid-State Circuits 36(4), 586–596 (2001)CrossRef Loose, M., Meier, K., Schemmel, J.: A self-calibrating single-chip CMOS camera with logarithmic response. IEEE J. Solid-State Circuits 36(4), 586–596 (2001)CrossRef
15.
Zurück zum Zitat Mäkitalo, M., Foi, A.: Noise parameter mismatch in variance stabilization, with an application to Poisson-Gaussian noise estimation. IEEE Trans. Image Process. 23(12), 5348–5359 (2014)MathSciNetCrossRefMATH Mäkitalo, M., Foi, A.: Noise parameter mismatch in variance stabilization, with an application to Poisson-Gaussian noise estimation. IEEE Trans. Image Process. 23(12), 5348–5359 (2014)MathSciNetCrossRefMATH
16.
Zurück zum Zitat Mann, S., Picard, R.W.: On being ‘undigital’ with digital cameras: extending dynamic range by combining differently exposed pictures. In: Proceedings of Imaging Science and Technology, pp. 442–448, May 1995 Mann, S., Picard, R.W.: On being ‘undigital’ with digital cameras: extending dynamic range by combining differently exposed pictures. In: Proceedings of Imaging Science and Technology, pp. 442–448, May 1995
17.
Zurück zum Zitat Mantiuk, R.K., Myszkowski, K., Seidel, H.P.: High dynamic range imaging. In: Wiley Encyclopedia of Electrical and Electronics Engineering. Wiley (2015) Mantiuk, R.K., Myszkowski, K., Seidel, H.P.: High dynamic range imaging. In: Wiley Encyclopedia of Electrical and Electronics Engineering. Wiley (2015)
18.
Zurück zum Zitat Nayar, S.K., Mitsunaga, T.: High dynamic range imaging: spatially varying pixel exposures. In: IEEE Conference on Computer Vision and Pattern Recogition (CVPR), June 2000 Nayar, S.K., Mitsunaga, T.: High dynamic range imaging: spatially varying pixel exposures. In: IEEE Conference on Computer Vision and Pattern Recogition (CVPR), June 2000
19.
Zurück zum Zitat Robertson, M.A., Borman, S., Stevenson, R.L.: Estimation-theoretic approach to dynamic range enhancement using multiple exposures. Electron. Imaging 12(2), 219–228 (2003)CrossRef Robertson, M.A., Borman, S., Stevenson, R.L.: Estimation-theoretic approach to dynamic range enhancement using multiple exposures. Electron. Imaging 12(2), 219–228 (2003)CrossRef
20.
Zurück zum Zitat Stumpfel, J., Tchou, C., Jones, A., Hawkins, T., Wenger, A., Debevec, P.: Direct HDR capture of the sun and sky. In: Proceedings of the 3rd International Conference on Computer Graphics, Virtual Reality, Visualisation and Interact, in Africa. pp. 145–149. AFRIGRAPH 2004, November 2004 Stumpfel, J., Tchou, C., Jones, A., Hawkins, T., Wenger, A., Debevec, P.: Direct HDR capture of the sun and sky. In: Proceedings of the 3rd International Conference on Computer Graphics, Virtual Reality, Visualisation and Interact, in Africa. pp. 145–149. AFRIGRAPH 2004, November 2004
21.
Zurück zum Zitat Tumblin, J., Agrawal, A., Raskar, R.: Why I want a gradient camera. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 103–110, June 2014 Tumblin, J., Agrawal, A., Raskar, R.: Why I want a gradient camera. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 103–110, June 2014
22.
Zurück zum Zitat Zhao, H., Shi, B., Fernandez-Cull, C., Yeung, S.K., Raskar, R.: Unbounded high dynamic range photography using a modulo camera. In: International Conference on Computational Photography (ICCP), April 2015 Zhao, H., Shi, B., Fernandez-Cull, C., Yeung, S.K., Raskar, R.: Unbounded high dynamic range photography using a modulo camera. In: International Conference on Computational Photography (ICCP), April 2015
Metadaten
Titel
Robust Multi-image HDR Reconstruction for the Modulo Camera
verfasst von
Florian Lang
Tobias Plötz
Stefan Roth
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-66709-6_7

Premium Partner