Skip to main content

2019 | OriginalPaper | Buchkapitel

Flash, Storm, and Mistral: Hardware-Friendly and High Quality Tone Mapping

verfasst von : Nikola Banić, Sven Lončarić

Erschienen in: Computer Vision, Imaging and Computer Graphics Theory and Applications

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

While high dynamic range (HDR) images are being used ever more widely, the majority of display devices are able to properly handle only low dynamic range (LDR) images. Tone mapping operators (TMOs) solve this problem by compressing the dynamic range of HDR images so that they can be displayed as LDR images. The problem with many state-of-the-art TMOs is that despite giving high quality results they are often too complex to be used for simple hardware implementations. In this paper several new TMOs formed around the perceptually based Naka-Rushton equation are proposed with the main goal being hardware-friendliness. The proposed TMOs are of gradually increasing complexity, which allows choosing the most appropriate trade-off between quality and complexity, and all of them are designed to have O(1) per-pixel complexity. The results are presented and discussed and it is shown that the proposed TMOs outperform most well-known publicly available TMOs in terms of quality and speed. The source codes of the proposed TMOs written in C++, Matlab, Python, Java, and HTML+JavaScript are available at http://​www.​fer.​unizg.​hr/​ipg/​resources/​color_​constancy/​.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Reinhard, E., Heidrich, W., Debevec, P., Pattanaik, S., Ward, G., Myszkowski, K.: High Dynamic Range Imaging: Acquisition, Display, and Image-Basedlighting. Morgan Kaufmann, Burlington (2010) Reinhard, E., Heidrich, W., Debevec, P., Pattanaik, S., Ward, G., Myszkowski, K.: High Dynamic Range Imaging: Acquisition, Display, and Image-Basedlighting. Morgan Kaufmann, Burlington (2010)
2.
Zurück zum Zitat Koschan, A., Abidi, M.: Digital Color Image Processing. Wiley, Hoboken (2008)CrossRef Koschan, A., Abidi, M.: Digital Color Image Processing. Wiley, Hoboken (2008)CrossRef
3.
Zurück zum Zitat Banić, N., Lončarić, S.: Improving the Tone Mapping Operators by Using a Redefined Version of the Luminance Channel. In: Image and Signal Processing. Springer (2014) 392–399 Banić, N., Lončarić, S.: Improving the Tone Mapping Operators by Using a Redefined Version of the Luminance Channel. In: Image and Signal Processing. Springer (2014) 392–399
4.
Zurück zum Zitat Nguyen, R.M., Brown, M.S.: Why you should forget luminance conversion and do something better. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 6750–6758 (2017) Nguyen, R.M., Brown, M.S.: Why you should forget luminance conversion and do something better. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 6750–6758 (2017)
5.
Zurück zum Zitat Tumblin, J., Rushmeier, H.: Tone reproduction for realistic images. IEEE Comput. Graph. Appl. 13, 42–48 (1993)CrossRef Tumblin, J., Rushmeier, H.: Tone reproduction for realistic images. IEEE Comput. Graph. Appl. 13, 42–48 (1993)CrossRef
6.
Zurück zum Zitat Chiu, K., et al.: Spatially nonuniform scaling functions for high contrast images. In: Graphics Interface, Canadian Information Processing Society, p. 245 (1993) Chiu, K., et al.: Spatially nonuniform scaling functions for high contrast images. In: Graphics Interface, Canadian Information Processing Society, p. 245 (1993)
7.
Zurück zum Zitat Ward, G.: A contrast-based scalefactor for luminance display. In: Graphics gems IV, pp. 415–421 (1994) Ward, G.: A contrast-based scalefactor for luminance display. In: Graphics gems IV, pp. 415–421 (1994)
9.
Zurück zum Zitat Pattanaik, S.N., Tumblin, J., Yee, H., Greenberg, D.P.: Time-dependent visual adaptation for fast realistic image display. In: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, pp. 47–54. ACM Press/Addison-Wesley Publishing Co. (2000) Pattanaik, S.N., Tumblin, J., Yee, H., Greenberg, D.P.: Time-dependent visual adaptation for fast realistic image display. In: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, pp. 47–54. ACM Press/Addison-Wesley Publishing Co. (2000)
10.
Zurück zum Zitat Drago, F., Myszkowski, K., Annen, T., Chiba, N.: Adaptive logarithmic mapping for displaying high contrast scenes. In: Computer Graphics Forum, vol. 22, pp. 419–426. Wiley Online Library (2003) Drago, F., Myszkowski, K., Annen, T., Chiba, N.: Adaptive logarithmic mapping for displaying high contrast scenes. In: Computer Graphics Forum, vol. 22, pp. 419–426. Wiley Online Library (2003)
11.
Zurück zum Zitat Reinhard, E., Devlin, K.: Dynamic range reduction inspired by photoreceptor physiology. IEEE Trans. Visual Comput. Graphics 11, 13–24 (2005)CrossRef Reinhard, E., Devlin, K.: Dynamic range reduction inspired by photoreceptor physiology. IEEE Trans. Visual Comput. Graphics 11, 13–24 (2005)CrossRef
12.
Zurück zum Zitat Larson, G.W., Rushmeier, H., Piatko, C.: A visibility matching tone reproduction operator for high dynamic range scenes. IEEE Trans. Visual Comput. Graphics 3, 291–306 (1997)CrossRef Larson, G.W., Rushmeier, H., Piatko, C.: A visibility matching tone reproduction operator for high dynamic range scenes. IEEE Trans. Visual Comput. Graphics 3, 291–306 (1997)CrossRef
13.
Zurück zum Zitat Braun, G.J., Fairchild, M.D.: Image lightness rescaling using sigmoidal contrast enhancement functions. J. Electron. Imaging 8, 380–393 (1999)CrossRef Braun, G.J., Fairchild, M.D.: Image lightness rescaling using sigmoidal contrast enhancement functions. J. Electron. Imaging 8, 380–393 (1999)CrossRef
14.
Zurück zum Zitat Tumblin, J., Turk, G.: LCIS: A boundary hierarchy for detail-preserving contrast reduction. In: Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques, pp. 83–90. ACM Press/Addison-Wesley Publishing Co. (1999) Tumblin, J., Turk, G.: LCIS: A boundary hierarchy for detail-preserving contrast reduction. In: Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques, pp. 83–90. ACM Press/Addison-Wesley Publishing Co. (1999)
15.
Zurück zum Zitat Durand, F., Dorsey, J.: Fast bilateral filtering for the display of high-dynamic-range images. In: ACM Transactions on Graphics (TOG), vol. 21, pp. 257–266 (2002) Durand, F., Dorsey, J.: Fast bilateral filtering for the display of high-dynamic-range images. In: ACM Transactions on Graphics (TOG), vol. 21, pp. 257–266 (2002)
16.
Zurück zum Zitat Reinhard, E., Stark, M., Shirley, P., Ferwerda, J.: Photographic tone reproduction for digital images. In: ACM Transactions on Graphics (TOG), vol. 21, pp. 267–276. ACM (2002) Reinhard, E., Stark, M., Shirley, P., Ferwerda, J.: Photographic tone reproduction for digital images. In: ACM Transactions on Graphics (TOG), vol. 21, pp. 267–276. ACM (2002)
17.
Zurück zum Zitat Fattal, R., Lischinski, D., Werman, M.: Gradient domain high dynamic range compression. In: ACM Transactions on Graphics (TOG), vol. 21, pp. 249–256. ACM (2002) Fattal, R., Lischinski, D., Werman, M.: Gradient domain high dynamic range compression. In: ACM Transactions on Graphics (TOG), vol. 21, pp. 249–256. ACM (2002)
18.
Zurück zum Zitat Mantiuk, R., Myszkowski, K., Seidel, H.P.: A perceptual framework for contrast processing of high dynamic range images. ACM Trans. Appl. Percept. (TAP) 3, 286–308 (2006)CrossRef Mantiuk, R., Myszkowski, K., Seidel, H.P.: A perceptual framework for contrast processing of high dynamic range images. ACM Trans. Appl. Percept. (TAP) 3, 286–308 (2006)CrossRef
19.
Zurück zum Zitat Meylan, L., Susstrunk, S.: High dynamic range image rendering with a retinex-based adaptive filter. IEEE Trans. Image Process. 15, 2820–2830 (2006)CrossRef Meylan, L., Susstrunk, S.: High dynamic range image rendering with a retinex-based adaptive filter. IEEE Trans. Image Process. 15, 2820–2830 (2006)CrossRef
21.
Zurück zum Zitat Banić, N., Lončarić, S.: Puma: a high-quality retinex-based tone mapping operator. In: Signal Processing Conference (EUSIPCO), 2016 24rd European, pp. 943–947. IEEE (2016) Banić, N., Lončarić, S.: Puma: a high-quality retinex-based tone mapping operator. In: Signal Processing Conference (EUSIPCO), 2016 24rd European, pp. 943–947. IEEE (2016)
22.
Zurück zum Zitat Kuang, J., Yamaguchi, H., Johnson, G.M., Fairchild, M.D.: Testing HDR image rendering algorithms. In: Color and Imaging Conference, vol. 2004, pp. 315–320. Society for Imaging Science and Technology (2004) Kuang, J., Yamaguchi, H., Johnson, G.M., Fairchild, M.D.: Testing HDR image rendering algorithms. In: Color and Imaging Conference, vol. 2004, pp. 315–320. Society for Imaging Science and Technology (2004)
23.
Zurück zum Zitat Kuang, J., Yamaguchi, H., Liu, C., Johnson, G.M., Fairchild, M.D.: Evaluating HDR rendering algorithms. ACM Trans. Appl. Percept. (TAP) 4, 9 (2007)CrossRef Kuang, J., Yamaguchi, H., Liu, C., Johnson, G.M., Fairchild, M.D.: Evaluating HDR rendering algorithms. ACM Trans. Appl. Percept. (TAP) 4, 9 (2007)CrossRef
24.
Zurück zum Zitat Urbano, C., Magalhães, L., Moura, J., Bessa, M., Marcos, A., Chalmers, A.: Tone mapping operators on small screen devices: an evaluation study. In: Computer Graphics Forum, vol. 29, pp. 2469–2478. Wiley Online Library (2010) Urbano, C., Magalhães, L., Moura, J., Bessa, M., Marcos, A., Chalmers, A.: Tone mapping operators on small screen devices: an evaluation study. In: Computer Graphics Forum, vol. 29, pp. 2469–2478. Wiley Online Library (2010)
25.
Zurück zum Zitat Banić, N., Lončarić, S.: Flash and storm: fast and highly practical tone mapping based on Naka-Rushton equation. In: International Conference on Computer Vision Theory and Applications (VISAPP), pp. 47–53 (2018) Banić, N., Lončarić, S.: Flash and storm: fast and highly practical tone mapping based on Naka-Rushton equation. In: International Conference on Computer Vision Theory and Applications (VISAPP), pp. 47–53 (2018)
26.
Zurück zum Zitat Banić, N., Lončarić, S.: Smart light random memory sprays retinex: a fast retinex implementation for high-quality brightness adjustment and color correction. JOSA A 32, 2136–2147 (2015)CrossRef Banić, N., Lončarić, S.: Smart light random memory sprays retinex: a fast retinex implementation for high-quality brightness adjustment and color correction. JOSA A 32, 2136–2147 (2015)CrossRef
27.
Zurück zum Zitat Banić, N., Lončarić, S.: Towards hardware-friendly Retinex algorithms. In: 2017 10th International Symposium on Image and Signal Processing and Analysis (ISPA), pp. 104–108. IEEE (2017) Banić, N., Lončarić, S.: Towards hardware-friendly Retinex algorithms. In: 2017 10th International Symposium on Image and Signal Processing and Analysis (ISPA), pp. 104–108. IEEE (2017)
28.
Zurück zum Zitat Shapley, R., Enroth-Cugell, C.: Visual adaptation and retinal gain controls. Prog. Retinal Res. 3, 263–346 (1984)CrossRef Shapley, R., Enroth-Cugell, C.: Visual adaptation and retinal gain controls. Prog. Retinal Res. 3, 263–346 (1984)CrossRef
29.
Zurück zum Zitat Dowling, J.E.: The Retina: An Approachable Part of the Brain. Harvard University Press, Cambridge (1987) Dowling, J.E.: The Retina: An Approachable Part of the Brain. Harvard University Press, Cambridge (1987)
30.
Zurück zum Zitat Joze, H.R.V., Drew, M.S., Finlayson, G.D., Rey, P.A.T.: The role of bright pixels in illumination estimation. In: Color and Imaging Conference, vol. 2012, pp. 41–46. Society for Imaging Science and Technology (2012) Joze, H.R.V., Drew, M.S., Finlayson, G.D., Rey, P.A.T.: The role of bright pixels in illumination estimation. In: Color and Imaging Conference, vol. 2012, pp. 41–46. Society for Imaging Science and Technology (2012)
31.
Zurück zum Zitat Huang, J., Mumford, D.: Statistics of natural images and models. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1999, vol. 1. IEEE (1999) Huang, J., Mumford, D.: Statistics of natural images and models. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1999, vol. 1. IEEE (1999)
34.
Zurück zum Zitat Ma, K., Yeganeh, H., Zeng, K., Wang, Z.: High dynamic range image compression by optimizing tone mapped image quality index. IEEE Trans. Image Process. 24, 3086–3097 (2015)MathSciNetCrossRef Ma, K., Yeganeh, H., Zeng, K., Wang, Z.: High dynamic range image compression by optimizing tone mapped image quality index. IEEE Trans. Image Process. 24, 3086–3097 (2015)MathSciNetCrossRef
35.
Zurück zum Zitat Yeganeh, H., Zhou, W.: Objective quality assessment of tone mapped images. IEEE Trans. Image Process. 22, 657–667 (2013)MathSciNetCrossRef Yeganeh, H., Zhou, W.: Objective quality assessment of tone mapped images. IEEE Trans. Image Process. 22, 657–667 (2013)MathSciNetCrossRef
36.
Zurück zum Zitat Wilson, H.R.: Psychophysical models of spatial vision and hyperacuity. Spat. Vis. 10, 64–81 (1991) Wilson, H.R.: Psychophysical models of spatial vision and hyperacuity. Spat. Vis. 10, 64–81 (1991)
37.
38.
Zurück zum Zitat Jobson, D.J., Rahman, Z.U., Woodell, G., et al.: A multiscale retinex for bridging the gap between color images and the human observation of scenes. IEEE Trans. Image Process. 6, 965–976 (1997)CrossRef Jobson, D.J., Rahman, Z.U., Woodell, G., et al.: A multiscale retinex for bridging the gap between color images and the human observation of scenes. IEEE Trans. Image Process. 6, 965–976 (1997)CrossRef
39.
Zurück zum Zitat Pattanaik, S.N., Ferwerda, J.A., Fairchild, M.D., Greenberg, D.P.: A multiscale model of adaptation and spatial vision for realistic image display. In: Proceedings of the 25th annual conference on Computer graphics and interactive techniques, pp. 287–298. ACM (1998) Pattanaik, S.N., Ferwerda, J.A., Fairchild, M.D., Greenberg, D.P.: A multiscale model of adaptation and spatial vision for realistic image display. In: Proceedings of the 25th annual conference on Computer graphics and interactive techniques, pp. 287–298. ACM (1998)
40.
Zurück zum Zitat Crow, F.C.: Summed-area tables for texture mapping. ACM SIGGRAPH Comput. Graph. 18, 207–212 (1984)CrossRef Crow, F.C.: Summed-area tables for texture mapping. ACM SIGGRAPH Comput. Graph. 18, 207–212 (1984)CrossRef
41.
Zurück zum Zitat Banić, N., Lončarić, S.: Firefly: a hardware-friendly real-time local brightness adjustment method. In: 2015 22nd IEEE International Conference on Image Processing (ICIP), pp. 3951–3955. IEEE (2015) Banić, N., Lončarić, S.: Firefly: a hardware-friendly real-time local brightness adjustment method. In: 2015 22nd IEEE International Conference on Image Processing (ICIP), pp. 3951–3955. IEEE (2015)
43.
Zurück zum Zitat Ashikhmin, M.: A tone mapping algorithm for high contrast images. In: Proceedings of the 13th Eurographics Workshop on Rendering, pp. 145–156. Eurographics Association (2002) Ashikhmin, M.: A tone mapping algorithm for high contrast images. In: Proceedings of the 13th Eurographics Workshop on Rendering, pp. 145–156. Eurographics Association (2002)
44.
Zurück zum Zitat Mantiuk, R., Daly, S., Kerofsky, L.: Display adaptive tone mapping. In: ACM Transactions on Graphics (TOG), vol. 27, p. 68. ACM (2008) Mantiuk, R., Daly, S., Kerofsky, L.: Display adaptive tone mapping. In: ACM Transactions on Graphics (TOG), vol. 27, p. 68. ACM (2008)
45.
Zurück zum Zitat Ziaei Nafchi, H., Shahkolaei, A., Farrahi Moghaddam, R., Cheriet, M.: FSITM: a feature similarity index for tone-mapped images. IEEE Signal Process. Lett. 22, 1026–1029 (2015)CrossRef Ziaei Nafchi, H., Shahkolaei, A., Farrahi Moghaddam, R., Cheriet, M.: FSITM: a feature similarity index for tone-mapped images. IEEE Signal Process. Lett. 22, 1026–1029 (2015)CrossRef
46.
Zurück zum Zitat Banić, N., Lončarić, S.: Sensitivity of tone mapped image quality metrics to perceptually hardly noticeable differences. In: Proceedings of The Fifth Croatian Computer Vision Workshop (CCVW 2013), no. 1, pp. 15–18. University of Zagreb Faculty of Electrical Engineering and Computing (2016) Banić, N., Lončarić, S.: Sensitivity of tone mapped image quality metrics to perceptually hardly noticeable differences. In: Proceedings of The Fifth Croatian Computer Vision Workshop (CCVW 2013), no. 1, pp. 15–18. University of Zagreb Faculty of Electrical Engineering and Computing (2016)
Metadaten
Titel
Flash, Storm, and Mistral: Hardware-Friendly and High Quality Tone Mapping
verfasst von
Nikola Banić
Sven Lončarić
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-26756-8_11