Skip to main content
Top

2019 | OriginalPaper | Chapter

Flash, Storm, and Mistral: Hardware-Friendly and High Quality Tone Mapping

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

While high dynamic range (HDR) images are being used ever more widely, the majority of display devices are able to properly handle only low dynamic range (LDR) images. Tone mapping operators (TMOs) solve this problem by compressing the dynamic range of HDR images so that they can be displayed as LDR images. The problem with many state-of-the-art TMOs is that despite giving high quality results they are often too complex to be used for simple hardware implementations. In this paper several new TMOs formed around the perceptually based Naka-Rushton equation are proposed with the main goal being hardware-friendliness. The proposed TMOs are of gradually increasing complexity, which allows choosing the most appropriate trade-off between quality and complexity, and all of them are designed to have O(1) per-pixel complexity. The results are presented and discussed and it is shown that the proposed TMOs outperform most well-known publicly available TMOs in terms of quality and speed. The source codes of the proposed TMOs written in C++, Matlab, Python, Java, and HTML+JavaScript are available at http://​www.​fer.​unizg.​hr/​ipg/​resources/​color_​constancy/​.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Reinhard, E., Heidrich, W., Debevec, P., Pattanaik, S., Ward, G., Myszkowski, K.: High Dynamic Range Imaging: Acquisition, Display, and Image-Basedlighting. Morgan Kaufmann, Burlington (2010) Reinhard, E., Heidrich, W., Debevec, P., Pattanaik, S., Ward, G., Myszkowski, K.: High Dynamic Range Imaging: Acquisition, Display, and Image-Basedlighting. Morgan Kaufmann, Burlington (2010)
2.
go back to reference Koschan, A., Abidi, M.: Digital Color Image Processing. Wiley, Hoboken (2008)CrossRef Koschan, A., Abidi, M.: Digital Color Image Processing. Wiley, Hoboken (2008)CrossRef
3.
go back to reference Banić, N., Lončarić, S.: Improving the Tone Mapping Operators by Using a Redefined Version of the Luminance Channel. In: Image and Signal Processing. Springer (2014) 392–399 Banić, N., Lončarić, S.: Improving the Tone Mapping Operators by Using a Redefined Version of the Luminance Channel. In: Image and Signal Processing. Springer (2014) 392–399
4.
go back to reference Nguyen, R.M., Brown, M.S.: Why you should forget luminance conversion and do something better. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 6750–6758 (2017) Nguyen, R.M., Brown, M.S.: Why you should forget luminance conversion and do something better. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 6750–6758 (2017)
5.
go back to reference Tumblin, J., Rushmeier, H.: Tone reproduction for realistic images. IEEE Comput. Graph. Appl. 13, 42–48 (1993)CrossRef Tumblin, J., Rushmeier, H.: Tone reproduction for realistic images. IEEE Comput. Graph. Appl. 13, 42–48 (1993)CrossRef
6.
go back to reference Chiu, K., et al.: Spatially nonuniform scaling functions for high contrast images. In: Graphics Interface, Canadian Information Processing Society, p. 245 (1993) Chiu, K., et al.: Spatially nonuniform scaling functions for high contrast images. In: Graphics Interface, Canadian Information Processing Society, p. 245 (1993)
7.
go back to reference Ward, G.: A contrast-based scalefactor for luminance display. In: Graphics gems IV, pp. 415–421 (1994) Ward, G.: A contrast-based scalefactor for luminance display. In: Graphics gems IV, pp. 415–421 (1994)
9.
go back to reference Pattanaik, S.N., Tumblin, J., Yee, H., Greenberg, D.P.: Time-dependent visual adaptation for fast realistic image display. In: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, pp. 47–54. ACM Press/Addison-Wesley Publishing Co. (2000) Pattanaik, S.N., Tumblin, J., Yee, H., Greenberg, D.P.: Time-dependent visual adaptation for fast realistic image display. In: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, pp. 47–54. ACM Press/Addison-Wesley Publishing Co. (2000)
10.
go back to reference Drago, F., Myszkowski, K., Annen, T., Chiba, N.: Adaptive logarithmic mapping for displaying high contrast scenes. In: Computer Graphics Forum, vol. 22, pp. 419–426. Wiley Online Library (2003) Drago, F., Myszkowski, K., Annen, T., Chiba, N.: Adaptive logarithmic mapping for displaying high contrast scenes. In: Computer Graphics Forum, vol. 22, pp. 419–426. Wiley Online Library (2003)
11.
go back to reference Reinhard, E., Devlin, K.: Dynamic range reduction inspired by photoreceptor physiology. IEEE Trans. Visual Comput. Graphics 11, 13–24 (2005)CrossRef Reinhard, E., Devlin, K.: Dynamic range reduction inspired by photoreceptor physiology. IEEE Trans. Visual Comput. Graphics 11, 13–24 (2005)CrossRef
12.
go back to reference Larson, G.W., Rushmeier, H., Piatko, C.: A visibility matching tone reproduction operator for high dynamic range scenes. IEEE Trans. Visual Comput. Graphics 3, 291–306 (1997)CrossRef Larson, G.W., Rushmeier, H., Piatko, C.: A visibility matching tone reproduction operator for high dynamic range scenes. IEEE Trans. Visual Comput. Graphics 3, 291–306 (1997)CrossRef
13.
go back to reference Braun, G.J., Fairchild, M.D.: Image lightness rescaling using sigmoidal contrast enhancement functions. J. Electron. Imaging 8, 380–393 (1999)CrossRef Braun, G.J., Fairchild, M.D.: Image lightness rescaling using sigmoidal contrast enhancement functions. J. Electron. Imaging 8, 380–393 (1999)CrossRef
14.
go back to reference Tumblin, J., Turk, G.: LCIS: A boundary hierarchy for detail-preserving contrast reduction. In: Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques, pp. 83–90. ACM Press/Addison-Wesley Publishing Co. (1999) Tumblin, J., Turk, G.: LCIS: A boundary hierarchy for detail-preserving contrast reduction. In: Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques, pp. 83–90. ACM Press/Addison-Wesley Publishing Co. (1999)
15.
go back to reference Durand, F., Dorsey, J.: Fast bilateral filtering for the display of high-dynamic-range images. In: ACM Transactions on Graphics (TOG), vol. 21, pp. 257–266 (2002) Durand, F., Dorsey, J.: Fast bilateral filtering for the display of high-dynamic-range images. In: ACM Transactions on Graphics (TOG), vol. 21, pp. 257–266 (2002)
16.
go back to reference Reinhard, E., Stark, M., Shirley, P., Ferwerda, J.: Photographic tone reproduction for digital images. In: ACM Transactions on Graphics (TOG), vol. 21, pp. 267–276. ACM (2002) Reinhard, E., Stark, M., Shirley, P., Ferwerda, J.: Photographic tone reproduction for digital images. In: ACM Transactions on Graphics (TOG), vol. 21, pp. 267–276. ACM (2002)
17.
go back to reference Fattal, R., Lischinski, D., Werman, M.: Gradient domain high dynamic range compression. In: ACM Transactions on Graphics (TOG), vol. 21, pp. 249–256. ACM (2002) Fattal, R., Lischinski, D., Werman, M.: Gradient domain high dynamic range compression. In: ACM Transactions on Graphics (TOG), vol. 21, pp. 249–256. ACM (2002)
18.
go back to reference Mantiuk, R., Myszkowski, K., Seidel, H.P.: A perceptual framework for contrast processing of high dynamic range images. ACM Trans. Appl. Percept. (TAP) 3, 286–308 (2006)CrossRef Mantiuk, R., Myszkowski, K., Seidel, H.P.: A perceptual framework for contrast processing of high dynamic range images. ACM Trans. Appl. Percept. (TAP) 3, 286–308 (2006)CrossRef
19.
go back to reference Meylan, L., Susstrunk, S.: High dynamic range image rendering with a retinex-based adaptive filter. IEEE Trans. Image Process. 15, 2820–2830 (2006)CrossRef Meylan, L., Susstrunk, S.: High dynamic range image rendering with a retinex-based adaptive filter. IEEE Trans. Image Process. 15, 2820–2830 (2006)CrossRef
21.
go back to reference Banić, N., Lončarić, S.: Puma: a high-quality retinex-based tone mapping operator. In: Signal Processing Conference (EUSIPCO), 2016 24rd European, pp. 943–947. IEEE (2016) Banić, N., Lončarić, S.: Puma: a high-quality retinex-based tone mapping operator. In: Signal Processing Conference (EUSIPCO), 2016 24rd European, pp. 943–947. IEEE (2016)
22.
go back to reference Kuang, J., Yamaguchi, H., Johnson, G.M., Fairchild, M.D.: Testing HDR image rendering algorithms. In: Color and Imaging Conference, vol. 2004, pp. 315–320. Society for Imaging Science and Technology (2004) Kuang, J., Yamaguchi, H., Johnson, G.M., Fairchild, M.D.: Testing HDR image rendering algorithms. In: Color and Imaging Conference, vol. 2004, pp. 315–320. Society for Imaging Science and Technology (2004)
23.
go back to reference Kuang, J., Yamaguchi, H., Liu, C., Johnson, G.M., Fairchild, M.D.: Evaluating HDR rendering algorithms. ACM Trans. Appl. Percept. (TAP) 4, 9 (2007)CrossRef Kuang, J., Yamaguchi, H., Liu, C., Johnson, G.M., Fairchild, M.D.: Evaluating HDR rendering algorithms. ACM Trans. Appl. Percept. (TAP) 4, 9 (2007)CrossRef
24.
go back to reference Urbano, C., Magalhães, L., Moura, J., Bessa, M., Marcos, A., Chalmers, A.: Tone mapping operators on small screen devices: an evaluation study. In: Computer Graphics Forum, vol. 29, pp. 2469–2478. Wiley Online Library (2010) Urbano, C., Magalhães, L., Moura, J., Bessa, M., Marcos, A., Chalmers, A.: Tone mapping operators on small screen devices: an evaluation study. In: Computer Graphics Forum, vol. 29, pp. 2469–2478. Wiley Online Library (2010)
25.
go back to reference Banić, N., Lončarić, S.: Flash and storm: fast and highly practical tone mapping based on Naka-Rushton equation. In: International Conference on Computer Vision Theory and Applications (VISAPP), pp. 47–53 (2018) Banić, N., Lončarić, S.: Flash and storm: fast and highly practical tone mapping based on Naka-Rushton equation. In: International Conference on Computer Vision Theory and Applications (VISAPP), pp. 47–53 (2018)
26.
go back to reference Banić, N., Lončarić, S.: Smart light random memory sprays retinex: a fast retinex implementation for high-quality brightness adjustment and color correction. JOSA A 32, 2136–2147 (2015)CrossRef Banić, N., Lončarić, S.: Smart light random memory sprays retinex: a fast retinex implementation for high-quality brightness adjustment and color correction. JOSA A 32, 2136–2147 (2015)CrossRef
27.
go back to reference Banić, N., Lončarić, S.: Towards hardware-friendly Retinex algorithms. In: 2017 10th International Symposium on Image and Signal Processing and Analysis (ISPA), pp. 104–108. IEEE (2017) Banić, N., Lončarić, S.: Towards hardware-friendly Retinex algorithms. In: 2017 10th International Symposium on Image and Signal Processing and Analysis (ISPA), pp. 104–108. IEEE (2017)
28.
go back to reference Shapley, R., Enroth-Cugell, C.: Visual adaptation and retinal gain controls. Prog. Retinal Res. 3, 263–346 (1984)CrossRef Shapley, R., Enroth-Cugell, C.: Visual adaptation and retinal gain controls. Prog. Retinal Res. 3, 263–346 (1984)CrossRef
29.
go back to reference Dowling, J.E.: The Retina: An Approachable Part of the Brain. Harvard University Press, Cambridge (1987) Dowling, J.E.: The Retina: An Approachable Part of the Brain. Harvard University Press, Cambridge (1987)
30.
go back to reference Joze, H.R.V., Drew, M.S., Finlayson, G.D., Rey, P.A.T.: The role of bright pixels in illumination estimation. In: Color and Imaging Conference, vol. 2012, pp. 41–46. Society for Imaging Science and Technology (2012) Joze, H.R.V., Drew, M.S., Finlayson, G.D., Rey, P.A.T.: The role of bright pixels in illumination estimation. In: Color and Imaging Conference, vol. 2012, pp. 41–46. Society for Imaging Science and Technology (2012)
31.
go back to reference Huang, J., Mumford, D.: Statistics of natural images and models. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1999, vol. 1. IEEE (1999) Huang, J., Mumford, D.: Statistics of natural images and models. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1999, vol. 1. IEEE (1999)
34.
go back to reference Ma, K., Yeganeh, H., Zeng, K., Wang, Z.: High dynamic range image compression by optimizing tone mapped image quality index. IEEE Trans. Image Process. 24, 3086–3097 (2015)MathSciNetCrossRef Ma, K., Yeganeh, H., Zeng, K., Wang, Z.: High dynamic range image compression by optimizing tone mapped image quality index. IEEE Trans. Image Process. 24, 3086–3097 (2015)MathSciNetCrossRef
35.
go back to reference Yeganeh, H., Zhou, W.: Objective quality assessment of tone mapped images. IEEE Trans. Image Process. 22, 657–667 (2013)MathSciNetCrossRef Yeganeh, H., Zhou, W.: Objective quality assessment of tone mapped images. IEEE Trans. Image Process. 22, 657–667 (2013)MathSciNetCrossRef
36.
go back to reference Wilson, H.R.: Psychophysical models of spatial vision and hyperacuity. Spat. Vis. 10, 64–81 (1991) Wilson, H.R.: Psychophysical models of spatial vision and hyperacuity. Spat. Vis. 10, 64–81 (1991)
37.
38.
go back to reference Jobson, D.J., Rahman, Z.U., Woodell, G., et al.: A multiscale retinex for bridging the gap between color images and the human observation of scenes. IEEE Trans. Image Process. 6, 965–976 (1997)CrossRef Jobson, D.J., Rahman, Z.U., Woodell, G., et al.: A multiscale retinex for bridging the gap between color images and the human observation of scenes. IEEE Trans. Image Process. 6, 965–976 (1997)CrossRef
39.
go back to reference Pattanaik, S.N., Ferwerda, J.A., Fairchild, M.D., Greenberg, D.P.: A multiscale model of adaptation and spatial vision for realistic image display. In: Proceedings of the 25th annual conference on Computer graphics and interactive techniques, pp. 287–298. ACM (1998) Pattanaik, S.N., Ferwerda, J.A., Fairchild, M.D., Greenberg, D.P.: A multiscale model of adaptation and spatial vision for realistic image display. In: Proceedings of the 25th annual conference on Computer graphics and interactive techniques, pp. 287–298. ACM (1998)
40.
go back to reference Crow, F.C.: Summed-area tables for texture mapping. ACM SIGGRAPH Comput. Graph. 18, 207–212 (1984)CrossRef Crow, F.C.: Summed-area tables for texture mapping. ACM SIGGRAPH Comput. Graph. 18, 207–212 (1984)CrossRef
41.
go back to reference Banić, N., Lončarić, S.: Firefly: a hardware-friendly real-time local brightness adjustment method. In: 2015 22nd IEEE International Conference on Image Processing (ICIP), pp. 3951–3955. IEEE (2015) Banić, N., Lončarić, S.: Firefly: a hardware-friendly real-time local brightness adjustment method. In: 2015 22nd IEEE International Conference on Image Processing (ICIP), pp. 3951–3955. IEEE (2015)
43.
go back to reference Ashikhmin, M.: A tone mapping algorithm for high contrast images. In: Proceedings of the 13th Eurographics Workshop on Rendering, pp. 145–156. Eurographics Association (2002) Ashikhmin, M.: A tone mapping algorithm for high contrast images. In: Proceedings of the 13th Eurographics Workshop on Rendering, pp. 145–156. Eurographics Association (2002)
44.
go back to reference Mantiuk, R., Daly, S., Kerofsky, L.: Display adaptive tone mapping. In: ACM Transactions on Graphics (TOG), vol. 27, p. 68. ACM (2008) Mantiuk, R., Daly, S., Kerofsky, L.: Display adaptive tone mapping. In: ACM Transactions on Graphics (TOG), vol. 27, p. 68. ACM (2008)
45.
go back to reference Ziaei Nafchi, H., Shahkolaei, A., Farrahi Moghaddam, R., Cheriet, M.: FSITM: a feature similarity index for tone-mapped images. IEEE Signal Process. Lett. 22, 1026–1029 (2015)CrossRef Ziaei Nafchi, H., Shahkolaei, A., Farrahi Moghaddam, R., Cheriet, M.: FSITM: a feature similarity index for tone-mapped images. IEEE Signal Process. Lett. 22, 1026–1029 (2015)CrossRef
46.
go back to reference Banić, N., Lončarić, S.: Sensitivity of tone mapped image quality metrics to perceptually hardly noticeable differences. In: Proceedings of The Fifth Croatian Computer Vision Workshop (CCVW 2013), no. 1, pp. 15–18. University of Zagreb Faculty of Electrical Engineering and Computing (2016) Banić, N., Lončarić, S.: Sensitivity of tone mapped image quality metrics to perceptually hardly noticeable differences. In: Proceedings of The Fifth Croatian Computer Vision Workshop (CCVW 2013), no. 1, pp. 15–18. University of Zagreb Faculty of Electrical Engineering and Computing (2016)
Metadata
Title
Flash, Storm, and Mistral: Hardware-Friendly and High Quality Tone Mapping
Authors
Nikola Banić
Sven Lončarić
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-030-26756-8_11

Premium Partner