Skip to main content
Erschienen in: Soft Computing 5/2018

11.09.2017 | Focus

Retinex-based image enhancement framework by using region covariance filter

verfasst von: Fuyu Tao, Xiaomin Yang, Wei Wu, Kai Liu, Zhili Zhou, Yiguang Liu

Erschienen in: Soft Computing | Ausgabe 5/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Clear images are critical in understanding real scenarios. However, the quality of images may be severely declined due to terrible conditions. Images exposed to such conditions are usually of low contrast, contain much noise, and suffer from weak details. And these drawbacks tend to negatively influence the subsequent processing tasks. Many existing image enhancement methods only solve a certain aspect of aforementioned drawbacks. This paper proposes a Retinex-based image enhancement framework that can increase contrast, eliminate noise, and enhance details at the same time. First, we utilize a region covariance filter to estimate the illumination accurately at multiple scales. The corresponding reflectance can be predicted by dividing the original image by its illumination. Second, we utilize contrast-limited adaptive histogram equalization to enhance the global contrast of original images because the illumination contains the low-frequency component. Third, since the reflectance contains the details of the original image and noise, we adopt a non-local means filter to eliminate noise and use a guided filter to enhance the details in the reflectance. Fourth, we synthesize the final enhanced image by fusing the enhanced illumination and reflectance at each scale. Experiments have proved the improvement of the proposed framework in terms of both visual perception and quantitative comparisons with other compared methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Ahn H, Keum B, Kim D, Lee HS (2013) Adaptive local tone mapping based on retinex for high dynamic range images. In: IEEE international conference on consumer electronics, pp 153–156 Ahn H, Keum B, Kim D, Lee HS (2013) Adaptive local tone mapping based on retinex for high dynamic range images. In: IEEE international conference on consumer electronics, pp 153–156
Zurück zum Zitat Alspach DL, Sorenson HW (1972) Nonlinear Bayesian estimation using Gaussian sum approximations. IEEE Trans Autom Control 17(4):439–448CrossRefMATH Alspach DL, Sorenson HW (1972) Nonlinear Bayesian estimation using Gaussian sum approximations. IEEE Trans Autom Control 17(4):439–448CrossRefMATH
Zurück zum Zitat Asha M, Gupta MK (2016) A basic approach to enhance a gray scale image. Imp J Interdiscip Res 2(7):126–129 Asha M, Gupta MK (2016) A basic approach to enhance a gray scale image. Imp J Interdiscip Res 2(7):126–129
Zurück zum Zitat Bai X, Zhou F, Xue B (2011) Infrared image enhancement through contrast enhancement by using multiscale new top-hat transform. Infrared Phys Technol 54(54):61–69CrossRef Bai X, Zhou F, Xue B (2011) Infrared image enhancement through contrast enhancement by using multiscale new top-hat transform. Infrared Phys Technol 54(54):61–69CrossRef
Zurück zum Zitat Buades A, Coll B, Morel JM (2005) A non-local algorithm for image denoising. In: IEEE computer society conference on computer vision and pattern recognition, pp 60–65 Buades A, Coll B, Morel JM (2005) A non-local algorithm for image denoising. In: IEEE computer society conference on computer vision and pattern recognition, pp 60–65
Zurück zum Zitat Chen B, Shu H, Coatrieux G, Chen G, Sun X, Coatrieux JL (2014) Color image analysis by quaternion-type moments. J Math Imaging Vis 51(1):124–144MathSciNetCrossRefMATH Chen B, Shu H, Coatrieux G, Chen G, Sun X, Coatrieux JL (2014) Color image analysis by quaternion-type moments. J Math Imaging Vis 51(1):124–144MathSciNetCrossRefMATH
Zurück zum Zitat Cheng H, Zhang Y (2012) Detecting of contrast over-enhancement. In: 2012 19th IEEE international conference on image processing, pp 961–964. IEEE Cheng H, Zhang Y (2012) Detecting of contrast over-enhancement. In: 2012 19th IEEE international conference on image processing, pp 961–964. IEEE
Zurück zum Zitat Choudhury A, Medioni G (2009) Perceptually motivated automatic color contrast enhancement. In: ICCV 2009—CRICV workshop, vol 7525, no 1, pp 1893–1900 Choudhury A, Medioni G (2009) Perceptually motivated automatic color contrast enhancement. In: ICCV 2009—CRICV workshop, vol 7525, no 1, pp 1893–1900
Zurück zum Zitat Elad M (2005) Retinex by two bilateral filters. Springer, Berlin Elad M (2005) Retinex by two bilateral filters. Springer, Berlin
Zurück zum Zitat Fallah M, Azizi A (2010) Quality assessment of image fusion techniques for multisensor high resolution satellite images (case study: IRS-p5 and IRS-P6 satellite images). Years Isprs Adv Remote Sensingence Pt 38(1):204–209 Fallah M, Azizi A (2010) Quality assessment of image fusion techniques for multisensor high resolution satellite images (case study: IRS-p5 and IRS-P6 satellite images). Years Isprs Adv Remote Sensingence Pt 38(1):204–209
Zurück zum Zitat Funt B, Ciurea F, Mccann J (2004) Retinex in matlab? J Electron Imaging 13(1):48–57CrossRef Funt B, Ciurea F, Mccann J (2004) Retinex in matlab? J Electron Imaging 13(1):48–57CrossRef
Zurück zum Zitat Ghani ASA, Isa NAM (2015) Enhancement of low quality underwater image through integrated global and local contrast correction. Appl Soft Comput 37(C):332–344CrossRef Ghani ASA, Isa NAM (2015) Enhancement of low quality underwater image through integrated global and local contrast correction. Appl Soft Comput 37(C):332–344CrossRef
Zurück zum Zitat Gu K, Zhai G, Yang X, Zhang W (2014) Automatic contrast enhancement technology with saliency preservation. IEEE Trans Circuits Syst Video Technol 25(9):1–1 Gu K, Zhai G, Yang X, Zhang W (2014) Automatic contrast enhancement technology with saliency preservation. IEEE Trans Circuits Syst Video Technol 25(9):1–1
Zurück zum Zitat He K, Sun J, Tang X (2013) Guided image filtering. IEEE Trans Pattern Anal Mach Intell 35(6):1397–1409CrossRef He K, Sun J, Tang X (2013) Guided image filtering. IEEE Trans Pattern Anal Mach Intell 35(6):1397–1409CrossRef
Zurück zum Zitat Jobson DJ, Rahman Z, Woodell GA (1997) Properties and performance of a center/surround retinex. IEEE Trans Image Process A Publ IEEE Signal Process Soc 6(3):451–462CrossRef Jobson DJ, Rahman Z, Woodell GA (1997) Properties and performance of a center/surround retinex. IEEE Trans Image Process A Publ IEEE Signal Process Soc 6(3):451–462CrossRef
Zurück zum Zitat Jobson DJ, Rahman ZU, Woodell GA (1997) A multiscale retinex for bridging the gap between color images and the human observation of scenes. IEEE Trans Image Process 6(7):965–976CrossRef Jobson DJ, Rahman ZU, Woodell GA (1997) A multiscale retinex for bridging the gap between color images and the human observation of scenes. IEEE Trans Image Process 6(7):965–976CrossRef
Zurück zum Zitat Karacan L, Erdem E, Erdem A (2013) Structure-preserving image smoothing via region covariances. ACM Trans Graph 32(6):1–11CrossRef Karacan L, Erdem E, Erdem A (2013) Structure-preserving image smoothing via region covariances. ACM Trans Graph 32(6):1–11CrossRef
Zurück zum Zitat Khan NA, Sandsten M (2016) Time–frequency image enhancement based on interference suppression in Wigner–Ville distribution. Signal Process 127:80–85CrossRef Khan NA, Sandsten M (2016) Time–frequency image enhancement based on interference suppression in Wigner–Ville distribution. Signal Process 127:80–85CrossRef
Zurück zum Zitat Kim SE, Jeon JJ, Eom IK (2016) Image contrast enhancement using entropy scaling in wavelet domain. Signal Process 127:1–11CrossRef Kim SE, Jeon JJ, Eom IK (2016) Image contrast enhancement using entropy scaling in wavelet domain. Signal Process 127:1–11CrossRef
Zurück zum Zitat Kimmel R, Elad M, Shaked D, Keshet R, Sobel I (2003) A variational framework for retinex. Int J Comput Vis 52(1):7–23CrossRefMATH Kimmel R, Elad M, Shaked D, Keshet R, Sobel I (2003) A variational framework for retinex. Int J Comput Vis 52(1):7–23CrossRefMATH
Zurück zum Zitat Lai R, Yang YT, Wang BJ, Zhou HX (2010) A quantitative measure based infrared image enhancement algorithm using plateau histogram. Opt Commun 283(21):4283–4288CrossRef Lai R, Yang YT, Wang BJ, Zhou HX (2010) A quantitative measure based infrared image enhancement algorithm using plateau histogram. Opt Commun 283(21):4283–4288CrossRef
Zurück zum Zitat Land EH, Mccann JJ (1971) Lightness and retinex theory. J Opt Soc Am 61(1):1–11CrossRef Land EH, Mccann JJ (1971) Lightness and retinex theory. J Opt Soc Am 61(1):1–11CrossRef
Zurück zum Zitat Li B, Xie W (2016) Image denoising and enhancement based on adaptive fractional calculus of small probability strategy. Neurocomputing 175:704–714CrossRef Li B, Xie W (2016) Image denoising and enhancement based on adaptive fractional calculus of small probability strategy. Neurocomputing 175:704–714CrossRef
Zurück zum Zitat Liu N, Zhang Y, Xie J, Yu J, Xiao H, Min T (2015) A novel high dynamic range image enhancement algorithm based on guided image filter. Opt Int J Light Electron Opt 126(23):4581–4585CrossRef Liu N, Zhang Y, Xie J, Yu J, Xiao H, Min T (2015) A novel high dynamic range image enhancement algorithm based on guided image filter. Opt Int J Light Electron Opt 126(23):4581–4585CrossRef
Zurück zum Zitat Maini R, Aggarwal H (2010) A comprehensive review of image enhancement techniques. Comput Sci 2(3):8–13 Maini R, Aggarwal H (2010) A comprehensive review of image enhancement techniques. Comput Sci 2(3):8–13
Zurück zum Zitat Meylan L, Susstrunk S (2006) High dynamic range image rendering with a retinex-based adaptive filter. IEEE Trans Image Process A Publ IEEE Signal Process Soc 15(9):2820–2830CrossRef Meylan L, Susstrunk S (2006) High dynamic range image rendering with a retinex-based adaptive filter. IEEE Trans Image Process A Publ IEEE Signal Process Soc 15(9):2820–2830CrossRef
Zurück zum Zitat Narsimha B, Suresh E, Chandar KP, Komuraiah B (2010) Enhancement of color images in hot domain with quantitative measurements using entropy and relative entropy In: International conference on signal and image processing, pp 34–38 Narsimha B, Suresh E, Chandar KP, Komuraiah B (2010) Enhancement of color images in hot domain with quantitative measurements using entropy and relative entropy In: International conference on signal and image processing, pp 34–38
Zurück zum Zitat Nercessian SC, Panetta KA, Agaian SS (2013) Non-linear direct multi-scale image enhancement based on the luminance and contrast masking characteristics of the human visual system. IEEE Trans Image Process A Publ IEEE Signal Process Soc 22(9):3549–3561CrossRef Nercessian SC, Panetta KA, Agaian SS (2013) Non-linear direct multi-scale image enhancement based on the luminance and contrast masking characteristics of the human visual system. IEEE Trans Image Process A Publ IEEE Signal Process Soc 22(9):3549–3561CrossRef
Zurück zum Zitat Pan Z, Lei J, Zhang Y, Sun X, Kwong S (2016) Fast motion estimation based on content property for low-complexity h. 265/hevc encoder. IEEE Trans Broadcast. 62(3):675–684. doi:10.1109/TBC.2016.2580920 Pan Z, Lei J, Zhang Y, Sun X, Kwong S (2016) Fast motion estimation based on content property for low-complexity h. 265/hevc encoder. IEEE Trans Broadcast. 62(3):675–684. doi:10.​1109/​TBC.​2016.​2580920
Zurück zum Zitat Paris S, Hasinoff SW, Kautz J (2011) Local Laplacian filters: edge-aware image processing with a Laplacian pyramid. ACM Trans Graph 30(4, article 68):1244–1259 Paris S, Hasinoff SW, Kautz J (2011) Local Laplacian filters: edge-aware image processing with a Laplacian pyramid. ACM Trans Graph 30(4, article 68):1244–1259
Zurück zum Zitat Qi W, Han J, Zhang Y, Bai LF (2016) Hierarchical image enhancement. Infrared Phys Technol 76:704–709CrossRef Qi W, Han J, Zhang Y, Bai LF (2016) Hierarchical image enhancement. Infrared Phys Technol 76:704–709CrossRef
Zurück zum Zitat Rahman ZU, Jobson DJ, Woodell GA (1996) Multi-scale retinex for color image enhancement. In: Proceedings of the international conference on image processing, 1996, vol 3, pp 1003–1006 Rahman ZU, Jobson DJ, Woodell GA (1996) Multi-scale retinex for color image enhancement. In: Proceedings of the international conference on image processing, 1996, vol 3, pp 1003–1006
Zurück zum Zitat Starck JL, Murtagh F, Cands EJ, Donoho DL (2003) Gray and color image contrast enhancement by the curvelet transform. IEEE Trans Image Process A Publ IEEE Signal Process Soc 12(6):706–717MathSciNetCrossRefMATH Starck JL, Murtagh F, Cands EJ, Donoho DL (2003) Gray and color image contrast enhancement by the curvelet transform. IEEE Trans Image Process A Publ IEEE Signal Process Soc 12(6):706–717MathSciNetCrossRefMATH
Zurück zum Zitat Tomasi C, Manduchi R (1998) Bilateral filtering for gray and color images. In: International conference on computer vision, pp 839–846 Tomasi C, Manduchi R (1998) Bilateral filtering for gray and color images. In: International conference on computer vision, pp 839–846
Zurück zum Zitat Tuzel O, Porikli F, Meer P (2006) Region covariance: a fast descriptor for detection and classification. In: Proceedings of the computer vision—ECCV 2006, European conference on computer vision, Graz, Austria, May 7–13, 2006, pp 589–600 Tuzel O, Porikli F, Meer P (2006) Region covariance: a fast descriptor for detection and classification. In: Proceedings of the computer vision—ECCV 2006, European conference on computer vision, Graz, Austria, May 7–13, 2006, pp 589–600
Zurück zum Zitat Wang Y, Wang H, Yin C, Dai M (2016) Biologically inspired image enhancement based on retinex. Neurocomputing 177:373–384CrossRef Wang Y, Wang H, Yin C, Dai M (2016) Biologically inspired image enhancement based on retinex. Neurocomputing 177:373–384CrossRef
Zurück zum Zitat Wen X, Shao L, Xue Y, Fang W (2015) A rapid learning algorithm for vehicle classification. Inf Sci 295:395–406CrossRef Wen X, Shao L, Xue Y, Fang W (2015) A rapid learning algorithm for vehicle classification. Inf Sci 295:395–406CrossRef
Zurück zum Zitat Xia Z, Wang X, Zhang L, Qin Z, Sun X, Ren K (2016) A privacy-preserving and copy-deterrence content-based image retrieval scheme in cloud computing. IEEE Trans Inf Forensics Secur 11(11):2594–2608 Xia Z, Wang X, Zhang L, Qin Z, Sun X, Ren K (2016) A privacy-preserving and copy-deterrence content-based image retrieval scheme in cloud computing. IEEE Trans Inf Forensics Secur 11(11):2594–2608
Zurück zum Zitat Xiao J, Peng H, Zhang Y, Tu C, Li Q (2014) Fast image enhancement based on color space fusion. Color Res Appl 41(1):22–31CrossRef Xiao J, Peng H, Zhang Y, Tu C, Li Q (2014) Fast image enhancement based on color space fusion. Color Res Appl 41(1):22–31CrossRef
Zurück zum Zitat Xu L, Lu C, Xu Y, Jia J (2011) Image smoothing via L0 gradient minimization. ACM Trans Graph 30(6):61–64 Xu L, Lu C, Xu Y, Jia J (2011) Image smoothing via L0 gradient minimization. ACM Trans Graph 30(6):61–64
Zurück zum Zitat Xu L, Yan Q, Xia Y, Jia J (2012) Structure extraction from texture via relative total variation. ACM Trans Graph 31(6):439–445 Xu L, Yan Q, Xia Y, Jia J (2012) Structure extraction from texture via relative total variation. ACM Trans Graph 31(6):439–445
Zurück zum Zitat Yuan T, Zheng X, Hu X, Zhou W, Wang W (2013) A method for the evaluation of image quality according to the recognition effectiveness of objects in the optical remote sensing image using machine learning algorithm. Linear Algebra Appl 244(3):69–80 Yuan T, Zheng X, Hu X, Zhou W, Wang W (2013) A method for the evaluation of image quality according to the recognition effectiveness of objects in the optical remote sensing image using machine learning algorithm. Linear Algebra Appl 244(3):69–80
Zurück zum Zitat Yuan C, Sun X, Lv R (2016) Fingerprint liveness detection based on multi-scale LPQ and PCA. China Commun 13(7):60–65CrossRef Yuan C, Sun X, Lv R (2016) Fingerprint liveness detection based on multi-scale LPQ and PCA. China Commun 13(7):60–65CrossRef
Zurück zum Zitat Zhang Q, Shen X, Xu L, Jia J (2014) Rolling guidance filter. In: Fleet D, Pajdla T, Schiele B, Tuytelaars T (eds) Computer Vision – ECCV 2014. ECCV 2014. Lecture Notes in Computer Science, vol 8691. Springer, Cham Zhang Q, Shen X, Xu L, Jia J (2014) Rolling guidance filter. In: Fleet D, Pajdla T, Schiele B, Tuytelaars T (eds) Computer Vision – ECCV 2014. ECCV 2014. Lecture Notes in Computer Science, vol 8691. Springer, Cham
Zurück zum Zitat Zheng Y, Byeungwoo J, Xu D, Wu QMJ, Zhang H (2015) Image segmentation by generalized hierarchical fuzzy c-means algorithm. J Intell Fuzzy Syst 28(2):4024–4028 Zheng Y, Byeungwoo J, Xu D, Wu QMJ, Zhang H (2015) Image segmentation by generalized hierarchical fuzzy c-means algorithm. J Intell Fuzzy Syst 28(2):4024–4028
Zurück zum Zitat Zhou Z, Wang Y, Wu QJ, Yang CN, Sun X (2016) Effective and efficient global context verification for image copy detection. IEEE Trans Inf Forensics Secur 12:48–63CrossRef Zhou Z, Wang Y, Wu QJ, Yang CN, Sun X (2016) Effective and efficient global context verification for image copy detection. IEEE Trans Inf Forensics Secur 12:48–63CrossRef
Zurück zum Zitat Zuiderveld K (1994) Contrast limited adaptive histogram equalization. In: Graphics gems IV. Academic Press Professional, pp 474–485 Zuiderveld K (1994) Contrast limited adaptive histogram equalization. In: Graphics gems IV. Academic Press Professional, pp 474–485
Metadaten
Titel
Retinex-based image enhancement framework by using region covariance filter
verfasst von
Fuyu Tao
Xiaomin Yang
Wei Wu
Kai Liu
Zhili Zhou
Yiguang Liu
Publikationsdatum
11.09.2017
Verlag
Springer Berlin Heidelberg
Erschienen in
Soft Computing / Ausgabe 5/2018
Print ISSN: 1432-7643
Elektronische ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-017-2813-2

Weitere Artikel der Ausgabe 5/2018

Soft Computing 5/2018 Zur Ausgabe