Skip to main content
Erschienen in: Neural Computing and Applications 1/2015

01.01.2015 | Original Article

A no-reference image quality assessment approach based on steerable pyramid decomposition using natural scene statistics

verfasst von: Fangfang Lu, Qunfei Zhao, Genke Yang

Erschienen in: Neural Computing and Applications | Ausgabe 1/2015

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

For majorities of no-reference image quality assessment (NRIQA) algorithms, prior knowledge about image distortion types is needed. However, the source distortions in the image are actually not given in most cases. In this paper, we propose a no-reference image quality assessment approach based on steerable pyramid decomposition using natural scene statistics without any prior knowledge about the distortions of the original image. Because the means of (\(\log _{2}\) of) subband coefficient amplitudes (MLSCAs) of the natural images have certain statistical properties independent of their contents, a predicted MLSCAs based on these properties can be considered as a reference index for assessment. A subband distortion is then defined as the difference between the reference and the real MLSCA of the distorted image. As against most NRIQA algorithms that are distortion specific, the subband distortion determined is independent of distortion types. Therefore, the proposed method is capable of assessing the quality of a distorted image across multiple distortion categories without any prior knowledge about the distortions of the original image. Finally, a set of weights for each subband, trained from the subjective mean opinion scores in the LIVE image database, is used to combine the subband distortions into a quality score for evaluating the distorted images. Experimental results show that the proposed method outperforms five no-reference algorithms using natural scene statistics.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Wu HR, Rao KR (2006) Digital video image quality and perceptual coding. CRC Press, Boca Raton Wu HR, Rao KR (2006) Digital video image quality and perceptual coding. CRC Press, Boca Raton
2.
Zurück zum Zitat Lin W, Kuo CCJ (2011) Perceptual visual quality metrics: a survey. J Vis Commun Image Represent 22:297–312CrossRef Lin W, Kuo CCJ (2011) Perceptual visual quality metrics: a survey. J Vis Commun Image Represent 22:297–312CrossRef
3.
Zurück zum Zitat Chikkerur S, Sundaram V, Reisslein M, Karam LJ (2011) Objective video quality assessment methods: a classification, review, and performance comparison. IEEE Trans Broadcast 57:165–182CrossRef Chikkerur S, Sundaram V, Reisslein M, Karam LJ (2011) Objective video quality assessment methods: a classification, review, and performance comparison. IEEE Trans Broadcast 57:165–182CrossRef
4.
Zurück zum Zitat Liu M, Yang X (2008) Image quality assessment by decision fusion. IEICE Electron Express 5(15):537–542CrossRef Liu M, Yang X (2008) Image quality assessment by decision fusion. IEICE Electron Express 5(15):537–542CrossRef
5.
Zurück zum Zitat Angelis AD, Moschitta A, Russo F, Carbone P (2009) A vector approach for image quality assessment and some metrological considerations. IEEE Trans Instrum Meas 58(1):14–25CrossRef Angelis AD, Moschitta A, Russo F, Carbone P (2009) A vector approach for image quality assessment and some metrological considerations. IEEE Trans Instrum Meas 58(1):14–25CrossRef
6.
Zurück zum Zitat Aznaveh AM, Mansouri A, Azar FT, Eslami M (2009) Image quality measurement besides distortion type classifying. Opt Rev 16(1):30–34CrossRef Aznaveh AM, Mansouri A, Azar FT, Eslami M (2009) Image quality measurement besides distortion type classifying. Opt Rev 16(1):30–34CrossRef
7.
Zurück zum Zitat Laparra V, Munoz-Mari J, Malo J (2010) Divisive normalization image quality metric revisited. J Opt Soc of Am A 27(4):852–864CrossRef Laparra V, Munoz-Mari J, Malo J (2010) Divisive normalization image quality metric revisited. J Opt Soc of Am A 27(4):852–864CrossRef
8.
Zurück zum Zitat Larson EC, Chandler DM (2010) Most apparent distortion: full-reference image quality assessment and the role of strategy. J Electron Imaging 19(1):011006-1–011006-21 Larson EC, Chandler DM (2010) Most apparent distortion: full-reference image quality assessment and the role of strategy. J Electron Imaging 19(1):011006-1–011006-21
9.
Zurück zum Zitat Lu F, Zhao Q, Yang G (2010) Color image quality assessment based on structural similarity. J Donghua Univ (Eng Ed) 27(4):443–450 Lu F, Zhao Q, Yang G (2010) Color image quality assessment based on structural similarity. J Donghua Univ (Eng Ed) 27(4):443–450
10.
Zurück zum Zitat Lubin J (1993) The use of psychophysical data and models in the analysis of display system performance. In: Watson AB (ed) Digital images and human vision. MIT Press, Cambridge, pp 163–178 Lubin J (1993) The use of psychophysical data and models in the analysis of display system performance. In: Watson AB (ed) Digital images and human vision. MIT Press, Cambridge, pp 163–178
11.
Zurück zum Zitat Daly S (1993) The visible differences predictor: an algorithm for the assessment of image fidelity. In: Watson AB (ed) Digital images and human vision. MIT Press, Cambridge, pp 179–206 Daly S (1993) The visible differences predictor: an algorithm for the assessment of image fidelity. In: Watson AB (ed) Digital images and human vision. MIT Press, Cambridge, pp 179–206
12.
Zurück zum Zitat Teo PC, Heeger DJ (1994) Perceptual image distortion. In: Proceedings of IEEE international conference on image processing, pp 982–986 Teo PC, Heeger DJ (1994) Perceptual image distortion. In: Proceedings of IEEE international conference on image processing, pp 982–986
13.
Zurück zum Zitat Winkler S (2000) Vision models and quality metrics for image processing applications. Ph.D., EPFL-PSE Winkler S (2000) Vision models and quality metrics for image processing applications. Ph.D., EPFL-PSE
14.
Zurück zum Zitat Yu Z, Wu HR, Winkler S, Chen T (2002) Vision model based impairment metric to evaluate blocking artifacts in digital video. In: Proceedings of the IEEE, vol 90, pp 154–169 Yu Z, Wu HR, Winkler S, Chen T (2002) Vision model based impairment metric to evaluate blocking artifacts in digital video. In: Proceedings of the IEEE, vol 90, pp 154–169
15.
Zurück zum Zitat Wang Z, Simoncelli EP (2005) Reduced-reference image quality assessment using a wavelet-domain natural image statistics model. In: Proceedings of the IS&T/SPIE’s 17th annual symposium on electronic imaging, vol 5666, pp 149–159 Wang Z, Simoncelli EP (2005) Reduced-reference image quality assessment using a wavelet-domain natural image statistics model. In: Proceedings of the IS&T/SPIE’s 17th annual symposium on electronic imaging, vol 5666, pp 149–159
16.
Zurück zum Zitat Gao X, Lu W, Tao D, Li X (2009) Image quality assessment based on multiscale geometric analysis. IEEE Trans Image Process 18(7):1409–1423CrossRefMathSciNet Gao X, Lu W, Tao D, Li X (2009) Image quality assessment based on multiscale geometric analysis. IEEE Trans Image Process 18(7):1409–1423CrossRefMathSciNet
17.
Zurück zum Zitat Wu HR, Yuen M (1997) A generalized block-edge impairment metric (GBIM) for video coding. IEEE Signal Process Lett 4:317–320CrossRef Wu HR, Yuen M (1997) A generalized block-edge impairment metric (GBIM) for video coding. IEEE Signal Process Lett 4:317–320CrossRef
18.
Zurück zum Zitat Wang Z, Sheikh HR, Bovik AC (2002) No-reference perceptual quality assessment of JPEG compressed images. In: Proceedings of the IEEE international conference on image processing, pp I-477–I-480 Wang Z, Sheikh HR, Bovik AC (2002) No-reference perceptual quality assessment of JPEG compressed images. In: Proceedings of the IEEE international conference on image processing, pp I-477–I-480
19.
Zurück zum Zitat Sheikh HR, Bovik AC, Cormack L (2005) No-reference quality assessment using natural scene statistics: JPEG2000. IEEE Trans Image Process 14(11):1918–1927CrossRef Sheikh HR, Bovik AC, Cormack L (2005) No-reference quality assessment using natural scene statistics: JPEG2000. IEEE Trans Image Process 14(11):1918–1927CrossRef
20.
Zurück zum Zitat Romberg JK (2003) Multiscale geometric image processing. PhD dissertation, Dept Elect Comput Eng, Rice Univ, Houston, TX Romberg JK (2003) Multiscale geometric image processing. PhD dissertation, Dept Elect Comput Eng, Rice Univ, Houston, TX
21.
Zurück zum Zitat Simoncelli EP, Freeman WT (1995) The steerable pyramid: a flexible architecture for multi-scale derivative computation. In: Proceedings of the IEEE international conference on image processing, Washington DC, pp 444–447 Simoncelli EP, Freeman WT (1995) The steerable pyramid: a flexible architecture for multi-scale derivative computation. In: Proceedings of the IEEE international conference on image processing, Washington DC, pp 444–447
22.
Zurück zum Zitat Candes EJ, Donoho DL (2000) Curvelets—a surprizingly effective nonadaptive representation for objects with edges. In: Cohen A, Rabut C, Schumaker LL (eds) Curve and surface fitting. Vanderbuilt University Press, Nashville, pp 105–120 Candes EJ, Donoho DL (2000) Curvelets—a surprizingly effective nonadaptive representation for objects with edges. In: Cohen A, Rabut C, Schumaker LL (eds) Curve and surface fitting. Vanderbuilt University Press, Nashville, pp 105–120
23.
Zurück zum Zitat Do MN, Vetterli M (2005) The contourlet transform: an efficient directional multiresolution image representation. IEEE Trans Image Process 14(12):2091–2106CrossRefMathSciNet Do MN, Vetterli M (2005) The contourlet transform: an efficient directional multiresolution image representation. IEEE Trans Image Process 14(12):2091–2106CrossRefMathSciNet
24.
Zurück zum Zitat Cunha AL, Zhou J, Do MN (2006) The nonsubsampled contourlet transform: theory, design, and applications. IEEE Trans Image Process 15(10):3089–3101CrossRef Cunha AL, Zhou J, Do MN (2006) The nonsubsampled contourlet transform: theory, design, and applications. IEEE Trans Image Process 15(10):3089–3101CrossRef
25.
Zurück zum Zitat Lu W, Zeng K, Tao D, Yuan Y, Gao X (2010) No-reference image quality assessment in contourlet domain. Neurocomputing 73:784–794CrossRef Lu W, Zeng K, Tao D, Yuan Y, Gao X (2010) No-reference image quality assessment in contourlet domain. Neurocomputing 73:784–794CrossRef
27.
Zurück zum Zitat Coifman RR, Donoho DL (1995) Translation invariant de-noising. In: Antoniadis A, Oppenheim G (eds) Wavelets and statistics. Springer, Berlin, pp 125–150CrossRef Coifman RR, Donoho DL (1995) Translation invariant de-noising. In: Antoniadis A, Oppenheim G (eds) Wavelets and statistics. Springer, Berlin, pp 125–150CrossRef
28.
Zurück zum Zitat Lu F, Zhao Q, Yang G (2011) Nonsubsampled contourlet transform based algorithm for no-reference image quality assessment. Opt Eng 50(6):067010-1–067010-10CrossRef Lu F, Zhao Q, Yang G (2011) Nonsubsampled contourlet transform based algorithm for no-reference image quality assessment. Opt Eng 50(6):067010-1–067010-10CrossRef
29.
Zurück zum Zitat Moorthy AK, Bovik AC (2010) A two-step framework for constructing blind image quality indices. IEEE Signal Process Lett 17(5):513–516CrossRef Moorthy AK, Bovik AC (2010) A two-step framework for constructing blind image quality indices. IEEE Signal Process Lett 17(5):513–516CrossRef
30.
Zurück zum Zitat Saad MA, Bovik AC, Charrier C (2010) A DCT statistics-based blind image quality index. IEEE Signal Process Lett 17(6):583–586CrossRef Saad MA, Bovik AC, Charrier C (2010) A DCT statistics-based blind image quality index. IEEE Signal Process Lett 17(6):583–586CrossRef
31.
Zurück zum Zitat Mittal A, Moorthy A, Bovik AC (2012) No-reference image quality assessment in the spatial domain. IEEE Trans Image Process 21(12):4695–4708 Mittal A, Moorthy A, Bovik AC (2012) No-reference image quality assessment in the spatial domain. IEEE Trans Image Process 21(12):4695–4708
32.
Zurück zum Zitat Ye P, Doermann D (2012) No-reference image quality assessment using visual codebooks. IEEE Trans Image Process 21:3129–3138CrossRefMathSciNet Ye P, Doermann D (2012) No-reference image quality assessment using visual codebooks. IEEE Trans Image Process 21:3129–3138CrossRefMathSciNet
33.
Zurück zum Zitat Li Z (1998) A neural model of contour in integration in the primary visual cortex. Neural Comput 10(4):903–940CrossRef Li Z (1998) A neural model of contour in integration in the primary visual cortex. Neural Comput 10(4):903–940CrossRef
34.
Zurück zum Zitat Watson AB (1998) Toward a perceptual video quality metric. In: Proceedings of the SPIE conference on human vision electronic imaging III, vol 3299, pp 139–147 Watson AB (1998) Toward a perceptual video quality metric. In: Proceedings of the SPIE conference on human vision electronic imaging III, vol 3299, pp 139–147
35.
Zurück zum Zitat Olshausen BA, Field DJ (2005) How close are we to understanding V1? Neural Comput 17(8):1665–1699CrossRefMATH Olshausen BA, Field DJ (2005) How close are we to understanding V1? Neural Comput 17(8):1665–1699CrossRefMATH
36.
Zurück zum Zitat Freeman WT, Adelson EH (1991) The design and use of steerable filters. IEEE Trans Pattern Anal Mach Intell 13:891–906CrossRef Freeman WT, Adelson EH (1991) The design and use of steerable filters. IEEE Trans Pattern Anal Mach Intell 13:891–906CrossRef
37.
Zurück zum Zitat Simoncelli EP, Freeman WT, Adelson EH, Heeger DJ (1992) Shiftable multiscale transforms. IEEE Trans Inf Theory 38:587–607CrossRefMathSciNet Simoncelli EP, Freeman WT, Adelson EH, Heeger DJ (1992) Shiftable multiscale transforms. IEEE Trans Inf Theory 38:587–607CrossRefMathSciNet
38.
Zurück zum Zitat Portilla J, Simoncelli EP (2000) A parametric texture model based on joint statistics of complex wavelet coefficients. Int J Comput Vis 40:49–70CrossRefMATH Portilla J, Simoncelli EP (2000) A parametric texture model based on joint statistics of complex wavelet coefficients. Int J Comput Vis 40:49–70CrossRefMATH
39.
Zurück zum Zitat Montoya-Zegarra JA, Leite NJ, Torres RdaS (2007) Rotation-invariant and scale-invariant steerable pyramid decomposition for texture image retrieval. In: SIBGRAPI 2007. XX Brazilian symposium on computer graphics and image processing, Minas Gerais, pp 121–128 Montoya-Zegarra JA, Leite NJ, Torres RdaS (2007) Rotation-invariant and scale-invariant steerable pyramid decomposition for texture image retrieval. In: SIBGRAPI 2007. XX Brazilian symposium on computer graphics and image processing, Minas Gerais, pp 121–128
40.
Zurück zum Zitat Fliegel K (2007) Perceptual assessment of image quality in multimedia technology. In: Proceedings of SPIE, mathematics of data/image pattern recognition, compression, coding, and encryption X, with applications, pp 670008-1–670008-8 Fliegel K (2007) Perceptual assessment of image quality in multimedia technology. In: Proceedings of SPIE, mathematics of data/image pattern recognition, compression, coding, and encryption X, with applications, pp 670008-1–670008-8
41.
Zurück zum Zitat Bro P, Jong S (1997) A fast non-negativity-constrained least squares algorithm. J Chemom 11(5):393–401CrossRef Bro P, Jong S (1997) A fast non-negativity-constrained least squares algorithm. J Chemom 11(5):393–401CrossRef
Metadaten
Titel
A no-reference image quality assessment approach based on steerable pyramid decomposition using natural scene statistics
verfasst von
Fangfang Lu
Qunfei Zhao
Genke Yang
Publikationsdatum
01.01.2015
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 1/2015
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-014-1699-5

Weitere Artikel der Ausgabe 1/2015

Neural Computing and Applications 1/2015 Zur Ausgabe