Skip to main content

2020 | OriginalPaper | Buchkapitel

No Reference Image Quality Assessment by Information Decomposition

verfasst von : Junchen Deng, Ci Wang, Shiqi Liu

Erschienen in: MultiMedia Modeling

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

No reference (NR) image quality assessment (IQA) is to automatically assess image quality as would be perceived by human without reference images. Currently, almost all state-of-the-art NR IQA approaches are trained and tested on the databases of synthetically distorted images. The synthetically distorted images are usually produced by superimposing one or several common distortions on the clean image, but the authentically distorted images are often simultaneously contaminated by several unknown distortions. Therefore, most IQA performances will greatly drop on the authentically distorted images. Recent researches on the human brain demonstrate that the human visual system (HVS) perceives image scenes by predicting the primary information and avoiding residual uncertainty. According to this theory, a new and robust NR IQA approach is proposed in this paper. By the proposed approach, the distorted image is decomposed into the orderly part and disorderly part to be separately processed as its primary information and uncertainty information. Global features of the distorted image are also calculated to describe the overall image contents. Experimental results on the synthetically and authentically image databases demonstrate that the proposed approach makes great progress in IQA performance.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Gu, K., Zhai, G., Yang, X., Zhang, W.: Hybrid no-reference quality metric for singly and multiply distorted images. IEEE Trans. Broadcast. 60(3), 555–567 (2014)CrossRef Gu, K., Zhai, G., Yang, X., Zhang, W.: Hybrid no-reference quality metric for singly and multiply distorted images. IEEE Trans. Broadcast. 60(3), 555–567 (2014)CrossRef
2.
Zurück zum Zitat Li, Q., Lin, W., Fang, Y.: No-reference quality assessment for multiply-distorted images in gradient domain. IEEE Sig. Process. Lett. 23(4), 541–545 (2016)CrossRef Li, Q., Lin, W., Fang, Y.: No-reference quality assessment for multiply-distorted images in gradient domain. IEEE Sig. Process. Lett. 23(4), 541–545 (2016)CrossRef
3.
Zurück zum Zitat Dai, T., Gu, K., Xu, Z., Tang, Q.: Blind quality assessment of multiply-distorted images based on structural degradation. In: 2017 IEEE International Conference on Image Processing (ICIP), pp. 171–175. IEEE (2017) Dai, T., Gu, K., Xu, Z., Tang, Q.: Blind quality assessment of multiply-distorted images based on structural degradation. In: 2017 IEEE International Conference on Image Processing (ICIP), pp. 171–175. IEEE (2017)
4.
Zurück zum Zitat Ghadiyaram, D., Bovik, A.C.: Massive online crowdsourced study of subjective and objective picture quality. IEEE Trans. Image Process. 25(1), 372–387 (2015)MathSciNetMATHCrossRef Ghadiyaram, D., Bovik, A.C.: Massive online crowdsourced study of subjective and objective picture quality. IEEE Trans. Image Process. 25(1), 372–387 (2015)MathSciNetMATHCrossRef
5.
Zurück zum Zitat Ghadiyaram, D., Bovik, A.C.: Perceptual quality prediction on authentically distorted images using a bag of features approach. J. Vis. 17(1), 32–32 (2017)CrossRef Ghadiyaram, D., Bovik, A.C.: Perceptual quality prediction on authentically distorted images using a bag of features approach. J. Vis. 17(1), 32–32 (2017)CrossRef
6.
Zurück zum Zitat Knill, D.C., Pouget, A.: The Bayesian brain: the role of uncertainty in neural coding and computation. Trends Neurosci. 27(12), 712–719 (2004)CrossRef Knill, D.C., Pouget, A.: The Bayesian brain: the role of uncertainty in neural coding and computation. Trends Neurosci. 27(12), 712–719 (2004)CrossRef
7.
Zurück zum Zitat Friston, K.: The free-energy principle: a unified brain theory? Nat. Rev. Neurosci. 11(2), 127–138 (2010)CrossRef Friston, K.: The free-energy principle: a unified brain theory? Nat. Rev. Neurosci. 11(2), 127–138 (2010)CrossRef
8.
Zurück zum Zitat Wu, J., Lin, W., Shi, G., Liu, A.: Reduced-reference image quality assessment with visual information fidelity. IEEE Trans. Multimed. 15(7), 1700–1705 (2013)CrossRef Wu, J., Lin, W., Shi, G., Liu, A.: Reduced-reference image quality assessment with visual information fidelity. IEEE Trans. Multimed. 15(7), 1700–1705 (2013)CrossRef
9.
Zurück zum Zitat Wu, J., Lin, W., Shi, G., Liu, A.: Perceptual quality metric with internal generative mechanism. IEEE Trans. Image Process. 22(1), 43–54 (2013)MathSciNetMATHCrossRef Wu, J., Lin, W., Shi, G., Liu, A.: Perceptual quality metric with internal generative mechanism. IEEE Trans. Image Process. 22(1), 43–54 (2013)MathSciNetMATHCrossRef
11.
Zurück zum Zitat Hughes, H.C., Nozawa, G., Kitterle, F.: Global precedence, spatial frequency channels, and the statistics of natural images. J. Cogn. Neurosci. 8(3), 197–230 (1996)CrossRef Hughes, H.C., Nozawa, G., Kitterle, F.: Global precedence, spatial frequency channels, and the statistics of natural images. J. Cogn. Neurosci. 8(3), 197–230 (1996)CrossRef
12.
Zurück zum Zitat Dabov, K., Foi, A., Katkovnik, V., Egiazarian, K.: Image denoising by sparse 3-D transform-domain collaborative filtering. IEEE Trans. Image Process. 16(8), 2080–2095 (2007)MathSciNetCrossRef Dabov, K., Foi, A., Katkovnik, V., Egiazarian, K.: Image denoising by sparse 3-D transform-domain collaborative filtering. IEEE Trans. Image Process. 16(8), 2080–2095 (2007)MathSciNetCrossRef
13.
Zurück zum Zitat Ojala, T., Pietikainen, M., Maenpaa, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 971–987 (2002)MATHCrossRef Ojala, T., Pietikainen, M., Maenpaa, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 971–987 (2002)MATHCrossRef
14.
Zurück zum Zitat Hou, X., Harel, J., Koch, C.: Image signature: highlighting sparse salient regions. IEEE Trans. Pattern Anal. Mach. Intell. 34(1), 194–201 (2011) Hou, X., Harel, J., Koch, C.: Image signature: highlighting sparse salient regions. IEEE Trans. Pattern Anal. Mach. Intell. 34(1), 194–201 (2011)
15.
Zurück zum Zitat Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)CrossRef Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)CrossRef
16.
Zurück zum Zitat Jayaraman, D., Mittal, A., Moorthy, A.K., Bovik, A.C.: Objective quality assessment of multiply distorted images. In: 2012 Conference Record of 46th Asilomar Conference on Signals, Systems and Computers (ASILOMAR), pp. 1693–1697, November 2012 Jayaraman, D., Mittal, A., Moorthy, A.K., Bovik, A.C.: Objective quality assessment of multiply distorted images. In: 2012 Conference Record of 46th Asilomar Conference on Signals, Systems and Computers (ASILOMAR), pp. 1693–1697, November 2012
17.
Zurück zum Zitat Jayant, N., Johnston, J., Safranek, R.: Signal compression based on models of human perception. In: Proceedings of the IEEE, pp. 1385–1422. IEEE, October 1993CrossRef Jayant, N., Johnston, J., Safranek, R.: Signal compression based on models of human perception. In: Proceedings of the IEEE, pp. 1385–1422. IEEE, October 1993CrossRef
18.
Zurück zum Zitat Zhang, X.H., Lin, W.S., Xue, P.: Improved estimation for just-noticeable visual distortion. Signal Process. 85(4), 795–808 (2005)MATHCrossRef Zhang, X.H., Lin, W.S., Xue, P.: Improved estimation for just-noticeable visual distortion. Signal Process. 85(4), 795–808 (2005)MATHCrossRef
19.
Zurück zum Zitat Schölkopf, B., Smola, A.J., Williamson, R.C., Bartlett, P.L.: New support vector algorithms. Neural Comput. 12(5), 1207–1245 (2000)CrossRef Schölkopf, B., Smola, A.J., Williamson, R.C., Bartlett, P.L.: New support vector algorithms. Neural Comput. 12(5), 1207–1245 (2000)CrossRef
21.
Zurück zum Zitat Video Quality Experts Group: Final report from the video quality experts group on the validation of objective models of video quality assessment, VQEG, March 2000 Video Quality Experts Group: Final report from the video quality experts group on the validation of objective models of video quality assessment, VQEG, March 2000
22.
Zurück zum Zitat Sheikh, H.R., Bovik, A.C.: Image information and visual quality. IEEE Trans. Image Process. 15(2), 430–444 (2006)CrossRef Sheikh, H.R., Bovik, A.C.: Image information and visual quality. IEEE Trans. Image Process. 15(2), 430–444 (2006)CrossRef
23.
Zurück zum Zitat Gu, K., Li, L., Lu, H., Lin, W.: A fast reliable image quality predictor by fusing micro-and macro-structures. IEEE Trans. Ind. Electron. 64(5), 3903–3912 (2017)CrossRef Gu, K., Li, L., Lu, H., Lin, W.: A fast reliable image quality predictor by fusing micro-and macro-structures. IEEE Trans. Ind. Electron. 64(5), 3903–3912 (2017)CrossRef
24.
Zurück zum Zitat Larson, E.C., Chandler, D.M.: Most apparent distortion: full-reference image quality assessment and the role of strategy. J. Electron. Imaging 19(1), 011006 (2010)CrossRef Larson, E.C., Chandler, D.M.: Most apparent distortion: full-reference image quality assessment and the role of strategy. J. Electron. Imaging 19(1), 011006 (2010)CrossRef
25.
Zurück zum Zitat Xue, W., Zhang, L., Mou, X., Bovik, A.C.: Gradient magnitude similarity deviation: a highly efficient perceptual image quality index. IEEE Trans. Image Process. 23(2), 684–695 (2013)MathSciNetMATHCrossRef Xue, W., Zhang, L., Mou, X., Bovik, A.C.: Gradient magnitude similarity deviation: a highly efficient perceptual image quality index. IEEE Trans. Image Process. 23(2), 684–695 (2013)MathSciNetMATHCrossRef
26.
Zurück zum Zitat Mittal, A., Soundararajan, R., Bovik, A.C.: Making a completely blind image quality analyzer. IEEE Signal Process. Lett. 20(3), 209–212 (2013)CrossRef Mittal, A., Soundararajan, R., Bovik, A.C.: Making a completely blind image quality analyzer. IEEE Signal Process. Lett. 20(3), 209–212 (2013)CrossRef
27.
Zurück zum Zitat Zhang, L., Zhang, L., Bovik, A.C.: A feature-enriched completely blind image quality evaluator. IEEE Trans. Image Process. 24(8), 2579–2591 (2015)MathSciNetMATHCrossRef Zhang, L., Zhang, L., Bovik, A.C.: A feature-enriched completely blind image quality evaluator. IEEE Trans. Image Process. 24(8), 2579–2591 (2015)MathSciNetMATHCrossRef
28.
Zurück zum Zitat Saad, M.A., Bovik, A.C., Charrier, C.: Blind image quality assessment: a natural scene statistics approach in the DCT domain. IEEE Trans. Image Process. 21(8), 3339–3352 (2012)MathSciNetMATHCrossRef Saad, M.A., Bovik, A.C., Charrier, C.: Blind image quality assessment: a natural scene statistics approach in the DCT domain. IEEE Trans. Image Process. 21(8), 3339–3352 (2012)MathSciNetMATHCrossRef
29.
Zurück zum Zitat Moorthy, A.K., Bovik, A.C.: Blind image quality assessment: from natural scene statistics to perceptual quality. IEEE Trans. Image Process. 20(12), 3350–3364 (2011)MathSciNetMATHCrossRef Moorthy, A.K., Bovik, A.C.: Blind image quality assessment: from natural scene statistics to perceptual quality. IEEE Trans. Image Process. 20(12), 3350–3364 (2011)MathSciNetMATHCrossRef
30.
Zurück zum Zitat Mittal, A., Moorthy, A.K., Bovik, A.C.: No-reference image quality assessment in the spatial domain. IEEE Trans. Image Process. 21(12), 4695–4708 (2012)MathSciNetMATHCrossRef Mittal, A., Moorthy, A.K., Bovik, A.C.: No-reference image quality assessment in the spatial domain. IEEE Trans. Image Process. 21(12), 4695–4708 (2012)MathSciNetMATHCrossRef
31.
Zurück zum Zitat Zhang, Y., Moorthy, A.K., Chandler, D.M., Bovik, A.C.: C-DIIVINE: no-reference image quality assessment based on local magnitude and phase statistics of natural scenes. Signal Process.: Image Commun. 29(7), 725–747 (2014) Zhang, Y., Moorthy, A.K., Chandler, D.M., Bovik, A.C.: C-DIIVINE: no-reference image quality assessment based on local magnitude and phase statistics of natural scenes. Signal Process.: Image Commun. 29(7), 725–747 (2014)
32.
Zurück zum Zitat Xue, W., Mou, X., Zhang, L., Bovik, A.C., Feng, X.: Blind image quality assessment using joint statistics of gradient magnitude and Laplacian features. IEEE Trans. Image Process. 23(11), 4850–4862 (2014)MathSciNetMATHCrossRef Xue, W., Mou, X., Zhang, L., Bovik, A.C., Feng, X.: Blind image quality assessment using joint statistics of gradient magnitude and Laplacian features. IEEE Trans. Image Process. 23(11), 4850–4862 (2014)MathSciNetMATHCrossRef
33.
Zurück zum Zitat Liu, L., Dong, H., Huang, H., Bovik, A.C.: No-reference image quality assessment in curvelet domain. Sig. Process.: Image Commun. 29(4), 494–505 (2014) Liu, L., Dong, H., Huang, H., Bovik, A.C.: No-reference image quality assessment in curvelet domain. Sig. Process.: Image Commun. 29(4), 494–505 (2014)
34.
Zurück zum Zitat Sheskin, D.J.: Handbook of Parametric and Nonparametric Statistical Procedures, 3rd edn. Chapman and Hall/CRC, New York (2003)MATHCrossRef Sheskin, D.J.: Handbook of Parametric and Nonparametric Statistical Procedures, 3rd edn. Chapman and Hall/CRC, New York (2003)MATHCrossRef
Metadaten
Titel
No Reference Image Quality Assessment by Information Decomposition
verfasst von
Junchen Deng
Ci Wang
Shiqi Liu
Copyright-Jahr
2020
DOI
https://doi.org/10.1007/978-3-030-37731-1_67

Neuer Inhalt