Skip to main content

2020 | OriginalPaper | Buchkapitel

Screen Content Picture Quality Evaluation by Colorful Sparse Reference Information

verfasst von : Huiqing Zhang, Donghao Li, Shuo Li, Zhifang Xia, Lijuan Tang

Erschienen in: Digital TV and Wireless Multimedia Communication

Verlag: Springer Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

With the rapid development of multimedia interactive applications, the processing volume of the screen content (SC) images is increasing day by day. The research on image quality assessment is the basis of many other applications. The focus of general image quality assessment (QA) research is natural scene (NS) images, now for the quality assessment research of SC images becomes very urgent and has received more and more attention. Accurate quality assessment of SC images helps improve the user experience. Based on these, this paper proposes an improved method using very sparse reference information for accurate quality assessment of SC images. Specifically, the proposed method extracts macroscopic, microscopic structure and color information respectively, and measures the differences in terms of macroscopic, microscopic features and color information between the original SC image and its distorted version, and finally calculates the overall quality score of the distorted SC image. The quality assessment model we built uses a dimension reduction histogram and only needs to transmit very sparse reference information. Experiments show that the proposed method has obvious superiority over the state-of-the-art relevant quality metrics in the visual quality assessment of SC images.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Yang, X.K., Ling, W.S., Lu, Z.K., Ong, E.P., Yao, S.S.: Just noticeable distortion model and its applications in video coding. Sig. Process. Image Commun. 20, 742–752 (2005) Yang, X.K., Ling, W.S., Lu, Z.K., Ong, E.P., Yao, S.S.: Just noticeable distortion model and its applications in video coding. Sig. Process. Image Commun. 20, 742–752 (2005)
2.
Zurück zum Zitat Yang, X.K., Lin, W.S., Lu, Z.K., Ong, E.P., Yao, S.S.: Motion-compensated residue preprocessing in video coding based on just-noticeable-distortion profile. IEEE Trans. Circ. Syst. Video Technol. 15(6), 742–752 (2005)CrossRef Yang, X.K., Lin, W.S., Lu, Z.K., Ong, E.P., Yao, S.S.: Motion-compensated residue preprocessing in video coding based on just-noticeable-distortion profile. IEEE Trans. Circ. Syst. Video Technol. 15(6), 742–752 (2005)CrossRef
3.
Zurück zum Zitat Zhai, G., Cai, J., Lin, W., Yang, X., Zhang, W., Etoh, M.: Cross-dimensional perceptual quality assessment for low bit-rate videos. IEEE Trans. Multimed. 10(7), 1316–1324 (2008)CrossRef Zhai, G., Cai, J., Lin, W., Yang, X., Zhang, W., Etoh, M.: Cross-dimensional perceptual quality assessment for low bit-rate videos. IEEE Trans. Multimed. 10(7), 1316–1324 (2008)CrossRef
4.
Zurück zum Zitat Zhai, G., Zhang, W., Yang, X., Lin, W., Xu, Y.: Efficient image deblocking based on postfiltering in shifted windows. IEEE Trans. Circ. Syst. Video Technol. 18(1), 122–126 (2008)CrossRef Zhai, G., Zhang, W., Yang, X., Lin, W., Xu, Y.: Efficient image deblocking based on postfiltering in shifted windows. IEEE Trans. Circ. Syst. Video Technol. 18(1), 122–126 (2008)CrossRef
5.
Zurück zum Zitat Zhu, W., Ding, W., Xu, J., Shi, Y., Yin, B.: Screen content coding based on HEVC framework. IEEE Trans. Multimed. 16(5), 1316–1326 (2014)CrossRef Zhu, W., Ding, W., Xu, J., Shi, Y., Yin, B.: Screen content coding based on HEVC framework. IEEE Trans. Multimed. 16(5), 1316–1326 (2014)CrossRef
6.
Zurück zum Zitat Gu, K., Zhai, G., Yang, X., Zhang, W., Chen, C.W.: Automatic contrast enhancement technology with saliency preservation. IEEE Trans. Circ. Syst. Video Technol. 25(9), 1480–1494 (2015)CrossRef Gu, K., Zhai, G., Yang, X., Zhang, W., Chen, C.W.: Automatic contrast enhancement technology with saliency preservation. IEEE Trans. Circ. Syst. Video Technol. 25(9), 1480–1494 (2015)CrossRef
7.
Zurück zum Zitat Gu, K., Tao, D., Qiao, J., Lin, W.: Learning a no-reference quality assessment model of enhanced images with big data. IEEE Trans. Neural Netw. Learn. Syst. 29(4), 1301–1313 (2018)CrossRef Gu, K., Tao, D., Qiao, J., Lin, W.: Learning a no-reference quality assessment model of enhanced images with big data. IEEE Trans. Neural Netw. Learn. Syst. 29(4), 1301–1313 (2018)CrossRef
8.
Zurück zum Zitat Zhu, X., Milanfar, P.: Automatic parameter selection for denoising algorithms using a no-reference measure of image content. IEEE Trans. Image Process. 19(12), 3116–3132 (2010)MathSciNetCrossRef Zhu, X., Milanfar, P.: Automatic parameter selection for denoising algorithms using a no-reference measure of image content. IEEE Trans. Image Process. 19(12), 3116–3132 (2010)MathSciNetCrossRef
9.
Zurück zum Zitat Mittal, A., Moorthy, A.K., Bovik, A.C.: No-reference image quality assessment in the spatial domain. IEEE Trans. Image Process. 21(12), 4695–4708 (2012)MathSciNetCrossRef Mittal, A., Moorthy, A.K., Bovik, A.C.: No-reference image quality assessment in the spatial domain. IEEE Trans. Image Process. 21(12), 4695–4708 (2012)MathSciNetCrossRef
10.
Zurück zum Zitat Wu, H.R., Reibman, A.R., Lin, W., Pereira, F., Hemami, S.S.: Perceptual visual signal compression and transmission. Proc. IEEE 101(9), 2025–2043 (2013)CrossRef Wu, H.R., Reibman, A.R., Lin, W., Pereira, F., Hemami, S.S.: Perceptual visual signal compression and transmission. Proc. IEEE 101(9), 2025–2043 (2013)CrossRef
11.
Zurück zum Zitat Zhang, L., Zhang, L., Mou, X., Zhang, D.: FSIM: a feature similarity index for image quality assessment. IEEE Trans. Image Process. 20(8), 2378–2386 (2011)MathSciNetCrossRef Zhang, L., Zhang, L., Mou, X., Zhang, D.: FSIM: a feature similarity index for image quality assessment. IEEE Trans. Image Process. 20(8), 2378–2386 (2011)MathSciNetCrossRef
12.
Zurück zum Zitat Liu, A., Lin, W., Narwaria, M.: Image quality assessment based on gradient similarity. IEEE Trans. Image Process. 21(4), 1500–1512 (2012)MathSciNetCrossRef Liu, A., Lin, W., Narwaria, M.: Image quality assessment based on gradient similarity. IEEE Trans. Image Process. 21(4), 1500–1512 (2012)MathSciNetCrossRef
13.
Zurück zum Zitat Yue, G., Hou, C., Gu, K., Mao, S., Zhang, W.: Biologically inspired blind quality assessment of tone-mapped images. IEEE Trans. Ind. Electron. 65(3), 2525–2536 (2018)CrossRef Yue, G., Hou, C., Gu, K., Mao, S., Zhang, W.: Biologically inspired blind quality assessment of tone-mapped images. IEEE Trans. Ind. Electron. 65(3), 2525–2536 (2018)CrossRef
14.
Zurück zum Zitat Gu, K., Zhai, G., Yang, X., Zhang, W.: Using free energy principle for blind image quality assessment. IEEE Trans. Multimed. 17(1), 50–63 (2015)CrossRef Gu, K., Zhai, G., Yang, X., Zhang, W.: Using free energy principle for blind image quality assessment. IEEE Trans. Multimed. 17(1), 50–63 (2015)CrossRef
15.
Zurück zum Zitat Zhai, G., Wu, X., Yang, X., Lin, W., Zhang, W.: A psychovisual quality metric in free-energy principle. IEEE Trans. Image Process. 21(1), 41–52 (2012)MathSciNetCrossRef Zhai, G., Wu, X., Yang, X., Lin, W., Zhang, W.: A psychovisual quality metric in free-energy principle. IEEE Trans. Image Process. 21(1), 41–52 (2012)MathSciNetCrossRef
16.
Zurück zum Zitat Gu, K., Zhai, G., Lin, W., Liu, M.: The analysis of image contrast: from quality assessment to automatic enhancement. IEEE Trans. Cybern. 46(1), 284–297 (2016)CrossRef Gu, K., Zhai, G., Lin, W., Liu, M.: The analysis of image contrast: from quality assessment to automatic enhancement. IEEE Trans. Cybern. 46(1), 284–297 (2016)CrossRef
17.
Zurück zum Zitat Gu, K., Lin, W., Zhai, G., Yang, X., Zhang, W., Chen, C.W.: No-reference quality metric of contrast-distorted images based on information maximization. IEEE Trans. Cybern. 47(12), 4559–4565 (2017)CrossRef Gu, K., Lin, W., Zhai, G., Yang, X., Zhang, W., Chen, C.W.: No-reference quality metric of contrast-distorted images based on information maximization. IEEE Trans. Cybern. 47(12), 4559–4565 (2017)CrossRef
18.
Zurück zum Zitat Gu, K., Zhou, J., Qiao, J., Zhai, G., Lin, W., Bovik, A.C.: No-reference quality assessment of screen content pictures. IEEE Trans. Image Process. 26(8), 4005–4018 (2017)MathSciNetCrossRef Gu, K., Zhou, J., Qiao, J., Zhai, G., Lin, W., Bovik, A.C.: No-reference quality assessment of screen content pictures. IEEE Trans. Image Process. 26(8), 4005–4018 (2017)MathSciNetCrossRef
19.
Zurück zum Zitat Yang, H., Fang, Y., Lin, W.: Perceptual quality assessment of screen content images. IEEE Trans. Image Process. 24(11), 4408–4421 (2015)MathSciNetCrossRef Yang, H., Fang, Y., Lin, W.: Perceptual quality assessment of screen content images. IEEE Trans. Image Process. 24(11), 4408–4421 (2015)MathSciNetCrossRef
20.
Zurück zum Zitat Gu, K., et al.: Saliency-guided quality assessment of screen content images. IEEE Trans. Multimed. 18(6), 1–13 (2016)CrossRef Gu, K., et al.: Saliency-guided quality assessment of screen content images. IEEE Trans. Multimed. 18(6), 1–13 (2016)CrossRef
21.
Zurück zum Zitat Wang, S., et al.: Subjective and objective quality assessment of compressed screen content images. IEEE J. Emerg. Sel. Top. Circ. Syst. 6(4), 532–543 (2016)CrossRef Wang, S., et al.: Subjective and objective quality assessment of compressed screen content images. IEEE J. Emerg. Sel. Top. Circ. Syst. 6(4), 532–543 (2016)CrossRef
22.
Zurück zum Zitat Wang, S., Gu, K., Zhang, X., Lin, W., Ma, S., Gao, W.: Reduced-reference quality assessment of screen content images. IEEE Trans. Circ. Syst. Video Technol. 28(1), 1–14 (2018)CrossRef Wang, S., Gu, K., Zhang, X., Lin, W., Ma, S., Gao, W.: Reduced-reference quality assessment of screen content images. IEEE Trans. Circ. Syst. Video Technol. 28(1), 1–14 (2018)CrossRef
23.
Zurück zum Zitat Jakhetiya, V., Gu, K., Lin, W., Li, Q., Jaiswal, S.P.: A prediction backed model for quality assessment of screen content and 3-D synthesized images. IEEE Trans. Ind. Inf. 14(2), 652–660 (2018)CrossRef Jakhetiya, V., Gu, K., Lin, W., Li, Q., Jaiswal, S.P.: A prediction backed model for quality assessment of screen content and 3-D synthesized images. IEEE Trans. Ind. Inf. 14(2), 652–660 (2018)CrossRef
24.
Zurück zum Zitat Ni, Z., Ma, L., Zeng, H., Cai, C., Ma, K.: Gradient direction for screen content image quality assessment. IEEE Signal Process. Lett. 23(10), 1394–1398 (2016)CrossRef Ni, Z., Ma, L., Zeng, H., Cai, C., Ma, K.: Gradient direction for screen content image quality assessment. IEEE Signal Process. Lett. 23(10), 1394–1398 (2016)CrossRef
25.
Zurück zum Zitat Zhang, L., Shen, Y., Li, H.: VSI: a visual saliency induced index for perceptual image quality assessment. IEEE Trans. Image Process. 23(10), 4270–4281 (2014)MathSciNetCrossRef Zhang, L., Shen, Y., Li, H.: VSI: a visual saliency induced index for perceptual image quality assessment. IEEE Trans. Image Process. 23(10), 4270–4281 (2014)MathSciNetCrossRef
26.
Zurück zum Zitat Gu, K., Li, L., Lu, H., Min, X., Lin, W.: A fast reliable image quality predictor by fusing micro- and macro-structures. IEEE Trans. Ind. Electron. 64(5), 3903–3912 (2017)CrossRef Gu, K., Li, L., Lu, H., Min, X., Lin, W.: A fast reliable image quality predictor by fusing micro- and macro-structures. IEEE Trans. Ind. Electron. 64(5), 3903–3912 (2017)CrossRef
27.
Zurück zum Zitat Min, X., Zhai, G., Gu, K., Yang, X., Guan, X.: Objective quality evaluation of dehazed images. IEEE Trans. Intell. Transp. Syst. 20, 1–14 (2018) Min, X., Zhai, G., Gu, K., Yang, X., Guan, X.: Objective quality evaluation of dehazed images. IEEE Trans. Intell. Transp. Syst. 20, 1–14 (2018)
28.
Zurück zum Zitat Li, Q., Wang, Z.: Reduced-reference image quality assessment using divisive normalization-based image representation. IEEE J. Sel. Top. Signal Process. 3(2), 202–211 (2009)CrossRef Li, Q., Wang, Z.: Reduced-reference image quality assessment using divisive normalization-based image representation. IEEE J. Sel. Top. Signal Process. 3(2), 202–211 (2009)CrossRef
29.
Zurück zum Zitat Wu, J., Lin, W., Shi, G., Liu, A.: Reduced-reference image quality assessment with visual information fidelity. IEEE Trans. Multimed. 15(7), 1700–1705 (2013)CrossRef Wu, J., Lin, W., Shi, G., Liu, A.: Reduced-reference image quality assessment with visual information fidelity. IEEE Trans. Multimed. 15(7), 1700–1705 (2013)CrossRef
30.
Zurück zum Zitat Wang, Z., Simoncelli, E.P.: Reduced-reference image quality assessment using a wavelet-domain natural image statistic model. In: Proceedings of the SPIE Human Vision and Electronic Imaging X, vol. 5666, pp. 149–159 (2005) Wang, Z., Simoncelli, E.P.: Reduced-reference image quality assessment using a wavelet-domain natural image statistic model. In: Proceedings of the SPIE Human Vision and Electronic Imaging X, vol. 5666, pp. 149–159 (2005)
31.
Zurück zum Zitat Narwaria, M., Lin, W., McLoughlin, I.V., Emmanuel, S., Chia, L.: Fourier transform-based scalable image quality measure. IEEE Trans. Image Process. 21(8), 3364–3377 (2012)MathSciNetCrossRef Narwaria, M., Lin, W., McLoughlin, I.V., Emmanuel, S., Chia, L.: Fourier transform-based scalable image quality measure. IEEE Trans. Image Process. 21(8), 3364–3377 (2012)MathSciNetCrossRef
32.
Zurück zum Zitat Gu, K., Zhai, G., Yang, X., Zhang, W.: A new reduced-reference image quality assessment using structural degradation model. In: 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013), pp. 1095–1098, May 2013 Gu, K., Zhai, G., Yang, X., Zhang, W.: A new reduced-reference image quality assessment using structural degradation model. In: 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013), pp. 1095–1098, May 2013
33.
Zurück zum Zitat Min, X., Zhai, G., Gu, K., Liu, Y., Yang, X.: Blind image quality estimation via distortion aggravation. IEEE Trans. Broadcast. 64(2), 508–517 (2018)CrossRef Min, X., Zhai, G., Gu, K., Liu, Y., Yang, X.: Blind image quality estimation via distortion aggravation. IEEE Trans. Broadcast. 64(2), 508–517 (2018)CrossRef
34.
Zurück zum Zitat Min, X., Gu, K., Zhai, G., Liu, J., Yang, X., Chen, C.W.: Blind quality assessment based on pseudo-reference image. IEEE Trans. Multimed. 20(8), 2049–2062 (2018)CrossRef Min, X., Gu, K., Zhai, G., Liu, J., Yang, X., Chen, C.W.: Blind quality assessment based on pseudo-reference image. IEEE Trans. Multimed. 20(8), 2049–2062 (2018)CrossRef
35.
Zurück zum Zitat Xia, Z., Gu, K., Wang, S., Liu, H., Kwong, S.T.W.: Towards accurate quality estimation of screen content pictures with very sparse reference information. IEEE Trans. Ind. Electron. 67(3), 2251–2261 (2019)CrossRef Xia, Z., Gu, K., Wang, S., Liu, H., Kwong, S.T.W.: Towards accurate quality estimation of screen content pictures with very sparse reference information. IEEE Trans. Ind. Electron. 67(3), 2251–2261 (2019)CrossRef
Metadaten
Titel
Screen Content Picture Quality Evaluation by Colorful Sparse Reference Information
verfasst von
Huiqing Zhang
Donghao Li
Shuo Li
Zhifang Xia
Lijuan Tang
Copyright-Jahr
2020
Verlag
Springer Singapore
DOI
https://doi.org/10.1007/978-981-15-3341-9_24

Neuer Inhalt