Skip to main content
Top

2020 | OriginalPaper | Chapter

Screen Content Picture Quality Evaluation by Colorful Sparse Reference Information

Authors : Huiqing Zhang, Donghao Li, Shuo Li, Zhifang Xia, Lijuan Tang

Published in: Digital TV and Wireless Multimedia Communication

Publisher: Springer Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

With the rapid development of multimedia interactive applications, the processing volume of the screen content (SC) images is increasing day by day. The research on image quality assessment is the basis of many other applications. The focus of general image quality assessment (QA) research is natural scene (NS) images, now for the quality assessment research of SC images becomes very urgent and has received more and more attention. Accurate quality assessment of SC images helps improve the user experience. Based on these, this paper proposes an improved method using very sparse reference information for accurate quality assessment of SC images. Specifically, the proposed method extracts macroscopic, microscopic structure and color information respectively, and measures the differences in terms of macroscopic, microscopic features and color information between the original SC image and its distorted version, and finally calculates the overall quality score of the distorted SC image. The quality assessment model we built uses a dimension reduction histogram and only needs to transmit very sparse reference information. Experiments show that the proposed method has obvious superiority over the state-of-the-art relevant quality metrics in the visual quality assessment of SC images.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Yang, X.K., Ling, W.S., Lu, Z.K., Ong, E.P., Yao, S.S.: Just noticeable distortion model and its applications in video coding. Sig. Process. Image Commun. 20, 742–752 (2005) Yang, X.K., Ling, W.S., Lu, Z.K., Ong, E.P., Yao, S.S.: Just noticeable distortion model and its applications in video coding. Sig. Process. Image Commun. 20, 742–752 (2005)
2.
go back to reference Yang, X.K., Lin, W.S., Lu, Z.K., Ong, E.P., Yao, S.S.: Motion-compensated residue preprocessing in video coding based on just-noticeable-distortion profile. IEEE Trans. Circ. Syst. Video Technol. 15(6), 742–752 (2005)CrossRef Yang, X.K., Lin, W.S., Lu, Z.K., Ong, E.P., Yao, S.S.: Motion-compensated residue preprocessing in video coding based on just-noticeable-distortion profile. IEEE Trans. Circ. Syst. Video Technol. 15(6), 742–752 (2005)CrossRef
3.
go back to reference Zhai, G., Cai, J., Lin, W., Yang, X., Zhang, W., Etoh, M.: Cross-dimensional perceptual quality assessment for low bit-rate videos. IEEE Trans. Multimed. 10(7), 1316–1324 (2008)CrossRef Zhai, G., Cai, J., Lin, W., Yang, X., Zhang, W., Etoh, M.: Cross-dimensional perceptual quality assessment for low bit-rate videos. IEEE Trans. Multimed. 10(7), 1316–1324 (2008)CrossRef
4.
go back to reference Zhai, G., Zhang, W., Yang, X., Lin, W., Xu, Y.: Efficient image deblocking based on postfiltering in shifted windows. IEEE Trans. Circ. Syst. Video Technol. 18(1), 122–126 (2008)CrossRef Zhai, G., Zhang, W., Yang, X., Lin, W., Xu, Y.: Efficient image deblocking based on postfiltering in shifted windows. IEEE Trans. Circ. Syst. Video Technol. 18(1), 122–126 (2008)CrossRef
5.
go back to reference Zhu, W., Ding, W., Xu, J., Shi, Y., Yin, B.: Screen content coding based on HEVC framework. IEEE Trans. Multimed. 16(5), 1316–1326 (2014)CrossRef Zhu, W., Ding, W., Xu, J., Shi, Y., Yin, B.: Screen content coding based on HEVC framework. IEEE Trans. Multimed. 16(5), 1316–1326 (2014)CrossRef
6.
go back to reference Gu, K., Zhai, G., Yang, X., Zhang, W., Chen, C.W.: Automatic contrast enhancement technology with saliency preservation. IEEE Trans. Circ. Syst. Video Technol. 25(9), 1480–1494 (2015)CrossRef Gu, K., Zhai, G., Yang, X., Zhang, W., Chen, C.W.: Automatic contrast enhancement technology with saliency preservation. IEEE Trans. Circ. Syst. Video Technol. 25(9), 1480–1494 (2015)CrossRef
7.
go back to reference Gu, K., Tao, D., Qiao, J., Lin, W.: Learning a no-reference quality assessment model of enhanced images with big data. IEEE Trans. Neural Netw. Learn. Syst. 29(4), 1301–1313 (2018)CrossRef Gu, K., Tao, D., Qiao, J., Lin, W.: Learning a no-reference quality assessment model of enhanced images with big data. IEEE Trans. Neural Netw. Learn. Syst. 29(4), 1301–1313 (2018)CrossRef
8.
go back to reference Zhu, X., Milanfar, P.: Automatic parameter selection for denoising algorithms using a no-reference measure of image content. IEEE Trans. Image Process. 19(12), 3116–3132 (2010)MathSciNetCrossRef Zhu, X., Milanfar, P.: Automatic parameter selection for denoising algorithms using a no-reference measure of image content. IEEE Trans. Image Process. 19(12), 3116–3132 (2010)MathSciNetCrossRef
9.
go back to reference Mittal, A., Moorthy, A.K., Bovik, A.C.: No-reference image quality assessment in the spatial domain. IEEE Trans. Image Process. 21(12), 4695–4708 (2012)MathSciNetCrossRef Mittal, A., Moorthy, A.K., Bovik, A.C.: No-reference image quality assessment in the spatial domain. IEEE Trans. Image Process. 21(12), 4695–4708 (2012)MathSciNetCrossRef
10.
go back to reference Wu, H.R., Reibman, A.R., Lin, W., Pereira, F., Hemami, S.S.: Perceptual visual signal compression and transmission. Proc. IEEE 101(9), 2025–2043 (2013)CrossRef Wu, H.R., Reibman, A.R., Lin, W., Pereira, F., Hemami, S.S.: Perceptual visual signal compression and transmission. Proc. IEEE 101(9), 2025–2043 (2013)CrossRef
11.
go back to reference Zhang, L., Zhang, L., Mou, X., Zhang, D.: FSIM: a feature similarity index for image quality assessment. IEEE Trans. Image Process. 20(8), 2378–2386 (2011)MathSciNetCrossRef Zhang, L., Zhang, L., Mou, X., Zhang, D.: FSIM: a feature similarity index for image quality assessment. IEEE Trans. Image Process. 20(8), 2378–2386 (2011)MathSciNetCrossRef
12.
go back to reference Liu, A., Lin, W., Narwaria, M.: Image quality assessment based on gradient similarity. IEEE Trans. Image Process. 21(4), 1500–1512 (2012)MathSciNetCrossRef Liu, A., Lin, W., Narwaria, M.: Image quality assessment based on gradient similarity. IEEE Trans. Image Process. 21(4), 1500–1512 (2012)MathSciNetCrossRef
13.
go back to reference Yue, G., Hou, C., Gu, K., Mao, S., Zhang, W.: Biologically inspired blind quality assessment of tone-mapped images. IEEE Trans. Ind. Electron. 65(3), 2525–2536 (2018)CrossRef Yue, G., Hou, C., Gu, K., Mao, S., Zhang, W.: Biologically inspired blind quality assessment of tone-mapped images. IEEE Trans. Ind. Electron. 65(3), 2525–2536 (2018)CrossRef
14.
go back to reference Gu, K., Zhai, G., Yang, X., Zhang, W.: Using free energy principle for blind image quality assessment. IEEE Trans. Multimed. 17(1), 50–63 (2015)CrossRef Gu, K., Zhai, G., Yang, X., Zhang, W.: Using free energy principle for blind image quality assessment. IEEE Trans. Multimed. 17(1), 50–63 (2015)CrossRef
15.
go back to reference Zhai, G., Wu, X., Yang, X., Lin, W., Zhang, W.: A psychovisual quality metric in free-energy principle. IEEE Trans. Image Process. 21(1), 41–52 (2012)MathSciNetCrossRef Zhai, G., Wu, X., Yang, X., Lin, W., Zhang, W.: A psychovisual quality metric in free-energy principle. IEEE Trans. Image Process. 21(1), 41–52 (2012)MathSciNetCrossRef
16.
go back to reference Gu, K., Zhai, G., Lin, W., Liu, M.: The analysis of image contrast: from quality assessment to automatic enhancement. IEEE Trans. Cybern. 46(1), 284–297 (2016)CrossRef Gu, K., Zhai, G., Lin, W., Liu, M.: The analysis of image contrast: from quality assessment to automatic enhancement. IEEE Trans. Cybern. 46(1), 284–297 (2016)CrossRef
17.
go back to reference Gu, K., Lin, W., Zhai, G., Yang, X., Zhang, W., Chen, C.W.: No-reference quality metric of contrast-distorted images based on information maximization. IEEE Trans. Cybern. 47(12), 4559–4565 (2017)CrossRef Gu, K., Lin, W., Zhai, G., Yang, X., Zhang, W., Chen, C.W.: No-reference quality metric of contrast-distorted images based on information maximization. IEEE Trans. Cybern. 47(12), 4559–4565 (2017)CrossRef
18.
go back to reference Gu, K., Zhou, J., Qiao, J., Zhai, G., Lin, W., Bovik, A.C.: No-reference quality assessment of screen content pictures. IEEE Trans. Image Process. 26(8), 4005–4018 (2017)MathSciNetCrossRef Gu, K., Zhou, J., Qiao, J., Zhai, G., Lin, W., Bovik, A.C.: No-reference quality assessment of screen content pictures. IEEE Trans. Image Process. 26(8), 4005–4018 (2017)MathSciNetCrossRef
19.
go back to reference Yang, H., Fang, Y., Lin, W.: Perceptual quality assessment of screen content images. IEEE Trans. Image Process. 24(11), 4408–4421 (2015)MathSciNetCrossRef Yang, H., Fang, Y., Lin, W.: Perceptual quality assessment of screen content images. IEEE Trans. Image Process. 24(11), 4408–4421 (2015)MathSciNetCrossRef
20.
go back to reference Gu, K., et al.: Saliency-guided quality assessment of screen content images. IEEE Trans. Multimed. 18(6), 1–13 (2016)CrossRef Gu, K., et al.: Saliency-guided quality assessment of screen content images. IEEE Trans. Multimed. 18(6), 1–13 (2016)CrossRef
21.
go back to reference Wang, S., et al.: Subjective and objective quality assessment of compressed screen content images. IEEE J. Emerg. Sel. Top. Circ. Syst. 6(4), 532–543 (2016)CrossRef Wang, S., et al.: Subjective and objective quality assessment of compressed screen content images. IEEE J. Emerg. Sel. Top. Circ. Syst. 6(4), 532–543 (2016)CrossRef
22.
go back to reference Wang, S., Gu, K., Zhang, X., Lin, W., Ma, S., Gao, W.: Reduced-reference quality assessment of screen content images. IEEE Trans. Circ. Syst. Video Technol. 28(1), 1–14 (2018)CrossRef Wang, S., Gu, K., Zhang, X., Lin, W., Ma, S., Gao, W.: Reduced-reference quality assessment of screen content images. IEEE Trans. Circ. Syst. Video Technol. 28(1), 1–14 (2018)CrossRef
23.
go back to reference Jakhetiya, V., Gu, K., Lin, W., Li, Q., Jaiswal, S.P.: A prediction backed model for quality assessment of screen content and 3-D synthesized images. IEEE Trans. Ind. Inf. 14(2), 652–660 (2018)CrossRef Jakhetiya, V., Gu, K., Lin, W., Li, Q., Jaiswal, S.P.: A prediction backed model for quality assessment of screen content and 3-D synthesized images. IEEE Trans. Ind. Inf. 14(2), 652–660 (2018)CrossRef
24.
go back to reference Ni, Z., Ma, L., Zeng, H., Cai, C., Ma, K.: Gradient direction for screen content image quality assessment. IEEE Signal Process. Lett. 23(10), 1394–1398 (2016)CrossRef Ni, Z., Ma, L., Zeng, H., Cai, C., Ma, K.: Gradient direction for screen content image quality assessment. IEEE Signal Process. Lett. 23(10), 1394–1398 (2016)CrossRef
25.
go back to reference Zhang, L., Shen, Y., Li, H.: VSI: a visual saliency induced index for perceptual image quality assessment. IEEE Trans. Image Process. 23(10), 4270–4281 (2014)MathSciNetCrossRef Zhang, L., Shen, Y., Li, H.: VSI: a visual saliency induced index for perceptual image quality assessment. IEEE Trans. Image Process. 23(10), 4270–4281 (2014)MathSciNetCrossRef
26.
go back to reference Gu, K., Li, L., Lu, H., Min, X., Lin, W.: A fast reliable image quality predictor by fusing micro- and macro-structures. IEEE Trans. Ind. Electron. 64(5), 3903–3912 (2017)CrossRef Gu, K., Li, L., Lu, H., Min, X., Lin, W.: A fast reliable image quality predictor by fusing micro- and macro-structures. IEEE Trans. Ind. Electron. 64(5), 3903–3912 (2017)CrossRef
27.
go back to reference Min, X., Zhai, G., Gu, K., Yang, X., Guan, X.: Objective quality evaluation of dehazed images. IEEE Trans. Intell. Transp. Syst. 20, 1–14 (2018) Min, X., Zhai, G., Gu, K., Yang, X., Guan, X.: Objective quality evaluation of dehazed images. IEEE Trans. Intell. Transp. Syst. 20, 1–14 (2018)
28.
go back to reference Li, Q., Wang, Z.: Reduced-reference image quality assessment using divisive normalization-based image representation. IEEE J. Sel. Top. Signal Process. 3(2), 202–211 (2009)CrossRef Li, Q., Wang, Z.: Reduced-reference image quality assessment using divisive normalization-based image representation. IEEE J. Sel. Top. Signal Process. 3(2), 202–211 (2009)CrossRef
29.
go back to reference Wu, J., Lin, W., Shi, G., Liu, A.: Reduced-reference image quality assessment with visual information fidelity. IEEE Trans. Multimed. 15(7), 1700–1705 (2013)CrossRef Wu, J., Lin, W., Shi, G., Liu, A.: Reduced-reference image quality assessment with visual information fidelity. IEEE Trans. Multimed. 15(7), 1700–1705 (2013)CrossRef
30.
go back to reference Wang, Z., Simoncelli, E.P.: Reduced-reference image quality assessment using a wavelet-domain natural image statistic model. In: Proceedings of the SPIE Human Vision and Electronic Imaging X, vol. 5666, pp. 149–159 (2005) Wang, Z., Simoncelli, E.P.: Reduced-reference image quality assessment using a wavelet-domain natural image statistic model. In: Proceedings of the SPIE Human Vision and Electronic Imaging X, vol. 5666, pp. 149–159 (2005)
31.
go back to reference Narwaria, M., Lin, W., McLoughlin, I.V., Emmanuel, S., Chia, L.: Fourier transform-based scalable image quality measure. IEEE Trans. Image Process. 21(8), 3364–3377 (2012)MathSciNetCrossRef Narwaria, M., Lin, W., McLoughlin, I.V., Emmanuel, S., Chia, L.: Fourier transform-based scalable image quality measure. IEEE Trans. Image Process. 21(8), 3364–3377 (2012)MathSciNetCrossRef
32.
go back to reference Gu, K., Zhai, G., Yang, X., Zhang, W.: A new reduced-reference image quality assessment using structural degradation model. In: 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013), pp. 1095–1098, May 2013 Gu, K., Zhai, G., Yang, X., Zhang, W.: A new reduced-reference image quality assessment using structural degradation model. In: 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013), pp. 1095–1098, May 2013
33.
go back to reference Min, X., Zhai, G., Gu, K., Liu, Y., Yang, X.: Blind image quality estimation via distortion aggravation. IEEE Trans. Broadcast. 64(2), 508–517 (2018)CrossRef Min, X., Zhai, G., Gu, K., Liu, Y., Yang, X.: Blind image quality estimation via distortion aggravation. IEEE Trans. Broadcast. 64(2), 508–517 (2018)CrossRef
34.
go back to reference Min, X., Gu, K., Zhai, G., Liu, J., Yang, X., Chen, C.W.: Blind quality assessment based on pseudo-reference image. IEEE Trans. Multimed. 20(8), 2049–2062 (2018)CrossRef Min, X., Gu, K., Zhai, G., Liu, J., Yang, X., Chen, C.W.: Blind quality assessment based on pseudo-reference image. IEEE Trans. Multimed. 20(8), 2049–2062 (2018)CrossRef
35.
go back to reference Xia, Z., Gu, K., Wang, S., Liu, H., Kwong, S.T.W.: Towards accurate quality estimation of screen content pictures with very sparse reference information. IEEE Trans. Ind. Electron. 67(3), 2251–2261 (2019)CrossRef Xia, Z., Gu, K., Wang, S., Liu, H., Kwong, S.T.W.: Towards accurate quality estimation of screen content pictures with very sparse reference information. IEEE Trans. Ind. Electron. 67(3), 2251–2261 (2019)CrossRef
Metadata
Title
Screen Content Picture Quality Evaluation by Colorful Sparse Reference Information
Authors
Huiqing Zhang
Donghao Li
Shuo Li
Zhifang Xia
Lijuan Tang
Copyright Year
2020
Publisher
Springer Singapore
DOI
https://doi.org/10.1007/978-981-15-3341-9_24