Skip to main content
Top

2018 | OriginalPaper | Chapter

On the Impact of Environmental Sound on Perceived Visual Quality

Authors : Wenhan Zhu, Guangtao Zhai, Wei Sun, Yi Xu, Jing Liu, Yucheng Zhu, Xiaokang Yang

Published in: Advances in Multimedia Information Processing – PCM 2017

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Most of existing visual quality assessment databases are created in controlled conditions where the experimental environments are always kept silent. However, the practical viewing environments often contain diverse environmental sounds. It is our daily experience that different sounds (e.g. chatter, honk and music) can affect our emotions, hence influencing our perceptions of images. So, there is a gap between visual quality under environmental sounds and existing researches of visual quality. Therefore, in this paper, we perform subjective quality evaluations with different types and volumes of environmental sounds. We build a rigorous experimental system to control various conditions of environmental sounds and construct the environmental sound–image database. Afterwards, the influence of environmental sounds on perceived visual quality are analysed from four perspectives: sound categories, sound volumes, distortion levels of images, and image contents.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Zhai, G., Wu, X., Yang, X., Lin, W., Zhang, W.: A psychovisual quality metric in free-energy principle. IEEE Trans. Image Process. 21(1), 41–52 (2012)MathSciNetCrossRef Zhai, G., Wu, X., Yang, X., Lin, W., Zhang, W.: A psychovisual quality metric in free-energy principle. IEEE Trans. Image Process. 21(1), 41–52 (2012)MathSciNetCrossRef
2.
go back to reference Zhai, G., Cai, J., Lin, W., Yang, X., Zhang, W.: Three dimensional scalable video adaptation via user-end perceptual quality assessment. IEEE Trans. Broadcast. 54(3), 719–727 (2008)CrossRef Zhai, G., Cai, J., Lin, W., Yang, X., Zhang, W.: Three dimensional scalable video adaptation via user-end perceptual quality assessment. IEEE Trans. Broadcast. 54(3), 719–727 (2008)CrossRef
4.
go back to reference Gu, K., Zhai, G., Yang, X., Zhang, W.: Using free energy principle for blind image quality assessment. IEEE Trans. Multimed. 17(1), 50–63 (2015)CrossRef Gu, K., Zhai, G., Yang, X., Zhang, W.: Using free energy principle for blind image quality assessment. IEEE Trans. Multimed. 17(1), 50–63 (2015)CrossRef
6.
go back to reference Xu, Q., Huang, Q., Jiang, T., Yan, B., Lin, W., Yao, Y.: HodgeRank on random graphs for subjective video quality assessment. IEEE Trans. Multimed. 14(3), 844–857 (2012)CrossRef Xu, Q., Huang, Q., Jiang, T., Yan, B., Lin, W., Yao, Y.: HodgeRank on random graphs for subjective video quality assessment. IEEE Trans. Multimed. 14(3), 844–857 (2012)CrossRef
7.
go back to reference Zeng, Z., Pantic, M., Roisman, G.I., Huang, T.S.: A survey of affect recognition methods: audio, visual, and spontaneous expressions. IEEE Trans. Pattern Anal. Mach. Intell. 31(1), 39–58 (2009)CrossRef Zeng, Z., Pantic, M., Roisman, G.I., Huang, T.S.: A survey of affect recognition methods: audio, visual, and spontaneous expressions. IEEE Trans. Pattern Anal. Mach. Intell. 31(1), 39–58 (2009)CrossRef
8.
go back to reference Perrott, D.R., Saberi, K., Brown, K., Strybel, T.Z.: Auditory psychomotor coordination and visual search performance. Attent. Percept. Psychophys. 48(3), 214–226 (1990)CrossRef Perrott, D.R., Saberi, K., Brown, K., Strybel, T.Z.: Auditory psychomotor coordination and visual search performance. Attent. Percept. Psychophys. 48(3), 214–226 (1990)CrossRef
9.
go back to reference Min, X., Zhai, G., Gu, K., Yang, X.: Fixation prediction through multimodal analysis. ACM Trans. Multimed. Comput. Commun. Appl. 13(1), 6:1–6:23 (2016)CrossRef Min, X., Zhai, G., Gu, K., Yang, X.: Fixation prediction through multimodal analysis. ACM Trans. Multimed. Comput. Commun. Appl. 13(1), 6:1–6:23 (2016)CrossRef
10.
go back to reference Min, X., Zhai, G., Gao, Z., Hu, C., Yang, X.: Sound influences visual attention discriminately in videos. In: Sixth International Workshop on Quality of Multimedia Experience, pp. 153–158. IEEE (2014) Min, X., Zhai, G., Gao, Z., Hu, C., Yang, X.: Sound influences visual attention discriminately in videos. In: Sixth International Workshop on Quality of Multimedia Experience, pp. 153–158. IEEE (2014)
11.
go back to reference Min, X., Zhai, G., Hu, C., Gu, K.: Fixation prediction through multimodal analysis. In: Visual Communications and Image Processing (VCIP), pp. 1–4. IEEE (2015) Min, X., Zhai, G., Hu, C., Gu, K.: Fixation prediction through multimodal analysis. In: Visual Communications and Image Processing (VCIP), pp. 1–4. IEEE (2015)
12.
go back to reference You, J., Reiter, U., Hannuksela, M.M., Gabbouj, M., Perkis, A.: Perceptual-based quality assessment for audio-visual services: a survey. Signal Process. Image Commun. 25(7), 482–501 (2010)CrossRef You, J., Reiter, U., Hannuksela, M.M., Gabbouj, M., Perkis, A.: Perceptual-based quality assessment for audio-visual services: a survey. Signal Process. Image Commun. 25(7), 482–501 (2010)CrossRef
13.
go back to reference Xu, Q., Xiong, J., Huang, Q., Yao, Y.: Online HodgeRank on random graphs for crowdsourceable QoE evaluation. IEEE Trans. Multimed. 16(2), 373–386 (2014)CrossRef Xu, Q., Xiong, J., Huang, Q., Yao, Y.: Online HodgeRank on random graphs for crowdsourceable QoE evaluation. IEEE Trans. Multimed. 16(2), 373–386 (2014)CrossRef
14.
go back to reference Xu, Q., Wu, Z., Su, L., Qin, L., Jiang, S., Huang, Q.: Bridging the gap between objective score and subjective preference in video quality assessment. In: IEEE International Conference on Multimedia and Expo, pp. 908–913. IEEE (2010) Xu, Q., Wu, Z., Su, L., Qin, L., Jiang, S., Huang, Q.: Bridging the gap between objective score and subjective preference in video quality assessment. In: IEEE International Conference on Multimedia and Expo, pp. 908–913. IEEE (2010)
15.
go back to reference Colomes, C., Lever, M., Rault, J.B., Dehery, Y.F., Faucon, G.: A perceptual model applied to audio bit-rate reduction. J. Audio Eng. Soc. 43, 233–240 (1995) Colomes, C., Lever, M., Rault, J.B., Dehery, Y.F., Faucon, G.: A perceptual model applied to audio bit-rate reduction. J. Audio Eng. Soc. 43, 233–240 (1995)
16.
go back to reference Sporer, T.: Objective audio signal evaluation-applied psychoacoustics for modeling the perceived quality of digital audio (1997) Sporer, T.: Objective audio signal evaluation-applied psychoacoustics for modeling the perceived quality of digital audio (1997)
17.
go back to reference Vanam, R., Creusere, C.D.: Scalable perceptual metric for evaluating audio quality. In: Signals, Systems and Computers, pp. 319–323 (2005) Vanam, R., Creusere, C.D.: Scalable perceptual metric for evaluating audio quality. In: Signals, Systems and Computers, pp. 319–323 (2005)
19.
go back to reference Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)CrossRef Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)CrossRef
20.
go back to reference Soundararajan, R., Bovik, A.C.: Video quality assessment by reduced reference spatio-temporal entropic differencing. IEEE Trans. Circuits Syst. Video Technol. 23(4), 684–694 (2013)CrossRef Soundararajan, R., Bovik, A.C.: Video quality assessment by reduced reference spatio-temporal entropic differencing. IEEE Trans. Circuits Syst. Video Technol. 23(4), 684–694 (2013)CrossRef
21.
go back to reference Yang, F., Wan, S., Chang, Y., Wu, H.R.: A novel objective no-reference metric for digital video quality assessment. IEEE Signal Process. Lett. 12(10), 685–688 (2005)CrossRef Yang, F., Wan, S., Chang, Y., Wu, H.R.: A novel objective no-reference metric for digital video quality assessment. IEEE Signal Process. Lett. 12(10), 685–688 (2005)CrossRef
22.
go back to reference Winkler, S.: Video quality and beyond. In: European Conference on Signal Processing, pp. 150–153 (2007) Winkler, S.: Video quality and beyond. In: European Conference on Signal Processing, pp. 150–153 (2007)
23.
go back to reference Beerends, J.G., Caluwe, F.E.D.: The influence of video quality on perceived audio quality and vice versa. J. Audio Eng. Soc. 47(5), 355–362 (1999) Beerends, J.G., Caluwe, F.E.D.: The influence of video quality on perceived audio quality and vice versa. J. Audio Eng. Soc. 47(5), 355–362 (1999)
24.
go back to reference Hands, D.S.: A basic multimedia quality model. IEEE Trans. Multimed. 6(6), 806–816 (2004)CrossRef Hands, D.S.: A basic multimedia quality model. IEEE Trans. Multimed. 6(6), 806–816 (2004)CrossRef
25.
go back to reference Frater, M.R., Arnold, J.F., Vahedian, A.: Impact of audio on subjective assessment of video quality in videoconferencing applications. IEEE Trans. Circuits Syst. Video Technol. 11(9), 1059–1062 (2001)CrossRef Frater, M.R., Arnold, J.F., Vahedian, A.: Impact of audio on subjective assessment of video quality in videoconferencing applications. IEEE Trans. Circuits Syst. Video Technol. 11(9), 1059–1062 (2001)CrossRef
26.
go back to reference Blakowski, G., Steinmetz, R.: A media synchronization survey: reference model, specification, and case studies. IEEE J. Sel. Areas Commun. 14(1), 5–35 (1996)CrossRef Blakowski, G., Steinmetz, R.: A media synchronization survey: reference model, specification, and case studies. IEEE J. Sel. Areas Commun. 14(1), 5–35 (1996)CrossRef
28.
go back to reference GB 3096-2008: Environmental quality standard for noise (2008) GB 3096-2008: Environmental quality standard for noise (2008)
29.
go back to reference ITU Recommendation BT.500-13: Methodology for the subjective assessment of the quality of television pictures (2012) ITU Recommendation BT.500-13: Methodology for the subjective assessment of the quality of television pictures (2012)
30.
go back to reference Sheikh, H.R., Sabir, M.F., Bovik, A.C.: A statistical evaluation of recent full reference image quality assessment algorithms. IEEE Trans. Image Process. 15(11), 3440–3451 (2006)CrossRef Sheikh, H.R., Sabir, M.F., Bovik, A.C.: A statistical evaluation of recent full reference image quality assessment algorithms. IEEE Trans. Image Process. 15(11), 3440–3451 (2006)CrossRef
Metadata
Title
On the Impact of Environmental Sound on Perceived Visual Quality
Authors
Wenhan Zhu
Guangtao Zhai
Wei Sun
Yi Xu
Jing Liu
Yucheng Zhu
Xiaokang Yang
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-319-77383-4_71