Skip to main content
Erschienen in: Multimedia Systems 3/2019

14.01.2019 | Regular Paper

A depth perception evaluation metric for immersive user experience towards 3D multimedia services

verfasst von: Huseyin Bayrak, Gokce Nur Yilmaz

Erschienen in: Multimedia Systems | Ausgabe 3/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The interest of users towards three-dimensional (3D) video is gaining momentum due to the recent breakthroughs in 3D video entertainment, education, network, etc. technologies. In order to speed up the advancement of these technologies, monitoring quality of experience of the 3D video, which focuses on end user’s point of view rather than service-oriented provisions, becomes a central concept among the researchers. Thanks to the stereoscopic viewing ability of human visual system (HVS), the depth perception evaluation of the 3D video can be considered as one of the most critical parts of this central concept. Due to the lack of efficiently and widely utilized objective metrics in literature, the depth perception assessment can currently only be ensured by cost and time-wise troublesome subjective measurements. Therefore, a no-reference objective metric, which is highly effective especially for on the fly depth perception assessment, is developed in this paper. Three proposed algorithms (i.e., Z direction motion, structural average depth and depth deviation) significant for the HVS to perceive the depth of the 3D video are integrated together while developing the proposed metric. Considering the outcomes of the proposed metric, it can be clearly stated that the provision of better 3D video experience to the end users can be accelerated in a timely fashion for the Future Internet multimedia services.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Hewage, C.T.: Perceptual quality driven 3-D video over networks. Doctoral Dissertation, University of Surrey (2008) Hewage, C.T.: Perceptual quality driven 3-D video over networks. Doctoral Dissertation, University of Surrey (2008)
2.
Zurück zum Zitat Yilmaz, G.N., No Reference, A.: Depth perception assessment metric for 3D video. Multimedia Tools Appl. 74(17), 6937–6950 (2015)CrossRef Yilmaz, G.N., No Reference, A.: Depth perception assessment metric for 3D video. Multimedia Tools Appl. 74(17), 6937–6950 (2015)CrossRef
3.
Zurück zum Zitat Chen, Z., Zhou, W., Li, W.: Blind stereoscopic video quality assessment: from depth perception to overall experience. IEEE Trans. Image Process. 27(2), 721–734 (2018) Chen, Z., Zhou, W., Li, W.: Blind stereoscopic video quality assessment: from depth perception to overall experience. IEEE Trans. Image Process. 27(2), 721–734 (2018)
4.
Zurück zum Zitat Dumici, E., Grgic, S., Sakic, K., Rocha, P.M.R., Cruz, L.A.S.: 3D video subjective quality: a new database and grade comparison study. Multimed Tools Appl. 76, 2087–2109 (2017)CrossRef Dumici, E., Grgic, S., Sakic, K., Rocha, P.M.R., Cruz, L.A.S.: 3D video subjective quality: a new database and grade comparison study. Multimed Tools Appl. 76, 2087–2109 (2017)CrossRef
5.
Zurück zum Zitat Hewage, C.T., Worrall, S.T., Dogan, S., Villette, S., Kondoz, A.M.: Quality evaluation of color plus depth map-based stereoscopic video. IEEE J. Select. Top. Signal Process. 3(2), 304–318 (2009)CrossRef Hewage, C.T., Worrall, S.T., Dogan, S., Villette, S., Kondoz, A.M.: Quality evaluation of color plus depth map-based stereoscopic video. IEEE J. Select. Top. Signal Process. 3(2), 304–318 (2009)CrossRef
6.
Zurück zum Zitat Malekmohamadi, H., Fernando, A., Kondoz, A.: A new reduced reference metric for color plus depth 3D video. J. Vis. Commun. Image Represent. 25(3), 534–541 (2014)CrossRef Malekmohamadi, H., Fernando, A., Kondoz, A.: A new reduced reference metric for color plus depth 3D video. J. Vis. Commun. Image Represent. 25(3), 534–541 (2014)CrossRef
7.
Zurück zum Zitat Le, T.H., Jung, S.W., Won, C.S.: A new depth image quality metric using a pair of color and depth images. Multimedia Tools Appl. 76, 1–19 (2016)CrossRef Le, T.H., Jung, S.W., Won, C.S.: A new depth image quality metric using a pair of color and depth images. Multimedia Tools Appl. 76, 1–19 (2016)CrossRef
8.
Zurück zum Zitat Li, Y., Po, L.M., Cheung, C.H., Xu, X., Feng, L., Yuan, F., Cheung, K.W.: No-reference video quality assessment with 3D shearlet transform and convolutional neural networks. IEEE Trans. Circ. Syst. Video Technol. 26(6), 1044–1057 (2016)CrossRef Li, Y., Po, L.M., Cheung, C.H., Xu, X., Feng, L., Yuan, F., Cheung, K.W.: No-reference video quality assessment with 3D shearlet transform and convolutional neural networks. IEEE Trans. Circ. Syst. Video Technol. 26(6), 1044–1057 (2016)CrossRef
9.
Zurück zum Zitat Lv, Y., Yu, M., Jiang, G., Shao, F., Peng, Z., Chen, F.: No-reference stereoscopic image quality assessment using binocular self-similarity and deep neural network. Sig. Process. Image Commun. 47, 346–357 (2016)CrossRef Lv, Y., Yu, M., Jiang, G., Shao, F., Peng, Z., Chen, F.: No-reference stereoscopic image quality assessment using binocular self-similarity and deep neural network. Sig. Process. Image Commun. 47, 346–357 (2016)CrossRef
10.
Zurück zum Zitat Huynh-Thu, Q., Ghanbari, M.: Scope of validity of PSNR in image/video quality assessment. IET Electron. Lett. 44(30), 800–801 (2008)CrossRef Huynh-Thu, Q., Ghanbari, M.: Scope of validity of PSNR in image/video quality assessment. IET Electron. Lett. 44(30), 800–801 (2008)CrossRef
11.
Zurück zum Zitat Pinson, M.H., Wolf, S.: A new standardized method for objectively measuring video quality. IEEE Trans. Broadcast. 50(3), 312–322 (2004)CrossRef Pinson, M.H., Wolf, S.: A new standardized method for objectively measuring video quality. IEEE Trans. Broadcast. 50(3), 312–322 (2004)CrossRef
12.
Zurück zum Zitat Wang, Z., Lu, L., Bovik, A.C.: Video quality assessment based on structural distortion measurement. Sig. Process. Image Commun. 19(2), 121–132 (2004)CrossRef Wang, Z., Lu, L., Bovik, A.C.: Video quality assessment based on structural distortion measurement. Sig. Process. Image Commun. 19(2), 121–132 (2004)CrossRef
13.
Zurück zum Zitat Khaustova, D., Fournier, J., Le Meur, O.: An objective metric for stereoscopic 3D video quality prediction using perceptual thresholds. Motion Imaging J. 124(2), 47–55 (2015)CrossRef Khaustova, D., Fournier, J., Le Meur, O.: An objective metric for stereoscopic 3D video quality prediction using perceptual thresholds. Motion Imaging J. 124(2), 47–55 (2015)CrossRef
14.
Zurück zum Zitat Beverley, K.I., Regan, D.: Visual perception of changing size: the effect of object size. Vis. Res. 19(10), 1093–1104 (1979)CrossRef Beverley, K.I., Regan, D.: Visual perception of changing size: the effect of object size. Vis. Res. 19(10), 1093–1104 (1979)CrossRef
15.
Zurück zum Zitat Cutting, J.E., Vishton, P.M.: Perceiving layout and knowing distance: the integration, relative potency and contextual use of different information about depth. In: Rogers, S., Epstein, W. (eds.) Perception of space and motion. New York: Academic, pp. 69–117 (1995)CrossRef Cutting, J.E., Vishton, P.M.: Perceiving layout and knowing distance: the integration, relative potency and contextual use of different information about depth. In: Rogers, S., Epstein, W. (eds.) Perception of space and motion. New York: Academic, pp. 69–117 (1995)CrossRef
16.
Zurück zum Zitat JSVM 9.13.1. CVS Server [Online]. Available Telnet: http://garcon.ient.rwth aachen.de:/cvs/jvt JSVM 9.13.1. CVS Server [Online]. Available Telnet: http://​garcon.​ient.​rwth aachen.de:/cvs/jvt
17.
Zurück zum Zitat ITU-R: BT.500-11. Methodology for the subjective assessment of the quality of television pictures ITU-R: BT.500-11. Methodology for the subjective assessment of the quality of television pictures
Metadaten
Titel
A depth perception evaluation metric for immersive user experience towards 3D multimedia services
verfasst von
Huseyin Bayrak
Gokce Nur Yilmaz
Publikationsdatum
14.01.2019
Verlag
Springer Berlin Heidelberg
Erschienen in
Multimedia Systems / Ausgabe 3/2019
Print ISSN: 0942-4962
Elektronische ISSN: 1432-1882
DOI
https://doi.org/10.1007/s00530-018-00602-8

Weitere Artikel der Ausgabe 3/2019

Multimedia Systems 3/2019 Zur Ausgabe

Neuer Inhalt