Skip to main content
Erschienen in: Multimedia Systems 6/2019

28.06.2019 | Regular Paper

A novel depth perception prediction metric for advanced multimedia applications

verfasst von: Gokce Nur Yilmaz

Erschienen in: Multimedia Systems | Ausgabe 6/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Ubiquitous multimedia applications diffuse our everyday life activities which appreciate their significance about improving our experiences. Therefore, proliferation of the multimedia applications enhancing these experiences needs critical attention of the researchers. Considering this motivation, to overcome the possible barrier of the proliferation of the 3D video-related multimedia applications providing enhanced quality of experience (QoE) to the end users, an objective metric is proposed in this study. The proposed metric tackles the depth perception prediction part reflecting the most important aspect of the 3D video QoE from the user point of view. Considering that the no reference metric type is the most effective one compared to its counterparts, the proposed metric is developed based on this type. In the light of the envision that human visual system-related cues have critical importance on developing accurate metrics, the focus of the proposed metric is directed on the association of the z-direction motion and stereopsis depth cues in the metric development. These cues are derived from the depth map contents having stressed significant depth levels. In addition, the analysis results of the conducted subjective experiments which are currently the “gold standards” for the reliable depth perception prediction are incorporated with the proposed metric. Considering the effective correlation coefficient and root mean square error performance assessment results taken using the proposed metric in comparison to the widely exploited quality assessment metrics in literature, it can be clearly stated that the development of the improved 3D video multimedia applications can be accelerated using it.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Tian S., Zhang, L., Morin, L., Deforges, O.: A full-reference image quality assessment metric for 3D synthesized views. In: International Symposium on Electronic Imaging (2018) Tian S., Zhang, L., Morin, L., Deforges, O.: A full-reference image quality assessment metric for 3D synthesized views. In: International Symposium on Electronic Imaging (2018)
2.
Zurück zum Zitat Galkandage, C., Calic, J., Dogan, S., Guillemaut, J.-Y.: Stereoscopic video quality assessment using binocular energy. IEEE J. Sel. Top. Signal Process. 11, 102–112 (2017)CrossRef Galkandage, C., Calic, J., Dogan, S., Guillemaut, J.-Y.: Stereoscopic video quality assessment using binocular energy. IEEE J. Sel. Top. Signal Process. 11, 102–112 (2017)CrossRef
3.
Zurück zum Zitat Battisti, F., Bosc, E., Carli, M., Callet, P.L., Perugia, S.: Objective image quality assessment of 3D synthesized views. Signal Process. Image Commun. 30, 78–88 (2015)CrossRef Battisti, F., Bosc, E., Carli, M., Callet, P.L., Perugia, S.: Objective image quality assessment of 3D synthesized views. Signal Process. Image Commun. 30, 78–88 (2015)CrossRef
4.
Zurück zum Zitat Le Callet, P., Möller, S., Perkis, A.: Qualinet white paper on definitions of quality of experience. Lausanne, Switzerland (2012) Le Callet, P., Möller, S., Perkis, A.: Qualinet white paper on definitions of quality of experience. Lausanne, Switzerland (2012)
5.
Zurück zum Zitat Parametric Bit-stream based Quality Assessment of Progressive Download and Adaptive Audio-visual Streaming Services over Reliable Transport. ITU-T Recommendation P.1203 (2017) Parametric Bit-stream based Quality Assessment of Progressive Download and Adaptive Audio-visual Streaming Services over Reliable Transport. ITU-T Recommendation P.1203 (2017)
6.
Zurück zum Zitat Subjective Video Quality Assessment Methods for Multimedia Applications. ITU-T Recommendation P.910 (2008) Subjective Video Quality Assessment Methods for Multimedia Applications. ITU-T Recommendation P.910 (2008)
7.
Zurück zum Zitat Rouse, D.M., Pepion, R., Le Callet, P., Hemami, S.S.: Tradeoffs in subjective testing methods for image and video quality assessment. In: Proceedings of the Human Vision and Electronic Imaging XV, USA (2010) Rouse, D.M., Pepion, R., Le Callet, P., Hemami, S.S.: Tradeoffs in subjective testing methods for image and video quality assessment. In: Proceedings of the Human Vision and Electronic Imaging XV, USA (2010)
8.
Zurück zum Zitat Bayrak, H., Nur Yilmaz, G.: A depth perception evaluation metric for immersive user experience towards 3D multimedia services. Multimedia Syst 25(3), 253–261 (2019)CrossRef Bayrak, H., Nur Yilmaz, G.: A depth perception evaluation metric for immersive user experience towards 3D multimedia services. Multimedia Syst 25(3), 253–261 (2019)CrossRef
9.
Zurück zum Zitat Nur, G., Akar, G.B.: An abstraction based reduced reference depth perception metric for 3D video. In: 19th IEEE International Conference on Image Processing (2012) Nur, G., Akar, G.B.: An abstraction based reduced reference depth perception metric for 3D video. In: 19th IEEE International Conference on Image Processing (2012)
10.
Zurück zum Zitat Nur Yilmaz, G.: A depth perception evaluation metric for immersive 3D video services. In: IEEE 3DTV Conference: The True Vision-Capture, Transmission and Display of 3D Video, Copenhagen, Denmark (2017) Nur Yilmaz, G.: A depth perception evaluation metric for immersive 3D video services. In: IEEE 3DTV Conference: The True Vision-Capture, Transmission and Display of 3D Video, Copenhagen, Denmark (2017)
11.
Zurück zum Zitat Hewage, C.T.E.R., Worrall, S.T., Dogan, S., Villette, S., Kondoz, A.M.: Quality evaluation of color plus depth map based 3D video. IEEE J. Sel. Top. Signal Process. 3(2), 304–318 (2009)CrossRef Hewage, C.T.E.R., Worrall, S.T., Dogan, S., Villette, S., Kondoz, A.M.: Quality evaluation of color plus depth map based 3D video. IEEE J. Sel. Top. Signal Process. 3(2), 304–318 (2009)CrossRef
12.
Zurück zum Zitat Nur, G., Kodikara Arachchi, H., Dogan, S., Kondoz, A.M.: Advanced adaptation techniques for improved video perception. IEEE Trans. Circuit Syst. Video Technol. 22(2), 225–240 (2012)CrossRef Nur, G., Kodikara Arachchi, H., Dogan, S., Kondoz, A.M.: Advanced adaptation techniques for improved video perception. IEEE Trans. Circuit Syst. Video Technol. 22(2), 225–240 (2012)CrossRef
13.
Zurück zum Zitat Cheda, D.: Monocular depth cues in computer vision applications. Electron. Lett. Comput. Vis. Image Anal. 13(2), 65–66 (2014)CrossRef Cheda, D.: Monocular depth cues in computer vision applications. Electron. Lett. Comput. Vis. Image Anal. 13(2), 65–66 (2014)CrossRef
14.
Zurück zum Zitat Westheimer, G.: Clinical evaluation of stereopsis. Vis. Res. 90, 38–40 (2013)CrossRef Westheimer, G.: Clinical evaluation of stereopsis. Vis. Res. 90, 38–40 (2013)CrossRef
15.
Zurück zum Zitat Huynh-Thu, J.Q., Ghanbari, M.: Scope of validity of PSNR in image/video quality assessment. IET Electron. Lett. 44(13), 800–801 (2008)CrossRef Huynh-Thu, J.Q., Ghanbari, M.: Scope of validity of PSNR in image/video quality assessment. IET Electron. Lett. 44(13), 800–801 (2008)CrossRef
16.
Zurück zum Zitat Wang, Z., Lu, L., Bovik, A.C.: Video quality assessment based on structural distortion measurement. Proc. Signal Process. Image Commu. 19(2), 121–132 (2004)CrossRef Wang, Z., Lu, L., Bovik, A.C.: Video quality assessment based on structural distortion measurement. Proc. Signal Process. Image Commu. 19(2), 121–132 (2004)CrossRef
17.
Zurück zum Zitat Pinson, M.H., Wolf, S.: A new standardized method for objectively measuring video quality. IEEE Trans. Broadcast. 50(3), 312–322 (2004)CrossRef Pinson, M.H., Wolf, S.: A new standardized method for objectively measuring video quality. IEEE Trans. Broadcast. 50(3), 312–322 (2004)CrossRef
18.
Zurück zum Zitat Hekstraa, A.P., Beerendsa, J.G., Ledermannb, D., de Caluwec, F.E., Kohlerb, S., Koenend, R.H., Rihsb, S., Ehrsame, M., Schlaussb, D.: PVQM-A perceptual video quality measure. Signal Process. Image Commun. 17, 781–798 (2002)CrossRef Hekstraa, A.P., Beerendsa, J.G., Ledermannb, D., de Caluwec, F.E., Kohlerb, S., Koenend, R.H., Rihsb, S., Ehrsame, M., Schlaussb, D.: PVQM-A perceptual video quality measure. Signal Process. Image Commun. 17, 781–798 (2002)CrossRef
19.
Zurück zum Zitat Joveluro, P., Malekmohamadi, H., Fernando, W.A.C., Kondoz, A.M.: Perceptual video quality metric for 3D video quality assessment. In: 3DTV-Conference: The True Vision-Capture, Transmission and Display of 3D Video (2010) Joveluro, P., Malekmohamadi, H., Fernando, W.A.C., Kondoz, A.M.: Perceptual video quality metric for 3D video quality assessment. In: 3DTV-Conference: The True Vision-Capture, Transmission and Display of 3D Video (2010)
20.
Zurück zum Zitat De Silva, V., Nur, G., Ekmekcioglu, E., Kondoz, A.M.: QoE of 3D media delivery systems. In: Moustafa, H., Zeadally, S. (Eds.) Media Networks: Architectures, Applications, and Standards. CRC Press Taylor and Francis Group (2012) De Silva, V., Nur, G., Ekmekcioglu, E., Kondoz, A.M.: QoE of 3D media delivery systems. In: Moustafa, H., Zeadally, S. (Eds.) Media Networks: Architectures, Applications, and Standards. CRC Press Taylor and Francis Group (2012)
21.
Zurück zum Zitat Erofeev, M., Vatolin, D., Voronov, A., Fedorov, A.: Toward an objective stereo-video quality metric depth perception of textured areas. In: International Conference on 3D Imaging (2012) Erofeev, M., Vatolin, D., Voronov, A., Fedorov, A.: Toward an objective stereo-video quality metric depth perception of textured areas. In: International Conference on 3D Imaging (2012)
22.
Zurück zum Zitat Wolf, S., Pinson, M.H.: Low bandwidth reduced reference video quality monitoring system. In: First International Workshop on Video Processing and Quality Metrics for Consumer Electronics, Scottsdale, Arizona (2005) Wolf, S., Pinson, M.H.: Low bandwidth reduced reference video quality monitoring system. In: First International Workshop on Video Processing and Quality Metrics for Consumer Electronics, Scottsdale, Arizona (2005)
23.
Zurück zum Zitat Hewage, C.T.E.R., Martini, M.G.: Reduced-reference quality evaluation for compressed depth maps associated with colour plus depth 3D video. In: 17th IEEE international conference on image processing, Hong Kong (2010) Hewage, C.T.E.R., Martini, M.G.: Reduced-reference quality evaluation for compressed depth maps associated with colour plus depth 3D video. In: 17th IEEE international conference on image processing, Hong Kong (2010)
24.
Zurück zum Zitat Martini, M.G., Villarini, B., Fiorucci, F.: A reduced-reference perceptual image and video quality metric based on edge preservation. EURASIP J. Adv. Signal Process. 1, 1–13 (2012) Martini, M.G., Villarini, B., Fiorucci, F.: A reduced-reference perceptual image and video quality metric based on edge preservation. EURASIP J. Adv. Signal Process. 1, 1–13 (2012)
25.
Zurück zum Zitat Nur, G.: Cartoon effect and ambient illumination based depth perception assessment of 3D Video. World Acad Sci Eng Technol Int J Comput Electri. Autom. Control Inf. Eng. 7(7), 890–893 (2013)MathSciNet Nur, G.: Cartoon effect and ambient illumination based depth perception assessment of 3D Video. World Acad Sci Eng Technol Int J Comput Electri. Autom. Control Inf. Eng. 7(7), 890–893 (2013)MathSciNet
26.
Zurück zum Zitat Hibbard, P.B., Haines, A.E., Hornsey, R.L.: Magnitude, precision, and realism of depth perception in stereoscopic vision. Cognit. Res. Princ. Implic. 2(1), 25 (2017)CrossRef Hibbard, P.B., Haines, A.E., Hornsey, R.L.: Magnitude, precision, and realism of depth perception in stereoscopic vision. Cognit. Res. Princ. Implic. 2(1), 25 (2017)CrossRef
27.
Zurück zum Zitat Lebreton, P., Raake, A., Barkowsky, M., Callet, P.L.: Evaluating depth perception of 3D stereoscopic videos. IEEE J. Sel. Top. Signal Process. 6, 710–720 (2012)CrossRef Lebreton, P., Raake, A., Barkowsky, M., Callet, P.L.: Evaluating depth perception of 3D stereoscopic videos. IEEE J. Sel. Top. Signal Process. 6, 710–720 (2012)CrossRef
28.
Zurück zum Zitat Kim, D., Min, D., Oh, J., Jeon, S., Sohn, K.: Depth map quality metric for three-dimensional video. In: SPIE Stereoscopic Displays and Applications, San Jose, CA, USA (2009) Kim, D., Min, D., Oh, J., Jeon, S., Sohn, K.: Depth map quality metric for three-dimensional video. In: SPIE Stereoscopic Displays and Applications, San Jose, CA, USA (2009)
29.
Zurück zum Zitat Mittal, A., Moorthy, A.K., Ghosh, J., Bovik, A.C.: Algorithm assessment of 3D quality of experience for images and videos. In: IEEE Digital Signal Processing Workshop (2011) Mittal, A., Moorthy, A.K., Ghosh, J., Bovik, A.C.: Algorithm assessment of 3D quality of experience for images and videos. In: IEEE Digital Signal Processing Workshop (2011)
30.
Zurück zum Zitat Solh, M., AlRegib, G.: A no-reference quality measure for DIBR-based 3D videos. In: IEEE International Workshop on Hot Topics in 3D, Barcelona, Spain (2011) Solh, M., AlRegib, G.: A no-reference quality measure for DIBR-based 3D videos. In: IEEE International Workshop on Hot Topics in 3D, Barcelona, Spain (2011)
31.
Zurück zum Zitat Nur Yilmaz, G.: A no reference depth perception assessment metric for 3D video. Multimedia Tools Appl. 74(17), 6937–6950 (2015)CrossRef Nur Yilmaz, G.: A no reference depth perception assessment metric for 3D video. Multimedia Tools Appl. 74(17), 6937–6950 (2015)CrossRef
32.
Zurück zum Zitat Nur Yilmaz, G.: Depth perception prediction of 3D video QoE for future internet services. In: 32nd International Conference on Information Networking. Chiang Mai, Thailand (2018) Nur Yilmaz, G.: Depth perception prediction of 3D video QoE for future internet services. In: 32nd International Conference on Information Networking. Chiang Mai, Thailand (2018)
33.
Zurück zum Zitat JSVM 9.13.1. CVS Server [Online]. Available Telnet: garcon.ient.rwth aachen.de:/cvs/jvt JSVM 9.13.1. CVS Server [Online]. Available Telnet: garcon.ient.rwth aachen.de:/cvs/jvt
34.
Zurück zum Zitat Tomasi, C., Manduchi, R.: Bilateral filtering for gray and color images. In: IEEE International Conference on Computer Vision. Bombay, India (1998) Tomasi, C., Manduchi, R.: Bilateral filtering for gray and color images. In: IEEE International Conference on Computer Vision. Bombay, India (1998)
35.
Zurück zum Zitat Xuan, G., Zhang, W., Chai, P.: EM Algorithms of Gaussian Mixture Model and Hidden Markov Model. In: International Conference on Image Processing. Thessaloniki, Greece (2001) Xuan, G., Zhang, W., Chai, P.: EM Algorithms of Gaussian Mixture Model and Hidden Markov Model. In: International Conference on Image Processing. Thessaloniki, Greece (2001)
36.
Zurück zum Zitat Do, C.B., Batzoglou, S.: What is the expectation maximization algorithm? Nat. Biotechnol. 26(8), 897–899 (2008)CrossRef Do, C.B., Batzoglou, S.: What is the expectation maximization algorithm? Nat. Biotechnol. 26(8), 897–899 (2008)CrossRef
37.
Zurück zum Zitat Methodology for the Subjective Assessment of the Quality of Television Pictures. ITU-T Recommendation BT.500 (2012) Methodology for the Subjective Assessment of the Quality of Television Pictures. ITU-T Recommendation BT.500 (2012)
Metadaten
Titel
A novel depth perception prediction metric for advanced multimedia applications
verfasst von
Gokce Nur Yilmaz
Publikationsdatum
28.06.2019
Verlag
Springer Berlin Heidelberg
Erschienen in
Multimedia Systems / Ausgabe 6/2019
Print ISSN: 0942-4962
Elektronische ISSN: 1432-1882
DOI
https://doi.org/10.1007/s00530-019-00623-x

Weitere Artikel der Ausgabe 6/2019

Multimedia Systems 6/2019 Zur Ausgabe

Neuer Inhalt