Skip to main content

2013 | OriginalPaper | Buchkapitel

15. Visual Quality Assessment of Synthesized Views in the Context of 3D-TV

verfasst von : Emilie Bosc, Patrick Le Callet, Luce Morin, Muriel Pressigout

Erschienen in: 3D-TV System with Depth-Image-Based Rendering

Verlag: Springer New York

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Depth-image-based rendering (DIBR) is fundamental to 3D-TV applications because the generation of new viewpoints is recurrent. Like any tool, DIBR methods are subject to evaluations, thanks to the assessment of the visual quality of the resulting generated views. This assessment task is peculiar because DIBR can be used for different 3D-TV applications: either in a 2D context (Free Viewpoint Television, FTV), or in a 3D context (3D displays reproducing stereoscopic vision). Depending on the context, the factors affecting the visual experience may differ. This chapter concerns the case of the use of DIBR in the 2D context. It addresses two particular cases of use: visualization of still images and visualization of video sequences, in FTV in the 2D context. Through these two cases, the main issues of DIBR are presented in terms of visual quality assessment. Two experiments are proposed as case studies addressing the problematic of this chapter: the first one concerns the assessment of still images and the second one concerns the video sequence assessment. The two experiments question the reliability of subjective and objective usual tools when assessing the visual quality of synthesized views in a 2D context.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Smolic A et al (2006) 3D video and free viewpoint video-technologies, applications and mpeg standards. In: Proceedings of the IEEE international conference on multimedia and expo (ICME’06), pp 2161–2164 Smolic A et al (2006) 3D video and free viewpoint video-technologies, applications and mpeg standards. In: Proceedings of the IEEE international conference on multimedia and expo (ICME’06), pp 2161–2164
2.
Zurück zum Zitat Fehn C (2004) Depth-image-based rendering (DIBR), compression and transmission for a new approach on 3D-TV. In: Proceedings of SPIE stereoscopic displays and virtual reality systems XI, vol 5291, pp 93–104 Fehn C (2004) Depth-image-based rendering (DIBR), compression and transmission for a new approach on 3D-TV. In: Proceedings of SPIE stereoscopic displays and virtual reality systems XI, vol 5291, pp 93–104
3.
Zurück zum Zitat Bosc E et al (2011) Towards a new quality metric for 3-D synthesized view assessment. IEEE J Sel Top in Sign Proces 5(7):1332–1343 CrossRef Bosc E et al (2011) Towards a new quality metric for 3-D synthesized view assessment. IEEE J Sel Top in Sign Proces 5(7):1332–1343 CrossRef
4.
Zurück zum Zitat De Silva DVS et al (2010) Intra mode selection method for depth maps of 3D video based on rendering distortion modeling. IEEE Trans Consum Electron 56(4):2735–2740CrossRef De Silva DVS et al (2010) Intra mode selection method for depth maps of 3D video based on rendering distortion modeling. IEEE Trans Consum Electron 56(4):2735–2740CrossRef
5.
Zurück zum Zitat Köppel M et al (2010) Temporally consistent handling of disocclusions with texture synthesis for depth-image-based rendering. In: Proceedings of IEEE international conference on image processing (ICIP), Hong Kong, China Köppel M et al (2010) Temporally consistent handling of disocclusions with texture synthesis for depth-image-based rendering. In: Proceedings of IEEE international conference on image processing (ICIP), Hong Kong, China
6.
Zurück zum Zitat Meesters M et al (2004) A survey of perceptual evaluations and requirements of three dimensional TV. IEEE Trans Circuits Syst Video Technol 14(3):381–391CrossRef Meesters M et al (2004) A survey of perceptual evaluations and requirements of three dimensional TV. IEEE Trans Circuits Syst Video Technol 14(3):381–391CrossRef
8.
Zurück zum Zitat Yuen M et al (1998) A survey of hybrid MC/DPCM/DCT video coding distortions. Sign Process 70(3):247–278MATHCrossRef Yuen M et al (1998) A survey of hybrid MC/DPCM/DCT video coding distortions. Sign Process 70(3):247–278MATHCrossRef
9.
Zurück zum Zitat Yasakethu SLP et al (2008) Quality analysis for 3D video using 2D video quality models. IEEE Trans Consum Electron 54(4):1969–1976CrossRef Yasakethu SLP et al (2008) Quality analysis for 3D video using 2D video quality models. IEEE Trans Consum Electron 54(4):1969–1976CrossRef
10.
Zurück zum Zitat Tikanmaki A et al (2008) Quality assessment of 3D video in rate allocation experiments. In: IEEE international symposium on consumer electronics, 14–16 April, Algarve, Portugal Tikanmaki A et al (2008) Quality assessment of 3D video in rate allocation experiments. In: IEEE international symposium on consumer electronics, 14–16 April, Algarve, Portugal
11.
Zurück zum Zitat Hewage CTER et al (2009) Quality evaluation of color plus depth map-based stereoscopic video. IEEE J Sel Top Sign Proces 3(2):304–318CrossRef Hewage CTER et al (2009) Quality evaluation of color plus depth map-based stereoscopic video. IEEE J Sel Top Sign Proces 3(2):304–318CrossRef
12.
Zurück zum Zitat You J et al (2010) Perceptual quality assessment for stereoscopic images based on 2D image quality metrics and disparity analysis. In: Proceedings of international workshop video processing and quality metrics, Scottsdale, Arizona, USA You J et al (2010) Perceptual quality assessment for stereoscopic images based on 2D image quality metrics and disparity analysis. In: Proceedings of international workshop video processing and quality metrics, Scottsdale, Arizona, USA
13.
Zurück zum Zitat Fehn C (2004) Depth-image-based rendering (DIBR), compression and transmission for a new approach on 3D-TV. In: Proceedings of SPIE conference on stereoscopic displays and virtual reality systems X, San Jose, USA Fehn C (2004) Depth-image-based rendering (DIBR), compression and transmission for a new approach on 3D-TV. In: Proceedings of SPIE conference on stereoscopic displays and virtual reality systems X, San Jose, USA
14.
Zurück zum Zitat Telea A (2004) An image inpainting technique based on the fast marching method. J Graph GPU Game Tools 9(1):23–34 Telea A (2004) An image inpainting technique based on the fast marching method. J Graph GPU Game Tools 9(1):23–34
15.
Zurück zum Zitat Tanimoto M et al (2008) Reference softwares for depth estimation and view synthesis. In: Presented at the ISO/IEC JTC1/SC29/WG11 MPEG 2008/M15377 Tanimoto M et al (2008) Reference softwares for depth estimation and view synthesis. In: Presented at the ISO/IEC JTC1/SC29/WG11 MPEG 2008/M15377
16.
Zurück zum Zitat Müller K et al (2008) View synthesis for advanced 3D video systems. EURASIP Journal on Image and Video Processing, vol 2008 Müller K et al (2008) View synthesis for advanced 3D video systems. EURASIP Journal on Image and Video Processing, vol 2008
17.
Zurück zum Zitat Ndjiki-Nya P et al (2010) Depth image based rendering with advanced texture synthesis. In: Proceedings of IEEE international conference on multimedia and expo (ICME), Singapore Ndjiki-Nya P et al (2010) Depth image based rendering with advanced texture synthesis. In: Proceedings of IEEE international conference on multimedia and expo (ICME), Singapore
18.
Zurück zum Zitat ITU-R BT (1993) 500, Methodology for the subjective assessment of the quality of television pictures, November 1993 ITU-R BT (1993) 500, Methodology for the subjective assessment of the quality of television pictures, November 1993
20.
Zurück zum Zitat ITU-T (2008) Subjective video quality assessment methods for multimedia applications. Geneva, Recommendation P 910, 2008 ITU-T (2008) Subjective video quality assessment methods for multimedia applications. Geneva, Recommendation P 910, 2008
21.
Zurück zum Zitat Barkowsky M (2009) Subjective and objective video quality measurement in low-bitrate multimedia scenarios. ISBN: 978-3-86853-142-8, Verlag Dr. Hut, 2009 Barkowsky M (2009) Subjective and objective video quality measurement in low-bitrate multimedia scenarios. ISBN: 978-3-86853-142-8, Verlag Dr. Hut, 2009
22.
Zurück zum Zitat Brotherton MD et al (2006) Subjective multimedia quality assessment. IEICE Trans Fundam Electron Commun Comp Sci ES E SERIES A 89(11):2920CrossRef Brotherton MD et al (2006) Subjective multimedia quality assessment. IEICE Trans Fundam Electron Commun Comp Sci ES E SERIES A 89(11):2920CrossRef
23.
Zurück zum Zitat Rouse DM et al (2010) Tradeoffs in subjective testing methods for image and video quality assessment. Human Vision and Electronic Imaging XV, vol 7527, p 75270F Rouse DM et al (2010) Tradeoffs in subjective testing methods for image and video quality assessment. Human Vision and Electronic Imaging XV, vol 7527, p 75270F
24.
Zurück zum Zitat Huynh-Thu Q et al (2011) Study of rating scales for subjective quality assessment of high-definition video. IEEE Trans Broadcast, pp 1–14, Mar 2011 Huynh-Thu Q et al (2011) Study of rating scales for subjective quality assessment of high-definition video. IEEE Trans Broadcast, pp 1–14, Mar 2011
25.
Zurück zum Zitat Handley JC (2001) Comparative analysis of Bradley-Terry and Thurstone-Mosteller paired comparison models for image quality assessment. In: IS and TS PICS conference, pp 108–112 Handley JC (2001) Comparative analysis of Bradley-Terry and Thurstone-Mosteller paired comparison models for image quality assessment. In: IS and TS PICS conference, pp 108–112
26.
Zurück zum Zitat Pinson M et al (2003) Comparing subjective video quality testing methodologies. In: SPIE video communications and image processing conference, Lugano, Switzerland Pinson M et al (2003) Comparing subjective video quality testing methodologies. In: SPIE video communications and image processing conference, Lugano, Switzerland
27.
Zurück zum Zitat Péchard S (2008) Qualité d’usage en télévision haute définition: évaluations subjectives et métriques objectives Péchard S (2008) Qualité d’usage en télévision haute définition: évaluations subjectives et métriques objectives
28.
Zurück zum Zitat Bosc E et al (2010) Focus on visual rendering quality through content-based depth map coding. In: Proceedings of picture coding symposium (PCS), Nagoya, Japan Bosc E et al (2010) Focus on visual rendering quality through content-based depth map coding. In: Proceedings of picture coding symposium (PCS), Nagoya, Japan
29.
Zurück zum Zitat Ebrahimi T et al (2004) JPEG vs. JPEG2000: an objective comparison of image encoding quality. In: Proceedings of SPIE, 2004, vol 5558, pp 300–308 Ebrahimi T et al (2004) JPEG vs. JPEG2000: an objective comparison of image encoding quality. In: Proceedings of SPIE, 2004, vol 5558, pp 300–308
30.
Zurück zum Zitat Wang Z et al (2002) A universal image quality index. IEEE Sign Process Lett 9(3):81–84CrossRef Wang Z et al (2002) A universal image quality index. IEEE Sign Process Lett 9(3):81–84CrossRef
31.
Zurück zum Zitat Sheikh HR et al (2005) An information fidelity criterion for image quality assessment using natural scene statistics. IEEE Trans Image Process 14(12):2117–2128CrossRef Sheikh HR et al (2005) An information fidelity criterion for image quality assessment using natural scene statistics. IEEE Trans Image Process 14(12):2117–2128CrossRef
32.
Zurück zum Zitat Pinson MH et al (2004) A new standardized method for objectively measuring video quality. IEEE Trans Broadcast 50(3):312–322CrossRef Pinson MH et al (2004) A new standardized method for objectively measuring video quality. IEEE Trans Broadcast 50(3):312–322CrossRef
33.
Zurück zum Zitat Wang Y (2006) Survey of objective video quality measurements. EMC Corporation Hopkinton, MA, vol 1748 Wang Y (2006) Survey of objective video quality measurements. EMC Corporation Hopkinton, MA, vol 1748
34.
Zurück zum Zitat Hekstra AP et al (2002) PVQM-A perceptual video quality measure. Sign Process Image Commun 17(10):781–798CrossRef Hekstra AP et al (2002) PVQM-A perceptual video quality measure. Sign Process Image Commun 17(10):781–798CrossRef
35.
Zurück zum Zitat Wang Z et al (2004) Image quality assessment: From error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612CrossRef Wang Z et al (2004) Image quality assessment: From error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612CrossRef
36.
Zurück zum Zitat Wang Z et al (2004) Video quality assessment based on structural distortion measurement. Sign Process Image Commun 19(2):121–132CrossRef Wang Z et al (2004) Video quality assessment based on structural distortion measurement. Sign Process Image Commun 19(2):121–132CrossRef
37.
Zurück zum Zitat Seshadrinathan K et al (2010) Motion tuned spatio-temporal quality assessment of natural videos. IEEE Trans Image Process 19(2):335–350MathSciNetCrossRef Seshadrinathan K et al (2010) Motion tuned spatio-temporal quality assessment of natural videos. IEEE Trans Image Process 19(2):335–350MathSciNetCrossRef
38.
Zurück zum Zitat Boev A et al (2009) Modelling of the stereoscopic HVS Boev A et al (2009) Modelling of the stereoscopic HVS
39.
Zurück zum Zitat Yang J et al (1994) Spatiotemporal separability in contrast sensitivity. Vision Res 34(19):2569–2576CrossRef Yang J et al (1994) Spatiotemporal separability in contrast sensitivity. Vision Res 34(19):2569–2576CrossRef
40.
Zurück zum Zitat Winkler S (2005) Digital video quality: vision models and metrics. Wiley Winkler S (2005) Digital video quality: vision models and metrics. Wiley
41.
Zurück zum Zitat Egiazarian K et al (2006) New full-reference quality metrics based on HVS. In: CD-ROM proceedings of the second international workshop on video processing and quality metrics, Scottsdale, USA Egiazarian K et al (2006) New full-reference quality metrics based on HVS. In: CD-ROM proceedings of the second international workshop on video processing and quality metrics, Scottsdale, USA
42.
Zurück zum Zitat Ponomarenko N et al (2007) On between-coefficient contrast masking of DCT basis functions. In: CD-ROM proceedings of the third international workshop on video processing and quality metrics, vol 4 Ponomarenko N et al (2007) On between-coefficient contrast masking of DCT basis functions. In: CD-ROM proceedings of the third international workshop on video processing and quality metrics, vol 4
43.
Zurück zum Zitat Chandler DM et al (2007) VSNR: a wavelet-based visual signal-to-noise ratio for natural images. IEEE Trans Image Process 16(9):2284–2298MathSciNetCrossRef Chandler DM et al (2007) VSNR: a wavelet-based visual signal-to-noise ratio for natural images. IEEE Trans Image Process 16(9):2284–2298MathSciNetCrossRef
44.
Zurück zum Zitat Damera-Venkata N et al (2002) Image quality assessment based on a degradation model. IEEE Trans Image Process 9(4):636–650CrossRef Damera-Venkata N et al (2002) Image quality assessment based on a degradation model. IEEE Trans Image Process 9(4):636–650CrossRef
45.
Zurück zum Zitat Sheikh HR et al (2006) Image information and visual quality. IEEE Trans Image Process 15(2):430–444CrossRef Sheikh HR et al (2006) Image information and visual quality. IEEE Trans Image Process 15(2):430–444CrossRef
46.
Zurück zum Zitat Van C et al (1996) Perceptual quality measure using a spatio-temporal model of the human visual system Van C et al (1996) Perceptual quality measure using a spatio-temporal model of the human visual system
48.
Zurück zum Zitat VQEG 3DTV Group (2010) VQEG 3DTV test plan for crosstalk influences on user quality of experience, 21 Oct 2010 VQEG 3DTV Group (2010) VQEG 3DTV test plan for crosstalk influences on user quality of experience, 21 Oct 2010
49.
Zurück zum Zitat Engelke U et al (2011) Towards a framework of inter-observer analysis in multimedia quality assessment Engelke U et al (2011) Towards a framework of inter-observer analysis in multimedia quality assessment
50.
51.
Zurück zum Zitat Seuntiens P (2006) Visual experience of 3D TV. Doctoral thesis, Eindhoven University of Technology Seuntiens P (2006) Visual experience of 3D TV. Doctoral thesis, Eindhoven University of Technology
52.
Zurück zum Zitat ITU (2000) Subjective assessment of stereoscopic television pictures. In: Recommandation ITU-R BT, p 1438 ITU (2000) Subjective assessment of stereoscopic television pictures. In: Recommandation ITU-R BT, p 1438
53.
Zurück zum Zitat Chen W et al (2010) New requirements of subjective video quality assessment methodologies for 3DTV. In: Fifth international workshop on video processing and quality metrics for consumer electronics—VPQM 2010, Scottsdale, Arizona, USA Chen W et al (2010) New requirements of subjective video quality assessment methodologies for 3DTV. In: Fifth international workshop on video processing and quality metrics for consumer electronics—VPQM 2010, Scottsdale, Arizona, USA
54.
Zurück zum Zitat Joveluro P et al (2010) Perceptual video quality metric for 3D video quality assessment. In: 3DTV-conference: the true vision-capture, transmission and display of 3D video (3DTV-CON), pp 1–4 Joveluro P et al (2010) Perceptual video quality metric for 3D video quality assessment. In: 3DTV-conference: the true vision-capture, transmission and display of 3D video (3DTV-CON), pp 1–4
55.
Zurück zum Zitat Zhao Y et al (2010) A perceptual metric for evaluating quality of synthesized sequences in 3DV system. In: Proceedings of SPIE, vol 7744, p 77440X Zhao Y et al (2010) A perceptual metric for evaluating quality of synthesized sequences in 3DV system. In: Proceedings of SPIE, vol 7744, p 77440X
56.
Zurück zum Zitat Ekmekcioglu E et al (2010) Depth based perceptual quality assessment for synthesized camera viewpoints. In: Proceedings of second international conference on user centric media, UCMedia 2010, Palma de Mallorca Ekmekcioglu E et al (2010) Depth based perceptual quality assessment for synthesized camera viewpoints. In: Proceedings of second international conference on user centric media, UCMedia 2010, Palma de Mallorca
57.
Zurück zum Zitat Yasakethu SLP et al (2011) A compound depth and image quality metric for measuring the effects of packet loss on 3D video. In: Proceedings of 17th international conference on digital signal processing, Corfu, Greece Yasakethu SLP et al (2011) A compound depth and image quality metric for measuring the effects of packet loss on 3D video. In: Proceedings of 17th international conference on digital signal processing, Corfu, Greece
58.
Zurück zum Zitat Solh M et al (2011) 3VQM: a vision-based quality measure for DIBR-based 3D videos. In: IEEE international conference on multimedia and expo (ICME) 2011, pp 1–6 Solh M et al (2011) 3VQM: a vision-based quality measure for DIBR-based 3D videos. In: IEEE international conference on multimedia and expo (ICME) 2011, pp 1–6
Metadaten
Titel
Visual Quality Assessment of Synthesized Views in the Context of 3D-TV
verfasst von
Emilie Bosc
Patrick Le Callet
Luce Morin
Muriel Pressigout
Copyright-Jahr
2013
Verlag
Springer New York
DOI
https://doi.org/10.1007/978-1-4419-9964-1_15

Neuer Inhalt