Top

The Journal of Supercomputing

Published in:

01-09-2015

Game theory based no-reference perceptual quality assessment for stereoscopic images

Authors: Feng Jiang, K. Bharanitharan, Shovan Barma, Hailiang Wang, Debin Zhao

Published in: The Journal of Supercomputing | Issue 9/2015

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

In this paper, a no-reference perceptual quality assessment for stereoscopic image is proposed. Inspired by the binocular rivalry mechanism, the observation annoyance perception is explained as a bargain process. Game theory is exploited to model the rivalry of the left eye and right eye. The relation between annoyance perception with binocular disparity is further demonstrated and an annoyance map is calculated to simulate the observer perception. Then, with the consideration of the properties of HVS, the edge map and a saliency map are used to adjust the annoyance map. Finally, Minkowski pooling and multi-scale strategy are applied to compute the final score. We use the EPFL database to validate the proposed metric. The experimental results show that the final objective scores have a high degree of consistency with the subjective scores.

previous article Prediction of purchase behaviors across heterogeneous social networks

next article A game theory-based block image compression method in encryption domain

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Tam W, Speranza F, Yano S (2011) Stereoscopic 3D-TV: visual comfort. IEEE Trans Broadcasting 57(2):335–346CrossRef

Lambooij M, Ijsselsteijn W, Fortuin M, Heynderickx I (2009) Visual discomfort and visual fatigue of stereoscopic displays: a review. J Imaging Sci Technol 53(3) 030201:1–14. 1, 2

Howarth PA (2011) Potential hazards of viewing 3-D stereoscopic television, cinema and computer games: a review. Ophthalmic Physiol Opt 31(2):111–122. 1, 2

Hoffman D, Girshick A, Akeley K, Banks M (2008) Vergence–accommodation conflicts hinder visual performance and cause visual fatigue. J Vis 8(3):1–30. 1, 2

Zhu L, Zhao Y, Wang S, Chen H (2011) Spatial error concealment for stereoscopic video coding based on pixel matching. J Supercomput 58(1):96–105CrossRef

Bovik AC, Wang Z (2006) Modern image quality assessment. Morgan & Claypool, Morgan

Moorthy AK, Bovik AC (2011) Blind image quality assessment: from natural scene statistics to perceptual quality. IEEE Trans Image Process 20(12):3350–3364MathSciNetCrossRef

Mittal A, Moorthy AK, Bovik AC (2012) Blind/referenceless image spatial quality evaluator. IEEE Trans Image Process 19(2):75–78MathSciNet

Saad MA, Bovik AC (2012) Blind image quality assessment: a natural scene statistics approach in the DCT domain. IEEE Trans Image Process 21(8):3339–3352MathSciNetCrossRef

10.

Lu F, Wang H, Ji X, Er G (2009) Quality assessment of 3D asymmetric view coding using spatial frequency dominance model. Proc. 3DTV-CON, pp 1–4

11.

Jin L, Boev A, Gotchev A, Egiazarian K (2011) 3D-DCT based perceptual quality assessment of stereo video. Proc. ICIP, pp 2521–2524

12.

Benoit A, Le Callet P, Campisi P, Cousseau R (2008) Using disparity for quality assessment of stereoscopic images. 15th IEEE International Conference on Image Processing, pp 389–392

13.

Xing L, You J, Ebrahimi T, Perkis A (2010) Estimating quality of experience on stereoscopic images. 2010 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS), pp 1–4

14.

Lambooij M, Ijsselsteijn W (2009) Visual discomfort and visual fatigue of stereoscopic displays: a review. J Imaging Sci Technol 53(3):3–12CrossRef

15.

Goldmann L, De Simone F, Ebrahimi T (2010) Impact of acquisition distortions on the quality of stereoscopic images. 5th International Workshop on Video Processing and Quality Metrics for Consumer Electronics (VPQM)

16.

Chen M-J, Su C-C, Kwon D-K, Cormack LK, Bovik AC (2013) Full-reference quality assessment of stereopairs accounting for rivalry. Signal Process Image Commun 28(9):1143–1155CrossRef

17.

Blake R, Westendorf DH, Overton R (1980) What is suppressed during binocular rivalry? Perception 9(2):223–231CrossRef

18.

Kaplan IT, Metlay W (1964) Light intensity and binocular rivalry. J Exp Psychol 67(1):22–26CrossRef

19.

Whittle P (1965) Binocular rivalry and the contrast at contours. Q J Exp Psychol 17(3):217–226MathSciNetCrossRef

20.

Levelt WJM (1968) On binocular rivalry. Mouton, The Hague

21.

Fahle M (1982) Binocular rivalry: suppression depends on orientation and spatial frequency. Vis Res 22(7):787–800CrossRef

22.

Logothetis NK, Schall JD (1989) Neuronal correlates of subjective visual perception. Science 245(4919):761–763CrossRef

23.

Leopold DA, Logothetis NK (1996) Activity changes in early visual cortex reflect monkeys’ percepts during binocular rivalry. Nature 379(6565):549–553CrossRef

24.

Alais D, Blake R (1999) Grouping visual features during binocular rivalry. Vis Res 39(26):4341–4353CrossRef

25.

Blake R, Logothetis NK (2002) Visual competition. Nat Rev Neurosci 3(1):13–21CrossRef

26.

Field DJ, Hayes A, Hess RF (1993) Contour integration by the human visual system: evidence for a local “association field”. Vis Res 33(2):173–193CrossRef

27.

Kapadia MK, Ito M, Gilbert CD, Westheimer G (1995) Improvement in visual sensitivity by changes in local context: parallel studies in human observers and in V1 of alert monkeys. Neuron 15(4):843–856CrossRef

28.

Nash JF Jr (1950) The bargaining problem. Econometrica 18(2):155–162MathSciNetCrossRefMATH

29.

von Neumann J (1928) Zur theorie der gesellschaftsspiele. Math Annal 100(1):295–320CrossRefMATH

30.

Nash JF Jr (1951) Non-cooperative games. Annal Math 54(2):286–295MathSciNetCrossRefMATH

31.

Osborne MJ, Rubistein A (1994) A course in game theory. MIT, CambridgeMATH

32.

Ahmad I, Luo J (2006) On using game theory to optimize the rate control in video coding. IEEE Trans Circuits Syst Video Technol 16(2):209–219CrossRef

33.

Roughgarden T (1991) Stackelberg scheduling strategies. Proc ACM STOC 1991:104–113

34.

Montet C, Serra D (2003) Game theory and economics, Houndmills, Basingstoke, Hampshire. Palgrave, New York

35.

Sandholm T (1996) Limitations of Vickrey auction in computational multiagent systems. Proc. 2nd Int. Conf. Multiagent Syst, pp 299–306

36.

Alagoz BB (2008) Obtaining depth maps from color images by region based stereo matching algorithms. OncuBilim Algorithm Syst Labs 8(4):1–12

37.

Wang Z, Bovik AC (2002) Why is image quality assessment so difficult. Proc IEEE Int Conf Acoust Speech Signal Process 4 IV: 3313–3316

38.

Canny J (1986) A computational approach to edge detection. IEEE Trans Pattern Anal Mach Intell 8(6):679–698CrossRef

39.

Harel J, Koch C, Perona P (2007) Graph-based visual saliency. NIPS 545–552

40.

Teo PC, Heeger DJ (1994) Perceptual image distortion. Proc SPIE 2179:127–141CrossRef

41.

De Simone F, Goldmann L, Baroncini V, Ebrahimi T (2009) Subjective evaluation of JPEG XR image compression, vol 7443. SPIE, San Diego

42.

ITU-R (2000) Subjective assessment of stereoscopic television pictures. Tech Rep BT 1438

43.

Han J, Jiang T, Ma S (2012) Stereoscopic video quality assessment model based on spatial–temporal structural information. Proc. VCIP, pp 119–125

44.

Joveluro P, Malekmohamadi H, Fernando WAC, Kondoz AM (2010) Perceptual video quality metric for 3D video quality assessment. Proc. 3DTV-CON, pp 1–4

Title: Game theory based no-reference perceptual quality assessment for stereoscopic images
Authors: Feng Jiang
K. Bharanitharan
Shovan Barma
Hailiang Wang
Debin Zhao
Publication date: 01-09-2015
Publisher: Springer US
Published in: The Journal of Supercomputing / Issue 9/2015
Print ISSN: 0920-8542
Electronic ISSN: 1573-0484
DOI: https://doi.org/10.1007/s11227-015-1412-1

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Springer Professional "Wirtschaft+Technik"

Other articles of this Issue 9/2015

Optimizing seam carving on multi-GPU systems for real-time content-aware image resizing

Design space exploration of hardware task superscalar architecture

Optimizing the Hadoop MapReduce Framework with high-performance storage devices

Cooperative game-theoretic power control with a balancing factor in large-scale LTE networks: an energy efficiency perspective

SP-ChainMail: a GPU-based sparse parallel ChainMail algorithm for deforming medical volumes

Game theoretic analysis for large-scale networks and traffic data

Premium Partner