Skip to main content
Erschienen in: Cognitive Computation 2/2010

01.06.2010

A Video Quality Assessment Metric Based on Human Visual System

verfasst von: Wen Lu, Xuelong Li, Xinbo Gao, Wenjian Tang, Jing Li, Dacheng Tao

Erschienen in: Cognitive Computation | Ausgabe 2/2010

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

It is important for practical application to design an effective and efficient metric for video quality. The most reliable way is by subjective evaluation. Thus, to design an objective metric by simulating human visual system (HVS) is quite reasonable and available. In this paper, the video quality assessment metric based on visual perception is proposed. Three-dimensional wavelet is utilized to decompose video and then extract features to mimic the multichannel structure of HVS. Spatio-temporal contrast sensitivity function (S-T CSF) is employed to weight coefficient obtained by three-dimensional wavelet to simulate nonlinearity feature of the human eyes. Perceptual threshold is exploited to obtain visual sensitive coefficients after S-T CSF filtered. Visual sensitive coefficients are normalized representation and then visual sensitive errors are calculated between reference and distorted video. Finally, temporal perceptual mechanism is applied to count values of video quality for reducing computational cost. Experimental results prove the proposed method outperforms the most existing methods and is comparable to LHS and PVQM.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Wang Z, Sheikh RH, Bovik CA. Objective video quality assessment. In: Furht B, Marques O, editors. The handbook of video databases: design and applications. Florida: CRC Press; 2003. p. 1041–78. Wang Z, Sheikh RH, Bovik CA. Objective video quality assessment. In: Furht B, Marques O, editors. The handbook of video databases: design and applications. Florida: CRC Press; 2003. p. 1041–78.
2.
Zurück zum Zitat ITU-R BT.500-11. Methodology for the subjective assessment of the quality of television pictures. 2002. ITU-R BT.500-11. Methodology for the subjective assessment of the quality of television pictures. 2002.
3.
Zurück zum Zitat Wang Z, Bovik CA. Modern image quality assessment. New York: Morgan and Claypool Publishing Company; 2006. Wang Z, Bovik CA. Modern image quality assessment. New York: Morgan and Claypool Publishing Company; 2006.
4.
Zurück zum Zitat Yuan Y, Evans A, Monro D. Low complexity separable matching pursuits. IEEE Int Conf Acoust Speech Signal Process. 2004;3(17–21):725–8. Yuan Y, Evans A, Monro D. Low complexity separable matching pursuits. IEEE Int Conf Acoust Speech Signal Process. 2004;3(17–21):725–8.
5.
Zurück zum Zitat Yuan Y, Monro D. Improved matching pursuits image coding. IEEE Int Conf Acoust Speech Signal Process. 2005;2:201–4. Yuan Y, Monro D. Improved matching pursuits image coding. IEEE Int Conf Acoust Speech Signal Process. 2005;2:201–4.
6.
Zurück zum Zitat Monro D, Yuan Y. Bases for low complexity matching pursuits image coding. IEEE Int Conf Image Process. 2005;2(11–14):249–52. Monro D, Yuan Y. Bases for low complexity matching pursuits image coding. IEEE Int Conf Image Process. 2005;2(11–14):249–52.
7.
Zurück zum Zitat Yuan Y, Monro D. 3D wavelet video coding with replicated matching pursuits. IEEE Int Conf Image Process. 2005;1(11–14):69–72. Yuan Y, Monro D. 3D wavelet video coding with replicated matching pursuits. IEEE Int Conf Image Process. 2005;1(11–14):69–72.
8.
Zurück zum Zitat Li X, Tao D, Gao X, Lu W. A natural image quality evaluation metric. Signal Process. 2009;89(4):548–55.CrossRef Li X, Tao D, Gao X, Lu W. A natural image quality evaluation metric. Signal Process. 2009;89(4):548–55.CrossRef
9.
Zurück zum Zitat ATIS Technical Report T1.TR.PP.74, Objective video quality measurement using a peak-signal-to-noise-ratio (PSNR) full reference technique. 2001. ATIS Technical Report T1.TR.PP.74, Objective video quality measurement using a peak-signal-to-noise-ratio (PSNR) full reference technique. 2001.
10.
Zurück zum Zitat Sarnoff Corporation, J. Lubin. Sarnoff JND Vision Model. Contribution to IEEE G-2.1.6 compression and processing subcommittee. 1997. Sarnoff Corporation, J. Lubin. Sarnoff JND Vision Model. Contribution to IEEE G-2.1.6 compression and processing subcommittee. 1997.
11.
Zurück zum Zitat Winkler S. A perceptual distortion metric for digital color video. In Proc SPIE, 3644: 175–184, San Jose, CA, Jan. 23–29, 1999. Winkler S. A perceptual distortion metric for digital color video. In Proc SPIE, 3644: 175–184, San Jose, CA, Jan. 23–29, 1999.
12.
Zurück zum Zitat Watson AB, Hu J, McGowan JF. DVQ: a digital video quality metric based on human vision. J Electron Imag. 2001;10(1):20–9.CrossRef Watson AB, Hu J, McGowan JF. DVQ: a digital video quality metric based on human vision. J Electron Imag. 2001;10(1):20–9.CrossRef
13.
Zurück zum Zitat Hekstra AP, Beerends JG, Ledermann D, de Caluwe FE, Kohler S, Koenen RH, Rihs S, Ehrsam M, Schlauss D. PVQM—a perceptual video quality measure. Signal Process Image Commun. 2002;17(10):781–98.CrossRef Hekstra AP, Beerends JG, Ledermann D, de Caluwe FE, Kohler S, Koenen RH, Rihs S, Ehrsam M, Schlauss D. PVQM—a perceptual video quality measure. Signal Process Image Commun. 2002;17(10):781–98.CrossRef
14.
Zurück zum Zitat VQEG. Final report from the video quality experts group on the validation of objective models of video quality assessment, phase I VQEG. 2000. 2000Available: http://www.vqeg.org/. VQEG. Final report from the video quality experts group on the validation of objective models of video quality assessment, phase I VQEG. 2000. 2000Available: http://​www.​vqeg.​org/​.
15.
Zurück zum Zitat Wang Z, Lu L, Bovik AC. Video quality assessment based on structural distortion measurement. Signal Process Image Commun. 2004;19(2):121–32.CrossRef Wang Z, Lu L, Bovik AC. Video quality assessment based on structural distortion measurement. Signal Process Image Commun. 2004;19(2):121–32.CrossRef
16.
Zurück zum Zitat Mei T, Hua X-S, Zhu C-Z, Zhou H-Q, Li S. Home video visual quality assessment with spatio-temporal factors. IEEE Trans Circuits Syst Video Technol. 2007;17(6):699–706.CrossRef Mei T, Hua X-S, Zhu C-Z, Zhou H-Q, Li S. Home video visual quality assessment with spatio-temporal factors. IEEE Trans Circuits Syst Video Technol. 2007;17(6):699–706.CrossRef
17.
Zurück zum Zitat Lu Z, Lin W, Yang Xiaokang, Ong EP, Yao S. Modeling visual attention’s modulatory aftereffects on visual sensitivity and quality evaluation. IEEE Trans Image Process. 2009;14(11):1928–42. Lu Z, Lin W, Yang Xiaokang, Ong EP, Yao S. Modeling visual attention’s modulatory aftereffects on visual sensitivity and quality evaluation. IEEE Trans Image Process. 2009;14(11):1928–42.
18.
Zurück zum Zitat Wang Z, Li Q. Video quality assessment using a statistical model of human visual speed perception. J Opt Soc Am A. 2007;24(12):B61–9.CrossRef Wang Z, Li Q. Video quality assessment using a statistical model of human visual speed perception. J Opt Soc Am A. 2007;24(12):B61–9.CrossRef
19.
Zurück zum Zitat Wandell BA. Foundations of vision. Sinauer Associates. 1995. Wandell BA. Foundations of vision. Sinauer Associates. 1995.
20.
Zurück zum Zitat Moyano E, Quiles FJ, Garrido A, Orozco-Barbosa L, Duato J. Efficient 3-D wavelet transform decomposition for video compression. International Workshop on Digital and Computational Video, 118–125, Feb. 2001. Moyano E, Quiles FJ, Garrido A, Orozco-Barbosa L, Duato J. Efficient 3-D wavelet transform decomposition for video compression. International Workshop on Digital and Computational Video, 118–125, Feb. 2001.
21.
Zurück zum Zitat Wang C, Ma K-L. A statistical approach to volume data quality assessment. IEEE Trans Vis Comput Graphics. 2008;14(3):590–602.CrossRef Wang C, Ma K-L. A statistical approach to volume data quality assessment. IEEE Trans Vis Comput Graphics. 2008;14(3):590–602.CrossRef
22.
Zurück zum Zitat Mallat SG. A theory for multiresolution decomposition: the wavelet representation. IEEE Trans Pattern Anal Mach Intell. 1989;11(7):674–93.CrossRef Mallat SG. A theory for multiresolution decomposition: the wavelet representation. IEEE Trans Pattern Anal Mach Intell. 1989;11(7):674–93.CrossRef
23.
Zurück zum Zitat Kelly DH. Motion and vision II. Stabilized spatio-temporal surface. J Opt Soc Am. 1979;69(10):1340–9.CrossRefPubMed Kelly DH. Motion and vision II. Stabilized spatio-temporal surface. J Opt Soc Am. 1979;69(10):1340–9.CrossRefPubMed
24.
Zurück zum Zitat Jia Y, Lin W, Kassim AA. Estimating just-noticeable distortion for video. IEEE Trans Circuits Syst Video Technol. 2006;16(7):820–9.CrossRef Jia Y, Lin W, Kassim AA. Estimating just-noticeable distortion for video. IEEE Trans Circuits Syst Video Technol. 2006;16(7):820–9.CrossRef
25.
Zurück zum Zitat Narita N. Subjective-evaluation method for quality of coded images. IEEE Trans Broadcasting. 1994;40(1):7–13.CrossRef Narita N. Subjective-evaluation method for quality of coded images. IEEE Trans Broadcasting. 1994;40(1):7–13.CrossRef
26.
Zurück zum Zitat Tan KT, Ghanbari M, Pearson DE. An objective measurement tool for MPEG video quality. Signal Process. 1998;70(3):279–94.CrossRef Tan KT, Ghanbari M, Pearson DE. An objective measurement tool for MPEG video quality. Signal Process. 1998;70(3):279–94.CrossRef
27.
Zurück zum Zitat Ninassi A, Meur OL, Callet PL, Barba D. Considering temporal variations of spatial visual distortions in video quality assessment. IEEE J Sel Topics Signal Process. 2009;3(2):253–65.CrossRef Ninassi A, Meur OL, Callet PL, Barba D. Considering temporal variations of spatial visual distortions in video quality assessment. IEEE J Sel Topics Signal Process. 2009;3(2):253–65.CrossRef
28.
Zurück zum Zitat Winkler S. A perceputal distortion metric for digital color video IV. Proc SPIE Human Vis Electron Imag. 1999;3644:175–84.CrossRef Winkler S. A perceputal distortion metric for digital color video IV. Proc SPIE Human Vis Electron Imag. 1999;3644:175–84.CrossRef
29.
Zurück zum Zitat Van den Branden Lambrecht CJ. A working spatio-temporal model of the human visual system for image restoration and quality assessment applications. Proc IEEE Int Conf Acoust Speech Signal Process. 1996;4:2291–4.CrossRef Van den Branden Lambrecht CJ. A working spatio-temporal model of the human visual system for image restoration and quality assessment applications. Proc IEEE Int Conf Acoust Speech Signal Process. 1996;4:2291–4.CrossRef
30.
Zurück zum Zitat Masry M, Hemami SS, Yegnaswamy S. A scalable waveletbased video distortion metric and applications. IEEE Trans Circuits Syst Video Technol. 2006;16(2):260–73.CrossRef Masry M, Hemami SS, Yegnaswamy S. A scalable waveletbased video distortion metric and applications. IEEE Trans Circuits Syst Video Technol. 2006;16(2):260–73.CrossRef
31.
Zurück zum Zitat Chou C-H, Chen C-W. A perceptually optimized 3-D subband codec for video communication over wireless channels. IEEE Trans Circuits Syst Video Technol. 1996;6(2):143–56.CrossRef Chou C-H, Chen C-W. A perceptually optimized 3-D subband codec for video communication over wireless channels. IEEE Trans Circuits Syst Video Technol. 1996;6(2):143–56.CrossRef
32.
Zurück zum Zitat Ong E, Lin W, Lu Z, Yao S, Etoh M. Visual distortion assessment with emphasis on spatially transitional regions. IEEE Trans Circuits Syst Video Technol. 2004;14(4):559–66.CrossRef Ong E, Lin W, Lu Z, Yao S, Etoh M. Visual distortion assessment with emphasis on spatially transitional regions. IEEE Trans Circuits Syst Video Technol. 2004;14(4):559–66.CrossRef
33.
Zurück zum Zitat Gunawan IP, Ghanbari M. Reduced-reference video quality assessment using discriminative local harmonic strength with motion consideration. IEEE Trans Circuits Syst Video Technol. 2008;18(1):71–83.CrossRef Gunawan IP, Ghanbari M. Reduced-reference video quality assessment using discriminative local harmonic strength with motion consideration. IEEE Trans Circuits Syst Video Technol. 2008;18(1):71–83.CrossRef
34.
Zurück zum Zitat Pan Q, Zhang L, Dai G, Zhang H. Two de-noising methods by wavelet transform. IEEE Trans Signal Process. 1999;47(12):3401–6.CrossRef Pan Q, Zhang L, Dai G, Zhang H. Two de-noising methods by wavelet transform. IEEE Trans Signal Process. 1999;47(12):3401–6.CrossRef
35.
Zurück zum Zitat Zhang L, Paul B, Wu X. Multiscale LMMSE-based image denoising with optimal wavelet selection. IEEE Trans Circuits Syst Video Technol. 2005;15(4):469–81.CrossRef Zhang L, Paul B, Wu X. Multiscale LMMSE-based image denoising with optimal wavelet selection. IEEE Trans Circuits Syst Video Technol. 2005;15(4):469–81.CrossRef
36.
Zurück zum Zitat Gao X, Lu W, Tao D, Li X. Image quality assessment based on multiscale geometric analysis. IEEE Trans Image Process. 2009;18(7):1409–23.CrossRefPubMed Gao X, Lu W, Tao D, Li X. Image quality assessment based on multiscale geometric analysis. IEEE Trans Image Process. 2009;18(7):1409–23.CrossRefPubMed
37.
Zurück zum Zitat Lu W, Zeng K, Tao D, Yuan Y, Gao X. No-reference image quality assessment in contourlet domain. Neurocomputing. 2010;73(1):784–94.CrossRef Lu W, Zeng K, Tao D, Yuan Y, Gao X. No-reference image quality assessment in contourlet domain. Neurocomputing. 2010;73(1):784–94.CrossRef
38.
Zurück zum Zitat Li X, Lin S, Yan S, Xu D. Discriminant locally linear embedding with high-order tensor data. IEEE Trans Syst Man Cybern Part B. 2008;38(2):342–52.CrossRef Li X, Lin S, Yan S, Xu D. Discriminant locally linear embedding with high-order tensor data. IEEE Trans Syst Man Cybern Part B. 2008;38(2):342–52.CrossRef
39.
Zurück zum Zitat Tao D, Li X, Wu X, Maybank SJ. General tensor discriminant analysis and Gabor features for gait recognition. IEEE Trans Pattern Anal Mach Intell. 2007;29(10):1700–15.CrossRefPubMed Tao D, Li X, Wu X, Maybank SJ. General tensor discriminant analysis and Gabor features for gait recognition. IEEE Trans Pattern Anal Mach Intell. 2007;29(10):1700–15.CrossRefPubMed
Metadaten
Titel
A Video Quality Assessment Metric Based on Human Visual System
verfasst von
Wen Lu
Xuelong Li
Xinbo Gao
Wenjian Tang
Jing Li
Dacheng Tao
Publikationsdatum
01.06.2010
Verlag
Springer-Verlag
Erschienen in
Cognitive Computation / Ausgabe 2/2010
Print ISSN: 1866-9956
Elektronische ISSN: 1866-9964
DOI
https://doi.org/10.1007/s12559-010-9040-9

Weitere Artikel der Ausgabe 2/2010

Cognitive Computation 2/2010 Zur Ausgabe

Premium Partner