Skip to main content
Erschienen in: Multimedia Systems 3/2019

29.10.2018 | Regular Paper

Quality evaluation of DIBR 3D images based on blind watermarking

verfasst von: Lei Chen, Jiying Zhao

Erschienen in: Multimedia Systems | Ausgabe 3/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The quality evaluation of stereoscopic images is becoming increasingly important in 3D multimedia applications. Watermarking-based quality evaluation has been a promising technology for 3D content quality evaluation. In this work, we propose a novel quality evaluation scheme for depth-image-based rendering (DIBR) 3D images. The scheme utilizes the watermarking technique to evaluate the quality of watermarked images under various distortions. In this scheme, the watermark is embedded into the selected coefficients of dual-tree complex wavelet transform sub-bands of the center view. The virtual left and right views are synthesized from the watermarked center view and the associated depth map using the DIBR technique at the receiver side. The watermark can be detected from the three views individually, and the quality of these views under various attacks can be estimated by examining the degradation of corresponding extracted watermarks. In addition, the quality evaluation is made possible by checking the generated mapping curve, which maps the normalized correlation of the extracted watermark to the quality measure of the watermarked image under distortions. There is a high correlation between the estimated quality and the calculated quality. The experimental results demonstrate that the proposed scheme has good performance of quality evaluation for DIBR 3D images under JPEG compression, JPEG 2000 compression, Gaussian noise, and Gaussian blur. Moreover, our proposed scheme exhibits superiority over other related methods in terms of evaluation accuracy.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)CrossRef Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)CrossRef
2.
Zurück zum Zitat Sheikh, H.R., Sabir, M.F., Bovik, A.C.: A statistical evaluation of recent full reference image quality assessment algorithms. IEEE Trans. Image Process. 15(11), 3441–3452 (2006)CrossRef Sheikh, H.R., Sabir, M.F., Bovik, A.C.: A statistical evaluation of recent full reference image quality assessment algorithms. IEEE Trans. Image Process. 15(11), 3441–3452 (2006)CrossRef
3.
Zurück zum Zitat Wang, Z., Simoncelli, E.P.: Reduced-reference image quality assessment using a wavelet domain natural image statistic model. In: Proceedings of SPIE conference on human vision and electronic imaging, vol. 5666, pp. 149–159 (2005) Wang, Z., Simoncelli, E.P.: Reduced-reference image quality assessment using a wavelet domain natural image statistic model. In: Proceedings of SPIE conference on human vision and electronic imaging, vol. 5666, pp. 149–159 (2005)
4.
Zurück zum Zitat Li, Q., Wang, Z.: Reduced-reference image quality assessment using divisive normalization-based image representation. IEEE J. Sel. Topics Signal Process. 3(2), 201–211 (2009) Li, Q., Wang, Z.: Reduced-reference image quality assessment using divisive normalization-based image representation. IEEE J. Sel. Topics Signal Process. 3(2), 201–211 (2009)
5.
Zurück zum Zitat Wang, Z., Sheikh, H.R., Bovik, A.C.: No-reference perceptual quality assessment of JPEG compressed images. In: Proceedings of IEEE International Conference on Image Processing, vol. 1, pp 477–480 (2002) Wang, Z., Sheikh, H.R., Bovik, A.C.: No-reference perceptual quality assessment of JPEG compressed images. In: Proceedings of IEEE International Conference on Image Processing, vol. 1, pp 477–480 (2002)
6.
Zurück zum Zitat Mittal, A., Moorthy, A.K., Bovik, A.C.: No-reference image quality assessment in the spatial domain. IEEE Trans. Image Process. 21(12), 4695–4708 (2012)MathSciNetCrossRefMATH Mittal, A., Moorthy, A.K., Bovik, A.C.: No-reference image quality assessment in the spatial domain. IEEE Trans. Image Process. 21(12), 4695–4708 (2012)MathSciNetCrossRefMATH
7.
Zurück zum Zitat Saad, M.A., Bovik, A.C., Charrier, C.: Blind image quality assessment: a natural scene statistics approach in the DCT domain. IEEE Trans. Image Process. 21(8), 3339–3352 (2012)MathSciNetCrossRefMATH Saad, M.A., Bovik, A.C., Charrier, C.: Blind image quality assessment: a natural scene statistics approach in the DCT domain. IEEE Trans. Image Process. 21(8), 3339–3352 (2012)MathSciNetCrossRefMATH
8.
Zurück zum Zitat Wang, S., Zheng, D., Zhao, J., Tam, W.J., Speranaza, F.: Adaptive watermarking and tree structure based image quality estimation. IEEE Trans. Multimed. 16(2), 311–325 (2014)CrossRef Wang, S., Zheng, D., Zhao, J., Tam, W.J., Speranaza, F.: Adaptive watermarking and tree structure based image quality estimation. IEEE Trans. Multimed. 16(2), 311–325 (2014)CrossRef
9.
Zurück zum Zitat Campisi, P., Carli, M., Giunta, G., Neri, A.: Blind quality assessment system for multimedia communications using tracing watermarking. IEEE Trans. Signal Process. 51(4), 996–1002 (2003)MathSciNetCrossRefMATH Campisi, P., Carli, M., Giunta, G., Neri, A.: Blind quality assessment system for multimedia communications using tracing watermarking. IEEE Trans. Signal Process. 51(4), 996–1002 (2003)MathSciNetCrossRefMATH
10.
Zurück zum Zitat Wang, S., Zheng, D., Zhao, J., Tam, W.J., Speranaza, F.: A digital watermarking and perceptual model based video quality measurement. In: Proceedings of IEEE International Instrumentation and Measurement Technology Conference, pp. 1729-1734 (2005) Wang, S., Zheng, D., Zhao, J., Tam, W.J., Speranaza, F.: A digital watermarking and perceptual model based video quality measurement. In: Proceedings of IEEE International Instrumentation and Measurement Technology Conference, pp. 1729-1734 (2005)
11.
Zurück zum Zitat Wang, S., Zheng, D., Zhao, J., Tam, W.J., Speranaza, F.: An image quality evaluation method based on digital watermarking. IEEE Trans. Circ. Syst. Video Technol. 17(1), 98–105 (2007)CrossRef Wang, S., Zheng, D., Zhao, J., Tam, W.J., Speranaza, F.: An image quality evaluation method based on digital watermarking. IEEE Trans. Circ. Syst. Video Technol. 17(1), 98–105 (2007)CrossRef
12.
Zurück zum Zitat Chen, M.J., Cormack, L.K., Bovik, A.C.: No-reference quality assessment of natural stereopairs. IEEE Trans. Image Process. 22(9), 3379–3391 (2013)MathSciNetCrossRefMATH Chen, M.J., Cormack, L.K., Bovik, A.C.: No-reference quality assessment of natural stereopairs. IEEE Trans. Image Process. 22(9), 3379–3391 (2013)MathSciNetCrossRefMATH
13.
Zurück zum Zitat Lin, Y.H., Wu, J.L.: Quality assessment of stereoscopic 3D image compression by binocular integration behaviors. IEEE Trans. Image Process. 23(4), 1527–1542 (2014)MathSciNetCrossRefMATH Lin, Y.H., Wu, J.L.: Quality assessment of stereoscopic 3D image compression by binocular integration behaviors. IEEE Trans. Image Process. 23(4), 1527–1542 (2014)MathSciNetCrossRefMATH
14.
Zurück zum Zitat Chen, L., Zhao, J.: Quality assessment of stereoscopic 3D images based on local and global visual characteristics. In: Proceedings of IEEE International Conference on Multimedia and Expo, pp. 61–66 (2017) Chen, L., Zhao, J.: Quality assessment of stereoscopic 3D images based on local and global visual characteristics. In: Proceedings of IEEE International Conference on Multimedia and Expo, pp. 61–66 (2017)
15.
Zurück zum Zitat Fehn, C.: Depth-image-based rendering (DIBR), compression and transmission for a new approach on 3D-TV. In: Proceedings of SPIE Conference on Stereoscopic Displays and Virtual Reality Systems XI, vol. 5291, pp. 93–104 (2004) Fehn, C.: Depth-image-based rendering (DIBR), compression and transmission for a new approach on 3D-TV. In: Proceedings of SPIE Conference on Stereoscopic Displays and Virtual Reality Systems XI, vol. 5291, pp. 93–104 (2004)
16.
Zurück zum Zitat Chen, L., Zhao, J.: Robust contourlet-based watermarking for depth-image-based rendering 3D images. In: Proceedings of IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, pp. 1–4 (2016) Chen, L., Zhao, J.: Robust contourlet-based watermarking for depth-image-based rendering 3D images. In: Proceedings of IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, pp. 1–4 (2016)
17.
Zurück zum Zitat Liu, X., Zhang, Y., Hu, S., Kwong, S., Kuo, C.C.J., Peng, Q.: Subjective and objective video quality assessment of 3D synthesized views with texture/depth compression distortion. IEEE Trans. Image Process. 24(12), 4847–4861 (2015)MathSciNetCrossRefMATH Liu, X., Zhang, Y., Hu, S., Kwong, S., Kuo, C.C.J., Peng, Q.: Subjective and objective video quality assessment of 3D synthesized views with texture/depth compression distortion. IEEE Trans. Image Process. 24(12), 4847–4861 (2015)MathSciNetCrossRefMATH
18.
Zurück zum Zitat Battisti, F., Bosc, E., Carli, M., Callet, P.L., Perugia, S.: Objective image quality assessment of 3D synthesized views. Signal Process. Image Commun. 30, 78–88 (2015)CrossRef Battisti, F., Bosc, E., Carli, M., Callet, P.L., Perugia, S.: Objective image quality assessment of 3D synthesized views. Signal Process. Image Commun. 30, 78–88 (2015)CrossRef
19.
Zurück zum Zitat Chen, L., Zhao, J.: Watermarking based quality assessment for DIBR 3D images. In: Proceedings of IEEE International Conference on Smart Data, pp. 810–814 (2016) Chen, L., Zhao, J.: Watermarking based quality assessment for DIBR 3D images. In: Proceedings of IEEE International Conference on Smart Data, pp. 810–814 (2016)
20.
Zurück zum Zitat Farias, M., Carli, M., Mitra, S.: Objective video quality metric based on data hiding. IEEE Trans. Consum. Electron. 51(3), 983–992 (2005)CrossRef Farias, M., Carli, M., Mitra, S.: Objective video quality metric based on data hiding. IEEE Trans. Consum. Electron. 51(3), 983–992 (2005)CrossRef
21.
Zurück zum Zitat Nezhadarya, E., Wang, Z., Ward, R.: Image quality monitoring using spread spectrum watermarking. In: Proceedings of IEEE International Conference on Image Processing, pp. 2233–2236 (2009) Nezhadarya, E., Wang, Z., Ward, R.: Image quality monitoring using spread spectrum watermarking. In: Proceedings of IEEE International Conference on Image Processing, pp. 2233–2236 (2009)
22.
Zurück zum Zitat Altous, S., Samee, M.K., Gotze, J.: Reduced reference image quality assessment for JPEG distoriton. In: Proceedings of IEEE International Symposium on ELMAR, pp. 431–436 (2011) Altous, S., Samee, M.K., Gotze, J.: Reduced reference image quality assessment for JPEG distoriton. In: Proceedings of IEEE International Symposium on ELMAR, pp. 431–436 (2011)
23.
Zurück zum Zitat Benoit, A., Callet, P.L., Campisi, P., Cousseau, R.: Using disparity for quality assessment of stereoscopic images. In: Proceedings of IEEE International Conference on Image Processing, pp. 389–392 (2008) Benoit, A., Callet, P.L., Campisi, P., Cousseau, R.: Using disparity for quality assessment of stereoscopic images. In: Proceedings of IEEE International Conference on Image Processing, pp. 389–392 (2008)
24.
Zurück zum Zitat You, J., Xing, L., Perkis, A., Wang, X.: Perceptual quality assessment for stereoscopic images based on 2D image quality metrics and disparity analysis. In: Proceedings of International Workshop on Video Processing, Quality Metrics and Consumer Electronics, pp. 61–66 (2010) You, J., Xing, L., Perkis, A., Wang, X.: Perceptual quality assessment for stereoscopic images based on 2D image quality metrics and disparity analysis. In: Proceedings of International Workshop on Video Processing, Quality Metrics and Consumer Electronics, pp. 61–66 (2010)
25.
Zurück zum Zitat Zhu, Z., Yang, Y.: Perceputal distortion meric for stero video quality evaluation. WSEAS Trans. Signal Process. 5(7), 241–250 (2009) Zhu, Z., Yang, Y.: Perceputal distortion meric for stero video quality evaluation. WSEAS Trans. Signal Process. 5(7), 241–250 (2009)
26.
Zurück zum Zitat Hewage, C.T.E.R., Martini, M.G.: Reduced-reference quality metric for 3D depth map transmission. In: Proceedings of 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video, pp. 1–4 (2010) Hewage, C.T.E.R., Martini, M.G.: Reduced-reference quality metric for 3D depth map transmission. In: Proceedings of 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video, pp. 1–4 (2010)
27.
Zurück zum Zitat Chen, M.J., Su, C.C., Kwon, D.K., Cormack, L.K., Bovik, A.C.: Full-reference quality assessment of stereopairs accounting for rivalry. Signal Process. Image Commun. 28(9), 1143–1155 (2013)CrossRef Chen, M.J., Su, C.C., Kwon, D.K., Cormack, L.K., Bovik, A.C.: Full-reference quality assessment of stereopairs accounting for rivalry. Signal Process. Image Commun. 28(9), 1143–1155 (2013)CrossRef
28.
Zurück zum Zitat Wang, J., Rehman, A., Zeng, K., Wang, S., Wang, Z.: Quality prediction of asymmetrically distorted stereoscopic 3D images. IEEE Trans. Image Process. 24(11), 3400–3414 (2015)MathSciNetCrossRefMATH Wang, J., Rehman, A., Zeng, K., Wang, S., Wang, Z.: Quality prediction of asymmetrically distorted stereoscopic 3D images. IEEE Trans. Image Process. 24(11), 3400–3414 (2015)MathSciNetCrossRefMATH
29.
Zurück zum Zitat Zhang, L., Tam, W.J.: Stereoscopic image generation based on depth images for 3D TV. IEEE Trans. Broadcast. 51(2), 191–199 (2005)CrossRef Zhang, L., Tam, W.J.: Stereoscopic image generation based on depth images for 3D TV. IEEE Trans. Broadcast. 51(2), 191–199 (2005)CrossRef
30.
Zurück zum Zitat Zhang, L., Vazquez, C., Knorr, S.: 3D-TV content creation: automatic 2D-to-3D video conversion. IEEE Trans. Broadcast. 57(2), 372–383 (2011)CrossRef Zhang, L., Vazquez, C., Knorr, S.: 3D-TV content creation: automatic 2D-to-3D video conversion. IEEE Trans. Broadcast. 57(2), 372–383 (2011)CrossRef
31.
Zurück zum Zitat Lee, P.J.: Effendi: nongeometric distortion smoothing approach for depth map preprocessing. IEEE Trans. Multimed. 13(2), 246–254 (2011)CrossRef Lee, P.J.: Effendi: nongeometric distortion smoothing approach for depth map preprocessing. IEEE Trans. Multimed. 13(2), 246–254 (2011)CrossRef
32.
Zurück zum Zitat Loo, P., Kingsburry, N.: Digital watermarking using complex wavelets. In: Proceedings of IEEE International Conference on Image Processing, pp. 29–32 (2000) Loo, P., Kingsburry, N.: Digital watermarking using complex wavelets. In: Proceedings of IEEE International Conference on Image Processing, pp. 29–32 (2000)
33.
Zurück zum Zitat Selesnick, I.W., Baraniuk, R.G., Kingsburry, N.G.: The dual-tree complex wavelet transform. IEEE Signal Process. Mag. 22(6), 123–151 (2005)CrossRef Selesnick, I.W., Baraniuk, R.G., Kingsburry, N.G.: The dual-tree complex wavelet transform. IEEE Signal Process. Mag. 22(6), 123–151 (2005)CrossRef
34.
Zurück zum Zitat Kim, H.D., Lee, J.W., Oh, T.W., Lee, H.K.: DT-CWT watermarking for DIBR 3D images. IEEE Trans. Broadcast. 58(4), 533–543 (2012)CrossRef Kim, H.D., Lee, J.W., Oh, T.W., Lee, H.K.: DT-CWT watermarking for DIBR 3D images. IEEE Trans. Broadcast. 58(4), 533–543 (2012)CrossRef
35.
Zurück zum Zitat Asikuzzaman, M., Alam, M.J., Lambert, A.J., Pickering, M.R.: A blind watermarking scheme for depth-image-based rendered 3D video using the dual-tree complex wavelet transform. In: Proceedings of IEEE International Conference on Image Processing, pp. 5497–5501 (2014) Asikuzzaman, M., Alam, M.J., Lambert, A.J., Pickering, M.R.: A blind watermarking scheme for depth-image-based rendered 3D video using the dual-tree complex wavelet transform. In: Proceedings of IEEE International Conference on Image Processing, pp. 5497–5501 (2014)
36.
Zurück zum Zitat Tam, W.J., Speranza, F., Yano, S., Shimono, K., Ono, H.: Stereoscopic 3D-TV: visual comfort. IEEE Trans. Broadcast. 57(2), 335–346 (2011)CrossRef Tam, W.J., Speranza, F., Yano, S., Shimono, K., Ono, H.: Stereoscopic 3D-TV: visual comfort. IEEE Trans. Broadcast. 57(2), 335–346 (2011)CrossRef
37.
Zurück zum Zitat Coria, L.E., Pickering, M.R., Nasiopoulos, P., Ward, R.K.: A video watermarking scheme based on the dual-tree complex wavelet transform. IEEE Trans. Inf. Forensics Secur. 3(3), 466–474 (2008)CrossRef Coria, L.E., Pickering, M.R., Nasiopoulos, P., Ward, R.K.: A video watermarking scheme based on the dual-tree complex wavelet transform. IEEE Trans. Inf. Forensics Secur. 3(3), 466–474 (2008)CrossRef
38.
Zurück zum Zitat Malvar, H.S., Florencio, D.A.F.: Improved spread spectrum: a new modulation techinque for robust watermarking. IEEE Trans. Signal Process. 51(4), 898–905 (2003)MathSciNetCrossRefMATH Malvar, H.S., Florencio, D.A.F.: Improved spread spectrum: a new modulation techinque for robust watermarking. IEEE Trans. Signal Process. 51(4), 898–905 (2003)MathSciNetCrossRefMATH
39.
Zurück zum Zitat Hirschmuller, H., Scharstein, D.: Evaluation of cost functions for stereo matching. In: Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2007) Hirschmuller, H., Scharstein, D.: Evaluation of cost functions for stereo matching. In: Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2007)
40.
Zurück zum Zitat Moorthy, A.K., Su, C.C., Mittal, A., Bovik, A.C.: Subjective evaluation of stereoscopic image quality. Signal Process. Image Commun. 28(8), 870–883 (2012)CrossRef Moorthy, A.K., Su, C.C., Mittal, A., Bovik, A.C.: Subjective evaluation of stereoscopic image quality. Signal Process. Image Commun. 28(8), 870–883 (2012)CrossRef
41.
Zurück zum Zitat Lin, Y.H., Wu, J.L.: A digital blind watermarking for depth-image-based rendering 3D images. IEEE Trans. Broadcast. 57(2), 602–611 (2011)CrossRef Lin, Y.H., Wu, J.L.: A digital blind watermarking for depth-image-based rendering 3D images. IEEE Trans. Broadcast. 57(2), 602–611 (2011)CrossRef
42.
Zurück zum Zitat Chen, L., Zhao, J.: Robust contourlet-based blind watermarking for depth-image-based rendering 3D images. Signal Process. Image Commun. 54, 56–65 (2017)CrossRef Chen, L., Zhao, J.: Robust contourlet-based blind watermarking for depth-image-based rendering 3D images. Signal Process. Image Commun. 54, 56–65 (2017)CrossRef
Metadaten
Titel
Quality evaluation of DIBR 3D images based on blind watermarking
verfasst von
Lei Chen
Jiying Zhao
Publikationsdatum
29.10.2018
Verlag
Springer Berlin Heidelberg
Erschienen in
Multimedia Systems / Ausgabe 3/2019
Print ISSN: 0942-4962
Elektronische ISSN: 1432-1882
DOI
https://doi.org/10.1007/s00530-018-0596-7

Weitere Artikel der Ausgabe 3/2019

Multimedia Systems 3/2019 Zur Ausgabe

Neuer Inhalt