Skip to main content
Top
Published in: Multimedia Systems 3/2019

29-10-2018 | Regular Paper

Quality evaluation of DIBR 3D images based on blind watermarking

Authors: Lei Chen, Jiying Zhao

Published in: Multimedia Systems | Issue 3/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The quality evaluation of stereoscopic images is becoming increasingly important in 3D multimedia applications. Watermarking-based quality evaluation has been a promising technology for 3D content quality evaluation. In this work, we propose a novel quality evaluation scheme for depth-image-based rendering (DIBR) 3D images. The scheme utilizes the watermarking technique to evaluate the quality of watermarked images under various distortions. In this scheme, the watermark is embedded into the selected coefficients of dual-tree complex wavelet transform sub-bands of the center view. The virtual left and right views are synthesized from the watermarked center view and the associated depth map using the DIBR technique at the receiver side. The watermark can be detected from the three views individually, and the quality of these views under various attacks can be estimated by examining the degradation of corresponding extracted watermarks. In addition, the quality evaluation is made possible by checking the generated mapping curve, which maps the normalized correlation of the extracted watermark to the quality measure of the watermarked image under distortions. There is a high correlation between the estimated quality and the calculated quality. The experimental results demonstrate that the proposed scheme has good performance of quality evaluation for DIBR 3D images under JPEG compression, JPEG 2000 compression, Gaussian noise, and Gaussian blur. Moreover, our proposed scheme exhibits superiority over other related methods in terms of evaluation accuracy.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)CrossRef Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)CrossRef
2.
go back to reference Sheikh, H.R., Sabir, M.F., Bovik, A.C.: A statistical evaluation of recent full reference image quality assessment algorithms. IEEE Trans. Image Process. 15(11), 3441–3452 (2006)CrossRef Sheikh, H.R., Sabir, M.F., Bovik, A.C.: A statistical evaluation of recent full reference image quality assessment algorithms. IEEE Trans. Image Process. 15(11), 3441–3452 (2006)CrossRef
3.
go back to reference Wang, Z., Simoncelli, E.P.: Reduced-reference image quality assessment using a wavelet domain natural image statistic model. In: Proceedings of SPIE conference on human vision and electronic imaging, vol. 5666, pp. 149–159 (2005) Wang, Z., Simoncelli, E.P.: Reduced-reference image quality assessment using a wavelet domain natural image statistic model. In: Proceedings of SPIE conference on human vision and electronic imaging, vol. 5666, pp. 149–159 (2005)
4.
go back to reference Li, Q., Wang, Z.: Reduced-reference image quality assessment using divisive normalization-based image representation. IEEE J. Sel. Topics Signal Process. 3(2), 201–211 (2009) Li, Q., Wang, Z.: Reduced-reference image quality assessment using divisive normalization-based image representation. IEEE J. Sel. Topics Signal Process. 3(2), 201–211 (2009)
5.
go back to reference Wang, Z., Sheikh, H.R., Bovik, A.C.: No-reference perceptual quality assessment of JPEG compressed images. In: Proceedings of IEEE International Conference on Image Processing, vol. 1, pp 477–480 (2002) Wang, Z., Sheikh, H.R., Bovik, A.C.: No-reference perceptual quality assessment of JPEG compressed images. In: Proceedings of IEEE International Conference on Image Processing, vol. 1, pp 477–480 (2002)
6.
go back to reference Mittal, A., Moorthy, A.K., Bovik, A.C.: No-reference image quality assessment in the spatial domain. IEEE Trans. Image Process. 21(12), 4695–4708 (2012)MathSciNetCrossRefMATH Mittal, A., Moorthy, A.K., Bovik, A.C.: No-reference image quality assessment in the spatial domain. IEEE Trans. Image Process. 21(12), 4695–4708 (2012)MathSciNetCrossRefMATH
7.
go back to reference Saad, M.A., Bovik, A.C., Charrier, C.: Blind image quality assessment: a natural scene statistics approach in the DCT domain. IEEE Trans. Image Process. 21(8), 3339–3352 (2012)MathSciNetCrossRefMATH Saad, M.A., Bovik, A.C., Charrier, C.: Blind image quality assessment: a natural scene statistics approach in the DCT domain. IEEE Trans. Image Process. 21(8), 3339–3352 (2012)MathSciNetCrossRefMATH
8.
go back to reference Wang, S., Zheng, D., Zhao, J., Tam, W.J., Speranaza, F.: Adaptive watermarking and tree structure based image quality estimation. IEEE Trans. Multimed. 16(2), 311–325 (2014)CrossRef Wang, S., Zheng, D., Zhao, J., Tam, W.J., Speranaza, F.: Adaptive watermarking and tree structure based image quality estimation. IEEE Trans. Multimed. 16(2), 311–325 (2014)CrossRef
9.
go back to reference Campisi, P., Carli, M., Giunta, G., Neri, A.: Blind quality assessment system for multimedia communications using tracing watermarking. IEEE Trans. Signal Process. 51(4), 996–1002 (2003)MathSciNetCrossRefMATH Campisi, P., Carli, M., Giunta, G., Neri, A.: Blind quality assessment system for multimedia communications using tracing watermarking. IEEE Trans. Signal Process. 51(4), 996–1002 (2003)MathSciNetCrossRefMATH
10.
go back to reference Wang, S., Zheng, D., Zhao, J., Tam, W.J., Speranaza, F.: A digital watermarking and perceptual model based video quality measurement. In: Proceedings of IEEE International Instrumentation and Measurement Technology Conference, pp. 1729-1734 (2005) Wang, S., Zheng, D., Zhao, J., Tam, W.J., Speranaza, F.: A digital watermarking and perceptual model based video quality measurement. In: Proceedings of IEEE International Instrumentation and Measurement Technology Conference, pp. 1729-1734 (2005)
11.
go back to reference Wang, S., Zheng, D., Zhao, J., Tam, W.J., Speranaza, F.: An image quality evaluation method based on digital watermarking. IEEE Trans. Circ. Syst. Video Technol. 17(1), 98–105 (2007)CrossRef Wang, S., Zheng, D., Zhao, J., Tam, W.J., Speranaza, F.: An image quality evaluation method based on digital watermarking. IEEE Trans. Circ. Syst. Video Technol. 17(1), 98–105 (2007)CrossRef
12.
go back to reference Chen, M.J., Cormack, L.K., Bovik, A.C.: No-reference quality assessment of natural stereopairs. IEEE Trans. Image Process. 22(9), 3379–3391 (2013)MathSciNetCrossRefMATH Chen, M.J., Cormack, L.K., Bovik, A.C.: No-reference quality assessment of natural stereopairs. IEEE Trans. Image Process. 22(9), 3379–3391 (2013)MathSciNetCrossRefMATH
13.
go back to reference Lin, Y.H., Wu, J.L.: Quality assessment of stereoscopic 3D image compression by binocular integration behaviors. IEEE Trans. Image Process. 23(4), 1527–1542 (2014)MathSciNetCrossRefMATH Lin, Y.H., Wu, J.L.: Quality assessment of stereoscopic 3D image compression by binocular integration behaviors. IEEE Trans. Image Process. 23(4), 1527–1542 (2014)MathSciNetCrossRefMATH
14.
go back to reference Chen, L., Zhao, J.: Quality assessment of stereoscopic 3D images based on local and global visual characteristics. In: Proceedings of IEEE International Conference on Multimedia and Expo, pp. 61–66 (2017) Chen, L., Zhao, J.: Quality assessment of stereoscopic 3D images based on local and global visual characteristics. In: Proceedings of IEEE International Conference on Multimedia and Expo, pp. 61–66 (2017)
15.
go back to reference Fehn, C.: Depth-image-based rendering (DIBR), compression and transmission for a new approach on 3D-TV. In: Proceedings of SPIE Conference on Stereoscopic Displays and Virtual Reality Systems XI, vol. 5291, pp. 93–104 (2004) Fehn, C.: Depth-image-based rendering (DIBR), compression and transmission for a new approach on 3D-TV. In: Proceedings of SPIE Conference on Stereoscopic Displays and Virtual Reality Systems XI, vol. 5291, pp. 93–104 (2004)
16.
go back to reference Chen, L., Zhao, J.: Robust contourlet-based watermarking for depth-image-based rendering 3D images. In: Proceedings of IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, pp. 1–4 (2016) Chen, L., Zhao, J.: Robust contourlet-based watermarking for depth-image-based rendering 3D images. In: Proceedings of IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, pp. 1–4 (2016)
17.
go back to reference Liu, X., Zhang, Y., Hu, S., Kwong, S., Kuo, C.C.J., Peng, Q.: Subjective and objective video quality assessment of 3D synthesized views with texture/depth compression distortion. IEEE Trans. Image Process. 24(12), 4847–4861 (2015)MathSciNetCrossRefMATH Liu, X., Zhang, Y., Hu, S., Kwong, S., Kuo, C.C.J., Peng, Q.: Subjective and objective video quality assessment of 3D synthesized views with texture/depth compression distortion. IEEE Trans. Image Process. 24(12), 4847–4861 (2015)MathSciNetCrossRefMATH
18.
go back to reference Battisti, F., Bosc, E., Carli, M., Callet, P.L., Perugia, S.: Objective image quality assessment of 3D synthesized views. Signal Process. Image Commun. 30, 78–88 (2015)CrossRef Battisti, F., Bosc, E., Carli, M., Callet, P.L., Perugia, S.: Objective image quality assessment of 3D synthesized views. Signal Process. Image Commun. 30, 78–88 (2015)CrossRef
19.
go back to reference Chen, L., Zhao, J.: Watermarking based quality assessment for DIBR 3D images. In: Proceedings of IEEE International Conference on Smart Data, pp. 810–814 (2016) Chen, L., Zhao, J.: Watermarking based quality assessment for DIBR 3D images. In: Proceedings of IEEE International Conference on Smart Data, pp. 810–814 (2016)
20.
go back to reference Farias, M., Carli, M., Mitra, S.: Objective video quality metric based on data hiding. IEEE Trans. Consum. Electron. 51(3), 983–992 (2005)CrossRef Farias, M., Carli, M., Mitra, S.: Objective video quality metric based on data hiding. IEEE Trans. Consum. Electron. 51(3), 983–992 (2005)CrossRef
21.
go back to reference Nezhadarya, E., Wang, Z., Ward, R.: Image quality monitoring using spread spectrum watermarking. In: Proceedings of IEEE International Conference on Image Processing, pp. 2233–2236 (2009) Nezhadarya, E., Wang, Z., Ward, R.: Image quality monitoring using spread spectrum watermarking. In: Proceedings of IEEE International Conference on Image Processing, pp. 2233–2236 (2009)
22.
go back to reference Altous, S., Samee, M.K., Gotze, J.: Reduced reference image quality assessment for JPEG distoriton. In: Proceedings of IEEE International Symposium on ELMAR, pp. 431–436 (2011) Altous, S., Samee, M.K., Gotze, J.: Reduced reference image quality assessment for JPEG distoriton. In: Proceedings of IEEE International Symposium on ELMAR, pp. 431–436 (2011)
23.
go back to reference Benoit, A., Callet, P.L., Campisi, P., Cousseau, R.: Using disparity for quality assessment of stereoscopic images. In: Proceedings of IEEE International Conference on Image Processing, pp. 389–392 (2008) Benoit, A., Callet, P.L., Campisi, P., Cousseau, R.: Using disparity for quality assessment of stereoscopic images. In: Proceedings of IEEE International Conference on Image Processing, pp. 389–392 (2008)
24.
go back to reference You, J., Xing, L., Perkis, A., Wang, X.: Perceptual quality assessment for stereoscopic images based on 2D image quality metrics and disparity analysis. In: Proceedings of International Workshop on Video Processing, Quality Metrics and Consumer Electronics, pp. 61–66 (2010) You, J., Xing, L., Perkis, A., Wang, X.: Perceptual quality assessment for stereoscopic images based on 2D image quality metrics and disparity analysis. In: Proceedings of International Workshop on Video Processing, Quality Metrics and Consumer Electronics, pp. 61–66 (2010)
25.
go back to reference Zhu, Z., Yang, Y.: Perceputal distortion meric for stero video quality evaluation. WSEAS Trans. Signal Process. 5(7), 241–250 (2009) Zhu, Z., Yang, Y.: Perceputal distortion meric for stero video quality evaluation. WSEAS Trans. Signal Process. 5(7), 241–250 (2009)
26.
go back to reference Hewage, C.T.E.R., Martini, M.G.: Reduced-reference quality metric for 3D depth map transmission. In: Proceedings of 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video, pp. 1–4 (2010) Hewage, C.T.E.R., Martini, M.G.: Reduced-reference quality metric for 3D depth map transmission. In: Proceedings of 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video, pp. 1–4 (2010)
27.
go back to reference Chen, M.J., Su, C.C., Kwon, D.K., Cormack, L.K., Bovik, A.C.: Full-reference quality assessment of stereopairs accounting for rivalry. Signal Process. Image Commun. 28(9), 1143–1155 (2013)CrossRef Chen, M.J., Su, C.C., Kwon, D.K., Cormack, L.K., Bovik, A.C.: Full-reference quality assessment of stereopairs accounting for rivalry. Signal Process. Image Commun. 28(9), 1143–1155 (2013)CrossRef
28.
go back to reference Wang, J., Rehman, A., Zeng, K., Wang, S., Wang, Z.: Quality prediction of asymmetrically distorted stereoscopic 3D images. IEEE Trans. Image Process. 24(11), 3400–3414 (2015)MathSciNetCrossRefMATH Wang, J., Rehman, A., Zeng, K., Wang, S., Wang, Z.: Quality prediction of asymmetrically distorted stereoscopic 3D images. IEEE Trans. Image Process. 24(11), 3400–3414 (2015)MathSciNetCrossRefMATH
29.
go back to reference Zhang, L., Tam, W.J.: Stereoscopic image generation based on depth images for 3D TV. IEEE Trans. Broadcast. 51(2), 191–199 (2005)CrossRef Zhang, L., Tam, W.J.: Stereoscopic image generation based on depth images for 3D TV. IEEE Trans. Broadcast. 51(2), 191–199 (2005)CrossRef
30.
go back to reference Zhang, L., Vazquez, C., Knorr, S.: 3D-TV content creation: automatic 2D-to-3D video conversion. IEEE Trans. Broadcast. 57(2), 372–383 (2011)CrossRef Zhang, L., Vazquez, C., Knorr, S.: 3D-TV content creation: automatic 2D-to-3D video conversion. IEEE Trans. Broadcast. 57(2), 372–383 (2011)CrossRef
31.
go back to reference Lee, P.J.: Effendi: nongeometric distortion smoothing approach for depth map preprocessing. IEEE Trans. Multimed. 13(2), 246–254 (2011)CrossRef Lee, P.J.: Effendi: nongeometric distortion smoothing approach for depth map preprocessing. IEEE Trans. Multimed. 13(2), 246–254 (2011)CrossRef
32.
go back to reference Loo, P., Kingsburry, N.: Digital watermarking using complex wavelets. In: Proceedings of IEEE International Conference on Image Processing, pp. 29–32 (2000) Loo, P., Kingsburry, N.: Digital watermarking using complex wavelets. In: Proceedings of IEEE International Conference on Image Processing, pp. 29–32 (2000)
33.
go back to reference Selesnick, I.W., Baraniuk, R.G., Kingsburry, N.G.: The dual-tree complex wavelet transform. IEEE Signal Process. Mag. 22(6), 123–151 (2005)CrossRef Selesnick, I.W., Baraniuk, R.G., Kingsburry, N.G.: The dual-tree complex wavelet transform. IEEE Signal Process. Mag. 22(6), 123–151 (2005)CrossRef
34.
go back to reference Kim, H.D., Lee, J.W., Oh, T.W., Lee, H.K.: DT-CWT watermarking for DIBR 3D images. IEEE Trans. Broadcast. 58(4), 533–543 (2012)CrossRef Kim, H.D., Lee, J.W., Oh, T.W., Lee, H.K.: DT-CWT watermarking for DIBR 3D images. IEEE Trans. Broadcast. 58(4), 533–543 (2012)CrossRef
35.
go back to reference Asikuzzaman, M., Alam, M.J., Lambert, A.J., Pickering, M.R.: A blind watermarking scheme for depth-image-based rendered 3D video using the dual-tree complex wavelet transform. In: Proceedings of IEEE International Conference on Image Processing, pp. 5497–5501 (2014) Asikuzzaman, M., Alam, M.J., Lambert, A.J., Pickering, M.R.: A blind watermarking scheme for depth-image-based rendered 3D video using the dual-tree complex wavelet transform. In: Proceedings of IEEE International Conference on Image Processing, pp. 5497–5501 (2014)
36.
go back to reference Tam, W.J., Speranza, F., Yano, S., Shimono, K., Ono, H.: Stereoscopic 3D-TV: visual comfort. IEEE Trans. Broadcast. 57(2), 335–346 (2011)CrossRef Tam, W.J., Speranza, F., Yano, S., Shimono, K., Ono, H.: Stereoscopic 3D-TV: visual comfort. IEEE Trans. Broadcast. 57(2), 335–346 (2011)CrossRef
37.
go back to reference Coria, L.E., Pickering, M.R., Nasiopoulos, P., Ward, R.K.: A video watermarking scheme based on the dual-tree complex wavelet transform. IEEE Trans. Inf. Forensics Secur. 3(3), 466–474 (2008)CrossRef Coria, L.E., Pickering, M.R., Nasiopoulos, P., Ward, R.K.: A video watermarking scheme based on the dual-tree complex wavelet transform. IEEE Trans. Inf. Forensics Secur. 3(3), 466–474 (2008)CrossRef
38.
go back to reference Malvar, H.S., Florencio, D.A.F.: Improved spread spectrum: a new modulation techinque for robust watermarking. IEEE Trans. Signal Process. 51(4), 898–905 (2003)MathSciNetCrossRefMATH Malvar, H.S., Florencio, D.A.F.: Improved spread spectrum: a new modulation techinque for robust watermarking. IEEE Trans. Signal Process. 51(4), 898–905 (2003)MathSciNetCrossRefMATH
39.
go back to reference Hirschmuller, H., Scharstein, D.: Evaluation of cost functions for stereo matching. In: Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2007) Hirschmuller, H., Scharstein, D.: Evaluation of cost functions for stereo matching. In: Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2007)
40.
go back to reference Moorthy, A.K., Su, C.C., Mittal, A., Bovik, A.C.: Subjective evaluation of stereoscopic image quality. Signal Process. Image Commun. 28(8), 870–883 (2012)CrossRef Moorthy, A.K., Su, C.C., Mittal, A., Bovik, A.C.: Subjective evaluation of stereoscopic image quality. Signal Process. Image Commun. 28(8), 870–883 (2012)CrossRef
41.
go back to reference Lin, Y.H., Wu, J.L.: A digital blind watermarking for depth-image-based rendering 3D images. IEEE Trans. Broadcast. 57(2), 602–611 (2011)CrossRef Lin, Y.H., Wu, J.L.: A digital blind watermarking for depth-image-based rendering 3D images. IEEE Trans. Broadcast. 57(2), 602–611 (2011)CrossRef
42.
go back to reference Chen, L., Zhao, J.: Robust contourlet-based blind watermarking for depth-image-based rendering 3D images. Signal Process. Image Commun. 54, 56–65 (2017)CrossRef Chen, L., Zhao, J.: Robust contourlet-based blind watermarking for depth-image-based rendering 3D images. Signal Process. Image Commun. 54, 56–65 (2017)CrossRef
Metadata
Title
Quality evaluation of DIBR 3D images based on blind watermarking
Authors
Lei Chen
Jiying Zhao
Publication date
29-10-2018
Publisher
Springer Berlin Heidelberg
Published in
Multimedia Systems / Issue 3/2019
Print ISSN: 0942-4962
Electronic ISSN: 1432-1882
DOI
https://doi.org/10.1007/s00530-018-0596-7

Other articles of this Issue 3/2019

Multimedia Systems 3/2019 Go to the issue