Skip to main content
Top
Published in: Wireless Personal Communications 1/2017

22-06-2017

Enhancement of Wireless 3D Video Communication Using Color-Plus-Depth Error Restoration Algorithms and Bayesian Kalman Filtering

Authors: W. El-Shafai, S. El-Rabaie, M. El-Halawany, F. E. Abd El-Samie

Published in: Wireless Personal Communications | Issue 1/2017

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper proposes a hybrid of Outer Block Boundary Matching Algorithm and Directional Interpolation Error Concealment Algorithm (DIECA) to recover the Motion Vectors (MVs) and the Disparity Vectors (DVs) of the lost color frames of the transmitted Three-Dimensional Video (3DV). For the lost 3DV depth frames, an Encoder-Independent Decoder-Dependent Depth-Assisted Error Concealment (EIDD-DAEC) algorithm is proposed. It exploits the recovered color MVs and DVs to estimate more additional concealment depth-assisted MVs and DVs. After that, the initially-estimated concealment candidate DVs and MVs are selected from all previously-predicted ones using the DIECA and the Decoder Motion Vector Estimation Algorithm (DMVEA). Finally, the proposed Bayesian Kalman Filtering (BKF) scheme is efficiently employed to filter out the inherent errors inside the selected concealment candidate color-plus-depth MVs and DVs to achieve better 3DV quality. Extensive experimental results on different standardized 3DV sequences demonstrate that the proposed color-plus-depth schemes are more robust against heavy losses and they achieve high 3DV quality performance with an improved average Peak Signal-to-Noise Ratio (PSNR) gain. They objectively and subjectively outperform the state-of-the-art error recovery techniques, especially at severe Packet Loss Rates (PLRs).

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Xiang, W., Gao, P., & Peng, Q. (2015). Robust multiview three-dimensional video communications based on distributed video coding. IEEE Systems Journal, 99, 1–11.CrossRef Xiang, W., Gao, P., & Peng, Q. (2015). Robust multiview three-dimensional video communications based on distributed video coding. IEEE Systems Journal, 99, 1–11.CrossRef
2.
go back to reference Cagri, O., Erhan, E., Janko, C., & Ahmet, K. (2016). Adaptive delivery of immersive 3D multi-view video over the Internet. Journal of Multimedia Tools and Applications, 75(20), 12431–12461.CrossRef Cagri, O., Erhan, E., Janko, C., & Ahmet, K. (2016). Adaptive delivery of immersive 3D multi-view video over the Internet. Journal of Multimedia Tools and Applications, 75(20), 12431–12461.CrossRef
3.
go back to reference Huanqiang, Z., Xiaolan, W., Canhui, C., Jing, C., & Yan, Z. (2014). Fast multiview video coding using adaptive prediction structure and hierarchical mode decision. IEEE Transactions on Circuits and Systems for Video Technology, 24(9), 1566–1578.CrossRef Huanqiang, Z., Xiaolan, W., Canhui, C., Jing, C., & Yan, Z. (2014). Fast multiview video coding using adaptive prediction structure and hierarchical mode decision. IEEE Transactions on Circuits and Systems for Video Technology, 24(9), 1566–1578.CrossRef
4.
go back to reference Ying, C., & Vetro, A. (2014). Next generation 3D formats with depth map support. IEEE Multimedia, 21(2), 90–94.CrossRef Ying, C., & Vetro, A. (2014). Next generation 3D formats with depth map support. IEEE Multimedia, 21(2), 90–94.CrossRef
5.
go back to reference Purica, A., Mora, E., Pesquet, P. B., Cagnazzo, M., & Ionescu, B. (2016). Multiview plus depth video coding with temporal prediction view synthesis. IEEE Transactions on Circuits and Systems for Video Technology, 26(2), 360–374.CrossRef Purica, A., Mora, E., Pesquet, P. B., Cagnazzo, M., & Ionescu, B. (2016). Multiview plus depth video coding with temporal prediction view synthesis. IEEE Transactions on Circuits and Systems for Video Technology, 26(2), 360–374.CrossRef
6.
go back to reference Abreu, A. D., Frossard, P., & Pereira, F. (2015). Optimizing multiview video plus depth prediction structures for interactive multiview video streaming. IEEE Journal of Selected Topics in Signal Processing, 9(3), 487–500.CrossRef Abreu, A. D., Frossard, P., & Pereira, F. (2015). Optimizing multiview video plus depth prediction structures for interactive multiview video streaming. IEEE Journal of Selected Topics in Signal Processing, 9(3), 487–500.CrossRef
7.
go back to reference Hewage, C. T. E. R., & Martini, M. G. (2013). Quality of experience for 3D video streaming. IEEE Communications Magazine, 51(5), 101–107.CrossRef Hewage, C. T. E. R., & Martini, M. G. (2013). Quality of experience for 3D video streaming. IEEE Communications Magazine, 51(5), 101–107.CrossRef
8.
go back to reference Liu, Z., Cheung, G., & Ji, Y. (2013). Optimizing distributed source coding for interactive multiview video streaming over lossy networks. IEEE Transactions on Circuits and Systems for Video Technology, 23(10), 1781–1794.CrossRef Liu, Z., Cheung, G., & Ji, Y. (2013). Optimizing distributed source coding for interactive multiview video streaming over lossy networks. IEEE Transactions on Circuits and Systems for Video Technology, 23(10), 1781–1794.CrossRef
9.
go back to reference El-Shafai, W. (2015). Pixel-level matching based multi-hypothesis error concealment modes for wireless 3D H.264/MVC communication. 3D Research, 6(3), 31.CrossRef El-Shafai, W. (2015). Pixel-level matching based multi-hypothesis error concealment modes for wireless 3D H.264/MVC communication. 3D Research, 6(3), 31.CrossRef
10.
go back to reference Khattak, S., Maugey, T., Hamzaoui, R., Ahmad, S., & Frossard, P. (2016). Temporal and inter-view consistent error concealment technique for multiview plus depth video. IEEE Transactions on Circuits and Systems for Video Technology, 26(5), 829–840.CrossRef Khattak, S., Maugey, T., Hamzaoui, R., Ahmad, S., & Frossard, P. (2016). Temporal and inter-view consistent error concealment technique for multiview plus depth video. IEEE Transactions on Circuits and Systems for Video Technology, 26(5), 829–840.CrossRef
11.
go back to reference Zhou, Y., Xiang, W., & Wang, G. (2015). Frame loss concealment for multiview video transmission over wireless multimedia sensor networks. IEEE Sensors Journal, 15(3), 1892–1901.CrossRef Zhou, Y., Xiang, W., & Wang, G. (2015). Frame loss concealment for multiview video transmission over wireless multimedia sensor networks. IEEE Sensors Journal, 15(3), 1892–1901.CrossRef
12.
go back to reference Lee, P. J., Kuo, K. T., & Chi, C. Y. (2014). An adaptive error concealment method based on fuzzy reasoning for multi-view video coding. Journal of Display Technology, 10(7), 560–567.CrossRef Lee, P. J., Kuo, K. T., & Chi, C. Y. (2014). An adaptive error concealment method based on fuzzy reasoning for multi-view video coding. Journal of Display Technology, 10(7), 560–567.CrossRef
13.
go back to reference Xiang, X., Zhao, D., Wang, Q., Ji, X., & Gao, W. (2007). A novel error concealment method for stereoscopic video coding. In Proceedings 2007 IEEE international conference on image processing (ICIP) (pp. 101–104). Xiang, X., Zhao, D., Wang, Q., Ji, X., & Gao, W. (2007). A novel error concealment method for stereoscopic video coding. In Proceedings 2007 IEEE international conference on image processing (ICIP) (pp. 101–104).
14.
go back to reference Hwang, M., & Ko, S. (2008). Hybrid temporal error concealment methods for block-based compressed video transmission. IEEE Transactions on Broadcasting, 54(2), 198–207.CrossRef Hwang, M., & Ko, S. (2008). Hybrid temporal error concealment methods for block-based compressed video transmission. IEEE Transactions on Broadcasting, 54(2), 198–207.CrossRef
15.
go back to reference Lie, W. N., Lee, C. M., Yeh, C. H., & Gao, Z. W. (2014). Motion vector recovery for video error concealment by using iterative dynamic-programming optimization. IEEE Transactions on Multimedia, 16(1), 216–227.CrossRef Lie, W. N., Lee, C. M., Yeh, C. H., & Gao, Z. W. (2014). Motion vector recovery for video error concealment by using iterative dynamic-programming optimization. IEEE Transactions on Multimedia, 16(1), 216–227.CrossRef
16.
go back to reference Gadgil, N., Li H., & Delp, E. J. (2015). Spatial subsampling-based multiple description video coding with adaptive temporal-spatial error concealment. In Proceedings 2015 IEEE picture coding symposium (PCS) (pp. 90–94). Gadgil, N., Li H., & Delp, E. J. (2015). Spatial subsampling-based multiple description video coding with adaptive temporal-spatial error concealment. In Proceedings 2015 IEEE picture coding symposium (PCS) (pp. 90–94).
17.
go back to reference Ebdelli, M., Le-Meur, O., & Guillemot, C. (2015). Video inpainting with short-term windows: application to object removal and error concealment. IEEE Transactions on Image Processing, 24(10), 3034–3047.CrossRefMathSciNet Ebdelli, M., Le-Meur, O., & Guillemot, C. (2015). Video inpainting with short-term windows: application to object removal and error concealment. IEEE Transactions on Image Processing, 24(10), 3034–3047.CrossRefMathSciNet
18.
go back to reference Yan, B., & Jie, Z. (2012). Efficient frame concealment for depth image-based 3-D video transmission. IEEE Transactions on Multimedia, 14(3), 936–941.CrossRef Yan, B., & Jie, Z. (2012). Efficient frame concealment for depth image-based 3-D video transmission. IEEE Transactions on Multimedia, 14(3), 936–941.CrossRef
19.
go back to reference Gao, Z. W., & Lie, W. N. (2004). Video error concealment by using Kalman-filtering technique. In Proceedings of the international symposium on circuits and systems (pp. 69–72). Gao, Z. W., & Lie, W. N. (2004). Video error concealment by using Kalman-filtering technique. In Proceedings of the international symposium on circuits and systems (pp. 69–72).
20.
go back to reference Mochn, J., Marchevsk, S., & Gamec, J. (2009). Kalman filter based error concealment algorithm. In Proceedings of 54th Internationales Wissenchaftliches Kolloquium (pp. 1–4). Mochn, J., Marchevsk, S., & Gamec, J. (2009). Kalman filter based error concealment algorithm. In Proceedings of 54th Internationales Wissenchaftliches Kolloquium (pp. 1–4).
21.
go back to reference Shihua, C., Cui, H., & Tang, K. (2014). An effective error concealment scheme for heavily corrupted H.264/AVC videos based on Kalman filtering. Signal, Image and Video Processing, 8(8), 1533–1542.CrossRef Shihua, C., Cui, H., & Tang, K. (2014). An effective error concealment scheme for heavily corrupted H.264/AVC videos based on Kalman filtering. Signal, Image and Video Processing, 8(8), 1533–1542.CrossRef
22.
go back to reference Wen, N. L., & Guan, H. L. (2013). Error concealment for 3D video transmission. In Proceedings of IEEE international symposium on circuits and systems (ISCAS) (pp. 2856–2559). Wen, N. L., & Guan, H. L. (2013). Error concealment for 3D video transmission. In Proceedings of IEEE international symposium on circuits and systems (ISCAS) (pp. 2856–2559).
23.
go back to reference Liu, Y., Wang, J., & Zhang, H. (2010). Depth image-based temporal error concealment for 3-D video transmission. IEEE Transactions on Circuits and Systems for Video Technology, 20(4), 600–604.CrossRef Liu, Y., Wang, J., & Zhang, H. (2010). Depth image-based temporal error concealment for 3-D video transmission. IEEE Transactions on Circuits and Systems for Video Technology, 20(4), 600–604.CrossRef
24.
go back to reference Chung, T. Y., Sull, S., & Kim, C. S. (2011). Frame loss concealment for stereoscopic video plus depth sequences. IEEE Transactions on Consumer Electronics, 57(3), 1336–1344.CrossRef Chung, T. Y., Sull, S., & Kim, C. S. (2011). Frame loss concealment for stereoscopic video plus depth sequences. IEEE Transactions on Consumer Electronics, 57(3), 1336–1344.CrossRef
25.
go back to reference Hong, C. S., Wang, C. C., Tai, S. C., & Luo, Y. C. (2011). Object-based error concealment in 3D video. In Proceedings of IEEE fifth international conference on genetic and evolutionary computing (ICGEC) (pp. 5–8). Hong, C. S., Wang, C. C., Tai, S. C., & Luo, Y. C. (2011). Object-based error concealment in 3D video. In Proceedings of IEEE fifth international conference on genetic and evolutionary computing (ICGEC) (pp. 5–8).
27.
go back to reference ISO/IEC JTC1/SC29/WG11. (2006). Common test conditions for multiview video coding. JVT-U207, Hangzhou, China. ISO/IEC JTC1/SC29/WG11. (2006). Common test conditions for multiview video coding. JVT-U207, Hangzhou, China.
Metadata
Title
Enhancement of Wireless 3D Video Communication Using Color-Plus-Depth Error Restoration Algorithms and Bayesian Kalman Filtering
Authors
W. El-Shafai
S. El-Rabaie
M. El-Halawany
F. E. Abd El-Samie
Publication date
22-06-2017
Publisher
Springer US
Published in
Wireless Personal Communications / Issue 1/2017
Print ISSN: 0929-6212
Electronic ISSN: 1572-834X
DOI
https://doi.org/10.1007/s11277-017-4503-x

Other articles of this Issue 1/2017

Wireless Personal Communications 1/2017 Go to the issue