Skip to main content
Erschienen in: Wireless Personal Communications 1/2017

22.06.2017

Enhancement of Wireless 3D Video Communication Using Color-Plus-Depth Error Restoration Algorithms and Bayesian Kalman Filtering

verfasst von: W. El-Shafai, S. El-Rabaie, M. El-Halawany, F. E. Abd El-Samie

Erschienen in: Wireless Personal Communications | Ausgabe 1/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper proposes a hybrid of Outer Block Boundary Matching Algorithm and Directional Interpolation Error Concealment Algorithm (DIECA) to recover the Motion Vectors (MVs) and the Disparity Vectors (DVs) of the lost color frames of the transmitted Three-Dimensional Video (3DV). For the lost 3DV depth frames, an Encoder-Independent Decoder-Dependent Depth-Assisted Error Concealment (EIDD-DAEC) algorithm is proposed. It exploits the recovered color MVs and DVs to estimate more additional concealment depth-assisted MVs and DVs. After that, the initially-estimated concealment candidate DVs and MVs are selected from all previously-predicted ones using the DIECA and the Decoder Motion Vector Estimation Algorithm (DMVEA). Finally, the proposed Bayesian Kalman Filtering (BKF) scheme is efficiently employed to filter out the inherent errors inside the selected concealment candidate color-plus-depth MVs and DVs to achieve better 3DV quality. Extensive experimental results on different standardized 3DV sequences demonstrate that the proposed color-plus-depth schemes are more robust against heavy losses and they achieve high 3DV quality performance with an improved average Peak Signal-to-Noise Ratio (PSNR) gain. They objectively and subjectively outperform the state-of-the-art error recovery techniques, especially at severe Packet Loss Rates (PLRs).

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Xiang, W., Gao, P., & Peng, Q. (2015). Robust multiview three-dimensional video communications based on distributed video coding. IEEE Systems Journal, 99, 1–11.CrossRef Xiang, W., Gao, P., & Peng, Q. (2015). Robust multiview three-dimensional video communications based on distributed video coding. IEEE Systems Journal, 99, 1–11.CrossRef
2.
Zurück zum Zitat Cagri, O., Erhan, E., Janko, C., & Ahmet, K. (2016). Adaptive delivery of immersive 3D multi-view video over the Internet. Journal of Multimedia Tools and Applications, 75(20), 12431–12461.CrossRef Cagri, O., Erhan, E., Janko, C., & Ahmet, K. (2016). Adaptive delivery of immersive 3D multi-view video over the Internet. Journal of Multimedia Tools and Applications, 75(20), 12431–12461.CrossRef
3.
Zurück zum Zitat Huanqiang, Z., Xiaolan, W., Canhui, C., Jing, C., & Yan, Z. (2014). Fast multiview video coding using adaptive prediction structure and hierarchical mode decision. IEEE Transactions on Circuits and Systems for Video Technology, 24(9), 1566–1578.CrossRef Huanqiang, Z., Xiaolan, W., Canhui, C., Jing, C., & Yan, Z. (2014). Fast multiview video coding using adaptive prediction structure and hierarchical mode decision. IEEE Transactions on Circuits and Systems for Video Technology, 24(9), 1566–1578.CrossRef
4.
Zurück zum Zitat Ying, C., & Vetro, A. (2014). Next generation 3D formats with depth map support. IEEE Multimedia, 21(2), 90–94.CrossRef Ying, C., & Vetro, A. (2014). Next generation 3D formats with depth map support. IEEE Multimedia, 21(2), 90–94.CrossRef
5.
Zurück zum Zitat Purica, A., Mora, E., Pesquet, P. B., Cagnazzo, M., & Ionescu, B. (2016). Multiview plus depth video coding with temporal prediction view synthesis. IEEE Transactions on Circuits and Systems for Video Technology, 26(2), 360–374.CrossRef Purica, A., Mora, E., Pesquet, P. B., Cagnazzo, M., & Ionescu, B. (2016). Multiview plus depth video coding with temporal prediction view synthesis. IEEE Transactions on Circuits and Systems for Video Technology, 26(2), 360–374.CrossRef
6.
Zurück zum Zitat Abreu, A. D., Frossard, P., & Pereira, F. (2015). Optimizing multiview video plus depth prediction structures for interactive multiview video streaming. IEEE Journal of Selected Topics in Signal Processing, 9(3), 487–500.CrossRef Abreu, A. D., Frossard, P., & Pereira, F. (2015). Optimizing multiview video plus depth prediction structures for interactive multiview video streaming. IEEE Journal of Selected Topics in Signal Processing, 9(3), 487–500.CrossRef
7.
Zurück zum Zitat Hewage, C. T. E. R., & Martini, M. G. (2013). Quality of experience for 3D video streaming. IEEE Communications Magazine, 51(5), 101–107.CrossRef Hewage, C. T. E. R., & Martini, M. G. (2013). Quality of experience for 3D video streaming. IEEE Communications Magazine, 51(5), 101–107.CrossRef
8.
Zurück zum Zitat Liu, Z., Cheung, G., & Ji, Y. (2013). Optimizing distributed source coding for interactive multiview video streaming over lossy networks. IEEE Transactions on Circuits and Systems for Video Technology, 23(10), 1781–1794.CrossRef Liu, Z., Cheung, G., & Ji, Y. (2013). Optimizing distributed source coding for interactive multiview video streaming over lossy networks. IEEE Transactions on Circuits and Systems for Video Technology, 23(10), 1781–1794.CrossRef
9.
Zurück zum Zitat El-Shafai, W. (2015). Pixel-level matching based multi-hypothesis error concealment modes for wireless 3D H.264/MVC communication. 3D Research, 6(3), 31.CrossRef El-Shafai, W. (2015). Pixel-level matching based multi-hypothesis error concealment modes for wireless 3D H.264/MVC communication. 3D Research, 6(3), 31.CrossRef
10.
Zurück zum Zitat Khattak, S., Maugey, T., Hamzaoui, R., Ahmad, S., & Frossard, P. (2016). Temporal and inter-view consistent error concealment technique for multiview plus depth video. IEEE Transactions on Circuits and Systems for Video Technology, 26(5), 829–840.CrossRef Khattak, S., Maugey, T., Hamzaoui, R., Ahmad, S., & Frossard, P. (2016). Temporal and inter-view consistent error concealment technique for multiview plus depth video. IEEE Transactions on Circuits and Systems for Video Technology, 26(5), 829–840.CrossRef
11.
Zurück zum Zitat Zhou, Y., Xiang, W., & Wang, G. (2015). Frame loss concealment for multiview video transmission over wireless multimedia sensor networks. IEEE Sensors Journal, 15(3), 1892–1901.CrossRef Zhou, Y., Xiang, W., & Wang, G. (2015). Frame loss concealment for multiview video transmission over wireless multimedia sensor networks. IEEE Sensors Journal, 15(3), 1892–1901.CrossRef
12.
Zurück zum Zitat Lee, P. J., Kuo, K. T., & Chi, C. Y. (2014). An adaptive error concealment method based on fuzzy reasoning for multi-view video coding. Journal of Display Technology, 10(7), 560–567.CrossRef Lee, P. J., Kuo, K. T., & Chi, C. Y. (2014). An adaptive error concealment method based on fuzzy reasoning for multi-view video coding. Journal of Display Technology, 10(7), 560–567.CrossRef
13.
Zurück zum Zitat Xiang, X., Zhao, D., Wang, Q., Ji, X., & Gao, W. (2007). A novel error concealment method for stereoscopic video coding. In Proceedings 2007 IEEE international conference on image processing (ICIP) (pp. 101–104). Xiang, X., Zhao, D., Wang, Q., Ji, X., & Gao, W. (2007). A novel error concealment method for stereoscopic video coding. In Proceedings 2007 IEEE international conference on image processing (ICIP) (pp. 101–104).
14.
Zurück zum Zitat Hwang, M., & Ko, S. (2008). Hybrid temporal error concealment methods for block-based compressed video transmission. IEEE Transactions on Broadcasting, 54(2), 198–207.CrossRef Hwang, M., & Ko, S. (2008). Hybrid temporal error concealment methods for block-based compressed video transmission. IEEE Transactions on Broadcasting, 54(2), 198–207.CrossRef
15.
Zurück zum Zitat Lie, W. N., Lee, C. M., Yeh, C. H., & Gao, Z. W. (2014). Motion vector recovery for video error concealment by using iterative dynamic-programming optimization. IEEE Transactions on Multimedia, 16(1), 216–227.CrossRef Lie, W. N., Lee, C. M., Yeh, C. H., & Gao, Z. W. (2014). Motion vector recovery for video error concealment by using iterative dynamic-programming optimization. IEEE Transactions on Multimedia, 16(1), 216–227.CrossRef
16.
Zurück zum Zitat Gadgil, N., Li H., & Delp, E. J. (2015). Spatial subsampling-based multiple description video coding with adaptive temporal-spatial error concealment. In Proceedings 2015 IEEE picture coding symposium (PCS) (pp. 90–94). Gadgil, N., Li H., & Delp, E. J. (2015). Spatial subsampling-based multiple description video coding with adaptive temporal-spatial error concealment. In Proceedings 2015 IEEE picture coding symposium (PCS) (pp. 90–94).
17.
Zurück zum Zitat Ebdelli, M., Le-Meur, O., & Guillemot, C. (2015). Video inpainting with short-term windows: application to object removal and error concealment. IEEE Transactions on Image Processing, 24(10), 3034–3047.CrossRefMathSciNet Ebdelli, M., Le-Meur, O., & Guillemot, C. (2015). Video inpainting with short-term windows: application to object removal and error concealment. IEEE Transactions on Image Processing, 24(10), 3034–3047.CrossRefMathSciNet
18.
Zurück zum Zitat Yan, B., & Jie, Z. (2012). Efficient frame concealment for depth image-based 3-D video transmission. IEEE Transactions on Multimedia, 14(3), 936–941.CrossRef Yan, B., & Jie, Z. (2012). Efficient frame concealment for depth image-based 3-D video transmission. IEEE Transactions on Multimedia, 14(3), 936–941.CrossRef
19.
Zurück zum Zitat Gao, Z. W., & Lie, W. N. (2004). Video error concealment by using Kalman-filtering technique. In Proceedings of the international symposium on circuits and systems (pp. 69–72). Gao, Z. W., & Lie, W. N. (2004). Video error concealment by using Kalman-filtering technique. In Proceedings of the international symposium on circuits and systems (pp. 69–72).
20.
Zurück zum Zitat Mochn, J., Marchevsk, S., & Gamec, J. (2009). Kalman filter based error concealment algorithm. In Proceedings of 54th Internationales Wissenchaftliches Kolloquium (pp. 1–4). Mochn, J., Marchevsk, S., & Gamec, J. (2009). Kalman filter based error concealment algorithm. In Proceedings of 54th Internationales Wissenchaftliches Kolloquium (pp. 1–4).
21.
Zurück zum Zitat Shihua, C., Cui, H., & Tang, K. (2014). An effective error concealment scheme for heavily corrupted H.264/AVC videos based on Kalman filtering. Signal, Image and Video Processing, 8(8), 1533–1542.CrossRef Shihua, C., Cui, H., & Tang, K. (2014). An effective error concealment scheme for heavily corrupted H.264/AVC videos based on Kalman filtering. Signal, Image and Video Processing, 8(8), 1533–1542.CrossRef
22.
Zurück zum Zitat Wen, N. L., & Guan, H. L. (2013). Error concealment for 3D video transmission. In Proceedings of IEEE international symposium on circuits and systems (ISCAS) (pp. 2856–2559). Wen, N. L., & Guan, H. L. (2013). Error concealment for 3D video transmission. In Proceedings of IEEE international symposium on circuits and systems (ISCAS) (pp. 2856–2559).
23.
Zurück zum Zitat Liu, Y., Wang, J., & Zhang, H. (2010). Depth image-based temporal error concealment for 3-D video transmission. IEEE Transactions on Circuits and Systems for Video Technology, 20(4), 600–604.CrossRef Liu, Y., Wang, J., & Zhang, H. (2010). Depth image-based temporal error concealment for 3-D video transmission. IEEE Transactions on Circuits and Systems for Video Technology, 20(4), 600–604.CrossRef
24.
Zurück zum Zitat Chung, T. Y., Sull, S., & Kim, C. S. (2011). Frame loss concealment for stereoscopic video plus depth sequences. IEEE Transactions on Consumer Electronics, 57(3), 1336–1344.CrossRef Chung, T. Y., Sull, S., & Kim, C. S. (2011). Frame loss concealment for stereoscopic video plus depth sequences. IEEE Transactions on Consumer Electronics, 57(3), 1336–1344.CrossRef
25.
Zurück zum Zitat Hong, C. S., Wang, C. C., Tai, S. C., & Luo, Y. C. (2011). Object-based error concealment in 3D video. In Proceedings of IEEE fifth international conference on genetic and evolutionary computing (ICGEC) (pp. 5–8). Hong, C. S., Wang, C. C., Tai, S. C., & Luo, Y. C. (2011). Object-based error concealment in 3D video. In Proceedings of IEEE fifth international conference on genetic and evolutionary computing (ICGEC) (pp. 5–8).
27.
Zurück zum Zitat ISO/IEC JTC1/SC29/WG11. (2006). Common test conditions for multiview video coding. JVT-U207, Hangzhou, China. ISO/IEC JTC1/SC29/WG11. (2006). Common test conditions for multiview video coding. JVT-U207, Hangzhou, China.
Metadaten
Titel
Enhancement of Wireless 3D Video Communication Using Color-Plus-Depth Error Restoration Algorithms and Bayesian Kalman Filtering
verfasst von
W. El-Shafai
S. El-Rabaie
M. El-Halawany
F. E. Abd El-Samie
Publikationsdatum
22.06.2017
Verlag
Springer US
Erschienen in
Wireless Personal Communications / Ausgabe 1/2017
Print ISSN: 0929-6212
Elektronische ISSN: 1572-834X
DOI
https://doi.org/10.1007/s11277-017-4503-x

Weitere Artikel der Ausgabe 1/2017

Wireless Personal Communications 1/2017 Zur Ausgabe

Neuer Inhalt