Skip to main content

2015 | OriginalPaper | Buchkapitel

Hole Filling Algorithm Using Spatial-Temporal Background Depth Map for View Synthesis in Free View Point Television

verfasst von : Huu Noi Doan, Beomsu Kim, Min-Cheol Hong

Erschienen in: Advances in Multimedia Information Processing -- PCM 2015

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper presents a new hole filling algorithm based on background modeling and texture synthesis. Depth information of hole areas is computed by using a local background estimation method. In order to exploit the correlation between frames in temporal domain, a background modeling method is used to extract reliable background reference scenes. The holes are then filled by combining the temporal background information and the estimated depth information. A modified exemplar-based inpainting method is used to fill remaining hole pixels. Experimental results demonstrate the capability of the proposed algorithm.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Smolic, A., Kauff, P., Knorr, S., Hornung, A., Kunter, M., Muller, M., Lang, M.: Three-dimensional video postproduction and processing. Proc. IEEE 99(4), 607–625 (2011)CrossRef Smolic, A., Kauff, P., Knorr, S., Hornung, A., Kunter, M., Muller, M., Lang, M.: Three-dimensional video postproduction and processing. Proc. IEEE 99(4), 607–625 (2011)CrossRef
2.
Zurück zum Zitat Muller, K., Merkle, P., Tech, G., Wiegand, T.: 3D video formats and coding methods. In: IEEE International ConferenceImage Processing, pp. 2339–2392 (2010) Muller, K., Merkle, P., Tech, G., Wiegand, T.: 3D video formats and coding methods. In: IEEE International ConferenceImage Processing, pp. 2339–2392 (2010)
3.
Zurück zum Zitat Dodgson, N.A.: Autostereoscopic 3D displays. Computer 38(8), 31–36 (2005)CrossRef Dodgson, N.A.: Autostereoscopic 3D displays. Computer 38(8), 31–36 (2005)CrossRef
4.
Zurück zum Zitat Fehn, C.: Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3DTV. In: SPIE Proceedings of the Stereoscopic Image Process and Rendering, pp. 93–104 (2004) Fehn, C.: Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3DTV. In: SPIE Proceedings of the Stereoscopic Image Process and Rendering, pp. 93–104 (2004)
5.
Zurück zum Zitat Zinger, S., Ruijters, D., Do, L., de With, P.H.N.: View interpolation for medical images on autostereoscopic displays. IEEE Trans. Circuits Syst. Video Technol. 22(1), 128–137 (2012)CrossRef Zinger, S., Ruijters, D., Do, L., de With, P.H.N.: View interpolation for medical images on autostereoscopic displays. IEEE Trans. Circuits Syst. Video Technol. 22(1), 128–137 (2012)CrossRef
6.
Zurück zum Zitat Zhang, L., Tam, W.J.: Stereoscopic image generation based on depth images for 3D TV. IEEE Trans. Broadcast. 51(2), 191–199 (2005)CrossRef Zhang, L., Tam, W.J.: Stereoscopic image generation based on depth images for 3D TV. IEEE Trans. Broadcast. 51(2), 191–199 (2005)CrossRef
7.
Zurück zum Zitat Lee, P.-J.: Effendi: nongeometric distortion smoothing approach for depth map preprocessing. IEEE Trans. Multimedia 13(2), 246–254 (2011)CrossRef Lee, P.-J.: Effendi: nongeometric distortion smoothing approach for depth map preprocessing. IEEE Trans. Multimedia 13(2), 246–254 (2011)CrossRef
8.
Zurück zum Zitat Zinger, S., Do, L., de With, P.H.N.: Free-viewpoint depth image based rendering. J. Vis. Commun. Image Represent. 21(5–6), 533–541 (2010)CrossRef Zinger, S., Do, L., de With, P.H.N.: Free-viewpoint depth image based rendering. J. Vis. Commun. Image Represent. 21(5–6), 533–541 (2010)CrossRef
9.
Zurück zum Zitat Doan, H.N., Nguyen, T.A., Kim, B., Hong, M.-C.: Directional hole filling algorithm in new view synthesis for 3D video using local segmentation. In: ACM International Conference Research in Adaptive and Convergent Systems, pp. 100–104, MD, USA (2014) Doan, H.N., Nguyen, T.A., Kim, B., Hong, M.-C.: Directional hole filling algorithm in new view synthesis for 3D video using local segmentation. In: ACM International Conference Research in Adaptive and Convergent Systems, pp. 100–104, MD, USA (2014)
10.
Zurück zum Zitat Solh, M., Alregib, G.: Hierarchical hole-filling for depth-based view synthesis in FTV and 3D video. IEEE. J. Sel. Top. Signal 6(5), 495–504 (2012)CrossRef Solh, M., Alregib, G.: Hierarchical hole-filling for depth-based view synthesis in FTV and 3D video. IEEE. J. Sel. Top. Signal 6(5), 495–504 (2012)CrossRef
11.
Zurück zum Zitat Oh, K., Yea, S., Ho, Y.-S.: Hole filling method using depth based in-painting for view synthesis in free viewpoint television and 3-D video. In: Picture Coding Symposium, pp. 1–4 (2009) Oh, K., Yea, S., Ho, Y.-S.: Hole filling method using depth based in-painting for view synthesis in free viewpoint television and 3-D video. In: Picture Coding Symposium, pp. 1–4 (2009)
12.
Zurück zum Zitat Marcelo, B., Guillermo, S., Vincent, C., Coloma, B.: Image inpainting. In: The 27th Annual Conference on Computer Graphics and Interactive Techniques, pp. 417–424 (2000) Marcelo, B., Guillermo, S., Vincent, C., Coloma, B.: Image inpainting. In: The 27th Annual Conference on Computer Graphics and Interactive Techniques, pp. 417–424 (2000)
13.
Zurück zum Zitat Criminisi, A., Perez, P., Toyama, K.: Object removal by exemplar-based inpainting. In: IEEE International Conference Computer Vision and Pattern Recognition, vol. 2, pp. 721–728 (2003) Criminisi, A., Perez, P., Toyama, K.: Object removal by exemplar-based inpainting. In: IEEE International Conference Computer Vision and Pattern Recognition, vol. 2, pp. 721–728 (2003)
14.
Zurück zum Zitat Ming, X., Wang, L.-H., Yang, Q.-Q., Li, D.-X., Zhang, M.: Depth-image-based rendering with spatial and temporal texture synthesis for 3DTV. EURASIP J. Image Video Process. 2013(1), 1–18 (2013)CrossRef Ming, X., Wang, L.-H., Yang, Q.-Q., Li, D.-X., Zhang, M.: Depth-image-based rendering with spatial and temporal texture synthesis for 3DTV. EURASIP J. Image Video Process. 2013(1), 1–18 (2013)CrossRef
15.
Zurück zum Zitat Koppel, M., Wang, W., Doshkov, D., Wiegand, T., Ndjiki-Nya, P.: Consistent spatio-temporal filling of disocclusions in the multiview-video-plus-depth format. In: IEEE International Workshop Multimedia Signal Processing, pp. 25–30 (2012) Koppel, M., Wang, W., Doshkov, D., Wiegand, T., Ndjiki-Nya, P.: Consistent spatio-temporal filling of disocclusions in the multiview-video-plus-depth format. In: IEEE International Workshop Multimedia Signal Processing, pp. 25–30 (2012)
16.
Zurück zum Zitat Yao, C., Tillo, T., Jimin, X.: Depth map driven hole filling algorithm exploiting temporal correlation information. IEEE Trans. Broadcast. 60(2), 394–404 (2014)CrossRef Yao, C., Tillo, T., Jimin, X.: Depth map driven hole filling algorithm exploiting temporal correlation information. IEEE Trans. Broadcast. 60(2), 394–404 (2014)CrossRef
17.
Zurück zum Zitat Kim, K., Chalidabhongse, T.H., Harwood, D., Davis, L.: Background modeling and subtraction by codebook construction. IEEE Int. Conf. Image Process. 5, 3061–3064 (2004) Kim, K., Chalidabhongse, T.H., Harwood, D., Davis, L.: Background modeling and subtraction by codebook construction. IEEE Int. Conf. Image Process. 5, 3061–3064 (2004)
18.
Zurück zum Zitat Fernandez-Sanchez, E.J., Javier, D., Eduardo, R.: Background subtraction based on color and depth using active sensors. Sensors 13(7), 8895–8915 (2013)CrossRef Fernandez-Sanchez, E.J., Javier, D., Eduardo, R.: Background subtraction based on color and depth using active sensors. Sensors 13(7), 8895–8915 (2013)CrossRef
19.
Zurück zum Zitat Glassner, A.S. (ed.): Graphics Gems I. Academic Press, Cambridge (1990)MATH Glassner, A.S. (ed.): Graphics Gems I. Academic Press, Cambridge (1990)MATH
Metadaten
Titel
Hole Filling Algorithm Using Spatial-Temporal Background Depth Map for View Synthesis in Free View Point Television
verfasst von
Huu Noi Doan
Beomsu Kim
Min-Cheol Hong
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-24078-7_61

Neuer Inhalt