Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Published in:
Sentiment-Aware Multi-modal Recommendation on Tourist Attractions Read chapter Read first chapter

2019 | OriginalPaper | Chapter

A Hierarchical Level Set Approach to for RGBD Image Matting

Authors : Wenliang Zeng, Ji Liu

Published in: MultiMedia Modeling

Publisher: Springer International Publishing

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper presents a novel method for the image matting of RGBD data, using a Hierarchical Level Set. The approach has four main steps. First of all, the color and depth channel is preprocessed. Noise is eliminated by using a Directional Joint Bilateral Filter and holes are removed from the depth map. Secondly, color cues and depth cues are integrated to segment the image using a Hierarchical Level Set Framework. After this, the segmentation of the color and depth cues is used to generate a trimap. Finally, an extended alpha matting approach is used to obtain the final matting result, with the color image, depth image and trimap serving as input. Experiments using complex natural images demonstrate that the proposed RGBD matting approach is able to generate good matting results.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
previous chapter Proposal of an Annotation Method for Integrating Musical Technique Knowledge Using a GTTM Time-Span Tree
next chapter A Genetic Programming Approach to Integrate Multilayer CNN Features for Image Classification
Literature
1.
Smith, A.R., Blinn, J.F.: Blue screen matting. In: International Conference on Computer Graphics and Interactive Techniques, pp. 259–268 (1996)
2.
Naqvi, S.S., Browne, W.N., Hollitt, C.: Salient object detection via spectral matting. Pattern Recogn. 51, 209–224 (2016)CrossRef
3.
Chuang, Y., Curless, B., Salesin, D., Szeliski, R.: A Bayesian approach to digital matting, vol. 2, pp. 264–271 (2001)
4.
Sun, J., Jia, J., Tang, C., Shum, H.: Poisson matting. In: International Conference on Computer Graphics and Interactive Techniques (2004)CrossRef
5.
Levin, A., Lischinski, D., Weiss, Y.: A closed-form solution to natural image matting. IEEE Trans. Pattern Anal. Mach. Intell. 30(2), 228–242 (2008)CrossRef
6.
Cho, J., Ziegler, R., Gross, M.H., Lee, K.H.: Improving alpha matte with depth information. IEICE Electron. Express 6(22), 1602–1607 (2009)CrossRef
7.
Gastal, E.S.L., Oliveira, M.M.: Shared sampling for real-time alpha matting. In: Computer Graphics Forum, vol. 29, no. 2, pp. 575–584 (2010)CrossRef
8.
Pollefeys, M., Aksoy, Y., Aydin, T.O.: Designing effective inter-pixel information flow for natural image matting (2017)
9.
Crabb, R., Tracey, C., Puranik, A., Davis, J.: Real-time foreground segmentation via range and color imaging, pp. 1–5 (2008)
10.
Wang, O., Finger, J., Yang, Q., Davis, J., Yang, R.: Automatic natural video matting with depth. In: Pacific Conference on Computer Graphics and Applications, pp. 469–472 (2007)
11.
Pitie, F., Kokaram, A.: Matting with a depth map. In: IEEE International Conference on Image Processing, pp. 21–24 (2010)
12.
Osher, S., Sethian, J.A.: Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations. J. Comput. Phys. 79(1), 12–49 (1988)MathSciNetCrossRef
13.
Xu, L., Sun, W., Au, O.C., et al.: Adaptive depth map assisted matting in 3D video. In: IEEE International Conference on Multimedia and Expo, pp. 1–6 (2011)
14.
Lee, S.W., Seo, Y.H., Yang, H.S.: Efficient foreground extraction using RGB-D imaging. Kluwer Academic Publishers (2016)
15.
Wang, L., Gong, M., Zhang, C., Yang, R., Zhang, C., Yang, Y.H.: Automatic real-time video matting using time-of-flight camera and multichannel poisson equations. Int. J. Comput. Vision 97(1), 104–121 (2012)CrossRef
16.
17.
Lu, T., Li, S.: Image matting with color and depth information, pp. 3787–3790 (2012)
18.
19.
Hao, W., Zheng, S., Guo, C., Xie, Y.: Level set contour extraction based on data-adaptive Gaussian smoother, pp. 11–15 (2012)
20.
Hu, P., Shuai, B., Liu, J., Wang, G.: Deep level sets for salient object detection. In: IEEE Conference on Computer Vision and Pattern Recognition (2017)
21.
Chan, T.F., Vese, L.A.: Active contours without edges. IEEE Trans. Image Process. 10(2), 266–277 (2001)CrossRef
22.
23.
Chen, L., Lin, H., Li, S.: Depth image enhancement for kinect using region growing and bilateral filter. In: International Conference on Pattern Recognition, pp. 3070-3073 (2013)
24.
Le, A.V., Jung, S., Won, C.S.: Directional joint bilateral filter for depth images. Sensors 14(7), 11362–11378 (2014)CrossRef
25.
Jung, S.: Enhancement of image and depth map using adaptive joint trilateral filter. IEEE Trans. Circuits Syst. Video Technol. 23(2), 269–280 (2013)CrossRef
26.
Li, C., Xu, C., Gui, C., Fox, M.D.: Level set evolution without re-initialization: a new variational formulation. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005, vol. 1, pp. 430–436 (2005)
27.
Ju, R., Liu, Y., Ren, T., Ge, L., Wu, G.: Depth-aware salient object detection using anisotropic center-surround difference. Signal Process. Image Commun. 38(C), 115–126 (2015)CrossRef
28.
29.
Varnousfaderani, E.S., Rajan, D.: Weighted color and texture sample selection for image matting. IEEE Trans. Image Process. 22(11), 4260–4270 (2013)MathSciNetCrossRef
30.
Li, C., Wang, P., Zhu, X., Pi, H.: Three-layer graph framework with the sumD feature for alpha matting. Comput. Vis. Image Underst. 162, 34–45 (2017)CrossRef
Metadata
Title
A Hierarchical Level Set Approach to for RGBD Image Matting
Authors
Wenliang Zeng
Ji Liu
Copyright Year
2019
Book
MultiMedia Modeling

Print ISBN: 978-3-030-05709-1

Electronic ISBN: 978-3-030-05710-7

Copyright Year: 2019

DOI
https://doi.org/10.1007/978-3-030-05710-7_52