Skip to main content

2016 | OriginalPaper | Buchkapitel

A Cluster Sampling Method for Image Matting via Sparse Coding

verfasst von : Xiaoxue Feng, Xiaohui Liang, Zili Zhang

Erschienen in: Computer Vision – ECCV 2016

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, we present a new image matting algorithm which solves two major problems encountered by previous sampling-based algorithms. The first is that existing sampling-based approaches typically rely on certain spatial assumptions in collecting samples from known regions, and thus their performance deteriorates if the underlying assumptions are not satisfied. Here, we propose a method that a more representative set of samples is collected so as not to miss out true samples. This is accomplished by clustering the foreground and background pixels and collecting samples from each of the clusters. The second problem is that the quality of matting result is determined by the goodness of a single sample pair which causes errors when sampling-based methods fail to select the best pairs. In this paper, we derive a new objective function for directly obtaining the estimation of the alpha matte from a bunch of samples. Comparison on a standard benchmark dataset demonstrates that the proposed approach generates more robust and accurate alpha matte than state-of-the-art methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Porter, T., Duff, T.: Compositing digital images. In: Proceedings of 11th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1984, pp. 253–259. ACM, New York (1984) Porter, T., Duff, T.: Compositing digital images. In: Proceedings of 11th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1984, pp. 253–259. ACM, New York (1984)
2.
Zurück zum Zitat Levin, A., Lischinski, D., Weiss, Y.: A closed form solution to natural image matting. In: Proceedings of 2006 IEEE Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 61–68, June 2006 Levin, A., Lischinski, D., Weiss, Y.: A closed form solution to natural image matting. In: Proceedings of 2006 IEEE Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 61–68, June 2006
3.
Zurück zum Zitat Levin, A., Rav-Acha, A., Lischinski, D.: Spectral matting. In: 2007 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8, June 2007 Levin, A., Rav-Acha, A., Lischinski, D.: Spectral matting. In: 2007 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8, June 2007
4.
Zurück zum Zitat Juan, O., Keriven, R.: Trimap segmentation for fast and user-friendly alpha matting. In: Paragios, N., Faugeras, O., Chan, T., Schnörr, C. (eds.) VLSM 2005. LNCS, vol. 3752, pp. 186–197. Springer, Heidelberg (2005). doi:10.1007/11567646_16 CrossRef Juan, O., Keriven, R.: Trimap segmentation for fast and user-friendly alpha matting. In: Paragios, N., Faugeras, O., Chan, T., Schnörr, C. (eds.) VLSM 2005. LNCS, vol. 3752, pp. 186–197. Springer, Heidelberg (2005). doi:10.​1007/​11567646_​16 CrossRef
5.
Zurück zum Zitat Sun, J., Jia, J., Tang, C.K., Shum, H.Y.: Poisson matting. ACM Trans. Graph. 23(3), 315–321 (2004)CrossRef Sun, J., Jia, J., Tang, C.K., Shum, H.Y.: Poisson matting. ACM Trans. Graph. 23(3), 315–321 (2004)CrossRef
6.
Zurück zum Zitat Bai, X., Sapiro, G.: A geodesic framework for fast interactive image and video segmentation and matting. In: IEEE 11th International Conference on Computer Vision, pp. 1–8, October 2007 Bai, X., Sapiro, G.: A geodesic framework for fast interactive image and video segmentation and matting. In: IEEE 11th International Conference on Computer Vision, pp. 1–8, October 2007
7.
Zurück zum Zitat Singaraju, D., Rother, C., Rhemann, C.: New appearance models for natural image matting. In: Proceedings of 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 659–666, June 2009 Singaraju, D., Rother, C., Rhemann, C.: New appearance models for natural image matting. In: Proceedings of 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 659–666, June 2009
8.
Zurück zum Zitat He, K., Sun, J., Tang, X.: Fast matting using large kernel matting Laplacian matrices. In: Proceedings of 2010 IEEE Conference on Computer Vision and Pattern Recognition, pp. 2165–2172, June 2010 He, K., Sun, J., Tang, X.: Fast matting using large kernel matting Laplacian matrices. In: Proceedings of 2010 IEEE Conference on Computer Vision and Pattern Recognition, pp. 2165–2172, June 2010
9.
Zurück zum Zitat Rhemann, C., Rother, C., Rav-Acha, A., Sharp, T.: High resolution matting via interactive trimap segmentation. In: Proceedings of 2008 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8, June 2008 Rhemann, C., Rother, C., Rav-Acha, A., Sharp, T.: High resolution matting via interactive trimap segmentation. In: Proceedings of 2008 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8, June 2008
10.
Zurück zum Zitat Chen, Q., Li, D., Tang, C.K.: KNN matting. In: Proceedings of 2012 IEEE Conference on Computer Vision and Pattern Recognition, pp. 869–876, June 2012 Chen, Q., Li, D., Tang, C.K.: KNN matting. In: Proceedings of 2012 IEEE Conference on Computer Vision and Pattern Recognition, pp. 869–876, June 2012
11.
Zurück zum Zitat Chuang, Y.Y., Curless, B., Salesin, D., Szeliski, R.: A Bayesian approach to digital matting. In: Proceedings of 2001 IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 264–271 (2001) Chuang, Y.Y., Curless, B., Salesin, D., Szeliski, R.: A Bayesian approach to digital matting. In: Proceedings of 2001 IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 264–271 (2001)
12.
Zurück zum Zitat Berman, A., Dadourian, A., Vlahos, P.: Method for removing from an image the background surrounding a selected object. US Patent 6134346 (2000) Berman, A., Dadourian, A., Vlahos, P.: Method for removing from an image the background surrounding a selected object. US Patent 6134346 (2000)
13.
Zurück zum Zitat Gastal, E.S.L., Oliveira, M.M.: Shared sampling for real-time alpha matting. Comput. Graph. Forum 29(2), 575–584 (2010)CrossRef Gastal, E.S.L., Oliveira, M.M.: Shared sampling for real-time alpha matting. Comput. Graph. Forum 29(2), 575–584 (2010)CrossRef
14.
Zurück zum Zitat He, K., Rhemann, C., Rother, C., Tang, X., Sun, J.: A global sampling method for alpha matting. In: Proceedings of 2011 IEEE Conference on Computer Vision and Pattern Recognition, pp. 2049–2056, June 2011 He, K., Rhemann, C., Rother, C., Tang, X., Sun, J.: A global sampling method for alpha matting. In: Proceedings of 2011 IEEE Conference on Computer Vision and Pattern Recognition, pp. 2049–2056, June 2011
15.
Zurück zum Zitat Shahrian, E., Rajan, D.: Weighted color and texture sample selection for image matting. In: Proceedings of 2012 IEEE Conference on Computer Vision and Pattern Recognition, pp. 718–725, June 2012 Shahrian, E., Rajan, D.: Weighted color and texture sample selection for image matting. In: Proceedings of 2012 IEEE Conference on Computer Vision and Pattern Recognition, pp. 718–725, June 2012
16.
Zurück zum Zitat Shahrian, E., Rajan, D., Price, B., Cohen, S.: Improving image matting using comprehensive sampling sets. In: Proceedings of 2013 IEEE Conference on Computer Vision and Pattern Recognition, pp. 636–643, June 2013 Shahrian, E., Rajan, D., Price, B., Cohen, S.: Improving image matting using comprehensive sampling sets. In: Proceedings of 2013 IEEE Conference on Computer Vision and Pattern Recognition, pp. 636–643, June 2013
17.
Zurück zum Zitat Johnson, J., Rajan, D., Cholakkal, H.: Sparse codes as alpha matte. In: Proceedings of British Machine Vision Conference. BMVA Press (2014) Johnson, J., Rajan, D., Cholakkal, H.: Sparse codes as alpha matte. In: Proceedings of British Machine Vision Conference. BMVA Press (2014)
18.
Zurück zum Zitat Karacan, L., Erdem, A., Erdem, E.: Image matting with KL-divergence based sparse sampling. In: IEEE 15th International Conference on Computer Vision, pp. 424–432 (2015) Karacan, L., Erdem, A., Erdem, E.: Image matting with KL-divergence based sparse sampling. In: IEEE 15th International Conference on Computer Vision, pp. 424–432 (2015)
19.
Zurück zum Zitat Wang, J., Cohen, M.: An iterative optimization approach for unified image segmentation and matting. In: IEEE 10th International Conference on Computer Vision, vol. 2, pp. 936–943, October 2005 Wang, J., Cohen, M.: An iterative optimization approach for unified image segmentation and matting. In: IEEE 10th International Conference on Computer Vision, vol. 2, pp. 936–943, October 2005
20.
Zurück zum Zitat Guan, Y., Chen, W., Liang, X., Ding, Z., Peng, Q.: Easy matting - a stroke based approach for continuous image matting. Comput. Graph. Forum 25, 567–576 (2006)CrossRef Guan, Y., Chen, W., Liang, X., Ding, Z., Peng, Q.: Easy matting - a stroke based approach for continuous image matting. Comput. Graph. Forum 25, 567–576 (2006)CrossRef
21.
Zurück zum Zitat Wang, J., Cohen, M.: Optimized color sampling for robust matting. In: Proceedings of 2007 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8, June 2007 Wang, J., Cohen, M.: Optimized color sampling for robust matting. In: Proceedings of 2007 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8, June 2007
22.
Zurück zum Zitat Chen, X., Zou, D., Zhou, S., Zhao, Q., Tan, P.: Image matting with local and nonlocal smooth priors. In: Proceedings of 2013 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1902–1907, June 2013 Chen, X., Zou, D., Zhou, S., Zhao, Q., Tan, P.: Image matting with local and nonlocal smooth priors. In: Proceedings of 2013 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1902–1907, June 2013
23.
Zurück zum Zitat Zhu, Q., Shao, L., Li, X., Wang, L.: Targeting accurate object extraction from an image: a comprehensive study of natural image matting. IEEE Trans. Neural Netw. Learn. Syst. 26(2), 185–207 (2015)MathSciNetCrossRef Zhu, Q., Shao, L., Li, X., Wang, L.: Targeting accurate object extraction from an image: a comprehensive study of natural image matting. IEEE Trans. Neural Netw. Learn. Syst. 26(2), 185–207 (2015)MathSciNetCrossRef
24.
Zurück zum Zitat Hartigan, J.A., Wong, M.A.: A k-means clustering algorithm. Appl. Stat. 28(1), 100–108 (1979)CrossRefMATH Hartigan, J.A., Wong, M.A.: A k-means clustering algorithm. Appl. Stat. 28(1), 100–108 (1979)CrossRefMATH
25.
Zurück zum Zitat Chen, Y., Mairal, J., Harchaoui, Z.: Fast and robust archetypal analysis for representation learning. CoRR abs/1405.6472 (2014) Chen, Y., Mairal, J., Harchaoui, Z.: Fast and robust archetypal analysis for representation learning. CoRR abs/1405.6472 (2014)
26.
Zurück zum Zitat Bach, F., Jenatton, R., Mairal, J., Obozinski, G.: Optimization with sparsity-inducing penalties. Found. Trends Mach. Learn. 4(1), 1–106 (2012)CrossRefMATH Bach, F., Jenatton, R., Mairal, J., Obozinski, G.: Optimization with sparsity-inducing penalties. Found. Trends Mach. Learn. 4(1), 1–106 (2012)CrossRefMATH
27.
Zurück zum Zitat Rhemann, C., Rother, C., Wang, J., Gelautz, M., Kohli, P., Rott, P.: A perceptually motivated online benchmark for image matting. In: Proceedings of 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1826–1833, June 2009 Rhemann, C., Rother, C., Wang, J., Gelautz, M., Kohli, P., Rott, P.: A perceptually motivated online benchmark for image matting. In: Proceedings of 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1826–1833, June 2009
Metadaten
Titel
A Cluster Sampling Method for Image Matting via Sparse Coding
verfasst von
Xiaoxue Feng
Xiaohui Liang
Zili Zhang
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-46475-6_13