Skip to main content

2014 | OriginalPaper | Buchkapitel

Active Online Learning for Interactive Segmentation Using Sparse Gaussian Processes

verfasst von : Rudolph Triebel, Jan Stühmer, Mohamed Souiai, Daniel Cremers

Erschienen in: Pattern Recognition

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We present an active learning framework for image segmentation with user interaction. Our system uses a sparse Gaussian Process classifier (GPC) trained on manually labeled image pixels (user scribbles) and refined in every active learning round. As a special feature, our method uses a very efficient online update rule to compute the class predictions in every round. The final segmentation of the image is computed via convex optimization. Results on a standard benchmark data set show that our algorithm is better than a recent state-of-the-art method. We also show that the queries made by the algorithm are more informative compared to randomly increasing the training data, and that our online version is much faster than the standard offline GPC inference.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
These can be either RGB pixel values or a combination of image coordinates and RGB values of the pixels. In our implementation, we use the latter, because it also provides locality information about background and foreground.
 
Literatur
1.
Zurück zum Zitat Boykov, Y., Veksler, O., Zabih, R.: Fast approximate energy minimization via graph cuts. Trans. Patt. Anal. Mach. Intell. 23(11), 1222–1239 (2001)CrossRef Boykov, Y., Veksler, O., Zabih, R.: Fast approximate energy minimization via graph cuts. Trans. Patt. Anal. Mach. Intell. 23(11), 1222–1239 (2001)CrossRef
2.
Zurück zum Zitat Csató, L., Opper, M.: Sparse on-line gaussian processes. Neural Comput. 14(3), 641–668 (2002)CrossRefMATH Csató, L., Opper, M.: Sparse on-line gaussian processes. Neural Comput. 14(3), 641–668 (2002)CrossRefMATH
3.
Zurück zum Zitat Felzenszwalb, P.F., Huttenlocher, D.P.: Efficient graph-based image segmentation. Int. J. Comput. Vis. 59(2), 167–181 (2004)CrossRef Felzenszwalb, P.F., Huttenlocher, D.P.: Efficient graph-based image segmentation. Int. J. Comput. Vis. 59(2), 167–181 (2004)CrossRef
4.
Zurück zum Zitat Kapoor, A., Grauman, K., Urtasun, R., Darrell, T.: Gaussian processes for object categorization. Int. J. Comput. Vis. 88(2), 169–188 (2010)CrossRef Kapoor, A., Grauman, K., Urtasun, R., Darrell, T.: Gaussian processes for object categorization. Int. J. Comput. Vis. 88(2), 169–188 (2010)CrossRef
5.
Zurück zum Zitat Lawrence, N., Seeger, M., Herbrich, R.: Fast sparse gaussian process methods: the informative vector machine. Adv. Neural Inf. Process. Syst. 15, 609–616 (2002) Lawrence, N., Seeger, M., Herbrich, R.: Fast sparse gaussian process methods: the informative vector machine. Adv. Neural Inf. Process. Syst. 15, 609–616 (2002)
6.
Zurück zum Zitat Lawrence, N.D., Platt, J.C., Jordan, M.I.: Extensions of the informative vector machine. In: Winkler, J.R., Niranjan, M., Lawrence, N.D. (eds.) Deterministic and Statistical Methods in Machine Learning. LNCS (LNAI), vol. 3635, pp. 56–87. Springer, Heidelberg (2005)CrossRef Lawrence, N.D., Platt, J.C., Jordan, M.I.: Extensions of the informative vector machine. In: Winkler, J.R., Niranjan, M., Lawrence, N.D. (eds.) Deterministic and Statistical Methods in Machine Learning. LNCS (LNAI), vol. 3635, pp. 56–87. Springer, Heidelberg (2005)CrossRef
7.
Zurück zum Zitat Lombaert, H., Sun, Y., Grady, L., Xu, C.: A multilevel banded graph cuts method for fast image segmentation. In: International Conference on Computer Vision (ICCV), pp. 259–265 (2005) Lombaert, H., Sun, Y., Grady, L., Xu, C.: A multilevel banded graph cuts method for fast image segmentation. In: International Conference on Computer Vision (ICCV), pp. 259–265 (2005)
8.
Zurück zum Zitat Nieuwenhuis, C., Cremers, D.: Spatially varying color distributions for interactive multi-label segmentation. Trans. Patt. Anal. Mach. Intell. 35(5), 1234–1247 (2013)CrossRef Nieuwenhuis, C., Cremers, D.: Spatially varying color distributions for interactive multi-label segmentation. Trans. Patt. Anal. Mach. Intell. 35(5), 1234–1247 (2013)CrossRef
9.
Zurück zum Zitat Nikolova, M., Esedoglu, S., Chan, T.F.: Algorithms for finding global minimizers of image segmentation and denoising models. SIAM J. Appl. Math. 66(5), 1632–1648 (2006)MathSciNetCrossRefMATH Nikolova, M., Esedoglu, S., Chan, T.F.: Algorithms for finding global minimizers of image segmentation and denoising models. SIAM J. Appl. Math. 66(5), 1632–1648 (2006)MathSciNetCrossRefMATH
10.
Zurück zum Zitat Paul, R., Triebel, R., Rus, D., Newman, P.: Semantic categorization of outdoor scenes with uncertainty estimates using multi-class Gaussian process classification. In: Proceedings of the International Conference on Intelligent Robots and Systems (IROS) (2012) Paul, R., Triebel, R., Rus, D., Newman, P.: Semantic categorization of outdoor scenes with uncertainty estimates using multi-class Gaussian process classification. In: Proceedings of the International Conference on Intelligent Robots and Systems (IROS) (2012)
11.
Zurück zum Zitat Pock, T., Cremers, D., Bischof, H., Chambolle, A.: An algorithm for minimizing the piecewise smooth mumford-shah functional. In: International Conference on Computer Vision (ICCV) (2009) Pock, T., Cremers, D., Bischof, H., Chambolle, A.: An algorithm for minimizing the piecewise smooth mumford-shah functional. In: International Conference on Computer Vision (ICCV) (2009)
12.
Zurück zum Zitat Rasmussen, C.E., Williams, C.K.I.: Gaussian Processes for Machine Learning. MIT Press, Cambridge (2006)MATH Rasmussen, C.E., Williams, C.K.I.: Gaussian Processes for Machine Learning. MIT Press, Cambridge (2006)MATH
13.
Zurück zum Zitat Rother, C., Kolmogorov, V., Blake, A.: Grabcut: Interactive foreground extraction using iterated graph cuts. ACM Trans. Graph. (TOG) 23(3), 309–314 (2004)CrossRef Rother, C., Kolmogorov, V., Blake, A.: Grabcut: Interactive foreground extraction using iterated graph cuts. ACM Trans. Graph. (TOG) 23(3), 309–314 (2004)CrossRef
14.
Zurück zum Zitat Santner, J., Pock, T., Bischof, H.: Interactive multi-label segmentation. In: Kimmel, R., Klette, R., Sugimoto, A. (eds.) ACCV 2010, Part I. LNCS, vol. 6492, pp. 397–410. Springer, Heidelberg (2011)CrossRef Santner, J., Pock, T., Bischof, H.: Interactive multi-label segmentation. In: Kimmel, R., Klette, R., Sugimoto, A. (eds.) ACCV 2010, Part I. LNCS, vol. 6492, pp. 397–410. Springer, Heidelberg (2011)CrossRef
15.
Zurück zum Zitat Triebel, R., Grimmett, H., Paul, R., Posner, I.: Driven learning for driving: how introspection improves semantic mapping. In: Proceedings of International Symposium on Robotics Research (ISRR) (2013) Triebel, R., Grimmett, H., Paul, R., Posner, I.: Driven learning for driving: how introspection improves semantic mapping. In: Proceedings of International Symposium on Robotics Research (ISRR) (2013)
16.
Zurück zum Zitat Unger, M., Pock, T., Trobin, W., Cremers, D., Bischof, H.: TVSeg - interactive total variation based image segmentation. In: British Machine Vision Conference (2008) Unger, M., Pock, T., Trobin, W., Cremers, D., Bischof, H.: TVSeg - interactive total variation based image segmentation. In: British Machine Vision Conference (2008)
17.
Zurück zum Zitat Vezhnevets, A., Buhmann, E.J., Ferrari, V.: Active learning for semantic segmentation with expected change. In: Conference on Computer Vision and Pattern Recognition (2012) Vezhnevets, A., Buhmann, E.J., Ferrari, V.: Active learning for semantic segmentation with expected change. In: Conference on Computer Vision and Pattern Recognition (2012)
18.
Zurück zum Zitat Wang, D., Yan, C., Shan, S., Chen, X.: Active learning for interactive segmentation with expected confidence change. In: Lee, K.M., Matsushita, Y., Rehg, J.M., Hu, Z. (eds.) ACCV 2012, Part I. LNCS, vol. 7724, pp. 790–802. Springer, Heidelberg (2013)CrossRef Wang, D., Yan, C., Shan, S., Chen, X.: Active learning for interactive segmentation with expected confidence change. In: Lee, K.M., Matsushita, Y., Rehg, J.M., Hu, Z. (eds.) ACCV 2012, Part I. LNCS, vol. 7724, pp. 790–802. Springer, Heidelberg (2013)CrossRef
Metadaten
Titel
Active Online Learning for Interactive Segmentation Using Sparse Gaussian Processes
verfasst von
Rudolph Triebel
Jan Stühmer
Mohamed Souiai
Daniel Cremers
Copyright-Jahr
2014
DOI
https://doi.org/10.1007/978-3-319-11752-2_53