Skip to main content
Top

2016 | OriginalPaper | Chapter

Sublabel-Accurate Convex Relaxation of Vectorial Multilabel Energies

Authors : Emanuel Laude, Thomas Möllenhoff, Michael Moeller, Jan Lellmann, Daniel Cremers

Published in: Computer Vision – ECCV 2016

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Convex relaxations of multilabel problems have been demonstrated to produce provably optimal or near-optimal solutions to a variety of computer vision problems. Yet, they are of limited practical use as they require a fine discretization of the label space, entailing a huge demand in memory and runtime. In this work, we propose the first sublabel accurate convex relaxation for vectorial multilabel problems. Our key idea is to approximate the dataterm in a piecewise convex (rather than piecewise linear) manner. As a result we have a more faithful approximation of the original cost function that provides a meaningful interpretation for fractional solutions of the relaxed convex problem.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
1.
go back to reference Alberti, G., Bouchitté, G., Maso, G.D.: The calibration method for the Mumford-Shah functional and free-discontinuity problems. Calc. Var. Partial Dif. 3(16), 299–333 (2003)MathSciNetCrossRefMATH Alberti, G., Bouchitté, G., Maso, G.D.: The calibration method for the Mumford-Shah functional and free-discontinuity problems. Calc. Var. Partial Dif. 3(16), 299–333 (2003)MathSciNetCrossRefMATH
2.
go back to reference Ambrosio, L., Fusco, N., Pallara, D.: Functions of bounded variation and free discontinuity problems. Oxford Mathematical Monographs, The Clarendon Press, Oxford University Press, New York (2000)MATH Ambrosio, L., Fusco, N., Pallara, D.: Functions of bounded variation and free discontinuity problems. Oxford Mathematical Monographs, The Clarendon Press, Oxford University Press, New York (2000)MATH
3.
go back to reference Barber, C.B., Dobkin, D.P., Huhdanpaa, H.: The quickhull algorithm for convex hulls. ACM Trans. Math. Softw. (TOMS) 22(4), 469–483 (1996)MathSciNetCrossRefMATH Barber, C.B., Dobkin, D.P., Huhdanpaa, H.: The quickhull algorithm for convex hulls. ACM Trans. Math. Softw. (TOMS) 22(4), 469–483 (1996)MathSciNetCrossRefMATH
4.
5.
go back to reference Fix, A., Agarwal, S.: Duality and the continuous graphical model. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014, Part III. LNCS, vol. 8691, pp. 266–281. Springer, Heidelberg (2014). doi:10.1007/978-3-319-10578-9_18 Fix, A., Agarwal, S.: Duality and the continuous graphical model. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014, Part III. LNCS, vol. 8691, pp. 266–281. Springer, Heidelberg (2014). doi:10.​1007/​978-3-319-10578-9_​18
6.
go back to reference Giaquinta, M., Modica, G., Souček, J.: Cartesian Currents in the Calculus of Variations I, II. Ergebnisse der Mathematik und ihrer Grenzgebiete. 3, vols. 37–38. Springer, Heidelberg (1998) Giaquinta, M., Modica, G., Souček, J.: Cartesian Currents in the Calculus of Variations I, II. Ergebnisse der Mathematik und ihrer Grenzgebiete. 3, vols. 37–38. Springer, Heidelberg (1998)
7.
go back to reference Goldluecke, B., Strekalovskiy, E., Cremers, D.: The natural total variation which arises from geometric measure theory. SIAM J. Imaging Sci. 5(2), 537–563 (2012)MathSciNetCrossRefMATH Goldluecke, B., Strekalovskiy, E., Cremers, D.: The natural total variation which arises from geometric measure theory. SIAM J. Imaging Sci. 5(2), 537–563 (2012)MathSciNetCrossRefMATH
8.
go back to reference Goldluecke, B., Strekalovskiy, E., Cremers, D.: Tight convex relaxations for vector-valued labeling. SIAM J. Imaging Sci. 6(3), 1626–1664 (2013)MathSciNetCrossRefMATH Goldluecke, B., Strekalovskiy, E., Cremers, D.: Tight convex relaxations for vector-valued labeling. SIAM J. Imaging Sci. 6(3), 1626–1664 (2013)MathSciNetCrossRefMATH
9.
go back to reference Ishikawa, H.: Exact optimization for Markov random fields with convex priors. IEEE Trans. Pattern Anal. Mach. Intell. 25(10), 1333–1336 (2003)MathSciNetCrossRef Ishikawa, H.: Exact optimization for Markov random fields with convex priors. IEEE Trans. Pattern Anal. Mach. Intell. 25(10), 1333–1336 (2003)MathSciNetCrossRef
10.
go back to reference Lellmann, J., Schnörr, C.: Continuous multiclass labeling approaches and algorithms. IEEE Trans. Pattern Anal. Mach. Intell. 4(4), 1049–1096 (2011)MathSciNetMATH Lellmann, J., Schnörr, C.: Continuous multiclass labeling approaches and algorithms. IEEE Trans. Pattern Anal. Mach. Intell. 4(4), 1049–1096 (2011)MathSciNetMATH
11.
go back to reference Lellmann, J., Strekalovskiy, E., Koetter, S., Cremers, D.: Total variation regularization for functions with values in a manifold. In: ICCV, December 2013 Lellmann, J., Strekalovskiy, E., Koetter, S., Cremers, D.: Total variation regularization for functions with values in a manifold. In: ICCV, December 2013
12.
go back to reference Möllenhoff, T., Laude, E., Moeller, M., Lellmann, J., Cremers, D.: Sublabel-accurate relaxation of nonconvex energies. In: CVPR (2016) Möllenhoff, T., Laude, E., Moeller, M., Lellmann, J., Cremers, D.: Sublabel-accurate relaxation of nonconvex energies. In: CVPR (2016)
13.
go back to reference Nocedal, J., Wright, S.J.: Numerical Optimization, 2nd edn. Springer, New York (2006)MATH Nocedal, J., Wright, S.J.: Numerical Optimization, 2nd edn. Springer, New York (2006)MATH
14.
go back to reference Pock, T., Cremers, D., Bischof, H., Chambolle, A.: An algorithm for minimizing the piecewise smooth Mumford-Shah functional. In: ICCV (2009) Pock, T., Cremers, D., Bischof, H., Chambolle, A.: An algorithm for minimizing the piecewise smooth Mumford-Shah functional. In: ICCV (2009)
15.
go back to reference Pock, T., Schoenemann, T., Graber, G., Bischof, H., Cremers, D.: A convex formulation of continuous multi-label problems. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part III. LNCS, vol. 5304, pp. 792–805. Springer, Heidelberg (2008)CrossRef Pock, T., Schoenemann, T., Graber, G., Bischof, H., Cremers, D.: A convex formulation of continuous multi-label problems. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part III. LNCS, vol. 5304, pp. 792–805. Springer, Heidelberg (2008)CrossRef
16.
go back to reference Pock, T., Cremers, D., Bischof, H., Chambolle, A.: Global solutions of variational models with convex regularization. IEEE Trans. Pattern Anal. Mach. Intell. 3(4), 1122–1145 (2010)MathSciNetMATH Pock, T., Cremers, D., Bischof, H., Chambolle, A.: Global solutions of variational models with convex regularization. IEEE Trans. Pattern Anal. Mach. Intell. 3(4), 1122–1145 (2010)MathSciNetMATH
18.
go back to reference Rudin, L.I., Osher, S., Fatemi, E.: Nonlinear total variation based noise removal algorithms. IEEE Trans. Pattern Anal. Mach. Intell. 60(1), 259–268 (1992)MathSciNetMATH Rudin, L.I., Osher, S., Fatemi, E.: Nonlinear total variation based noise removal algorithms. IEEE Trans. Pattern Anal. Mach. Intell. 60(1), 259–268 (1992)MathSciNetMATH
19.
go back to reference Sapiro, G., Ringach, D.: Anisotropic diffusion of multivalued images with applications to color filtering. IEEE Trans. Pattern Anal. Mach. Intell. 5(11), 1582–1586 (1996)MATH Sapiro, G., Ringach, D.: Anisotropic diffusion of multivalued images with applications to color filtering. IEEE Trans. Pattern Anal. Mach. Intell. 5(11), 1582–1586 (1996)MATH
20.
go back to reference Strekalovskiy, E., Chambolle, A., Cremers, D.: Convex relaxation of vectorial problems with coupled regularization. IEEE Trans. Pattern Anal. Mach. Intell. 7(1), 294–336 (2014)MathSciNetMATH Strekalovskiy, E., Chambolle, A., Cremers, D.: Convex relaxation of vectorial problems with coupled regularization. IEEE Trans. Pattern Anal. Mach. Intell. 7(1), 294–336 (2014)MathSciNetMATH
21.
go back to reference Zach, C.: Dual decomposition for joint discrete-continuous optimization. In: AISTATS, pp. 632–640 (2013) Zach, C.: Dual decomposition for joint discrete-continuous optimization. In: AISTATS, pp. 632–640 (2013)
22.
go back to reference Zach, C., Kohli, P.: A convex discrete-continuous approach for Markov random fields. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part VI. LNCS, vol. 7577, pp. 386–399. Springer, Heidelberg (2012) Zach, C., Kohli, P.: A convex discrete-continuous approach for Markov random fields. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part VI. LNCS, vol. 7577, pp. 386–399. Springer, Heidelberg (2012)
Metadata
Title
Sublabel-Accurate Convex Relaxation of Vectorial Multilabel Energies
Authors
Emanuel Laude
Thomas Möllenhoff
Michael Moeller
Jan Lellmann
Daniel Cremers
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-46448-0_37

Premium Partner