Skip to main content
Top

2018 | OriginalPaper | Chapter

5. Functional Lifting for Variational Problems with Higher-Order Regularization

Authors : Benedikt Loewenhauser, Jan Lellmann

Published in: Imaging, Vision and Learning Based on Optimization and PDEs

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Variational approaches are an established paradigm in the field of image processing. The non-convexity of the functional can be addressed by functional lifting and convex relaxation techniques, which aim to solve a convex approximation of the original energy on a larger space. However, so far these approaches have been limited to first-order, gradient-based regularizers such as the total variation. In this work, we propose a way to extend functional lifting to a second-order regularizer derived from the Laplacian. We prove that it can be represented efficiently and thus allows numerical optimization. We experimentally demonstrate the usefulness on a synthetic convex denoising problem and on synthetic as well as real-world image registration problems.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
See [28] and http://​github.​com/​tum-vision/​prost for the most recent version.
 
Literature
1.
go back to reference L. Ambrosio, N. Fusco, D. Pallara, Functions of Bounded Variation and Free Discontinuity Problems (Clarendon Press, Oxford, 2000)MATH L. Ambrosio, N. Fusco, D. Pallara, Functions of Bounded Variation and Free Discontinuity Problems (Clarendon Press, Oxford, 2000)MATH
2.
3.
go back to reference T. Brox, A. Bruhn, N. Papenberg, J. Weickert, High accuracy optical flow estimation based on a theory for warping, in European Conference on Computer Vision (Springer, Berlin, 2004), pp. 25–36MATH T. Brox, A. Bruhn, N. Papenberg, J. Weickert, High accuracy optical flow estimation based on a theory for warping, in European Conference on Computer Vision (Springer, Berlin, 2004), pp. 25–36MATH
4.
go back to reference A. Chambolle, An algorithm for total variation minimization and applications. J. Math. Imag. Vis. 20, 89–97 (2004)MathSciNetCrossRef A. Chambolle, An algorithm for total variation minimization and applications. J. Math. Imag. Vis. 20, 89–97 (2004)MathSciNetCrossRef
5.
go back to reference A. Chambolle, T. Pock, A first-order primal-dual algorithm for convex problems with applications to imaging. J. Math. Imag. Vis. 40(1), 120–145 (2011)MathSciNetCrossRef A. Chambolle, T. Pock, A first-order primal-dual algorithm for convex problems with applications to imaging. J. Math. Imag. Vis. 40(1), 120–145 (2011)MathSciNetCrossRef
6.
7.
go back to reference T. Chan, A. Marquina, P. Mulet, Higher-order total variation-based image restoration. J. Sci. Comput. 22(2), 503–516 (2000)MathSciNetMATH T. Chan, A. Marquina, P. Mulet, Higher-order total variation-based image restoration. J. Sci. Comput. 22(2), 503–516 (2000)MathSciNetMATH
8.
go back to reference T. Chan, S. Esedoḡlu, F. Park, A. Yip, Total variation image restoration: overview and recent developments, in The Handbook of Mathematical Models in Computer Vision (Springer, Berlin, 2005) T. Chan, S. Esedoḡlu, F. Park, A. Yip, Total variation image restoration: overview and recent developments, in The Handbook of Mathematical Models in Computer Vision (Springer, Berlin, 2005)
9.
go back to reference F. Demengel, Fonctions à Hessien borné. Ann. Inst. Fourier 34, 155–190 (1985)CrossRef F. Demengel, Fonctions à Hessien borné. Ann. Inst. Fourier 34, 155–190 (1985)CrossRef
10.
11.
go back to reference W.J. Fu, Penalized regressions: the bridge versus the lasso. J. Comput. Graph. Stat. 7(3), 397–416 (1998)MathSciNet W.J. Fu, Penalized regressions: the bridge versus the lasso. J. Comput. Graph. Stat. 7(3), 397–416 (1998)MathSciNet
12.
go back to reference M. Grant, S. Boyd, Graph implementations for nonsmooth convex programs, in Recent Advances in Learning and Control (Springer, Berlin, 2008), pp. 95–110CrossRef M. Grant, S. Boyd, Graph implementations for nonsmooth convex programs, in Recent Advances in Learning and Control (Springer, Berlin, 2008), pp. 95–110CrossRef
14.
15.
go back to reference W. Hinterberger, O. Scherzer, Variational methods on the space of functions of bounded Hessian for convexification and denoising. Computing 76(1), 109–133 (2006)MathSciNetCrossRef W. Hinterberger, O. Scherzer, Variational methods on the space of functions of bounded Hessian for convexification and denoising. Computing 76(1), 109–133 (2006)MathSciNetCrossRef
16.
go back to reference B.K.P. Horn, B.G. Schunck, Determining optical flow. Artif. Intell. 17, 185–203 (1981)CrossRef B.K.P. Horn, B.G. Schunck, Determining optical flow. Artif. Intell. 17, 185–203 (1981)CrossRef
17.
go back to reference H. Ishikawa, Exact optimization for Markov random fields with convex priors. Pattern. Anal. Mach. Intell. 25(10), 1333–1336 (2003)CrossRef H. Ishikawa, Exact optimization for Markov random fields with convex priors. Pattern. Anal. Mach. Intell. 25(10), 1333–1336 (2003)CrossRef
18.
go back to reference E. Laude, T. Möllenhoff, M. Moeller, J. Lellmann, D. Cremers, Sublabel-accurate convex relaxation of vectorial multilabel energies, in European Conference on Computer Vision (Springer, Berlin, 2016), pp. 614–627 E. Laude, T. Möllenhoff, M. Moeller, J. Lellmann, D. Cremers, Sublabel-accurate convex relaxation of vectorial multilabel energies, in European Conference on Computer Vision (Springer, Berlin, 2016), pp. 614–627
19.
go back to reference J. Lellmann, C. Schnörr, Continuous multiclass labeling approaches and algorithms. SIAM J. Imag. Sci. 4(4), 1049–1096 (2011)MathSciNetCrossRef J. Lellmann, C. Schnörr, Continuous multiclass labeling approaches and algorithms. SIAM J. Imag. Sci. 4(4), 1049–1096 (2011)MathSciNetCrossRef
20.
go back to reference J. Lellmann, J. Kappes, J. Yuan, F. Becker, C. Schnörr, Convex multi-class image labeling by simplex-constrained total variation, in Scale Space and Variational Methods in Computer Vision. Lecture Notes in Computer Science, vol. 5567 (2009), pp. 150–162 J. Lellmann, J. Kappes, J. Yuan, F. Becker, C. Schnörr, Convex multi-class image labeling by simplex-constrained total variation, in Scale Space and Variational Methods in Computer Vision. Lecture Notes in Computer Science, vol. 5567 (2009), pp. 150–162
21.
go back to reference J. Lellmann, E. Strekalovskiy, S. Koetter, D. Cremers, Total variation regularization for functions with values in a manifold, in International Conference on Computer Vision (2013), pp. 2944–2951 J. Lellmann, E. Strekalovskiy, S. Koetter, D. Cremers, Total variation regularization for functions with values in a manifold, in International Conference on Computer Vision (2013), pp. 2944–2951
22.
go back to reference M. Lysaker, X.C. Tai, Iterative image restoration combining total variation minimization and a second-order functional. Int. J. Comput. Vis. 66(1), 5–18 (2006)CrossRef M. Lysaker, X.C. Tai, Iterative image restoration combining total variation minimization and a second-order functional. Int. J. Comput. Vis. 66(1), 5–18 (2006)CrossRef
23.
go back to reference M. Lysaker, A. Lundervold, X.C. Tai, Noise removal using fourth-order partial differential equation with applications to medical magnetic resonance images in space and time. IEEE Trans. Image Process. 12(12), 1579–1590 (2003)CrossRef M. Lysaker, A. Lundervold, X.C. Tai, Noise removal using fourth-order partial differential equation with applications to medical magnetic resonance images in space and time. IEEE Trans. Image Process. 12(12), 1579–1590 (2003)CrossRef
24.
go back to reference J. Modersitzki, Numerical Methods for Image Registration (Oxford University Press on Demand, Oxford, 2004)MATH J. Modersitzki, Numerical Methods for Image Registration (Oxford University Press on Demand, Oxford, 2004)MATH
25.
go back to reference J. Modersitzki, FAIR: Flexible Algorithms for Image Registration (SIAM, Philadelphia, 2009)CrossRef J. Modersitzki, FAIR: Flexible Algorithms for Image Registration (SIAM, Philadelphia, 2009)CrossRef
26.
go back to reference T. Möllenhoff, E. Strekalovskiy, M. Moeller, D. Cremers, The primal-dual hybrid gradient method for semiconvex splittings. SIAM J. Imag. Sci. 8(2), 827–857 (2015)MathSciNetCrossRef T. Möllenhoff, E. Strekalovskiy, M. Moeller, D. Cremers, The primal-dual hybrid gradient method for semiconvex splittings. SIAM J. Imag. Sci. 8(2), 827–857 (2015)MathSciNetCrossRef
27.
go back to reference T. Möllenhoff, E. Strekalovskiy, M. Möller, D. Cremers, Low rank priors for color image regularization, in International Workshop on Energy Minimization Methods in Computer Vision and Pattern Recognition (Springer, Berlin, 2015), pp. 126–140 T. Möllenhoff, E. Strekalovskiy, M. Möller, D. Cremers, Low rank priors for color image regularization, in International Workshop on Energy Minimization Methods in Computer Vision and Pattern Recognition (Springer, Berlin, 2015), pp. 126–140
28.
go back to reference T. Möllenhoff, E. Laude, M. Moeller, J. Lellmann, D. Cremers, Sublabel-accurate relaxation of nonconvex energies, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2016), pp. 3948–3956 T. Möllenhoff, E. Laude, M. Moeller, J. Lellmann, D. Cremers, Sublabel-accurate relaxation of nonconvex energies, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2016), pp. 3948–3956
29.
go back to reference M. Nikolova, Analysis of the recovery of edges in images and signals by minimizing nonconvex regularized least-squares. Multiscale Model. Simul. 4(3), 960–991 (2005)MathSciNetCrossRef M. Nikolova, Analysis of the recovery of edges in images and signals by minimizing nonconvex regularized least-squares. Multiscale Model. Simul. 4(3), 960–991 (2005)MathSciNetCrossRef
30.
go back to reference J. Nocedal, S.J. Wright, Numerical Optimization (Springer, Berlin, 2006)MATH J. Nocedal, S.J. Wright, Numerical Optimization (Springer, Berlin, 2006)MATH
31.
go back to reference K. Papafitsoros, C.B. Schönlieb, A combined first and second order variational approach for image reconstruction. J. Math. Imag. Vision 48(2), 308–338 (2014)MathSciNetCrossRef K. Papafitsoros, C.B. Schönlieb, A combined first and second order variational approach for image reconstruction. J. Math. Imag. Vision 48(2), 308–338 (2014)MathSciNetCrossRef
32.
go back to reference T. Pock, A. Chambolle, D. Cremers, H. Bischof, A convex relaxation approach for computing minimal partitions, in Computer Vision and Pattern Recognition (2009) T. Pock, A. Chambolle, D. Cremers, H. Bischof, A convex relaxation approach for computing minimal partitions, in Computer Vision and Pattern Recognition (2009)
33.
go back to reference T. Pock, D. Cremers, H. Bischof, A. Chambolle, Global solutions of variational models with convex regularization. J. Imag. Sci. 3(4), 1122–1145 (2010)MathSciNetCrossRef T. Pock, D. Cremers, H. Bischof, A. Chambolle, Global solutions of variational models with convex regularization. J. Imag. Sci. 3(4), 1122–1145 (2010)MathSciNetCrossRef
34.
go back to reference R.T. Rockafellar, Convex Analysis (Princeton University Press, Princeton, 1970)CrossRef R.T. Rockafellar, Convex Analysis (Princeton University Press, Princeton, 1970)CrossRef
35.
go back to reference L. Rudin, S. Osher, E. Fatemi, Nonlinear total variation based noise removal algorithms. Physica D 60, 259–268 (1992)MathSciNetCrossRef L. Rudin, S. Osher, E. Fatemi, Nonlinear total variation based noise removal algorithms. Physica D 60, 259–268 (1992)MathSciNetCrossRef
36.
go back to reference S. Setzer, G. Steidl, T. Teuber, Infimal convolution regularizations with discrete l1-type functionals. Commun. Math. Sci 9(3), 797–872 (2011)MathSciNetCrossRef S. Setzer, G. Steidl, T. Teuber, Infimal convolution regularizations with discrete l1-type functionals. Commun. Math. Sci 9(3), 797–872 (2011)MathSciNetCrossRef
37.
go back to reference P. Suquet, Existence et régularité des solutions des équations de la plasticité parfaite. C. R. Acad. Sci. Paris, Ser. A 286, 1201–1204 (1978) P. Suquet, Existence et régularité des solutions des équations de la plasticité parfaite. C. R. Acad. Sci. Paris, Ser. A 286, 1201–1204 (1978)
38.
go back to reference J. Yuan, E. Bae, X.C. Tai, Y. Boykov, A continuous max-flow approach to Potts model, in European Conference on Computer Vision (2010), pp. 379–392 J. Yuan, E. Bae, X.C. Tai, Y. Boykov, A continuous max-flow approach to Potts model, in European Conference on Computer Vision (2010), pp. 379–392
39.
go back to reference C. Zach, D. Gallup, J.M. Frahm, M. Niethammer, Fast global labeling for real-time stereo using multiple plane sweeps, in Vision, Modeling, and Visualization (2008) C. Zach, D. Gallup, J.M. Frahm, M. Niethammer, Fast global labeling for real-time stereo using multiple plane sweeps, in Vision, Modeling, and Visualization (2008)
40.
go back to reference C. Zach, C. Häne, M. Pollefeys, What is optimized in convex relaxations for multilabel problems: connecting discrete and continuously inspired map inference. IEEE Trans. Pattern Anal. Mach. Intell. 36(1), 157–170 (2014)CrossRef C. Zach, C. Häne, M. Pollefeys, What is optimized in convex relaxations for multilabel problems: connecting discrete and continuously inspired map inference. IEEE Trans. Pattern Anal. Mach. Intell. 36(1), 157–170 (2014)CrossRef
41.
Metadata
Title
Functional Lifting for Variational Problems with Higher-Order Regularization
Authors
Benedikt Loewenhauser
Jan Lellmann
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-319-91274-5_5

Premium Partner