Skip to main content
Erschienen in: Optimization and Engineering 4/2017

03.06.2017

Difference of convex functions algorithms (DCA) for image restoration via a Markov random field model

verfasst von: Hoai An Le Thi, Tao Pham Dinh

Erschienen in: Optimization and Engineering | Ausgabe 4/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, we introduce a novel approach in the nonconvex optimization framework for image restoration via a Markov random field (MRF) model. While image restoration is elegantly expressed in the language of MRF’s, the resulting energy minimization problem was widely viewed as intractable: it exhibits a highly nonsmooth nonconvex energy function with many local minima, and is known to be NP-hard. The main goal of this paper is to develop fast and scalable approximation optimization approaches to a nonsmooth nonconvex MRF model which corresponds to an MRF with a truncated quadratic (also known as half-quadratic) prior. For this aim, we use the difference of convex functions (DC) programming and DC algorithm (DCA), a fast and robust approach in smooth/nonsmooth nonconvex programming, which have been successfully applied in various fields in recent years. We propose two DC formulations and investigate the two corresponding versions of DCA. Numerical simulations show the efficiency, reliability and robustness of our customized DCAs with respect to the standard GNC algorithm and the Graph-Cut based method—a more recent and efficient approach to image analysis.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
Zurück zum Zitat Azencott R (1987) Markov fields and image analysis. In: Proceedings on AFCET, Antibes, France Azencott R (1987) Markov fields and image analysis. In: Proceedings on AFCET, Antibes, France
Zurück zum Zitat Blake A, Zisserman A (1987) Visual reconstruction. MIT Press, Cambridge Blake A, Zisserman A (1987) Visual reconstruction. MIT Press, Cambridge
Zurück zum Zitat Boykov Y, Veksler O, Zabih R (2001) Fast approximate energy minimization via graph cuts. PAMI 23(11):1222–1239CrossRef Boykov Y, Veksler O, Zabih R (2001) Fast approximate energy minimization via graph cuts. PAMI 23(11):1222–1239CrossRef
Zurück zum Zitat Chan TF, Esedoglu S, Nikolova M (2006) Algorithm for finding global minimizers of image segmentation and denoising models. SIAM Appl Math 66(5):1632–1648CrossRefMATHMathSciNet Chan TF, Esedoglu S, Nikolova M (2006) Algorithm for finding global minimizers of image segmentation and denoising models. SIAM Appl Math 66(5):1632–1648CrossRefMATHMathSciNet
Zurück zum Zitat Czyzyk J, Mesnier MP, Mor JJ (1998) The NEOS server. IEEE Comput Sci Eng 5(3):68–75CrossRef Czyzyk J, Mesnier MP, Mor JJ (1998) The NEOS server. IEEE Comput Sci Eng 5(3):68–75CrossRef
Zurück zum Zitat Dolan ED (2001) N.E.O.S. server. 4.0 administrative guide. Technical Memorandum ANL/MCS-TM-250, Argonne National Laboratory, Argonne, IL Dolan ED (2001) N.E.O.S. server. 4.0 administrative guide. Technical Memorandum ANL/MCS-TM-250, Argonne National Laboratory, Argonne, IL
Zurück zum Zitat Geiger D, Girosi F (1991) Parallel and deterministic algorithms for MRFs: surface reconstruction. IEEE Trans Pattern Anal Mach Intell PAMI 13:401–412CrossRef Geiger D, Girosi F (1991) Parallel and deterministic algorithms for MRFs: surface reconstruction. IEEE Trans Pattern Anal Mach Intell PAMI 13:401–412CrossRef
Zurück zum Zitat Geman S, Geman D (1984) Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Trans Pattern Anal Mach Intell PAMI 6:721–741CrossRefMATH Geman S, Geman D (1984) Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Trans Pattern Anal Mach Intell PAMI 6:721–741CrossRefMATH
Zurück zum Zitat Golub GH, Van Loan CF (1996) Matrix computations. Johns Hopkins University Press, BaltimoreMATH Golub GH, Van Loan CF (1996) Matrix computations. Johns Hopkins University Press, BaltimoreMATH
Zurück zum Zitat Gropp W, Moré JJ (1997) Optimization environments and the NEOS server. In: Buhmann MD, Iserles A (eds) Approximation theory and optimization. Cambridge University Press, pp 167–182 Gropp W, Moré JJ (1997) Optimization environments and the NEOS server. In: Buhmann MD, Iserles A (eds) Approximation theory and optimization. Cambridge University Press, pp 167–182
Zurück zum Zitat Jensen JB, Nielsen M (1992) A simple genetic algorithm applied to discontinuous regularization. In: Proceedings IEEE workshop on NNSP, Copenhagen, 29 Aug–2 Sept Jensen JB, Nielsen M (1992) A simple genetic algorithm applied to discontinuous regularization. In: Proceedings IEEE workshop on NNSP, Copenhagen, 29 Aug–2 Sept
Zurück zum Zitat Komodakis N, Tziritas G (2007) Approximate labeling via graph cuts based on linear programming. IEEE Trans Pattern Anal Mach Intell 29(8):1436–1453CrossRef Komodakis N, Tziritas G (2007) Approximate labeling via graph cuts based on linear programming. IEEE Trans Pattern Anal Mach Intell 29(8):1436–1453CrossRef
Zurück zum Zitat Komodakis N, Paragios N, Tziritas G (2008) Performance vs computational efficiency for optimizing single and dynamic MRFs: setting the state of the art with primal dual strategies. In: CVIU Komodakis N, Paragios N, Tziritas G (2008) Performance vs computational efficiency for optimizing single and dynamic MRFs: setting the state of the art with primal dual strategies. In: CVIU
Zurück zum Zitat Le Thi HA (1997) Contribution à l’optimisation non convexe et l’optimisation globale: Théorie, Algoritmes et Applications, Habilitation à Diriger des Recherches. Université de Rouen Le Thi HA (1997) Contribution à l’optimisation non convexe et l’optimisation globale: Théorie, Algoritmes et Applications, Habilitation à Diriger des Recherches. Université de Rouen
Zurück zum Zitat Le Thi HA (2000) An efficient algorithm for globally minimizing a quadratic function under convex quadratic constraints. Math Program Ser A 87(3):401–426CrossRefMATHMathSciNet Le Thi HA (2000) An efficient algorithm for globally minimizing a quadratic function under convex quadratic constraints. Math Program Ser A 87(3):401–426CrossRefMATHMathSciNet
Zurück zum Zitat Le Thi HA, Nguyen MC (2014) Self-organizing maps by difference of convex functions optimization. Data Min Knowl Discov 28(5–6):1336–1365CrossRefMATHMathSciNet Le Thi HA, Nguyen MC (2014) Self-organizing maps by difference of convex functions optimization. Data Min Knowl Discov 28(5–6):1336–1365CrossRefMATHMathSciNet
Zurück zum Zitat Le Thi HA, Pham Dinh T (1997) Solving a class of linearly constrained indefinite quadratic problems by DC algorithms. J Glob Optim 11(3):253–285CrossRefMATH Le Thi HA, Pham Dinh T (1997) Solving a class of linearly constrained indefinite quadratic problems by DC algorithms. J Glob Optim 11(3):253–285CrossRefMATH
Zurück zum Zitat Le Thi HA, Pham Dinh T (2003) Large scale molecular optimization from distance matrices by a DC optimization approach. SIAM J Optim 14(1):77–116CrossRefMATHMathSciNet Le Thi HA, Pham Dinh T (2003) Large scale molecular optimization from distance matrices by a DC optimization approach. SIAM J Optim 14(1):77–116CrossRefMATHMathSciNet
Zurück zum Zitat Le Thi HA, Pham Dinh T (2005) The DC (difference of convex functions) programming and DCA revisited with DC models of real world nonconvex optimization problems. Ann Oper Res 133:23–46CrossRefMATHMathSciNet Le Thi HA, Pham Dinh T (2005) The DC (difference of convex functions) programming and DCA revisited with DC models of real world nonconvex optimization problems. Ann Oper Res 133:23–46CrossRefMATHMathSciNet
Zurück zum Zitat Le Thi HA, Le HM, Pham Dinh T (2007a) Optimization based DC programming and DCA for hierarchical clustering. Eur J Oper Res 183(3):1067–1085CrossRefMATHMathSciNet Le Thi HA, Le HM, Pham Dinh T (2007a) Optimization based DC programming and DCA for hierarchical clustering. Eur J Oper Res 183(3):1067–1085CrossRefMATHMathSciNet
Zurück zum Zitat Le Thi HA, Belghiti T, Pham Dinh T (2007b) A new efficient algorithm based on DC programming and DCA for clustering. J Glob Optim 37:593–608CrossRefMATHMathSciNet Le Thi HA, Belghiti T, Pham Dinh T (2007b) A new efficient algorithm based on DC programming and DCA for clustering. J Glob Optim 37:593–608CrossRefMATHMathSciNet
Zurück zum Zitat Le Thi HA, Huynh VN, Pham Dinh T (2009) Convergence Analysis of DC Algorithms for DC programming with subanalytic data. Research Report. National Institute for Applied Sciences, Rouen, France Le Thi HA, Huynh VN, Pham Dinh T (2009) Convergence Analysis of DC Algorithms for DC programming with subanalytic data. Research Report. National Institute for Applied Sciences, Rouen, France
Zurück zum Zitat Le Thi HA, Le HM, Pham Dinh T, Huynh VN (2013) Binary classification via spherical separator by DC programming and DCA. J Glob Optim 56(4):1393–1407CrossRefMATHMathSciNet Le Thi HA, Le HM, Pham Dinh T, Huynh VN (2013) Binary classification via spherical separator by DC programming and DCA. J Glob Optim 56(4):1393–1407CrossRefMATHMathSciNet
Zurück zum Zitat Le Thi HA, Huynh VN, Pham Dinh T (2014a) DC programming and DCA for solving general DC programs. In: Proceedings of 2nd international conference on computer science, applied mathematics and applications (ICCSAMA 2014), advances in intelligent systems and computing, vol 282, pp 15–35. Springer Le Thi HA, Huynh VN, Pham Dinh T (2014a) DC programming and DCA for solving general DC programs. In: Proceedings of 2nd international conference on computer science, applied mathematics and applications (ICCSAMA 2014), advances in intelligent systems and computing, vol 282, pp 15–35. Springer
Zurück zum Zitat Le Thi HA, Le HM, Pham Dinh T (2014b) New and efficient DCA based algorithms for minimum sum-of-squares clustering. Pattern Recognit 47(1):388–401CrossRefMATH Le Thi HA, Le HM, Pham Dinh T (2014b) New and efficient DCA based algorithms for minimum sum-of-squares clustering. Pattern Recognit 47(1):388–401CrossRefMATH
Zurück zum Zitat Le Thi HA, Vo XT, Pham Dinh T (2014c) Feature selection for linear SVMs under uncertain data: robust optimization based on difference of convex functions algorithms. Neural Netw 59:36–50CrossRefMATH Le Thi HA, Vo XT, Pham Dinh T (2014c) Feature selection for linear SVMs under uncertain data: robust optimization based on difference of convex functions algorithms. Neural Netw 59:36–50CrossRefMATH
Zurück zum Zitat Le Thi HA, Nguyen MC, Pham Dinh T (2014d) A DC programming approach for finding communities in networks. Neural Comput 26(12):2827–2854CrossRefMathSciNet Le Thi HA, Nguyen MC, Pham Dinh T (2014d) A DC programming approach for finding communities in networks. Neural Comput 26(12):2827–2854CrossRefMathSciNet
Zurück zum Zitat Le Thi HA, Le HM, Pham Dinh T (2015a) Feature selection in machine learning: an exact penalty approach using a difference of convex function algorithm. Mach Learn 101(1):163–186CrossRefMATHMathSciNet Le Thi HA, Le HM, Pham Dinh T (2015a) Feature selection in machine learning: an exact penalty approach using a difference of convex function algorithm. Mach Learn 101(1):163–186CrossRefMATHMathSciNet
Zurück zum Zitat Le Thi HA, Pham Dinh T, Le HM, Vo XT (2015b) DC approximation approaches for sparse optimization. Eur J Oper Res 244(1):26–46CrossRefMATHMathSciNet Le Thi HA, Pham Dinh T, Le HM, Vo XT (2015b) DC approximation approaches for sparse optimization. Eur J Oper Res 244(1):26–46CrossRefMATHMathSciNet
Zurück zum Zitat Liu Y, Shen X, Doss H (2005) Multicategory \(\psi\)-learning and support vector machine. J Comput Graph Stat 14:219–236CrossRefMathSciNet Liu Y, Shen X, Doss H (2005) Multicategory \(\psi\)-learning and support vector machine. J Comput Graph Stat 14:219–236CrossRefMathSciNet
Zurück zum Zitat Neumann J, Schnörr C, Steidl G (2005) Combined SVM-based feature selection and classification. Mach Learn 61(1–3):129–150CrossRefMATH Neumann J, Schnörr C, Steidl G (2005) Combined SVM-based feature selection and classification. Mach Learn 61(1–3):129–150CrossRefMATH
Zurück zum Zitat Nielsen M (1993) Graduated non-convexity by smoothness focusing. Technical report 18-5-93. University of Copenhagen, DIKU Nielsen M (1993) Graduated non-convexity by smoothness focusing. Technical report 18-5-93. University of Copenhagen, DIKU
Zurück zum Zitat Nikolova M (2004) Weakly constrained minimization: application to the estimation of images and signals involving constant regions. J Math Imaging Vis 21:155–175CrossRefMathSciNet Nikolova M (2004) Weakly constrained minimization: application to the estimation of images and signals involving constant regions. J Math Imaging Vis 21:155–175CrossRefMathSciNet
Zurück zum Zitat Nikolova M (2005) Analysis of the recovery of edges in images and signals by minimizing nonconvex regularized least-squares. Multiscale Model Simul 4(3):960–991CrossRefMATHMathSciNet Nikolova M (2005) Analysis of the recovery of edges in images and signals by minimizing nonconvex regularized least-squares. Multiscale Model Simul 4(3):960–991CrossRefMATHMathSciNet
Zurück zum Zitat Nikolova M, Ng MK (2005) Analysis of half-quadratic minimization methods for signal and image recovery. SIAM J Sci Comput 27(3):937–966CrossRefMATHMathSciNet Nikolova M, Ng MK (2005) Analysis of half-quadratic minimization methods for signal and image recovery. SIAM J Sci Comput 27(3):937–966CrossRefMATHMathSciNet
Zurück zum Zitat Pham Dinh T (1984) Méthode de décomposition pour la minimisation d’une forme quadratique convexe en grande dimension. Sé minaire d’Analyse Numérique Univ. Grenoble, France Pham Dinh T (1984) Méthode de décomposition pour la minimisation d’une forme quadratique convexe en grande dimension. Sé minaire d’Analyse Numérique Univ. Grenoble, France
Zurück zum Zitat Pham Dinh T, Le Thi Hoai An (1997) Convex analysis approach to DC programming: theory, algorithms and applications. Acta Math Vietnam 22(1):289–357 (Dedicated to Professor Hoang Tuy on the occasion of his 70th birthday)MATHMathSciNet Pham Dinh T, Le Thi Hoai An (1997) Convex analysis approach to DC programming: theory, algorithms and applications. Acta Math Vietnam 22(1):289–357 (Dedicated to Professor Hoang Tuy on the occasion of his 70th birthday)MATHMathSciNet
Zurück zum Zitat Pham Dinh T, Le Thi HA (2002) DC programming. Theory, algorithms, applications: the state of the art. In: First international workshop on global constrained optimization and constraint satisfaction. Valbonne-Sophia Antipolis, 2–4 Oct Pham Dinh T, Le Thi HA (2002) DC programming. Theory, algorithms, applications: the state of the art. In: First international workshop on global constrained optimization and constraint satisfaction. Valbonne-Sophia Antipolis, 2–4 Oct
Zurück zum Zitat Pham Dinh T, Le Thi HA (2014) Recent advances in DC programming and DCA. Trans Comput Collect Intell 8342:1–37 Pham Dinh T, Le Thi HA (2014) Recent advances in DC programming and DCA. Trans Comput Collect Intell 8342:1–37
Zurück zum Zitat Pham Dinh T, Le Thi HA, Akoa François (2009) Combining DCA and interior point techniques for large-scale nonconvex quadratic programming. Optim Methods Softw 23(4):609–629CrossRefMATHMathSciNet Pham Dinh T, Le Thi HA, Akoa François (2009) Combining DCA and interior point techniques for large-scale nonconvex quadratic programming. Optim Methods Softw 23(4):609–629CrossRefMATHMathSciNet
Zurück zum Zitat Portilla J, Simoncelli EP (2000) Image denoising via adjustment of wavelet coefficient magnitude correlation. In: Proceedings of the 7th international conference on image processing, Vancouver, BC, Canada. IEEE Computer Society, 10–13 Sept Portilla J, Simoncelli EP (2000) Image denoising via adjustment of wavelet coefficient magnitude correlation. In: Proceedings of the 7th international conference on image processing, Vancouver, BC, Canada. IEEE Computer Society, 10–13 Sept
Zurück zum Zitat Rangarajan A, Chellappa R (1990) Generalized graduated non-convexity algorithm for maximum a posteriori image estimation. In: Proceedings on ICPR, pp 127–133 Rangarajan A, Chellappa R (1990) Generalized graduated non-convexity algorithm for maximum a posteriori image estimation. In: Proceedings on ICPR, pp 127–133
Zurück zum Zitat Ronan C, Fabian S, Jason W, Bottou L (2006) Trading convexity for scalability. In: International conference on machine learning ICML Ronan C, Fabian S, Jason W, Bottou L (2006) Trading convexity for scalability. In: International conference on machine learning ICML
Zurück zum Zitat Saad Y (2003) Iterative methods for sparse linear systems, 2nd edn. SIAM, PhiladelphiaCrossRefMATH Saad Y (2003) Iterative methods for sparse linear systems, 2nd edn. SIAM, PhiladelphiaCrossRefMATH
Zurück zum Zitat Shen X, Tseng GC, Zhang X, Wong WH (2003) \(\psi\)-Learning. J Am Stat Assoc 98:724–734CrossRefMATH Shen X, Tseng GC, Zhang X, Wong WH (2003) \(\psi\)-Learning. J Am Stat Assoc 98:724–734CrossRefMATH
Zurück zum Zitat Simchony T, Chellappa R, Lichtenstein Z (1989) Pyramid implementation of optimal step conjugate search algorithms for some low level vision problems. IEEE Trans Syst Man Cybern 19(6):408–425CrossRefMathSciNet Simchony T, Chellappa R, Lichtenstein Z (1989) Pyramid implementation of optimal step conjugate search algorithms for some low level vision problems. IEEE Trans Syst Man Cybern 19(6):408–425CrossRefMathSciNet
Zurück zum Zitat Szeliski R, Zabih R, Scharstein D, Veksler O, Kolmogorov V, Agarwala A, Tappen M, Rother C (2006) A comparative study of energy minimization methods for Markov random fields. In: Leonardis A, Bischof H, Prinz A (eds) ECCV 2006, part II, LNCS 3952, pp 16–29. Springer, Berlin Szeliski R, Zabih R, Scharstein D, Veksler O, Kolmogorov V, Agarwala A, Tappen M, Rother C (2006) A comparative study of energy minimization methods for Markov random fields. In: Leonardis A, Bischof H, Prinz A (eds) ECCV 2006, part II, LNCS 3952, pp 16–29. Springer, Berlin
Zurück zum Zitat Vanderbei RJ (2002) LOQO user’s manual version 4.05, Operations Research and Financial Engineering. Technical report no. ORFE-99 Vanderbei RJ (2002) LOQO user’s manual version 4.05, Operations Research and Financial Engineering. Technical report no. ORFE-99
Zurück zum Zitat Weber S, Schüle T, Schnörr C (2005) Prior learning and convex–concave regularization of binary tomography. Electron Notes Discrete Math 20:313–327CrossRefMATHMathSciNet Weber S, Schüle T, Schnörr C (2005) Prior learning and convex–concave regularization of binary tomography. Electron Notes Discrete Math 20:313–327CrossRefMATHMathSciNet
Zurück zum Zitat Winkler G (2006) Image analysis, random fields and Markov chain Monte Carlo methods: a mathematical introduction, vol 2. Springer, Berlin Winkler G (2006) Image analysis, random fields and Markov chain Monte Carlo methods: a mathematical introduction, vol 2. Springer, Berlin
Metadaten
Titel
Difference of convex functions algorithms (DCA) for image restoration via a Markov random field model
verfasst von
Hoai An Le Thi
Tao Pham Dinh
Publikationsdatum
03.06.2017
Verlag
Springer US
Erschienen in
Optimization and Engineering / Ausgabe 4/2017
Print ISSN: 1389-4420
Elektronische ISSN: 1573-2924
DOI
https://doi.org/10.1007/s11081-017-9359-0

Weitere Artikel der Ausgabe 4/2017

Optimization and Engineering 4/2017 Zur Ausgabe

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.