Skip to main content
Erschienen in: Journal of Scientific Computing 2/2018

11.10.2017

Flows Generating Nonlinear Eigenfunctions

verfasst von: Raz Z. Nossek, Guy Gilboa

Erschienen in: Journal of Scientific Computing | Ausgabe 2/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Linear eigenvalue analysis has provided a fundamental framework for many scientific and engineering disciplines. Consequently, vast research was devoted to numerical schemes for computing eigenfunctions. In recent years, new research in image processing and machine-learning has shown the applicability of nonlinear eigenvalue analysis, specifically based on operators induced by convex functionals. This has provided new insights, better theoretical understanding and improved image-processing, clustering and classification algorithms. However, the theory of nonlinear eigenvalue problems is still very preliminary. We present a new class of nonlinear flows that can generate nonlinear eigenfunctions of the form \(T(u)=\lambda u\), where T(u) is a nonlinear operator and \(\lambda \in \mathbb {R} \) is the eigenvalue. We develop the theory where T(u) is a subgradient element of a regularizing one-homogeneous functional, such as total-variation or total-generalized-variation. We focus on a forward flow which simultaneously smooths the solution (with respect to the regularizer) while increasing the 2-norm. An analog discrete flow and its normalized version are formulated and analyzed. The flows translate to a series of convex minimization steps. In addition we suggest an indicator to measure the affinity of a function to an eigenfunction and relate it to pseudo-eigenfunctions in the linear case.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Appell, J., De Pascale, E., Vignoli, A.: Nonlinear spectral theory, vol. 10. Walter de Gruyter, Berlin (2004)CrossRefMATH Appell, J., De Pascale, E., Vignoli, A.: Nonlinear spectral theory, vol. 10. Walter de Gruyter, Berlin (2004)CrossRefMATH
2.
Zurück zum Zitat Attouch, H., Bolte, J., Svaiter, B.F.: Convergence of descent methods for semi-algebraic and tame problems: proximal algorithms, forward-backward splitting, and regularized gauss-seidel methods. Math. Program. 137, 91–129 (2013)MathSciNetCrossRefMATH Attouch, H., Bolte, J., Svaiter, B.F.: Convergence of descent methods for semi-algebraic and tame problems: proximal algorithms, forward-backward splitting, and regularized gauss-seidel methods. Math. Program. 137, 91–129 (2013)MathSciNetCrossRefMATH
3.
4.
Zurück zum Zitat Aujol, J., Gilboa, G., Chan, T., Osher, S.: Structure-texture image decomposition—modeling, algorithms, and parameter selection. Int. J. Comput. Vision 67, 111–136 (2006)CrossRefMATH Aujol, J., Gilboa, G., Chan, T., Osher, S.: Structure-texture image decomposition—modeling, algorithms, and parameter selection. Int. J. Comput. Vision 67, 111–136 (2006)CrossRefMATH
5.
Zurück zum Zitat Aujol, J.-F., Gilboa, G., Papadakis, N.: Theoretical analysis of flows estimating eigenfunctions of one-homogeneous functionals for segmentation and clustering. Preprint. HAL-01563922. (2017) Aujol, J.-F., Gilboa, G., Papadakis, N.: Theoretical analysis of flows estimating eigenfunctions of one-homogeneous functionals for segmentation and clustering. Preprint. HAL-01563922. (2017)
7.
Zurück zum Zitat Benning, M., Brune, C., Burger, M., Müller, J.: Higher-order tv methodsenhancement via bregman iteration. J. Sci. Comput. 54, 269–310 (2013)MathSciNetCrossRefMATH Benning, M., Brune, C., Burger, M., Müller, J.: Higher-order tv methodsenhancement via bregman iteration. J. Sci. Comput. 54, 269–310 (2013)MathSciNetCrossRefMATH
8.
Zurück zum Zitat Benning, M., Burger, M.: Ground states and singular vectors of convex variational regularization methods. Methods Appl. Anal. 20, 295–334 (2013)MathSciNetMATH Benning, M., Burger, M.: Ground states and singular vectors of convex variational regularization methods. Methods Appl. Anal. 20, 295–334 (2013)MathSciNetMATH
9.
Zurück zum Zitat Börm, S., Mehl, C.: Numerical Methods for Eigenvalue Problems. Walter de Gruyter, Berlin (2012)CrossRefMATH Börm, S., Mehl, C.: Numerical Methods for Eigenvalue Problems. Walter de Gruyter, Berlin (2012)CrossRefMATH
11.
Zurück zum Zitat Bresson, X., Laurent, T., Uminsky, D., Brecht, J.: Convergence and energy landscape for cheeger cut clustering. In: Advances in Neural Information Processing Systems, pp. 1385–1393 (2012) Bresson, X., Laurent, T., Uminsky, D., Brecht, J.: Convergence and energy landscape for cheeger cut clustering. In: Advances in Neural Information Processing Systems, pp. 1385–1393 (2012)
12.
Zurück zum Zitat Bresson, X., Laurent, T., Uminsky, D., Von Brecht, J.: Multiclass total variation clustering. In: Advances in Neural Information Processing Systems, pp. 1421–1429 (2013) Bresson, X., Laurent, T., Uminsky, D., Von Brecht, J.: Multiclass total variation clustering. In: Advances in Neural Information Processing Systems, pp. 1421–1429 (2013)
13.
Zurück zum Zitat Bresson, X., Szlam, A.: Total variation, cheeger cuts. In: Proceedings of the 27th International Conference on Machine Learning (ICML-10), pp. 1039–1046 (2010) Bresson, X., Szlam, A.: Total variation, cheeger cuts. In: Proceedings of the 27th International Conference on Machine Learning (ICML-10), pp. 1039–1046 (2010)
14.
Zurück zum Zitat Bresson, X., Tai, X.-C., Chan, T.F., Szlam, A.: Multi-class transductive learning based on 1 relaxations of Cheeger cut and Mumford-Shah-Potts model. J. Math. Imaging Vis. 49, 191–201 (2014)MathSciNetCrossRefMATH Bresson, X., Tai, X.-C., Chan, T.F., Szlam, A.: Multi-class transductive learning based on 1 relaxations of Cheeger cut and Mumford-Shah-Potts model. J. Math. Imaging Vis. 49, 191–201 (2014)MathSciNetCrossRefMATH
15.
Zurück zum Zitat Brinkmann, E.-M., Burger, M., Rasch, J., Sutour, C.: Bias-reduction in variational regularization, arXiv preprint arXiv:1606.05113 (2016) Brinkmann, E.-M., Burger, M., Rasch, J., Sutour, C.: Bias-reduction in variational regularization, arXiv preprint arXiv:​1606.​05113 (2016)
16.
Zurück zum Zitat Burger, M., Gilboa, G., Moeller, M., Eckardt, L., Cremers, D.: Spectral decompositions using one-homogeneous functionals, arXiv preprint arXiv:1601.02912 (2016) Burger, M., Gilboa, G., Moeller, M., Eckardt, L., Cremers, D.: Spectral decompositions using one-homogeneous functionals, arXiv preprint arXiv:​1601.​02912 (2016)
17.
Zurück zum Zitat Burger, M., Gilboa, G., Osher, S., Xu, J., et al.: Nonlinear inverse scale space methods. Commun. Math. Sci. 4, 179–212 (2006)MathSciNetCrossRefMATH Burger, M., Gilboa, G., Osher, S., Xu, J., et al.: Nonlinear inverse scale space methods. Commun. Math. Sci. 4, 179–212 (2006)MathSciNetCrossRefMATH
18.
Zurück zum Zitat Burger, M., He, L., Schönlieb, C.-B.: Cahn–Hilliard inpainting and a generalization for grayvalue images. SIAM J. Imaging Sci. 2, 1129–1167 (2009)MathSciNetCrossRefMATH Burger, M., He, L., Schönlieb, C.-B.: Cahn–Hilliard inpainting and a generalization for grayvalue images. SIAM J. Imaging Sci. 2, 1129–1167 (2009)MathSciNetCrossRefMATH
19.
Zurück zum Zitat Burger, M., Osher, S.: A guide to the tv zoo. In: Level Set and PDE Based Reconstruction Methods in Imaging, Springer, pp. 1–70 (2013) Burger, M., Osher, S.: A guide to the tv zoo. In: Level Set and PDE Based Reconstruction Methods in Imaging, Springer, pp. 1–70 (2013)
21.
Zurück zum Zitat Chambolle, A., Caselles, V., Cremers, D., Novaga, M., Pock, T.: An introduction to total variation for image analysis. Theor. Found. Numer. Methods Sparse Recovery 9, 227 (2010)MathSciNetMATH Chambolle, A., Caselles, V., Cremers, D., Novaga, M., Pock, T.: An introduction to total variation for image analysis. Theor. Found. Numer. Methods Sparse Recovery 9, 227 (2010)MathSciNetMATH
22.
Zurück zum Zitat Chambolle, A., Pock, T.: A first-order primal-dual algorithm for convex problems with applications to imaging. J. Math. Imaging Vis. 40, 120–145 (2011)MathSciNetCrossRefMATH Chambolle, A., Pock, T.: A first-order primal-dual algorithm for convex problems with applications to imaging. J. Math. Imaging Vis. 40, 120–145 (2011)MathSciNetCrossRefMATH
23.
Zurück zum Zitat Chatelin, F.: The spectral approximation of linear operators with applications to the computation of eigenelements of differential and integral operators. SIAM Rev. 23, 495–522 (1981)MathSciNetCrossRefMATH Chatelin, F.: The spectral approximation of linear operators with applications to the computation of eigenelements of differential and integral operators. SIAM Rev. 23, 495–522 (1981)MathSciNetCrossRefMATH
24.
25.
Zurück zum Zitat Dabov, K., Foi, A., Katkovnik, V., Egiazarian, K.: Image denoising by sparse 3-d transform-domain collaborative filtering. IEEE Trans. Image Process. 16, 2080–2095 (2007)MathSciNetCrossRef Dabov, K., Foi, A., Katkovnik, V., Egiazarian, K.: Image denoising by sparse 3-d transform-domain collaborative filtering. IEEE Trans. Image Process. 16, 2080–2095 (2007)MathSciNetCrossRef
26.
Zurück zum Zitat Deledalle, C.-A., Papadakis, N., Salmon, J.: On debiasing restoration algorithms: applications to total-variation and nonlocal-means. In: International Conference on Scale Space and Variational Methods in Computer Vision, Springer, pp. 129–141 (2015) Deledalle, C.-A., Papadakis, N., Salmon, J.: On debiasing restoration algorithms: applications to total-variation and nonlocal-means. In: International Conference on Scale Space and Variational Methods in Computer Vision, Springer, pp. 129–141 (2015)
27.
Zurück zum Zitat Dong, B., Ji, H., Li, J., Shen, Z., Xu, Y.: Wavelet frame based blind image inpainting. Appl. Comput. Harmonic Anal. 32, 268–279 (2012)MathSciNetCrossRefMATH Dong, B., Ji, H., Li, J., Shen, Z., Xu, Y.: Wavelet frame based blind image inpainting. Appl. Comput. Harmonic Anal. 32, 268–279 (2012)MathSciNetCrossRefMATH
28.
Zurück zum Zitat Ekeland, I., Temam, R.: Convex Analysis and 9 Variational Problems. SIAM, New Delhi (1976)MATH Ekeland, I., Temam, R.: Convex Analysis and 9 Variational Problems. SIAM, New Delhi (1976)MATH
29.
Zurück zum Zitat Elmoataz, A., Lezoray, O., Bougleux, S.: Nonlocal discrete regularization on weighted graphs: a framework for image and manifold processing. IEEE Trans. Image Process. 17, 1047–1060 (2008)MathSciNetCrossRefMATH Elmoataz, A., Lezoray, O., Bougleux, S.: Nonlocal discrete regularization on weighted graphs: a framework for image and manifold processing. IEEE Trans. Image Process. 17, 1047–1060 (2008)MathSciNetCrossRefMATH
30.
31.
32.
Zurück zum Zitat Gilboa, G., Osher, S.: Nonlocal operators with applications to image processing. Multiscale Model. Simul. 7, 1005–1028 (2009)MathSciNetCrossRefMATH Gilboa, G., Osher, S.: Nonlocal operators with applications to image processing. Multiscale Model. Simul. 7, 1005–1028 (2009)MathSciNetCrossRefMATH
33.
Zurück zum Zitat Hein, M., Bühler, T.: An inverse power method for nonlinear eigenproblems with applications in 1-spectral clustering and sparse pca. In: Lafferty, J.D., Williams, C.K.I., Shawe-Taylor, J., Zemel, R.S., Culotta, A. (eds.) Advances in Neural Information Processing Systems 23, pp. 847–855. Curran Associates, Inc., New York (2010) Hein, M., Bühler, T.: An inverse power method for nonlinear eigenproblems with applications in 1-spectral clustering and sparse pca. In: Lafferty, J.D., Williams, C.K.I., Shawe-Taylor, J., Zemel, R.S., Culotta, A. (eds.) Advances in Neural Information Processing Systems 23, pp. 847–855. Curran Associates, Inc., New York (2010)
35.
Zurück zum Zitat Kindermann, S., Osher, S., Jones, P.W.: Deblurring and denoising of images by nonlocal functionals. Multiscale Model. Simul. 4, 1091–1115 (2005)MathSciNetCrossRefMATH Kindermann, S., Osher, S., Jones, P.W.: Deblurring and denoising of images by nonlocal functionals. Multiscale Model. Simul. 4, 1091–1115 (2005)MathSciNetCrossRefMATH
36.
Zurück zum Zitat Knoll, F., Bredies, K., Pock, T., Stollberger, R.: Second order total generalized variation (TGV) for MRI. Magn. Reson. Med. 65, 480–491 (2011)CrossRef Knoll, F., Bredies, K., Pock, T., Stollberger, R.: Second order total generalized variation (TGV) for MRI. Magn. Reson. Med. 65, 480–491 (2011)CrossRef
37.
Zurück zum Zitat Landau, H.J.: On Szegö’s eingenvalue distribution theorem and non-hermitian kernels. Journal d’Analyse Mathématique 28, 335–357 (1975)CrossRefMATH Landau, H.J.: On Szegö’s eingenvalue distribution theorem and non-hermitian kernels. Journal d’Analyse Mathématique 28, 335–357 (1975)CrossRefMATH
38.
Zurück zum Zitat Lellmann, J., Kappes, J., Yuan, J., Becker, F., Schnörr, C.: Convex multi-class image labeling by simplex-constrained total variation. In: International Conference on Scale Space and Variational Methods in Computer Vision, Springer, pp. 150–162 (2009) Lellmann, J., Kappes, J., Yuan, J., Becker, F., Schnörr, C.: Convex multi-class image labeling by simplex-constrained total variation. In: International Conference on Scale Space and Variational Methods in Computer Vision, Springer, pp. 150–162 (2009)
40.
Zurück zum Zitat Meyer, Y.: Oscillating patterns in image processing and in some nonlinear evolution equations, March 2001. The 15th Dean Jacquelines B. Lewis Memorial Lectures. (2001) Meyer, Y.: Oscillating patterns in image processing and in some nonlinear evolution equations, March 2001. The 15th Dean Jacquelines B. Lewis Memorial Lectures. (2001)
41.
Zurück zum Zitat Papafitsoros, K., Bredies, K.: A study of the one dimensional total generalised variation regularisation problem. arXiv preprint arXiv:1309.5900 (2013) Papafitsoros, K., Bredies, K.: A study of the one dimensional total generalised variation regularisation problem. arXiv preprint arXiv:​1309.​5900 (2013)
43.
44.
Zurück zum Zitat Saad, Y.: Numerical Methods for Large Eigenvalue Problems. Society for Industrial and Applied Mathematics, Philadelphia (2011)CrossRefMATH Saad, Y.: Numerical Methods for Large Eigenvalue Problems. Society for Industrial and Applied Mathematics, Philadelphia (2011)CrossRefMATH
45.
Zurück zum Zitat Sawatzky, A., Tenbrinck, D., Jiang, X., Burger, M.: A variational framework for region-based segmentation incorporating physical noise models. J. Math. Imaging Vis. 47, 179–209 (2013)MathSciNetCrossRefMATH Sawatzky, A., Tenbrinck, D., Jiang, X., Burger, M.: A variational framework for region-based segmentation incorporating physical noise models. J. Math. Imaging Vis. 47, 179–209 (2013)MathSciNetCrossRefMATH
46.
Zurück zum Zitat Schmaltz, C., Rosenhahn, B., Brox, T., Weickert, J.: Region-based pose tracking with occlusions using 3d models. Mach. Vis. Appl. 23, 557–577 (2012)CrossRef Schmaltz, C., Rosenhahn, B., Brox, T., Weickert, J.: Region-based pose tracking with occlusions using 3d models. Mach. Vis. Appl. 23, 557–577 (2012)CrossRef
47.
48.
Zurück zum Zitat Trefethen, L.N.: Approximation theory and numerical linear algebra. In: Algorithms for approximation II, Springer, pp. 336–360 (1990) Trefethen, L.N.: Approximation theory and numerical linear algebra. In: Algorithms for approximation II, Springer, pp. 336–360 (1990)
49.
Zurück zum Zitat Trefethen, L.N.: Pseudospectra of matrices. Numer. Anal 91, 234–266 (1991)MATH Trefethen, L.N.: Pseudospectra of matrices. Numer. Anal 91, 234–266 (1991)MATH
50.
Zurück zum Zitat Trefethen, L.N., Bau III, D.: Numerical Linear Algebra, vol. 50. Siam, New Delhi (1997)CrossRefMATH Trefethen, L.N., Bau III, D.: Numerical Linear Algebra, vol. 50. Siam, New Delhi (1997)CrossRefMATH
51.
Zurück zum Zitat Trefethen, L.N., Embree, M.: Spectra and Pseudospectra: The Behavior of Nonnormal Matrices and Operators. Princeton University Press, Princeton (2005)MATH Trefethen, L.N., Embree, M.: Spectra and Pseudospectra: The Behavior of Nonnormal Matrices and Operators. Princeton University Press, Princeton (2005)MATH
53.
Zurück zum Zitat Weickert, J., Schnörr, C.: A theoretical framework for convex regularizers in pde-based computation of image motion. Int. J. Comput. Vis. 45, 245–264 (2001)CrossRefMATH Weickert, J., Schnörr, C.: A theoretical framework for convex regularizers in pde-based computation of image motion. Int. J. Comput. Vis. 45, 245–264 (2001)CrossRefMATH
54.
Zurück zum Zitat Weiss, Y., Torralba, A., Fergus, R.: Spectral hashing. In: Koller, D., Schuurmans, D., Bengio, Y., Bottou, L. (eds.) Advances in Neural Information Processing Systems 21, pp. 1753–1760. Curran Associates, Inc., New York (2009) Weiss, Y., Torralba, A., Fergus, R.: Spectral hashing. In: Koller, D., Schuurmans, D., Bengio, Y., Bottou, L. (eds.) Advances in Neural Information Processing Systems 21, pp. 1753–1760. Curran Associates, Inc., New York (2009)
55.
Zurück zum Zitat Werlberger, M., Pock, T., Unger, M., Bischof, H.: Optical flow guided tv-l1 video interpolation and restoration. In: International Workshop on Energy Minimization Methods in Computer Vision and Pattern Recognition, Springer, pp. 273–286 (2011) Werlberger, M., Pock, T., Unger, M., Bischof, H.: Optical flow guided tv-l1 video interpolation and restoration. In: International Workshop on Energy Minimization Methods in Computer Vision and Pattern Recognition, Springer, pp. 273–286 (2011)
56.
Zurück zum Zitat Wilkinson, J.H., Wilkinson, J.H.: The Algebraic Eigenvalue Problem, vol. 87. Clarendon Press, Oxford (1965)MATH Wilkinson, J.H., Wilkinson, J.H.: The Algebraic Eigenvalue Problem, vol. 87. Clarendon Press, Oxford (1965)MATH
57.
Zurück zum Zitat Yang, M., Liang, J., Zhang, J., Gao, H., Meng, F., Xingdong, L., Song, S.-J.: Non-local means theory based perona-malik model for image denosing. Neurocomputing 120, 262–267 (2013)CrossRef Yang, M., Liang, J., Zhang, J., Gao, H., Meng, F., Xingdong, L., Song, S.-J.: Non-local means theory based perona-malik model for image denosing. Neurocomputing 120, 262–267 (2013)CrossRef
58.
Zurück zum Zitat Zoran, D., Weiss, Y.: From learning models of natural image patches to whole image restoration. In: 2011 International Conference on Computer Vision, IEEE, pp. 479–486 (2011) Zoran, D., Weiss, Y.: From learning models of natural image patches to whole image restoration. In: 2011 International Conference on Computer Vision, IEEE, pp. 479–486 (2011)
Metadaten
Titel
Flows Generating Nonlinear Eigenfunctions
verfasst von
Raz Z. Nossek
Guy Gilboa
Publikationsdatum
11.10.2017
Verlag
Springer US
Erschienen in
Journal of Scientific Computing / Ausgabe 2/2018
Print ISSN: 0885-7474
Elektronische ISSN: 1573-7691
DOI
https://doi.org/10.1007/s10915-017-0577-6

Weitere Artikel der Ausgabe 2/2018

Journal of Scientific Computing 2/2018 Zur Ausgabe