In this paper, a Riemannian BFGS method is defined for minimizing a smooth function on a Riemannian manifold endowed with a retraction and a vector transport. The method is based on a Riemannian generalization of a cautious update and a weak line search condition. It is shown that, the Riemannian BFGS method converges (i) globally to a stationary point without assuming that the objective function is convex and (ii) superlinearly to a nondegenerate minimizer. The weak line search condition removes completely the need to consider the differentiated retraction. The joint diagonalization problem is used to demonstrate the performance of the algorithm with various parameters, line search conditions, and pairs of retraction and vector transport.
Bitte loggen Sie sich ein, um Zugang zu diesem Inhalt zu erhalten
P.-A. Absil, R. Mahony, R. Sepulchre,
Optimization Algorithms on Matrix Manifolds (Princeton University Press, Princeton, 2008)
An Introduction to Differentiable Manifolds and Riemannian Geometry, 2nd edn. (Academic, Orlando, 1986)
R.H. Byrd, J. Nocedal, A tool for the analysis of quasi-newton methods with application to unconstrained minimization. SIAM J. Numer. Anal.
26 (3), 727–739 (1989)
Y.-H. Dai, A perfect example for the BFGS method. Math. Program.
138 (1–2), 501–530 (2013). doi:10.1007/s10107-012-0522-2
J.E. Dennis, R.B. Schnabel,
Numerical Methods for Unconstrained Optimization and Nonlinear Equations (Springer, New Jersey, 1983)
D. Gabay, Minimizing a differentiable function over a differential manifold. J. Optim. Theory Appl.
37 (2), 177–219 (1982)
W. Huang, Optimization algorithms on Riemannian manifolds with applications, Ph.D. thesis, Department of Mathematics, Florida State University (2013)
W. Huang, P.-A. Absil, K. A. Gallivan, A Riemannian symmetric rank-one trust-region method. Math. Program.
150 (2), 179–216 (2015)
W. Huang, K.A. Gallivan, P.-A. Absil, A Broyden class of quasi-Newton methods for Riemannian optimization. SIAM J. Optim.
25 (3), 1660–1685 (2015)
D.-H. Li, M. Fukushima, A modified BFGS method and its global convergence in nonconvex minimization. J. Comput. Appl. Math.
129, 15–35 (2001)
D.-H. Li, M. Fukushima, On the global convergence of the BFGS method for nonconvex unconstrained optimization problems. SIAM J. Optim.
11 (4), 1054–1064 (2001). doi:10.1137/S1052623499354242
J. Nocedal, S.J. Wright,
Numerical Optimization, 2nd edn. (Springer, New York, 2006)
W. Ring, B. Wirth, Optimization methods on Riemannian manifolds and their application to shape space. SIAM J. Optim.
22 (2), 596–627 (2012). doi:10.1137/11082885X
B. Savas, L.H. Lim, Quasi-Newton methods on Grassmannians and multilinear approximations of tensors. SIAM J. Sci. Comput.
32 (6), 3352–3393 (2010)
M. Seibert, M. Kleinsteuber, K. Hüper, Properties of the BFGS method on Riemannian manifolds. Mathematical System Theory – Festschrift in Honor of Uwe Helmke on the Occasion of his Sixtieth Birthday (2013), pp. 395–412
F.J. Theis, T.P. Cason, P.-A. Absil, Soft dimension reduction for ICA by joint diagonalization on the Stiefel manifold, in
Proceedings of the 8th International Conference on Independent Component Analysis and Signal Separation, Paraty, vol. 5441 (2009), pp. 354–361
Über dieses Kapitel
A Riemannian BFGS Method for Nonconvex Optimization Problems