Abstract
In this work we present an extension of Chubanov’s algorithm to the case of homogeneous feasibility problems over a symmetric cone \( {\mathcal {K}}\). As in Chubanov’s method for linear feasibility problems, the algorithm consists of a basic procedure and a step where the solutions are confined to the intersection of a half-space and \( {\mathcal {K}}\). Following an earlier work by Kitahara and Tsuchiya on second order cone feasibility problems, progress is measured through the volumes of those intersections: when they become sufficiently small, we know it is time to stop. We never have to explicitly compute the volumes, it is only necessary to keep track of the reductions between iterations. We show this is enough to obtain concrete upper bounds to the minimum eigenvalues of a scaled version of the original feasibility problem. Another distinguishing feature of our approach is the usage of a spectral norm that takes into account the way that \( {\mathcal {K}}\) is decomposed as simple cones. In several key cases, including semidefinite programming and second order cone programming, these norms make it possible to obtain better complexity bounds for the basic procedure when compared to a recent approach by Peña and Soheili. Finally, in the appendix, we present a translation of the algorithm to the homogeneous feasibility problem in semidefinite programming.
Similar content being viewed by others
Notes
As in the case of semidefinite matrices, an element of \(x \in \mathrm {int}\, {\mathcal {K}}\) with small minimum eigenvalue is very close to the boundary of \( {\mathcal {K}}\). So, while item 3 does not rule out the possibility of (P) being infeasible, it shows that it is very close to being infeasible.
It is not entirely obvious that \(\left\| \cdot \right\| _{\infty }\) and \(\left\| \cdot \right\| _1\) are norms in the general setting of Jordan algebras, for more details see Example 2 in [8].
If \(y\ne 0\) and \(y \in {\mathcal {K}}\) then \(\langle y , {e} \rangle > 0\), since the latter is sum of the eigenvalues of y, which are nonnegative. Furthermore, not all of them are zero, since \(y \ne 0\).
It is easy to verify this computation by using a computer algebra system such as the open-source software maxima [17]. Consider the following three maxima commands: f:-z*(p-1)+(z⌃2*p⌃2)/(2*(1-p*z)); zp:solve(diff(f,z,1),z); for i:1 thru 2 do disp(combine(expand(ratsimp(substitute(zp[i],z,f)))));. The first two commands compute \(z_{\rho }\) and the last computes \(\psi (z_{\rho })\). Note that we discard one of the solutions because it is not in \((0, 1/\rho )\).
\(P_ {\mathcal {A}}y \ne 0\) implies \(y \ne 0\), which implies \(\langle y , {e} \rangle > 0\), since \(y \in {\mathcal {K}}\). See the footnote in Theorem 10.
References
Alizadeh, F., Goldfarb, D.: Second-order cone programming. Math. Program. 95(1), 3–51 (2003)
Basescu, V.L., Mitchell, J.E.: An analytic center cutting plane approach for conic programming. Math. Oper. Res. 33(3), 529–551 (2008)
Chubanov, S.: A strongly polynomial algorithm for linear systems having a binary solution. Math. Program. 134(2), 533–570 (2012)
Chubanov, S.: A polynomial projection algorithm for linear feasibility problems. Math. Program. 153(2), 687–713 (2015)
Faraut, J., Korányi, A.: Analysis on Symmetric Cones. Oxford Mathematical Monographs. Clarendon Press, Oxford (1994)
Faybusovich, L.: Euclidean Jordan algebras and interior-point algorithms. Positivity 1(4), 331–357 (1997)
Faybusovich, L.: A Jordan-algebraic approach to potential-reduction algorithms. Math. Z. 239(1), 117–129 (2002)
Faybusovich, L.: Several Jordan-algebraic aspects of optimization. Optimization 57(3), 379–393 (2008)
Goffin, J.-L., Vial, J.-P.: Convex nondifferentiable optimization: a survey focused on the analytic center cutting plane method. Optim. Methods Softw. 17(5), 805–867 (2002)
Hirzerbruch, U.: Der min–max-satz von E. Fischer für formal-reelle Jordan-algebren. Math. Ann. 186, 65–69 (1970)
Karmarkar, N.: A new polynomial-time algorithm for linear programming. Combinatorica 4(4), 373–395 (1984)
Khachiyan, L.: Polynomial algorithms in linear programming. USSR Comput. Math. Math. Phys. 20(1), 53–72 (1980)
Kitahara, T., Tsuchiya, T.: An extension of Chubanov’s polynomial-time linear programming algorithm to second-order cone programming. Optim. Methods Softw. (2017). https://doi.org/10.1080/10556788.2017.1382495
Li, D., Roos, K., Terlaky, T.: A polynomial column-wise rescaling von Neumann algorithm. Optimization Online. http://www.optimization-online.org/DB_HTML/2015/06/4979.html (June 2015)
Luo, Z., Sturm, J.F., Zhang, S.: Duality results for conic convex programming. Technical Report, Econometric Institute, Erasmus University Rotterdam, The Netherlands (1997)
Luo, Z.-Q., Sun, J.: A polynomial cutting surfaces algorithm for the convex feasibility problem defined by self-concordant inequalities. Comput. Optim. Appl. 15(2), 167–191 (2000)
Maxima: Maxima, a computer algebra system. Version 5.36.1. http://maxima.sourceforge.net/ (2015)
Monteiro, R.D., Tsuchiya, T.: Polynomial convergence of primal-dual algorithms for the second-order cone program based on the MZ-family of directions. Math. Program. 88(1), 61–83 (2000)
Muramatsu, M.: On a commutative class of search directions for linear programming over symmetric cones. J. Optim. Theory Appl. 112(3), 595–625 (2002)
Nemirovski, A.S., Todd, M.J.: Interior-point methods for optimization. Acta Numer. 17, 191–234 (2008)
Nesterov, Y., Nemirovskii, A.: Interior-Point Polynomial Algorithms in Convex Programming. Society for Industrial and Applied Mathematics, Philadelphia (1994)
Oskoorouchi, M.R., Goffin, J.-L.: An interior point cutting plane method for the convex feasibility problem with second-order cone inequalities. Math. Oper. Res. 30(1), 127–149 (2005)
Peña, J., Soheili, N.: Solving conic systems via projection and rescaling. Mathematical Programming, e-prints (to appear) (Dec. 2015). arXiv:1512.06154
Rockafellar, R.T.: Convex Analysis. Princeton University Press, Princeton (1997)
Roos, K.: An improved version of Chubanov’s method for solving a homogeneous feasibility problem. Optimization Online. http://www.optimization-online.org/DB_HTML/2016/11/5745.html (2016)
Schmieta, S., Alizadeh, F.: Extension of primal-dual interior point algorithms to symmetric cones. Math. Program. 96(3), 409–438 (2003)
Soheili, N., Peña, J.: A smooth perceptron algorithm. SIAM J. Optim. 22(2), 728–737 (2012)
Sturm, J.F.: Similarity and other spectral relations for symmetric cones. Linear Algebra Appl. 312(1–3), 135–154 (2000)
Sun, J., Toh, K.-C., Zhao, G.: An analytic center cutting plane method for semidefinite feasibility problems. Math. Oper. Res. 27(2), 332–346 (2002)
Toh, K.-C., Zhao, G., Sun, J.: A multiple-cut analytic center cutting plane method for semidefinite feasibility problems. SIAM J. Optim. 12(4), 1126–1146 (2002)
Tsuchiya, T.: A convergence analysis of the scaling-invariant primal-dual path-following algorithms for second-order cone programming. Optim. Methods Softw. 11(1–4), 141–182 (1999)
Acknowledgements
We thank the referees for their helpful and insightful comments, which helped to improve the paper. This article benefited from an e-mail discussion with Prof. Javier Peña, which helped clarify some points regarding [23]. T. Kitahara is supported by Grant-in-Aid for Young Scientists (B) 15K15941. M. Muramatsu and T. Tsuchiya are supported in part with Grant-in-Aid for Scientific Research (C) 26330025. M. Muramatsu is also partially supported by the Grant-in-Aid for Scientific Research (B)26280005. T. Tsuchiya is also partially supported by the Grant-in-Aid for Scientific Research (B)15H02968.
Author information
Authors and Affiliations
Corresponding author
A The case of semidefinite programming
A The case of semidefinite programming
For ease of reference, we “translate” here Algorithms 1 and 2 for the case of semidefinite programming, see Algorithms 3 and 4. In this case, we have \(\ell = 1, r = n\), \( {\mathcal {K}}= {\mathcal {S}^{n}_+}\) and \({\mathcal {E}}\) is the space of \(n\times n\) symmetric matrices \({\mathcal {S}}^n\). We recall that if \(y \in {\mathcal {S}^{n}_+}\), then \(\left\| y\right\| _1 = \langle {e} , y \rangle = {\mathrm {tr}}\,y\), so the stopping criteria in Algorithm 1 becomes \(\left\| z\right\| \le \frac{1}{2n}{\mathrm {tr}}\,y\). We will use \(I_n\) to denote the \(n\times n\) identity matrix. We will write \(y \succeq 0\), if y is positive semidefinite and \(y \succ 0\), if y is positive definite.
Furthermore, for \(w \in {\mathcal {S}^{n}_+}\), the quadratic map \(Q_{w}\) is the function that takes \(x \in {\mathcal {S}}^n\) to wxw. We do not need, in fact, to explicitly construct the operator \(Q_{w}\). In particular, if \( {\mathcal {A}}x = 0\) is represented as the set of solutions of m linear equalities \({\mathrm {tr}}\,(a_1x) = 0, \ldots , {\mathrm {tr}}\,(a_mx) = 0\), the first assignment in Line 11 of Algorithm 4 is the same as substituting every \(a_i\) by \(n(w^{-1/2}a_iw^{-1/2})\). Finally, as remarked at the end of Sect. 4, the condition \(z \ne 0\) in Algorithm 3 can be substituted by \(y^i - z \not \succeq 0\).
Rights and permissions
About this article
Cite this article
Lourenço, B.F., Kitahara, T., Muramatsu, M. et al. An extension of Chubanov’s algorithm to symmetric cones. Math. Program. 173, 117–149 (2019). https://doi.org/10.1007/s10107-017-1207-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10107-017-1207-7