Skip to main content
Log in

An extension of Chubanov’s algorithm to symmetric cones

  • Full Length Paper
  • Series A
  • Published:
Mathematical Programming Submit manuscript

Abstract

In this work we present an extension of Chubanov’s algorithm to the case of homogeneous feasibility problems over a symmetric cone \( {\mathcal {K}}\). As in Chubanov’s method for linear feasibility problems, the algorithm consists of a basic procedure and a step where the solutions are confined to the intersection of a half-space and \( {\mathcal {K}}\). Following an earlier work by Kitahara and Tsuchiya on second order cone feasibility problems, progress is measured through the volumes of those intersections: when they become sufficiently small, we know it is time to stop. We never have to explicitly compute the volumes, it is only necessary to keep track of the reductions between iterations. We show this is enough to obtain concrete upper bounds to the minimum eigenvalues of a scaled version of the original feasibility problem. Another distinguishing feature of our approach is the usage of a spectral norm that takes into account the way that \( {\mathcal {K}}\) is decomposed as simple cones. In several key cases, including semidefinite programming and second order cone programming, these norms make it possible to obtain better complexity bounds for the basic procedure when compared to a recent approach by Peña and Soheili. Finally, in the appendix, we present a translation of the algorithm to the homogeneous feasibility problem in semidefinite programming.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

Similar content being viewed by others

Notes

  1. As in the case of semidefinite matrices, an element of \(x \in \mathrm {int}\, {\mathcal {K}}\) with small minimum eigenvalue is very close to the boundary of \( {\mathcal {K}}\). So, while item 3 does not rule out the possibility of (P) being infeasible, it shows that it is very close to being infeasible.

  2. It is not entirely obvious that \(\left\| \cdot \right\| _{\infty }\) and \(\left\| \cdot \right\| _1\) are norms in the general setting of Jordan algebras, for more details see Example 2 in [8].

  3. If \(y\ne 0\) and \(y \in {\mathcal {K}}\) then \(\langle y , {e} \rangle > 0\), since the latter is sum of the eigenvalues of y, which are nonnegative. Furthermore, not all of them are zero, since \(y \ne 0\).

  4. It is easy to verify this computation by using a computer algebra system such as the open-source software maxima [17]. Consider the following three maxima commands: f:-z*(p-1)+(z⌃2*p⌃2)/(2*(1-p*z)); zp:solve(diff(f,z,1),z); for i:1 thru 2 do disp(combine(expand(ratsimp(substitute(zp[i],z,f)))));. The first two commands compute \(z_{\rho }\) and the last computes \(\psi (z_{\rho })\). Note that we discard one of the solutions because it is not in \((0, 1/\rho )\).

  5. \(P_ {\mathcal {A}}y \ne 0\) implies \(y \ne 0\), which implies \(\langle y , {e} \rangle > 0\), since \(y \in {\mathcal {K}}\). See the footnote in Theorem 10.

References

  1. Alizadeh, F., Goldfarb, D.: Second-order cone programming. Math. Program. 95(1), 3–51 (2003)

    Article  MathSciNet  MATH  Google Scholar 

  2. Basescu, V.L., Mitchell, J.E.: An analytic center cutting plane approach for conic programming. Math. Oper. Res. 33(3), 529–551 (2008)

    Article  MathSciNet  MATH  Google Scholar 

  3. Chubanov, S.: A strongly polynomial algorithm for linear systems having a binary solution. Math. Program. 134(2), 533–570 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  4. Chubanov, S.: A polynomial projection algorithm for linear feasibility problems. Math. Program. 153(2), 687–713 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  5. Faraut, J., Korányi, A.: Analysis on Symmetric Cones. Oxford Mathematical Monographs. Clarendon Press, Oxford (1994)

    MATH  Google Scholar 

  6. Faybusovich, L.: Euclidean Jordan algebras and interior-point algorithms. Positivity 1(4), 331–357 (1997)

    Article  MathSciNet  MATH  Google Scholar 

  7. Faybusovich, L.: A Jordan-algebraic approach to potential-reduction algorithms. Math. Z. 239(1), 117–129 (2002)

    Article  MathSciNet  MATH  Google Scholar 

  8. Faybusovich, L.: Several Jordan-algebraic aspects of optimization. Optimization 57(3), 379–393 (2008)

    Article  MathSciNet  MATH  Google Scholar 

  9. Goffin, J.-L., Vial, J.-P.: Convex nondifferentiable optimization: a survey focused on the analytic center cutting plane method. Optim. Methods Softw. 17(5), 805–867 (2002)

    Article  MathSciNet  MATH  Google Scholar 

  10. Hirzerbruch, U.: Der min–max-satz von E. Fischer für formal-reelle Jordan-algebren. Math. Ann. 186, 65–69 (1970)

    Article  MathSciNet  Google Scholar 

  11. Karmarkar, N.: A new polynomial-time algorithm for linear programming. Combinatorica 4(4), 373–395 (1984)

    Article  MathSciNet  MATH  Google Scholar 

  12. Khachiyan, L.: Polynomial algorithms in linear programming. USSR Comput. Math. Math. Phys. 20(1), 53–72 (1980)

    Article  MathSciNet  MATH  Google Scholar 

  13. Kitahara, T., Tsuchiya, T.: An extension of Chubanov’s polynomial-time linear programming algorithm to second-order cone programming. Optim. Methods Softw. (2017). https://doi.org/10.1080/10556788.2017.1382495

  14. Li, D., Roos, K., Terlaky, T.: A polynomial column-wise rescaling von Neumann algorithm. Optimization Online. http://www.optimization-online.org/DB_HTML/2015/06/4979.html (June 2015)

  15. Luo, Z., Sturm, J.F., Zhang, S.: Duality results for conic convex programming. Technical Report, Econometric Institute, Erasmus University Rotterdam, The Netherlands (1997)

  16. Luo, Z.-Q., Sun, J.: A polynomial cutting surfaces algorithm for the convex feasibility problem defined by self-concordant inequalities. Comput. Optim. Appl. 15(2), 167–191 (2000)

    Article  MathSciNet  MATH  Google Scholar 

  17. Maxima: Maxima, a computer algebra system. Version 5.36.1. http://maxima.sourceforge.net/ (2015)

  18. Monteiro, R.D., Tsuchiya, T.: Polynomial convergence of primal-dual algorithms for the second-order cone program based on the MZ-family of directions. Math. Program. 88(1), 61–83 (2000)

    Article  MathSciNet  MATH  Google Scholar 

  19. Muramatsu, M.: On a commutative class of search directions for linear programming over symmetric cones. J. Optim. Theory Appl. 112(3), 595–625 (2002)

    Article  MathSciNet  MATH  Google Scholar 

  20. Nemirovski, A.S., Todd, M.J.: Interior-point methods for optimization. Acta Numer. 17, 191–234 (2008)

    Article  MathSciNet  MATH  Google Scholar 

  21. Nesterov, Y., Nemirovskii, A.: Interior-Point Polynomial Algorithms in Convex Programming. Society for Industrial and Applied Mathematics, Philadelphia (1994)

    Book  MATH  Google Scholar 

  22. Oskoorouchi, M.R., Goffin, J.-L.: An interior point cutting plane method for the convex feasibility problem with second-order cone inequalities. Math. Oper. Res. 30(1), 127–149 (2005)

    Article  MathSciNet  MATH  Google Scholar 

  23. Peña, J., Soheili, N.: Solving conic systems via projection and rescaling. Mathematical Programming, e-prints (to appear) (Dec. 2015). arXiv:1512.06154

  24. Rockafellar, R.T.: Convex Analysis. Princeton University Press, Princeton (1997)

    MATH  Google Scholar 

  25. Roos, K.: An improved version of Chubanov’s method for solving a homogeneous feasibility problem. Optimization Online. http://www.optimization-online.org/DB_HTML/2016/11/5745.html (2016)

  26. Schmieta, S., Alizadeh, F.: Extension of primal-dual interior point algorithms to symmetric cones. Math. Program. 96(3), 409–438 (2003)

    Article  MathSciNet  MATH  Google Scholar 

  27. Soheili, N., Peña, J.: A smooth perceptron algorithm. SIAM J. Optim. 22(2), 728–737 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  28. Sturm, J.F.: Similarity and other spectral relations for symmetric cones. Linear Algebra Appl. 312(1–3), 135–154 (2000)

    Article  MathSciNet  MATH  Google Scholar 

  29. Sun, J., Toh, K.-C., Zhao, G.: An analytic center cutting plane method for semidefinite feasibility problems. Math. Oper. Res. 27(2), 332–346 (2002)

    Article  MathSciNet  MATH  Google Scholar 

  30. Toh, K.-C., Zhao, G., Sun, J.: A multiple-cut analytic center cutting plane method for semidefinite feasibility problems. SIAM J. Optim. 12(4), 1126–1146 (2002)

    Article  MathSciNet  MATH  Google Scholar 

  31. Tsuchiya, T.: A convergence analysis of the scaling-invariant primal-dual path-following algorithms for second-order cone programming. Optim. Methods Softw. 11(1–4), 141–182 (1999)

    Article  MathSciNet  MATH  Google Scholar 

Download references

Acknowledgements

We thank the referees for their helpful and insightful comments, which helped to improve the paper. This article benefited from an e-mail discussion with Prof. Javier Peña, which helped clarify some points regarding [23]. T. Kitahara is supported by Grant-in-Aid for Young Scientists (B) 15K15941. M. Muramatsu and T. Tsuchiya are supported in part with Grant-in-Aid for Scientific Research (C) 26330025. M. Muramatsu is also partially supported by the Grant-in-Aid for Scientific Research (B)26280005. T. Tsuchiya is also partially supported by the Grant-in-Aid for Scientific Research (B)15H02968.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Bruno F. Lourenço.

A The case of semidefinite programming

A The case of semidefinite programming

For ease of reference, we “translate” here Algorithms 1 and 2 for the case of semidefinite programming, see Algorithms 3 and 4. In this case, we have \(\ell = 1, r = n\), \( {\mathcal {K}}= {\mathcal {S}^{n}_+}\) and \({\mathcal {E}}\) is the space of \(n\times n\) symmetric matrices \({\mathcal {S}}^n\). We recall that if \(y \in {\mathcal {S}^{n}_+}\), then \(\left\| y\right\| _1 = \langle {e} , y \rangle = {\mathrm {tr}}\,y\), so the stopping criteria in Algorithm 1 becomes \(\left\| z\right\| \le \frac{1}{2n}{\mathrm {tr}}\,y\). We will use \(I_n\) to denote the \(n\times n\) identity matrix. We will write \(y \succeq 0\), if y is positive semidefinite and \(y \succ 0\), if y is positive definite.

figure g
figure h

Furthermore, for \(w \in {\mathcal {S}^{n}_+}\), the quadratic map \(Q_{w}\) is the function that takes \(x \in {\mathcal {S}}^n\) to wxw. We do not need, in fact, to explicitly construct the operator \(Q_{w}\). In particular, if \( {\mathcal {A}}x = 0\) is represented as the set of solutions of m linear equalities \({\mathrm {tr}}\,(a_1x) = 0, \ldots , {\mathrm {tr}}\,(a_mx) = 0\), the first assignment in Line 11 of Algorithm 4 is the same as substituting every \(a_i\) by \(n(w^{-1/2}a_iw^{-1/2})\). Finally, as remarked at the end of Sect. 4, the condition \(z \ne 0\) in Algorithm 3 can be substituted by \(y^i - z \not \succeq 0\).

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lourenço, B.F., Kitahara, T., Muramatsu, M. et al. An extension of Chubanov’s algorithm to symmetric cones. Math. Program. 173, 117–149 (2019). https://doi.org/10.1007/s10107-017-1207-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10107-017-1207-7

Keywords

Mathematics Subject Classification

Navigation