Skip to main content
Top

2017 | OriginalPaper | Chapter

Univariate Polynomial Optimization with Sum-of-Squares Interpolants

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

One of the most common tools in polynomial optimization is the approximation of the cone of nonnegative polynomials with the cone of sum-of-squares polynomials. This leads to polynomial-time solvable approximations for many NP-hard optimization problems using semidefinite programming (SDP). While theoretically satisfactory, the translation of optimization problems involving sum-of-squares polynomials to SDPs is not always practical. First, in the common SDP formulation, the dual variables are semidefinite matrices whose condition numbers grow exponentially with the degree of the polynomials involved, which is detrimental for a floating-point implementation. Second, the SDP representation of sum-of-squares polynomials roughly squares the number of optimization variables, increasing the time and memory complexity of the solution algorithms by several orders of magnitude. In this paper we focus on the first, numerical, issue. We show that a reformulation of the sum-of-squares SDP using polynomial interpolants yields a substantial improvement over the standard formulation, and problems involving sum-of-squares interpolants of hundreds of degrees can be handled without difficulty by commonly used semidefinite programming solvers. Preliminary numerical results using semi-infinite optimization problems align with the theoretical predictions. In all problems considered, available memory is the only factor limiting the degrees of polynomials.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
1.
go back to reference Ahmadi, A.A., Parrilo, P.A.: Non-monotonic Lyapunov functions for stability of discrete time nonlinear and switched systems. In: 47th IEEE Conference on Decision and Control (CDC), pp. 614–621. IEEE, Piscataway (2008) Ahmadi, A.A., Parrilo, P.A.: Non-monotonic Lyapunov functions for stability of discrete time nonlinear and switched systems. In: 47th IEEE Conference on Decision and Control (CDC), pp. 614–621. IEEE, Piscataway (2008)
2.
go back to reference Alizadeh, F.: Semidefinite and second-order cone programming and their application to shape-constrained regression and density estimation. In: Proceedings of the INFORMS Annual Meeting. INFORMS, Pittsburg, PA (2006)CrossRef Alizadeh, F.: Semidefinite and second-order cone programming and their application to shape-constrained regression and density estimation. In: Proceedings of the INFORMS Annual Meeting. INFORMS, Pittsburg, PA (2006)CrossRef
3.
go back to reference Alizadeh, F., Papp, D.: Estimating arrival rate of nonhomogeneous Poisson processes with semidefinite programming. Ann. Oper. Res. 208(1), 291–308 (2013). doi:10.1007/s10479-011-1020-2CrossRefMathSciNetMATH Alizadeh, F., Papp, D.: Estimating arrival rate of nonhomogeneous Poisson processes with semidefinite programming. Ann. Oper. Res. 208(1), 291–308 (2013). doi:10.1007/s10479-011-1020-2CrossRefMathSciNetMATH
4.
go back to reference Bachoc, C., Vallentin, F.: New upper bounds for kissing numbers from semidefinite programming. J. Am. Math. Soc. 21(3), 909–924 (2008)CrossRefMathSciNetMATH Bachoc, C., Vallentin, F.: New upper bounds for kissing numbers from semidefinite programming. J. Am. Math. Soc. 21(3), 909–924 (2008)CrossRefMathSciNetMATH
5.
go back to reference Ballinger, B., Blekherman, G., Cohn, H., Giansiracusa, N., Kelly, E., Schürmann, A.: Experimental study of energy-minimizing point configurations on spheres. Exp. Math. 18(3), 257–283 (2009)CrossRefMathSciNetMATH Ballinger, B., Blekherman, G., Cohn, H., Giansiracusa, N., Kelly, E., Schürmann, A.: Experimental study of energy-minimizing point configurations on spheres. Exp. Math. 18(3), 257–283 (2009)CrossRefMathSciNetMATH
6.
go back to reference Ben-Tal, A., Nemirovski, A.: Lectures on Modern Convex Optimization. SIAM, Philadelphia, PA (2001)CrossRefMATH Ben-Tal, A., Nemirovski, A.: Lectures on Modern Convex Optimization. SIAM, Philadelphia, PA (2001)CrossRefMATH
7.
go back to reference Berrut, J.P., Trefethen, L.N.: Barycentric Lagrange interpolation. SIAM Rev. 46(3), 501–517 (2004). doi:10.1137/S0036144502417715CrossRefMathSciNetMATH Berrut, J.P., Trefethen, L.N.: Barycentric Lagrange interpolation. SIAM Rev. 46(3), 501–517 (2004). doi:10.1137/S0036144502417715CrossRefMathSciNetMATH
8.
go back to reference Blekherman, G.: Nonnegative polynomials and sums of squares. J. Am. Math. Assoc. 25(3), 617–635 (2012). doi:10.1090/S0894-0347-2012-00733-4CrossRefMathSciNetMATH Blekherman, G.: Nonnegative polynomials and sums of squares. J. Am. Math. Assoc. 25(3), 617–635 (2012). doi:10.1090/S0894-0347-2012-00733-4CrossRefMathSciNetMATH
9.
go back to reference Blekherman, G., Parrilo, P.A., Thomas, R.R.: Semidefinite optimization and convex algebraic geometry. SIAM, Philadelphia (2013)MATH Blekherman, G., Parrilo, P.A., Thomas, R.R.: Semidefinite optimization and convex algebraic geometry. SIAM, Philadelphia (2013)MATH
10.
go back to reference Bojanic, R., DeVore, R.: On polynomials of best one sided approximation. L’Enseignement Mathématique 12(3), 139–164 (1966)MathSciNetMATH Bojanic, R., DeVore, R.: On polynomials of best one sided approximation. L’Enseignement Mathématique 12(3), 139–164 (1966)MathSciNetMATH
13.
go back to reference Clenshaw, C.W.: A note on the summation of Chebyshev series. Math. Comput. 9, 118–120 (1955). doi:10.1090/S0025-5718-1955-0071856-0CrossRefMathSciNetMATH Clenshaw, C.W.: A note on the summation of Chebyshev series. Math. Comput. 9, 118–120 (1955). doi:10.1090/S0025-5718-1955-0071856-0CrossRefMathSciNetMATH
14.
go back to reference de Klerk, E.: Computer-assisted proofs and semidefinite programming. Optima 100, 11–12 (2016) de Klerk, E.: Computer-assisted proofs and semidefinite programming. Optima 100, 11–12 (2016)
15.
go back to reference Dette, H.: Optimal designs for a class of polynomials of odd or even degree. Ann. Stat. 20(1), 238–259 (1992). doi:10.1214/aos/1176348520CrossRefMathSciNetMATH Dette, H.: Optimal designs for a class of polynomials of odd or even degree. Ann. Stat. 20(1), 238–259 (1992). doi:10.1214/aos/1176348520CrossRefMathSciNetMATH
16.
go back to reference Driscoll, T.A., Hale, N., Trefethen, L.N.: Chebfun Guide. Pafnuty Publications, Oxford, UK (2014) Driscoll, T.A., Hale, N., Trefethen, L.N.: Chebfun Guide. Pafnuty Publications, Oxford, UK (2014)
17.
go back to reference Dunkl, C.F., Xu, Y.: Orthogonal Polynomials of Several Variables. In: Encyclopedia of Mathematics and Its Applications, vol. 81. Cambridge University Press, Cambridge, UK (2001) Dunkl, C.F., Xu, Y.: Orthogonal Polynomials of Several Variables. In: Encyclopedia of Mathematics and Its Applications, vol. 81. Cambridge University Press, Cambridge, UK (2001)
18.
go back to reference Fedorov, V.V.: Theory of Optimal Experiments. Academic, New York, NY (1972) Fedorov, V.V.: Theory of Optimal Experiments. Academic, New York, NY (1972)
19.
go back to reference Genin, Y., Hachez, Y., Nesterov, Y., Van Dooren, P.: Convex optimization over positive polynomials and filter design. In: Proceedings of the 2000 UKACC International Conference on Control (2000) Genin, Y., Hachez, Y., Nesterov, Y., Van Dooren, P.: Convex optimization over positive polynomials and filter design. In: Proceedings of the 2000 UKACC International Conference on Control (2000)
20.
go back to reference Ghaddar, B., Marecek, J., Mevissen, M.: Optimal power flow as a polynomial optimization problem. IEEE Trans. Power Syst. 31(1), 539–546 (2016)CrossRef Ghaddar, B., Marecek, J., Mevissen, M.: Optimal power flow as a polynomial optimization problem. IEEE Trans. Power Syst. 31(1), 539–546 (2016)CrossRef
21.
go back to reference Gil, A., Segura, J., Temme, N.M.: Numerical methods for special functions. SIAM, Philadelphia, PA (2007)CrossRefMATH Gil, A., Segura, J., Temme, N.M.: Numerical methods for special functions. SIAM, Philadelphia, PA (2007)CrossRefMATH
22.
go back to reference Handelman, D.: Representing polynomials by positive linear functions on compact convex polyhedra. Pac. J. Math. 132(1), 35–62 (1988)CrossRefMathSciNetMATH Handelman, D.: Representing polynomials by positive linear functions on compact convex polyhedra. Pac. J. Math. 132(1), 35–62 (1988)CrossRefMathSciNetMATH
23.
go back to reference Hardy, G.H., Littlewood, J.E., Pólya, G.: Inequalities. Cambridge University Press, Cambridge (1934)MATH Hardy, G.H., Littlewood, J.E., Pólya, G.: Inequalities. Cambridge University Press, Cambridge (1934)MATH
24.
go back to reference Henrion, D., Lasserre, J.B., Löfberg, J.: GloptiPoly 3: moments, optimization and semidefinite programming. Optim. Methods Softw. 24(4–5), 761–779 (2009)CrossRefMathSciNetMATH Henrion, D., Lasserre, J.B., Löfberg, J.: GloptiPoly 3: moments, optimization and semidefinite programming. Optim. Methods Softw. 24(4–5), 761–779 (2009)CrossRefMathSciNetMATH
25.
go back to reference Heß, R., Henrion, D., Lasserre, J.B., Pham, T.S.: Semidefinite approximations of the polynomial abscissa. SIAM J. Control Optim. 54(3), 1633–1656 (2016)CrossRefMathSciNetMATH Heß, R., Henrion, D., Lasserre, J.B., Pham, T.S.: Semidefinite approximations of the polynomial abscissa. SIAM J. Control Optim. 54(3), 1633–1656 (2016)CrossRefMathSciNetMATH
26.
27.
28.
go back to reference Horst, R., Pardalos, P.M.: Handbook of Global Optimization, vol. 2. Springer, New York (2013)MATH Horst, R., Pardalos, P.M.: Handbook of Global Optimization, vol. 2. Springer, New York (2013)MATH
29.
30.
go back to reference Lasserre, J.B., Toh, K.C., Yang, S.: A bounded degree SOS hierarchy for polynomial optimization. EURO J. Comput. Optim. 5(1), 87–117 (2017). doi:10.1007/s13675-015-0050-yCrossRefMathSciNetMATH Lasserre, J.B., Toh, K.C., Yang, S.: A bounded degree SOS hierarchy for polynomial optimization. EURO J. Comput. Optim. 5(1), 87–117 (2017). doi:10.1007/s13675-015-0050-yCrossRefMathSciNetMATH
31.
go back to reference Lofberg, J., Parrilo, P.A.: From coefficients to samples: a new approach to SOS optimization. In: 43rd IEEE Conference on Decision and Control, vol. 3, pp. 3154–3159. IEEE, Piscataway (2004) Lofberg, J., Parrilo, P.A.: From coefficients to samples: a new approach to SOS optimization. In: 43rd IEEE Conference on Decision and Control, vol. 3, pp. 3154–3159. IEEE, Piscataway (2004)
32.
go back to reference Lukács, F.: Verschärfung der ersten Mittelwertsatzes der Integralrechnung für rationale Polynome. Math. Z. 2, 229–305 (1918). doi:10.1007/BF01199412CrossRefMATH Lukács, F.: Verschärfung der ersten Mittelwertsatzes der Integralrechnung für rationale Polynome. Math. Z. 2, 229–305 (1918). doi:10.1007/BF01199412CrossRefMATH
33.
go back to reference Mehrotra, S., Papp, D.: A cutting surface algorithm for semi-infinite convex programming with an application to moment robust optimization. SIAM J. Optim. 24(4), 1670–1697 (2014). doi:10.1137/130925013CrossRefMathSciNetMATH Mehrotra, S., Papp, D.: A cutting surface algorithm for semi-infinite convex programming with an application to moment robust optimization. SIAM J. Optim. 24(4), 1670–1697 (2014). doi:10.1137/130925013CrossRefMathSciNetMATH
34.
go back to reference Menini, L., Tornambè, A.: Exact sum of squares decomposition of univariate polynomials. In: 54th IEEE Conference on Decision and Control (CDC), pp. 1072–1077 (2015). doi:10.1109/CDC.2015.7402354 Menini, L., Tornambè, A.: Exact sum of squares decomposition of univariate polynomials. In: 54th IEEE Conference on Decision and Control (CDC), pp. 1072–1077 (2015). doi:10.1109/CDC.2015.7402354
35.
go back to reference Nesterov, Y.: Squared functional systems and optimization problems. In: Frenk, H., Roos, K., Terlaky, T., Zhang, S. (eds.) High Performance Optimization. Applied Optimization, vol. 33, pp. 405–440. Kluwer Academic Publishers, Dordrecht, The Netherlands (2000)CrossRef Nesterov, Y.: Squared functional systems and optimization problems. In: Frenk, H., Roos, K., Terlaky, T., Zhang, S. (eds.) High Performance Optimization. Applied Optimization, vol. 33, pp. 405–440. Kluwer Academic Publishers, Dordrecht, The Netherlands (2000)CrossRef
36.
go back to reference Papp, D.: Optimization models for shape-constrained function estimation problems involving nonnegative polynomials and their restrictions. Ph.D. thesis, Rutgers University (2011) Papp, D.: Optimization models for shape-constrained function estimation problems involving nonnegative polynomials and their restrictions. Ph.D. thesis, Rutgers University (2011)
37.
go back to reference Papp, D.: Optimal designs for rational function regression. J. Am. Stat. Assoc. 107(497), 400–411 (2012). doi:10.1080/01621459.2012.656035CrossRefMathSciNetMATH Papp, D.: Optimal designs for rational function regression. J. Am. Stat. Assoc. 107(497), 400–411 (2012). doi:10.1080/01621459.2012.656035CrossRefMathSciNetMATH
38.
go back to reference Papp, D., Alizadeh, F.: Shape constrained estimation using nonnegative splines. J. Comput. Graph. Stat. 23(1), 211–231 (2014)CrossRefMathSciNet Papp, D., Alizadeh, F.: Shape constrained estimation using nonnegative splines. J. Comput. Graph. Stat. 23(1), 211–231 (2014)CrossRefMathSciNet
39.
go back to reference Parrilo, P.A.: Semidefinite programming relaxations for semialgebraic problems. Math. Program. 96(2), 293–320 (2003). doi:10.1007/s10107-003-0387-5CrossRefMathSciNetMATH Parrilo, P.A.: Semidefinite programming relaxations for semialgebraic problems. Math. Program. 96(2), 293–320 (2003). doi:10.1007/s10107-003-0387-5CrossRefMathSciNetMATH
40.
go back to reference Pukelsheim, F.: Optimal Design of Experiments. Wiley, New York (1993)MATH Pukelsheim, F.: Optimal Design of Experiments. Wiley, New York (1993)MATH
42.
go back to reference Rudolf, G., Noyan, N., Papp, D., Alizadeh, F.: Bilinear optimality constraints for the cone of positive polynomials. Math. Program. 129(1), 5–31 (2011). doi:10.1007/s10107-011-0458-yCrossRefMathSciNetMATH Rudolf, G., Noyan, N., Papp, D., Alizadeh, F.: Bilinear optimality constraints for the cone of positive polynomials. Math. Program. 129(1), 5–31 (2011). doi:10.1007/s10107-011-0458-yCrossRefMathSciNetMATH
43.
44.
45.
go back to reference Timan, A.F.: Theory of Approximation of Functions of a Real Variable. Pergamon Press, Oxford, UK (1963)MATH Timan, A.F.: Theory of Approximation of Functions of a Real Variable. Pergamon Press, Oxford, UK (1963)MATH
46.
go back to reference Toh, K.C., Todd, M.J., Tütüncü, R.H.: SDPT3—a Matlab software package for semidefinite programming, version 1.3. Optim. Methods Softw. 11–12(1–4), 545–581 (1999). doi:10.1080/10556789908805762 Toh, K.C., Todd, M.J., Tütüncü, R.H.: SDPT3—a Matlab software package for semidefinite programming, version 1.3. Optim. Methods Softw. 11–12(1–4), 545–581 (1999). doi:10.1080/10556789908805762
47.
go back to reference Trefethen, L.N.: Approximation Theory and Approximation Practice. SIAM, Philadelphia, PA (2013)MATH Trefethen, L.N.: Approximation Theory and Approximation Practice. SIAM, Philadelphia, PA (2013)MATH
49.
go back to reference Unkelbach, J., Papp, D.: The emergence of nonuniform spatiotemporal fractionation schemes within the standard BED model. Med. Phys. 42(5), 2234–2241 (2015)CrossRef Unkelbach, J., Papp, D.: The emergence of nonuniform spatiotemporal fractionation schemes within the standard BED model. Med. Phys. 42(5), 2234–2241 (2015)CrossRef
50.
go back to reference Vallentin, F.: Optimization in discrete geometry. Optima 100, 1–10 (2016) Vallentin, F.: Optimization in discrete geometry. Optima 100, 1–10 (2016)
Metadata
Title
Univariate Polynomial Optimization with Sum-of-Squares Interpolants
Author
Dávid Papp
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-66616-7_9

Premium Partner