Skip to main content

2017 | OriginalPaper | Buchkapitel

Consensus-based Parallel Algorithm for Robust Convex Optimization with Scenario Approach in Colored Network

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper mainly proposes an parallel distributed learning algorithm for the robust convex optimization (RCO). Firstly, the scenario approach is used to transform RCO into its probabilistic approximation Scenario Problem (SP), which is distributively solved by multiprocessors to lighten the computational burden. Secondly, each processor (node) of the colored network processes the local optimization via a primal-dual subgradient algorithm (PDSA) to obtain an optimal solution called a local variable. Finally, a consensus method named the Colored Distributed Average Consensus (CDAC), which is based on Distributed Average Consensus (DAC), is proposed to act on the whole local variables to obtain the global optimal solution. Experimental results show that CDAC has an advantage in terms of computational time over DAC, while they have the same results.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
5.
Zurück zum Zitat Ben-Tal, A., Hertog, D., Vial, J.: Deriving robust counterparts of nonlinear uncertain inequalities. Math. Program. 149, 265–299 (2015)MathSciNetCrossRefMATH Ben-Tal, A., Hertog, D., Vial, J.: Deriving robust counterparts of nonlinear uncertain inequalities. Math. Program. 149, 265–299 (2015)MathSciNetCrossRefMATH
6.
Zurück zum Zitat Calafiore, G., Campi, M.: Uncertain convex programs: randomized solutions and confidence levels. Math. Program. 102, 25–46 (2005)MathSciNetCrossRefMATH Calafiore, G., Campi, M.: Uncertain convex programs: randomized solutions and confidence levels. Math. Program. 102, 25–46 (2005)MathSciNetCrossRefMATH
7.
Zurück zum Zitat Campi, M., Garatti, S.: The exact feasibility of randomized solutions of uncertain convex programs. SIAM J. Optim. 19, 1211–1230 (2008)MathSciNetCrossRefMATH Campi, M., Garatti, S.: The exact feasibility of randomized solutions of uncertain convex programs. SIAM J. Optim. 19, 1211–1230 (2008)MathSciNetCrossRefMATH
8.
Zurück zum Zitat Farias, D., Roy, B.: On constraint sampling in the linear programming approach to approximate dynamic programming. Math. Oper. Res. 29, 462–478 (2004)MathSciNetCrossRefMATH Farias, D., Roy, B.: On constraint sampling in the linear programming approach to approximate dynamic programming. Math. Oper. Res. 29, 462–478 (2004)MathSciNetCrossRefMATH
9.
Zurück zum Zitat You, K., Tempo, R.: Networked parallel algorithms for robust convex optimization via the scenario spproach. arXiv preprint. arXiv: 1607.05507 (2016) You, K., Tempo, R.: Networked parallel algorithms for robust convex optimization via the scenario spproach. arXiv preprint. arXiv:​ 1607.​05507 (2016)
10.
Zurück zum Zitat Scardapane, S., Wang, D., Panella, M., Uncini, A.: Distributed learning for random vector functional-link networks. Inf. Sci. 301, 271–284 (2015) Scardapane, S., Wang, D., Panella, M., Uncini, A.: Distributed learning for random vector functional-link networks. Inf. Sci. 301, 271–284 (2015)
11.
Zurück zum Zitat Alamo, T., Tempo, R., Luque, A., Ramirez, D.: Randomized methods for design of uncertain systems: sample complexity and sequential algorithms. Automatica 52, 160–172 (2013)MathSciNetCrossRefMATH Alamo, T., Tempo, R., Luque, A., Ramirez, D.: Randomized methods for design of uncertain systems: sample complexity and sequential algorithms. Automatica 52, 160–172 (2013)MathSciNetCrossRefMATH
12.
Zurück zum Zitat Sen, S., Sherali, H.: A class of convergent of primal-dual subgradient algorithms for decomposable convex program. Math. Program. 35, 279–297 (1986)MathSciNetCrossRefMATH Sen, S., Sherali, H.: A class of convergent of primal-dual subgradient algorithms for decomposable convex program. Math. Program. 35, 279–297 (1986)MathSciNetCrossRefMATH
13.
Zurück zum Zitat Boyd, S., Parikh, N., Chu, E., Peleato, B., Eckstein, J.: Distributed optimization and statistical learning via the alternating direction method of multipliers. Found. Trends\(\textregistered \) Mach. Learn. 3, 1–122 (2011) Boyd, S., Parikh, N., Chu, E., Peleato, B., Eckstein, J.: Distributed optimization and statistical learning via the alternating direction method of multipliers. Found. Trends\(\textregistered \) Mach. Learn. 3, 1–122 (2011)
15.
Zurück zum Zitat Olfati-Saber, R., Fax, J., Murray, R.: Consensus and cooperation in networked multi-agent systems. Proc. IEEE 95, 215–233 (2007)CrossRef Olfati-Saber, R., Fax, J., Murray, R.: Consensus and cooperation in networked multi-agent systems. Proc. IEEE 95, 215–233 (2007)CrossRef
16.
Zurück zum Zitat Ghaoui, L., Lebret, H.: Robust solutions to least-squares problems with uncertain data. SIAM J. Matrix Anal. A. 18, 1035–1064 (1997)MathSciNetCrossRefMATH Ghaoui, L., Lebret, H.: Robust solutions to least-squares problems with uncertain data. SIAM J. Matrix Anal. A. 18, 1035–1064 (1997)MathSciNetCrossRefMATH
17.
Zurück zum Zitat Mota, J., Xavier, J., Aguiar, P., Püschel, M.: D-ADMM: A communication-efficient distributed algorithm for separable optimization. IEEE Trans. Sig. Process. 61, 2718–2723 (2013)MathSciNetCrossRef Mota, J., Xavier, J., Aguiar, P., Püschel, M.: D-ADMM: A communication-efficient distributed algorithm for separable optimization. IEEE Trans. Sig. Process. 61, 2718–2723 (2013)MathSciNetCrossRef
18.
Zurück zum Zitat Wang, H., Gao, Y., Shi, Y., Wang, R.: Group-based alternating direction method of multipliers for distributed linear classification. IEEE Trans. Cybern. 99, 1–15 (2016) Wang, H., Gao, Y., Shi, Y., Wang, R.: Group-based alternating direction method of multipliers for distributed linear classification. IEEE Trans. Cybern. 99, 1–15 (2016)
19.
Zurück zum Zitat Wang, H., Gao, Y., Shi, Y., Wang, H.: A fast distributed classification algorithm for large-scale imbalanced data. In: 16th IEEE International Conference on Data Mining, pp. 1251–1256. IEEE, New Orleans (2016) Wang, H., Gao, Y., Shi, Y., Wang, H.: A fast distributed classification algorithm for large-scale imbalanced data. In: 16th IEEE International Conference on Data Mining, pp. 1251–1256. IEEE, New Orleans (2016)
20.
Zurück zum Zitat Goldstein, T., O’Donoghue, B., Setzer, S., Baraniuk, R.: Fast alternating direction optimization methods. SIAM J. Imaging. Sci. 7, 1588–1623 (2014)MathSciNetCrossRefMATH Goldstein, T., O’Donoghue, B., Setzer, S., Baraniuk, R.: Fast alternating direction optimization methods. SIAM J. Imaging. Sci. 7, 1588–1623 (2014)MathSciNetCrossRefMATH
Metadaten
Titel
Consensus-based Parallel Algorithm for Robust Convex Optimization with Scenario Approach in Colored Network
verfasst von
Fan Feng
Feilong Cao
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-68935-7_25

Premium Partner