Skip to main content

2017 | OriginalPaper | Buchkapitel

Recommending PSO Variants Using Meta-Learning Framework for Global Optimization

verfasst von : Xianghua Chu, Fulin Cai, Jiansheng Chen, Li Li

Erschienen in: Simulated Evolution and Learning

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Since inception, particle swarm optimization (PSO) has raised a great interest across various disciplines, thus producing a large number of PSO variants with respective strengths. However, a variant may perform variously on diverse problems, which leads to the risk of the algorithm selection of PSOs for a specific problem without prior knowledge. Hence, it is worth investigating a link between problem characteristics and algorithm performance. To address this issue, we propose a recommendation system of PSO variants for global optimization problem using meta-learning framework. Benchmark functions in the learning instance repository are pictured by meta-features to obtain characteristics and solved by the candidate PSO heuristics to gather performance rankings. k-NN method is employed to develop meta-learning system for recommending the predicted rankings of candidate PSO-variants. Results show that the predicted rankings highly correlate to the ideal rankings and achieve high precision on best algorithm recommendation. Besides, problem surface characteristics play a key role in recommendation performance, followed by sample point characteristics. To sum up, the proposed framework can significantly reduce the risk of algorithm selection.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Eberhart, R., Kennedy, J.: A new optimizer using particle swarm theory. In: Sixth International Symposium on Micro Machine and Human Science, pp. 39–43 (1995) Eberhart, R., Kennedy, J.: A new optimizer using particle swarm theory. In: Sixth International Symposium on Micro Machine and Human Science, pp. 39–43 (1995)
2.
Zurück zum Zitat Kennedy, J., Eberhart, R.: Particle swarm optimization. In: IEEE International Conference on Neural Networks, vol. 4, pp. 1942–1948 (1995) Kennedy, J., Eberhart, R.: Particle swarm optimization. In: IEEE International Conference on Neural Networks, vol. 4, pp. 1942–1948 (1995)
3.
Zurück zum Zitat Wolpert, D.H., Macready, W.G.: No free lunch theorems for optimization. IEEE Trans. Evol. Comput. 1, 67–82 (1997)CrossRef Wolpert, D.H., Macready, W.G.: No free lunch theorems for optimization. IEEE Trans. Evol. Comput. 1, 67–82 (1997)CrossRef
4.
Zurück zum Zitat Brazdil, P.: Metalearning: Applications to Data Mining. Cognitive Technologies (2009) Brazdil, P.: Metalearning: Applications to Data Mining. Cognitive Technologies (2009)
5.
Zurück zum Zitat Rice, J.R.: The algorithm selection problem. Adv. Comput. 15, 65–118 (1976)CrossRef Rice, J.R.: The algorithm selection problem. Adv. Comput. 15, 65–118 (1976)CrossRef
6.
Zurück zum Zitat Smith-Miles, K.A.: Towards insightful algorithm selection for optimisation using meta-learning concepts. In: IEEE International Joint Conference on Neural Networks, pp. 4118–4124 (2008) Smith-Miles, K.A.: Towards insightful algorithm selection for optimisation using meta-learning concepts. In: IEEE International Joint Conference on Neural Networks, pp. 4118–4124 (2008)
7.
Zurück zum Zitat Kanda, J., Carvalho, A.D., Hruschka, E., Soares, C., Brazdil, P.: Meta-learning to select the best meta-heuristic for the traveling salesman problem: a comparison of meta-features. Neurocomputing 205, 393–406 (2016)CrossRef Kanda, J., Carvalho, A.D., Hruschka, E., Soares, C., Brazdil, P.: Meta-learning to select the best meta-heuristic for the traveling salesman problem: a comparison of meta-features. Neurocomputing 205, 393–406 (2016)CrossRef
8.
Zurück zum Zitat Bischl, B., Mersmann, O., Trautmann, H., Preu, M.: Algorithm selection based on exploratory landscape analysis and cost-sensitive learning. In: Conference on Genetic and Evolutionary Computation, pp. 313–320 (2012) Bischl, B., Mersmann, O., Trautmann, H., Preu, M.: Algorithm selection based on exploratory landscape analysis and cost-sensitive learning. In: Conference on Genetic and Evolutionary Computation, pp. 313–320 (2012)
9.
Zurück zum Zitat Mersmann, O., Bischl, B., Trautmann, H., Preuss, M., Weihs, C.: Exploratory landscape analysis. In: Proceedings of Genetic and Evolutionary Computation Conference, GECCO 2011, Dublin, Ireland, July, pp. 829–836 (2011) Mersmann, O., Bischl, B., Trautmann, H., Preuss, M., Weihs, C.: Exploratory landscape analysis. In: Proceedings of Genetic and Evolutionary Computation Conference, GECCO 2011, Dublin, Ireland, July, pp. 829–836 (2011)
10.
Zurück zum Zitat Muñoz, M.A., Kirley, M., Halgamuge, S.K.: A meta-learning prediction model of algorithm performance for continuous optimization problems. In: Coello, C.A.C., Cutello, V., Deb, K., Forrest, S., Nicosia, G., Pavone, M. (eds.) PPSN 2012. LNCS, vol. 7491, pp. 226–235. Springer, Heidelberg (2012). doi:10.1007/978-3-642-32937-1_23 CrossRef Muñoz, M.A., Kirley, M., Halgamuge, S.K.: A meta-learning prediction model of algorithm performance for continuous optimization problems. In: Coello, C.A.C., Cutello, V., Deb, K., Forrest, S., Nicosia, G., Pavone, M. (eds.) PPSN 2012. LNCS, vol. 7491, pp. 226–235. Springer, Heidelberg (2012). doi:10.​1007/​978-3-642-32937-1_​23 CrossRef
11.
Zurück zum Zitat Malan, K.M., Engelbrecht, A.P.: Particle swarm optimisation failure prediction based on fitness landscape characteristics. In: IEEE Symposium on Swarm Intelligence, pp. 1–9 (2014) Malan, K.M., Engelbrecht, A.P.: Particle swarm optimisation failure prediction based on fitness landscape characteristics. In: IEEE Symposium on Swarm Intelligence, pp. 1–9 (2014)
12.
Zurück zum Zitat Muñoz, M.A., Sun, Y., Kirley, M., Halgamuge, S.K.: Algorithm selection for black-box continuous optimization problems: a survey on methods and challenges. Inf. Sci. 317, 224–245 (2015)CrossRef Muñoz, M.A., Sun, Y., Kirley, M., Halgamuge, S.K.: Algorithm selection for black-box continuous optimization problems: a survey on methods and challenges. Inf. Sci. 317, 224–245 (2015)CrossRef
13.
Zurück zum Zitat Suganthan, P.N., Hansen, N., Liang, J.J., Deb, K., Chen, Y.-P., Auger, A., Tiwari, S.: Problem definitions and evaluation criteria for the CEC 2005 special session on real-parameter optimization. KanGAL report (2005) Suganthan, P.N., Hansen, N., Liang, J.J., Deb, K., Chen, Y.-P., Auger, A., Tiwari, S.: Problem definitions and evaluation criteria for the CEC 2005 special session on real-parameter optimization. KanGAL report (2005)
14.
Zurück zum Zitat Shi, Y., Eberhart, R.: Modified particle swarm optimizer. In: IEEE World Congress on Computational Intelligence, pp. 69–73 (1998) Shi, Y., Eberhart, R.: Modified particle swarm optimizer. In: IEEE World Congress on Computational Intelligence, pp. 69–73 (1998)
15.
Zurück zum Zitat Clerc, M., Kennedy, J.: The particle swarm - explosion, stability, and convergence in a multidimensional complex space. IEEE Trans. Evol. Comput. 20, 1671–1676 (2002) Clerc, M., Kennedy, J.: The particle swarm - explosion, stability, and convergence in a multidimensional complex space. IEEE Trans. Evol. Comput. 20, 1671–1676 (2002)
16.
Zurück zum Zitat Kennedy, J., Mendes, R.: Population structure and particle swarm performance. In: Proceedings of the 2002 Congress on Evolutionary Computation, pp. 1671–1676 (2002) Kennedy, J., Mendes, R.: Population structure and particle swarm performance. In: Proceedings of the 2002 Congress on Evolutionary Computation, pp. 1671–1676 (2002)
17.
Zurück zum Zitat Parsopoulos, K.E., Vrahatis, M.N.: A unified particle swarm optimization scheme. In: International Conference of Computational Methods in Sciences and Engineering, pp. 221–226 (2004) Parsopoulos, K.E., Vrahatis, M.N.: A unified particle swarm optimization scheme. In: International Conference of Computational Methods in Sciences and Engineering, pp. 221–226 (2004)
18.
Zurück zum Zitat Liang, J.J., Qin, A.K., Suganthan, P.N., Baskar, S.: Comprehensive learning particle swarm optimizer for global optimization of multimodal functions. IEEE Trans. Evol. Comput. 10, 281–295 (2006)CrossRef Liang, J.J., Qin, A.K., Suganthan, P.N., Baskar, S.: Comprehensive learning particle swarm optimizer for global optimization of multimodal functions. IEEE Trans. Evol. Comput. 10, 281–295 (2006)CrossRef
19.
Zurück zum Zitat Frans, V.D.B., Engelbrecht, A.P.: A cooperative approach to particle swarm optimization. IEEE Trans. Evol. Comput. 8, 225–239 (2004)CrossRef Frans, V.D.B., Engelbrecht, A.P.: A cooperative approach to particle swarm optimization. IEEE Trans. Evol. Comput. 8, 225–239 (2004)CrossRef
20.
Zurück zum Zitat Liao, T., Molina, D., Tzle, T.: Performance evaluation of automatically tuned continuous optimizers on different benchmark sets. Appl. Soft Comput. 27, 490–503 (2014)CrossRef Liao, T., Molina, D., Tzle, T.: Performance evaluation of automatically tuned continuous optimizers on different benchmark sets. Appl. Soft Comput. 27, 490–503 (2014)CrossRef
21.
Zurück zum Zitat Auger, A., Hansen, N.: Performance evaluation of an advanced local search evolutionary algorithm. In: The 2005 IEEE Congress on Evolutionary Computation, vol. 2, pp. 1777–1784 (2005) Auger, A., Hansen, N.: Performance evaluation of an advanced local search evolutionary algorithm. In: The 2005 IEEE Congress on Evolutionary Computation, vol. 2, pp. 1777–1784 (2005)
22.
Zurück zum Zitat Romero, C., Olmo, J.L., Ventura, S.: A meta-learning approach for recommending a subset of white-box classification algorithms for Moodle datasets. In: Educational Data Mining (2013) Romero, C., Olmo, J.L., Ventura, S.: A meta-learning approach for recommending a subset of white-box classification algorithms for Moodle datasets. In: Educational Data Mining (2013)
23.
Zurück zum Zitat Sun, Q., Pfahringer, B.: Pairwise meta-rules for better meta-learning-based algorithm ranking. Mach. Learn. 93, 141–161 (2013)MathSciNetCrossRefMATH Sun, Q., Pfahringer, B.: Pairwise meta-rules for better meta-learning-based algorithm ranking. Mach. Learn. 93, 141–161 (2013)MathSciNetCrossRefMATH
24.
Zurück zum Zitat Cui, C., Hu, M., Weir, J.D., Wu, T.: A recommendation system for meta-modeling: a meta-learning based approach. Expert Syst. Appl. 46, 33–44 (2015)CrossRef Cui, C., Hu, M., Weir, J.D., Wu, T.: A recommendation system for meta-modeling: a meta-learning based approach. Expert Syst. Appl. 46, 33–44 (2015)CrossRef
25.
Zurück zum Zitat Lunacek, M., Whitley, D.: The dispersion metric and the CMA evolution strategy. In: Proceedings of Genetic and Evolutionary Computation Conference, GECCO 2006, Seattle, Washington, USA, July, pp. 477–484 (2006) Lunacek, M., Whitley, D.: The dispersion metric and the CMA evolution strategy. In: Proceedings of Genetic and Evolutionary Computation Conference, GECCO 2006, Seattle, Washington, USA, July, pp. 477–484 (2006)
26.
Zurück zum Zitat Jones, T., Forrest, S.: Fitness distance correlation as a measure of problem difficulty for genetic algorithms. In: International Conference on Genetic Algorithms, pp. 184–192 (1995) Jones, T., Forrest, S.: Fitness distance correlation as a measure of problem difficulty for genetic algorithms. In: International Conference on Genetic Algorithms, pp. 184–192 (1995)
28.
Zurück zum Zitat Ferrari, D.G., Castro, L.N.D.: Clustering algorithm selection by meta-learning systems: a new distance-based problem characterization and ranking combination methods. Inf. Sci. 301, 181–194 (2015)CrossRef Ferrari, D.G., Castro, L.N.D.: Clustering algorithm selection by meta-learning systems: a new distance-based problem characterization and ranking combination methods. Inf. Sci. 301, 181–194 (2015)CrossRef
29.
Zurück zum Zitat Brazdil, P.B., Soares, C., Costa, J.P.D.: Ranking learning algorithms: using IBL and meta-learning on accuracy and time results. Mach. Learn. 50, 251–277 (2003)CrossRefMATH Brazdil, P.B., Soares, C., Costa, J.P.D.: Ranking learning algorithms: using IBL and meta-learning on accuracy and time results. Mach. Learn. 50, 251–277 (2003)CrossRefMATH
30.
Zurück zum Zitat Neave, H.R., Worthington, P.L.: Distribution-free tests. Contemp. Sociol. 19, 488 (1990)CrossRef Neave, H.R., Worthington, P.L.: Distribution-free tests. Contemp. Sociol. 19, 488 (1990)CrossRef
31.
Zurück zum Zitat Matala, A.: Sample Size Requierement for Monte Carlo–Simulations Using Latin Hypercube Sampling. Helsinki University of Technology, Espoo (2008) Matala, A.: Sample Size Requierement for Monte Carlo–Simulations Using Latin Hypercube Sampling. Helsinki University of Technology, Espoo (2008)
Metadaten
Titel
Recommending PSO Variants Using Meta-Learning Framework for Global Optimization
verfasst von
Xianghua Chu
Fulin Cai
Jiansheng Chen
Li Li
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-68759-9_77