Skip to main content

2021 | OriginalPaper | Buchkapitel

Hybridization of Metaheuristic and Population-Based Algorithms with Neural Network Learning for Function Approximation

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper attempts to improve the learning representation of radial basis function neural network (RBFNN) through metaheuristic algorithm (MHA) and evolutionary algorithm (EA). Next, the ant colony optimization (ACO)-based and genetic algorithm (GA)-based approaches are employed to train RBFNN. The proposed hybridization of ACO-based and GA-based approaches (HAG) algorithm incorporates the complementarity of exploration and exploitation abilities to reach resolution optimization. The property of population diversity has higher chance to search the global optimal instead of being restricted to local optimal extremely in two benchmark problems. The experimental results have shown that ACO-based and GA-based approaches can be integrated intelligently and develop into a hybrid algorithm which aims for receiving the best precise learning expression among relevant algorithms in this paper. Additionally, method assessment results for two benchmark continuous test function experiments and show that the proposed HAG algorithm outperforms relevant algorithms in term of preciseness for learning of function approximation.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Al-Obaidi, M.A., Li, J.P., Kara-Zaïtri, C., Mujtaba, I.M.: Optimisation of reverse osmosis based wastewater treatment system for the removal of chlorophenol using genetic algorithms. Chem. Eng. J. 316, 91–100 (2017)CrossRef Al-Obaidi, M.A., Li, J.P., Kara-Zaïtri, C., Mujtaba, I.M.: Optimisation of reverse osmosis based wastewater treatment system for the removal of chlorophenol using genetic algorithms. Chem. Eng. J. 316, 91–100 (2017)CrossRef
2.
Zurück zum Zitat Al-Roomi, A.R., El-Hawary, M.E.: Universal functions originator. Appl. Soft Comput. 94, 106417–106448 (2020)CrossRef Al-Roomi, A.R., El-Hawary, M.E.: Universal functions originator. Appl. Soft Comput. 94, 106417–106448 (2020)CrossRef
3.
Zurück zum Zitat Ansari, M., Othman, F., El-Shafie, A.: Optimized fuzzy inference system to enhance prediction accuracy for influent characteristics of a sewage treatment plant. Sci. Total Environ. 722, 137878–137890 (2020)CrossRef Ansari, M., Othman, F., El-Shafie, A.: Optimized fuzzy inference system to enhance prediction accuracy for influent characteristics of a sewage treatment plant. Sci. Total Environ. 722, 137878–137890 (2020)CrossRef
4.
Zurück zum Zitat Bilal, M.P., Zaheer, H., Garcia-Hernandez, L., Abraham, A.: Differential evolution: a review of more than two decades of research. Eng. Appl. Artif. Intell. 90, 103479–1034502 (2020)CrossRef Bilal, M.P., Zaheer, H., Garcia-Hernandez, L., Abraham, A.: Differential evolution: a review of more than two decades of research. Eng. Appl. Artif. Intell. 90, 103479–1034502 (2020)CrossRef
5.
Zurück zum Zitat Chen, S., Cowan, C.F.N., Grant, P.M.: Orthogonal least squares learning algorithm for radial basis function networks. IEEE Trans. Neural Netw. 2(2), 302–309 (1991)CrossRef Chen, S., Cowan, C.F.N., Grant, P.M.: Orthogonal least squares learning algorithm for radial basis function networks. IEEE Trans. Neural Netw. 2(2), 302–309 (1991)CrossRef
6.
Zurück zum Zitat Chen, S., Wu, Y., Luk, B.L.: Combined genetic algorithm optimization and regularized orthogonal least squares learning for radial basis function networks. IEEE Trans. Neural Netw. 10(5), 1239–1243 (1999)CrossRef Chen, S., Wu, Y., Luk, B.L.: Combined genetic algorithm optimization and regularized orthogonal least squares learning for radial basis function networks. IEEE Trans. Neural Netw. 10(5), 1239–1243 (1999)CrossRef
9.
Zurück zum Zitat Duda, R.O., Hart, P.E.: Pattern Classification and Scene Analysis. John Wiley and Sons, New York (1973)MATH Duda, R.O., Hart, P.E.: Pattern Classification and Scene Analysis. John Wiley and Sons, New York (1973)MATH
10.
Zurück zum Zitat Dzalbs, I., Kalganova, T.: Accelerating supply chains with Ant Colony Optimization across a range of hardware solutions. Comput. Ind. Eng. 147, 106610–106623 (2020)CrossRef Dzalbs, I., Kalganova, T.: Accelerating supply chains with Ant Colony Optimization across a range of hardware solutions. Comput. Ind. Eng. 147, 106610–106623 (2020)CrossRef
11.
Zurück zum Zitat Faramarzi, A., Heidarinejad, M., Stephens, B., Mirjalili, S.: Equilibrium optimizer: a novel optimization algorithm. Knowl. Based Syst. 191, 105190–105210 (2020)CrossRef Faramarzi, A., Heidarinejad, M., Stephens, B., Mirjalili, S.: Equilibrium optimizer: a novel optimization algorithm. Knowl. Based Syst. 191, 105190–105210 (2020)CrossRef
12.
Zurück zum Zitat Ghafil, H.N., Jarmai, K.: Dynamic differential annealed optimization: new metaheuristic optimization algorithm for engineering applications. Appl. Soft Comput. 93, 106392–106410 (2020)CrossRef Ghafil, H.N., Jarmai, K.: Dynamic differential annealed optimization: new metaheuristic optimization algorithm for engineering applications. Appl. Soft Comput. 93, 106392–106410 (2020)CrossRef
13.
Zurück zum Zitat Goldberg, D.E.: Genetic Algorithms in Search Optimization and Machine Learning. Addison-Wesley, Boston (1989)MATH Goldberg, D.E.: Genetic Algorithms in Search Optimization and Machine Learning. Addison-Wesley, Boston (1989)MATH
14.
Zurück zum Zitat Hamzaday, A., Baykasoglu, A., Akpinar, S.: Solving combinatorial optimization problems with single seekers society algorithm. Knowl. Based Syst. 201–202, 106036–106065 (2020)CrossRef Hamzaday, A., Baykasoglu, A., Akpinar, S.: Solving combinatorial optimization problems with single seekers society algorithm. Knowl. Based Syst. 201–202, 106036–106065 (2020)CrossRef
15.
Zurück zum Zitat Holland, J.H.: Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence. MIT Press, Cambridge (1992)CrossRef Holland, J.H.: Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence. MIT Press, Cambridge (1992)CrossRef
16.
Zurück zum Zitat Islam, J., Vasant, P.M., Negash, B.M., Laruccia, M.B., Myint, M., Watada, J.: A holistic review on artificial intelligence techniques for well placement optimization problem. Adv. Eng. Softw. 141, 102767–102786 (2020)CrossRef Islam, J., Vasant, P.M., Negash, B.M., Laruccia, M.B., Myint, M., Watada, J.: A holistic review on artificial intelligence techniques for well placement optimization problem. Adv. Eng. Softw. 141, 102767–102786 (2020)CrossRef
17.
Zurück zum Zitat Jakobsson, S., Andersson, B., Edelvik, F.: Rational radial basis function interpolation with applications to antenna design. J. Comput. Appl. Math. 233(4), 889–904 (2009)MathSciNetCrossRef Jakobsson, S., Andersson, B., Edelvik, F.: Rational radial basis function interpolation with applications to antenna design. J. Comput. Appl. Math. 233(4), 889–904 (2009)MathSciNetCrossRef
18.
Zurück zum Zitat Jugulum, R., Taguchi, S., et al.: Computer-Based Robust Engineering: Essentials for DFSS. ASQ Quality Press, Milwaukee (2004) Jugulum, R., Taguchi, S., et al.: Computer-Based Robust Engineering: Essentials for DFSS. ASQ Quality Press, Milwaukee (2004)
19.
Zurück zum Zitat Kefayat, M., Ara, A.I., Niaki, S.A.N.: A hybrid of ant colony optimization and artificial bee colony algorithm for probabilistic optimal placement and sizing of distributed energy resources. Energ. Convers. Manage. 92, 149–161 (2015)CrossRef Kefayat, M., Ara, A.I., Niaki, S.A.N.: A hybrid of ant colony optimization and artificial bee colony algorithm for probabilistic optimal placement and sizing of distributed energy resources. Energ. Convers. Manage. 92, 149–161 (2015)CrossRef
20.
Zurück zum Zitat Kozak, J., Boryczka, U.: Multiple boosting in the Ant colony decision forest meta-classifier. Knowl. Based Syst. 75, 141–151 (2015)CrossRef Kozak, J., Boryczka, U.: Multiple boosting in the Ant colony decision forest meta-classifier. Knowl. Based Syst. 75, 141–151 (2015)CrossRef
21.
Zurück zum Zitat Lin, Y.K., Yeh, C.T., Huang, P.S.: A hybrid ant-tabu algorithm for solving a multistate flow network reliability maximization problem. Appl. Soft Comput. 13, 3529–3543 (2013)CrossRef Lin, Y.K., Yeh, C.T., Huang, P.S.: A hybrid ant-tabu algorithm for solving a multistate flow network reliability maximization problem. Appl. Soft Comput. 13, 3529–3543 (2013)CrossRef
22.
Zurück zum Zitat Lin, C.F., Wu, C.C., Yang, P.H., Kuo, T.Y.: Application of Taguchi method in lightemitting diode backlight design for wide color gamut displays. J. Disp. Technol. 5(8), 323–330 (2009)CrossRef Lin, C.F., Wu, C.C., Yang, P.H., Kuo, T.Y.: Application of Taguchi method in lightemitting diode backlight design for wide color gamut displays. J. Disp. Technol. 5(8), 323–330 (2009)CrossRef
23.
Zurück zum Zitat Liu, B., Aliakbarian, H., Ma, Z., Vandenbosch, G.A.E., Gielen, G., Excell, P.: An efficient method for antenna design optimization based on evolutionary computation and machine learning techniques. IEEE Trans. Antennas Propag. 62(1), 7–18 (2014)CrossRef Liu, B., Aliakbarian, H., Ma, Z., Vandenbosch, G.A.E., Gielen, G., Excell, P.: An efficient method for antenna design optimization based on evolutionary computation and machine learning techniques. IEEE Trans. Antennas Propag. 62(1), 7–18 (2014)CrossRef
24.
Zurück zum Zitat Looney, C.G.: Advances in feedforward neural networks: demystifying knowledge acquiring black boxes. IEEE Trans. Knowl. Data Eng. 8(2), 211–226 (1996)CrossRef Looney, C.G.: Advances in feedforward neural networks: demystifying knowledge acquiring black boxes. IEEE Trans. Knowl. Data Eng. 8(2), 211–226 (1996)CrossRef
25.
Zurück zum Zitat Luan, J., Yao, Z., Zhao, F., Song, X.: A novel method to solve supplier selection problem: hybrid algorithm of genetic algorithm and ant colony optimization. Math. Comput. Simul. 156, 294–309 (2019)MathSciNetCrossRef Luan, J., Yao, Z., Zhao, F., Song, X.: A novel method to solve supplier selection problem: hybrid algorithm of genetic algorithm and ant colony optimization. Math. Comput. Simul. 156, 294–309 (2019)MathSciNetCrossRef
26.
Zurück zum Zitat McCulloch, W.S., Pitts, W.: A logical calculus of the ideas immanent in nervous activity. Bull. Math. Biophys. 5(4), 115–133 (1943)MathSciNetCrossRef McCulloch, W.S., Pitts, W.: A logical calculus of the ideas immanent in nervous activity. Bull. Math. Biophys. 5(4), 115–133 (1943)MathSciNetCrossRef
27.
Zurück zum Zitat Naghibi, S.A., Ahmadi, K., Daneshi, A.: Application of support vector machine, random forest, and genetic algorithm optimized random forest models in groundwater potential mapping. Water Resour. Manage. 31(9), 2761–2775 (2017)CrossRef Naghibi, S.A., Ahmadi, K., Daneshi, A.: Application of support vector machine, random forest, and genetic algorithm optimized random forest models in groundwater potential mapping. Water Resour. Manage. 31(9), 2761–2775 (2017)CrossRef
28.
Zurück zum Zitat Qasem, S.N., Shamsuddin, S.M., Zain, A.M.: Multi-objective hybrid evolutionary algorithms for radial basis function neural network design. Knowl. Based Syst. 27, 475–497 (2012)CrossRef Qasem, S.N., Shamsuddin, S.M., Zain, A.M.: Multi-objective hybrid evolutionary algorithms for radial basis function neural network design. Knowl. Based Syst. 27, 475–497 (2012)CrossRef
29.
Zurück zum Zitat Rao, R.V., Rai, D.P., Balic, J.: A multi-objective algorithm for optimization of modern machining processes. Eng. Appl. Artif. Intell. 61, 103–125 (2017)CrossRef Rao, R.V., Rai, D.P., Balic, J.: A multi-objective algorithm for optimization of modern machining processes. Eng. Appl. Artif. Intell. 61, 103–125 (2017)CrossRef
30.
Zurück zum Zitat Salehpoor, I.B., Molla-Alizadeh-Zavardehi, S.: A constrained portfolio selection model at considering risk-adjusted measure by using hybrid meta-heuristic algorithms. Appl. Soft Comput. 75, 233–253 (2019)CrossRef Salehpoor, I.B., Molla-Alizadeh-Zavardehi, S.: A constrained portfolio selection model at considering risk-adjusted measure by using hybrid meta-heuristic algorithms. Appl. Soft Comput. 75, 233–253 (2019)CrossRef
31.
Zurück zum Zitat Savsani, P., Jhala, R.L., Savsani, V.: Effect of hybridizing biogeography-based optimization (BBO) technique with artificial immune algorithm (AIA) and Ant colony optimization (ACO). Appl. Soft Comput. 21, 542–553 (2014)CrossRef Savsani, P., Jhala, R.L., Savsani, V.: Effect of hybridizing biogeography-based optimization (BBO) technique with artificial immune algorithm (AIA) and Ant colony optimization (ACO). Appl. Soft Comput. 21, 542–553 (2014)CrossRef
32.
Zurück zum Zitat Sulaiman, M.H., Mustaffa, Z., Saari, M.M., Daniyal, H.: Barnacles mating optimizer: a new bio-inspired algorithm for solving engineering optimization problems. Eng. Appl. Artif. Intell. 87, 103330–103342 (2020)CrossRef Sulaiman, M.H., Mustaffa, Z., Saari, M.M., Daniyal, H.: Barnacles mating optimizer: a new bio-inspired algorithm for solving engineering optimization problems. Eng. Appl. Artif. Intell. 87, 103330–103342 (2020)CrossRef
33.
Zurück zum Zitat Taguchi, G., Chowdhury, S., Wu, Y.: Taguchi’s Quality Engineering Handbook. Wiley, Hoboken (2005)MATH Taguchi, G., Chowdhury, S., Wu, Y.: Taguchi’s Quality Engineering Handbook. Wiley, Hoboken (2005)MATH
34.
Zurück zum Zitat Tayfur, G.: Modern optimization methods in water resources planning, engineering and management. Water Resour. Manage. 31(10), 3205–3233 (2017)CrossRef Tayfur, G.: Modern optimization methods in water resources planning, engineering and management. Water Resour. Manage. 31(10), 3205–3233 (2017)CrossRef
35.
Zurück zum Zitat Tian, Z.: Short-term wind speed prediction based on LMD and improved FA optimized combined kernel function LSSVM. Eng. Appl. Artif. Intell. 91, 103573–103596 (2020)CrossRef Tian, Z.: Short-term wind speed prediction based on LMD and improved FA optimized combined kernel function LSSVM. Eng. Appl. Artif. Intell. 91, 103573–103596 (2020)CrossRef
36.
Zurück zum Zitat Urquhart, M., Ljungskog, E., Sebben, S.: Surrogate-based optimisation using adaptively scaled radial basis functions. Appl. Soft Comput. 88, 106050–106066 (2020)CrossRef Urquhart, M., Ljungskog, E., Sebben, S.: Surrogate-based optimisation using adaptively scaled radial basis functions. Appl. Soft Comput. 88, 106050–106066 (2020)CrossRef
37.
Zurück zum Zitat Yang, Z., Li, K., Guo, Y., Ma, H., Zheng, M.: Compact real-valued teaching-learning based optimization with the applications to neural network training. Knowl. Based Syst. 159, 51–62 (2018)CrossRef Yang, Z., Li, K., Guo, Y., Ma, H., Zheng, M.: Compact real-valued teaching-learning based optimization with the applications to neural network training. Knowl. Based Syst. 159, 51–62 (2018)CrossRef
38.
Zurück zum Zitat Yin, X., Niu, Z., He, Z., Li, Z.S., Lee, D.: An integrated computational intelligence technique based operating parameters optimization scheme for quality improvement oriented process-manufacturing system. Comput. Ind. Eng. 140, 106284–106298 (2020)CrossRef Yin, X., Niu, Z., He, Z., Li, Z.S., Lee, D.: An integrated computational intelligence technique based operating parameters optimization scheme for quality improvement oriented process-manufacturing system. Comput. Ind. Eng. 140, 106284–106298 (2020)CrossRef
39.
Zurück zum Zitat Zhang, F., Liao, Z.: Gold price forecasting based on RBF neural network and hybrid fuzzy clustering algorithm. In: Jiuping, X., Fry, J.A., Lev, B., Hajiyev, A. (eds.) Proceedings of the Seventh International Conference on Management Science and Engineering Management, pp. 73–84. Springer, Heidelberg (2014). https://doi.org/10.1007/978-3-642-40078-0_6CrossRef Zhang, F., Liao, Z.: Gold price forecasting based on RBF neural network and hybrid fuzzy clustering algorithm. In: Jiuping, X., Fry, J.A., Lev, B., Hajiyev, A. (eds.) Proceedings of the Seventh International Conference on Management Science and Engineering Management, pp. 73–84. Springer, Heidelberg (2014). https://​doi.​org/​10.​1007/​978-3-642-40078-0_​6CrossRef
Metadaten
Titel
Hybridization of Metaheuristic and Population-Based Algorithms with Neural Network Learning for Function Approximation
verfasst von
Zhen-Yao Chen
Copyright-Jahr
2021
DOI
https://doi.org/10.1007/978-3-030-88113-9_4

Premium Partner