Skip to main content
Top

2021 | OriginalPaper | Chapter

Hybridization of Metaheuristic and Population-Based Algorithms with Neural Network Learning for Function Approximation

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper attempts to improve the learning representation of radial basis function neural network (RBFNN) through metaheuristic algorithm (MHA) and evolutionary algorithm (EA). Next, the ant colony optimization (ACO)-based and genetic algorithm (GA)-based approaches are employed to train RBFNN. The proposed hybridization of ACO-based and GA-based approaches (HAG) algorithm incorporates the complementarity of exploration and exploitation abilities to reach resolution optimization. The property of population diversity has higher chance to search the global optimal instead of being restricted to local optimal extremely in two benchmark problems. The experimental results have shown that ACO-based and GA-based approaches can be integrated intelligently and develop into a hybrid algorithm which aims for receiving the best precise learning expression among relevant algorithms in this paper. Additionally, method assessment results for two benchmark continuous test function experiments and show that the proposed HAG algorithm outperforms relevant algorithms in term of preciseness for learning of function approximation.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Al-Obaidi, M.A., Li, J.P., Kara-Zaïtri, C., Mujtaba, I.M.: Optimisation of reverse osmosis based wastewater treatment system for the removal of chlorophenol using genetic algorithms. Chem. Eng. J. 316, 91–100 (2017)CrossRef Al-Obaidi, M.A., Li, J.P., Kara-Zaïtri, C., Mujtaba, I.M.: Optimisation of reverse osmosis based wastewater treatment system for the removal of chlorophenol using genetic algorithms. Chem. Eng. J. 316, 91–100 (2017)CrossRef
2.
go back to reference Al-Roomi, A.R., El-Hawary, M.E.: Universal functions originator. Appl. Soft Comput. 94, 106417–106448 (2020)CrossRef Al-Roomi, A.R., El-Hawary, M.E.: Universal functions originator. Appl. Soft Comput. 94, 106417–106448 (2020)CrossRef
3.
go back to reference Ansari, M., Othman, F., El-Shafie, A.: Optimized fuzzy inference system to enhance prediction accuracy for influent characteristics of a sewage treatment plant. Sci. Total Environ. 722, 137878–137890 (2020)CrossRef Ansari, M., Othman, F., El-Shafie, A.: Optimized fuzzy inference system to enhance prediction accuracy for influent characteristics of a sewage treatment plant. Sci. Total Environ. 722, 137878–137890 (2020)CrossRef
4.
go back to reference Bilal, M.P., Zaheer, H., Garcia-Hernandez, L., Abraham, A.: Differential evolution: a review of more than two decades of research. Eng. Appl. Artif. Intell. 90, 103479–1034502 (2020)CrossRef Bilal, M.P., Zaheer, H., Garcia-Hernandez, L., Abraham, A.: Differential evolution: a review of more than two decades of research. Eng. Appl. Artif. Intell. 90, 103479–1034502 (2020)CrossRef
5.
go back to reference Chen, S., Cowan, C.F.N., Grant, P.M.: Orthogonal least squares learning algorithm for radial basis function networks. IEEE Trans. Neural Netw. 2(2), 302–309 (1991)CrossRef Chen, S., Cowan, C.F.N., Grant, P.M.: Orthogonal least squares learning algorithm for radial basis function networks. IEEE Trans. Neural Netw. 2(2), 302–309 (1991)CrossRef
6.
go back to reference Chen, S., Wu, Y., Luk, B.L.: Combined genetic algorithm optimization and regularized orthogonal least squares learning for radial basis function networks. IEEE Trans. Neural Netw. 10(5), 1239–1243 (1999)CrossRef Chen, S., Wu, Y., Luk, B.L.: Combined genetic algorithm optimization and regularized orthogonal least squares learning for radial basis function networks. IEEE Trans. Neural Netw. 10(5), 1239–1243 (1999)CrossRef
9.
go back to reference Duda, R.O., Hart, P.E.: Pattern Classification and Scene Analysis. John Wiley and Sons, New York (1973)MATH Duda, R.O., Hart, P.E.: Pattern Classification and Scene Analysis. John Wiley and Sons, New York (1973)MATH
10.
go back to reference Dzalbs, I., Kalganova, T.: Accelerating supply chains with Ant Colony Optimization across a range of hardware solutions. Comput. Ind. Eng. 147, 106610–106623 (2020)CrossRef Dzalbs, I., Kalganova, T.: Accelerating supply chains with Ant Colony Optimization across a range of hardware solutions. Comput. Ind. Eng. 147, 106610–106623 (2020)CrossRef
11.
go back to reference Faramarzi, A., Heidarinejad, M., Stephens, B., Mirjalili, S.: Equilibrium optimizer: a novel optimization algorithm. Knowl. Based Syst. 191, 105190–105210 (2020)CrossRef Faramarzi, A., Heidarinejad, M., Stephens, B., Mirjalili, S.: Equilibrium optimizer: a novel optimization algorithm. Knowl. Based Syst. 191, 105190–105210 (2020)CrossRef
12.
go back to reference Ghafil, H.N., Jarmai, K.: Dynamic differential annealed optimization: new metaheuristic optimization algorithm for engineering applications. Appl. Soft Comput. 93, 106392–106410 (2020)CrossRef Ghafil, H.N., Jarmai, K.: Dynamic differential annealed optimization: new metaheuristic optimization algorithm for engineering applications. Appl. Soft Comput. 93, 106392–106410 (2020)CrossRef
13.
go back to reference Goldberg, D.E.: Genetic Algorithms in Search Optimization and Machine Learning. Addison-Wesley, Boston (1989)MATH Goldberg, D.E.: Genetic Algorithms in Search Optimization and Machine Learning. Addison-Wesley, Boston (1989)MATH
14.
go back to reference Hamzaday, A., Baykasoglu, A., Akpinar, S.: Solving combinatorial optimization problems with single seekers society algorithm. Knowl. Based Syst. 201–202, 106036–106065 (2020)CrossRef Hamzaday, A., Baykasoglu, A., Akpinar, S.: Solving combinatorial optimization problems with single seekers society algorithm. Knowl. Based Syst. 201–202, 106036–106065 (2020)CrossRef
15.
go back to reference Holland, J.H.: Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence. MIT Press, Cambridge (1992)CrossRef Holland, J.H.: Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence. MIT Press, Cambridge (1992)CrossRef
16.
go back to reference Islam, J., Vasant, P.M., Negash, B.M., Laruccia, M.B., Myint, M., Watada, J.: A holistic review on artificial intelligence techniques for well placement optimization problem. Adv. Eng. Softw. 141, 102767–102786 (2020)CrossRef Islam, J., Vasant, P.M., Negash, B.M., Laruccia, M.B., Myint, M., Watada, J.: A holistic review on artificial intelligence techniques for well placement optimization problem. Adv. Eng. Softw. 141, 102767–102786 (2020)CrossRef
17.
go back to reference Jakobsson, S., Andersson, B., Edelvik, F.: Rational radial basis function interpolation with applications to antenna design. J. Comput. Appl. Math. 233(4), 889–904 (2009)MathSciNetCrossRef Jakobsson, S., Andersson, B., Edelvik, F.: Rational radial basis function interpolation with applications to antenna design. J. Comput. Appl. Math. 233(4), 889–904 (2009)MathSciNetCrossRef
18.
go back to reference Jugulum, R., Taguchi, S., et al.: Computer-Based Robust Engineering: Essentials for DFSS. ASQ Quality Press, Milwaukee (2004) Jugulum, R., Taguchi, S., et al.: Computer-Based Robust Engineering: Essentials for DFSS. ASQ Quality Press, Milwaukee (2004)
19.
go back to reference Kefayat, M., Ara, A.I., Niaki, S.A.N.: A hybrid of ant colony optimization and artificial bee colony algorithm for probabilistic optimal placement and sizing of distributed energy resources. Energ. Convers. Manage. 92, 149–161 (2015)CrossRef Kefayat, M., Ara, A.I., Niaki, S.A.N.: A hybrid of ant colony optimization and artificial bee colony algorithm for probabilistic optimal placement and sizing of distributed energy resources. Energ. Convers. Manage. 92, 149–161 (2015)CrossRef
20.
go back to reference Kozak, J., Boryczka, U.: Multiple boosting in the Ant colony decision forest meta-classifier. Knowl. Based Syst. 75, 141–151 (2015)CrossRef Kozak, J., Boryczka, U.: Multiple boosting in the Ant colony decision forest meta-classifier. Knowl. Based Syst. 75, 141–151 (2015)CrossRef
21.
go back to reference Lin, Y.K., Yeh, C.T., Huang, P.S.: A hybrid ant-tabu algorithm for solving a multistate flow network reliability maximization problem. Appl. Soft Comput. 13, 3529–3543 (2013)CrossRef Lin, Y.K., Yeh, C.T., Huang, P.S.: A hybrid ant-tabu algorithm for solving a multistate flow network reliability maximization problem. Appl. Soft Comput. 13, 3529–3543 (2013)CrossRef
22.
go back to reference Lin, C.F., Wu, C.C., Yang, P.H., Kuo, T.Y.: Application of Taguchi method in lightemitting diode backlight design for wide color gamut displays. J. Disp. Technol. 5(8), 323–330 (2009)CrossRef Lin, C.F., Wu, C.C., Yang, P.H., Kuo, T.Y.: Application of Taguchi method in lightemitting diode backlight design for wide color gamut displays. J. Disp. Technol. 5(8), 323–330 (2009)CrossRef
23.
go back to reference Liu, B., Aliakbarian, H., Ma, Z., Vandenbosch, G.A.E., Gielen, G., Excell, P.: An efficient method for antenna design optimization based on evolutionary computation and machine learning techniques. IEEE Trans. Antennas Propag. 62(1), 7–18 (2014)CrossRef Liu, B., Aliakbarian, H., Ma, Z., Vandenbosch, G.A.E., Gielen, G., Excell, P.: An efficient method for antenna design optimization based on evolutionary computation and machine learning techniques. IEEE Trans. Antennas Propag. 62(1), 7–18 (2014)CrossRef
24.
go back to reference Looney, C.G.: Advances in feedforward neural networks: demystifying knowledge acquiring black boxes. IEEE Trans. Knowl. Data Eng. 8(2), 211–226 (1996)CrossRef Looney, C.G.: Advances in feedforward neural networks: demystifying knowledge acquiring black boxes. IEEE Trans. Knowl. Data Eng. 8(2), 211–226 (1996)CrossRef
25.
go back to reference Luan, J., Yao, Z., Zhao, F., Song, X.: A novel method to solve supplier selection problem: hybrid algorithm of genetic algorithm and ant colony optimization. Math. Comput. Simul. 156, 294–309 (2019)MathSciNetCrossRef Luan, J., Yao, Z., Zhao, F., Song, X.: A novel method to solve supplier selection problem: hybrid algorithm of genetic algorithm and ant colony optimization. Math. Comput. Simul. 156, 294–309 (2019)MathSciNetCrossRef
26.
go back to reference McCulloch, W.S., Pitts, W.: A logical calculus of the ideas immanent in nervous activity. Bull. Math. Biophys. 5(4), 115–133 (1943)MathSciNetCrossRef McCulloch, W.S., Pitts, W.: A logical calculus of the ideas immanent in nervous activity. Bull. Math. Biophys. 5(4), 115–133 (1943)MathSciNetCrossRef
27.
go back to reference Naghibi, S.A., Ahmadi, K., Daneshi, A.: Application of support vector machine, random forest, and genetic algorithm optimized random forest models in groundwater potential mapping. Water Resour. Manage. 31(9), 2761–2775 (2017)CrossRef Naghibi, S.A., Ahmadi, K., Daneshi, A.: Application of support vector machine, random forest, and genetic algorithm optimized random forest models in groundwater potential mapping. Water Resour. Manage. 31(9), 2761–2775 (2017)CrossRef
28.
go back to reference Qasem, S.N., Shamsuddin, S.M., Zain, A.M.: Multi-objective hybrid evolutionary algorithms for radial basis function neural network design. Knowl. Based Syst. 27, 475–497 (2012)CrossRef Qasem, S.N., Shamsuddin, S.M., Zain, A.M.: Multi-objective hybrid evolutionary algorithms for radial basis function neural network design. Knowl. Based Syst. 27, 475–497 (2012)CrossRef
29.
go back to reference Rao, R.V., Rai, D.P., Balic, J.: A multi-objective algorithm for optimization of modern machining processes. Eng. Appl. Artif. Intell. 61, 103–125 (2017)CrossRef Rao, R.V., Rai, D.P., Balic, J.: A multi-objective algorithm for optimization of modern machining processes. Eng. Appl. Artif. Intell. 61, 103–125 (2017)CrossRef
30.
go back to reference Salehpoor, I.B., Molla-Alizadeh-Zavardehi, S.: A constrained portfolio selection model at considering risk-adjusted measure by using hybrid meta-heuristic algorithms. Appl. Soft Comput. 75, 233–253 (2019)CrossRef Salehpoor, I.B., Molla-Alizadeh-Zavardehi, S.: A constrained portfolio selection model at considering risk-adjusted measure by using hybrid meta-heuristic algorithms. Appl. Soft Comput. 75, 233–253 (2019)CrossRef
31.
go back to reference Savsani, P., Jhala, R.L., Savsani, V.: Effect of hybridizing biogeography-based optimization (BBO) technique with artificial immune algorithm (AIA) and Ant colony optimization (ACO). Appl. Soft Comput. 21, 542–553 (2014)CrossRef Savsani, P., Jhala, R.L., Savsani, V.: Effect of hybridizing biogeography-based optimization (BBO) technique with artificial immune algorithm (AIA) and Ant colony optimization (ACO). Appl. Soft Comput. 21, 542–553 (2014)CrossRef
32.
go back to reference Sulaiman, M.H., Mustaffa, Z., Saari, M.M., Daniyal, H.: Barnacles mating optimizer: a new bio-inspired algorithm for solving engineering optimization problems. Eng. Appl. Artif. Intell. 87, 103330–103342 (2020)CrossRef Sulaiman, M.H., Mustaffa, Z., Saari, M.M., Daniyal, H.: Barnacles mating optimizer: a new bio-inspired algorithm for solving engineering optimization problems. Eng. Appl. Artif. Intell. 87, 103330–103342 (2020)CrossRef
33.
go back to reference Taguchi, G., Chowdhury, S., Wu, Y.: Taguchi’s Quality Engineering Handbook. Wiley, Hoboken (2005)MATH Taguchi, G., Chowdhury, S., Wu, Y.: Taguchi’s Quality Engineering Handbook. Wiley, Hoboken (2005)MATH
34.
go back to reference Tayfur, G.: Modern optimization methods in water resources planning, engineering and management. Water Resour. Manage. 31(10), 3205–3233 (2017)CrossRef Tayfur, G.: Modern optimization methods in water resources planning, engineering and management. Water Resour. Manage. 31(10), 3205–3233 (2017)CrossRef
35.
go back to reference Tian, Z.: Short-term wind speed prediction based on LMD and improved FA optimized combined kernel function LSSVM. Eng. Appl. Artif. Intell. 91, 103573–103596 (2020)CrossRef Tian, Z.: Short-term wind speed prediction based on LMD and improved FA optimized combined kernel function LSSVM. Eng. Appl. Artif. Intell. 91, 103573–103596 (2020)CrossRef
36.
go back to reference Urquhart, M., Ljungskog, E., Sebben, S.: Surrogate-based optimisation using adaptively scaled radial basis functions. Appl. Soft Comput. 88, 106050–106066 (2020)CrossRef Urquhart, M., Ljungskog, E., Sebben, S.: Surrogate-based optimisation using adaptively scaled radial basis functions. Appl. Soft Comput. 88, 106050–106066 (2020)CrossRef
37.
go back to reference Yang, Z., Li, K., Guo, Y., Ma, H., Zheng, M.: Compact real-valued teaching-learning based optimization with the applications to neural network training. Knowl. Based Syst. 159, 51–62 (2018)CrossRef Yang, Z., Li, K., Guo, Y., Ma, H., Zheng, M.: Compact real-valued teaching-learning based optimization with the applications to neural network training. Knowl. Based Syst. 159, 51–62 (2018)CrossRef
38.
go back to reference Yin, X., Niu, Z., He, Z., Li, Z.S., Lee, D.: An integrated computational intelligence technique based operating parameters optimization scheme for quality improvement oriented process-manufacturing system. Comput. Ind. Eng. 140, 106284–106298 (2020)CrossRef Yin, X., Niu, Z., He, Z., Li, Z.S., Lee, D.: An integrated computational intelligence technique based operating parameters optimization scheme for quality improvement oriented process-manufacturing system. Comput. Ind. Eng. 140, 106284–106298 (2020)CrossRef
39.
go back to reference Zhang, F., Liao, Z.: Gold price forecasting based on RBF neural network and hybrid fuzzy clustering algorithm. In: Jiuping, X., Fry, J.A., Lev, B., Hajiyev, A. (eds.) Proceedings of the Seventh International Conference on Management Science and Engineering Management, pp. 73–84. Springer, Heidelberg (2014). https://doi.org/10.1007/978-3-642-40078-0_6CrossRef Zhang, F., Liao, Z.: Gold price forecasting based on RBF neural network and hybrid fuzzy clustering algorithm. In: Jiuping, X., Fry, J.A., Lev, B., Hajiyev, A. (eds.) Proceedings of the Seventh International Conference on Management Science and Engineering Management, pp. 73–84. Springer, Heidelberg (2014). https://​doi.​org/​10.​1007/​978-3-642-40078-0_​6CrossRef
Metadata
Title
Hybridization of Metaheuristic and Population-Based Algorithms with Neural Network Learning for Function Approximation
Author
Zhen-Yao Chen
Copyright Year
2021
DOI
https://doi.org/10.1007/978-3-030-88113-9_4

Premium Partner