Skip to main content
Erschienen in: Progress in Artificial Intelligence 1/2017

04.10.2016 | Regular Paper

A novel artificial bee colony optimization strategy-based extreme learning machine algorithm

verfasst von: Yang Wang, Anna Wang, Qing Ai, Haijing Sun

Erschienen in: Progress in Artificial Intelligence | Ausgabe 1/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Extreme learning machine (ELM) is a kind of single-hidden layer feedforward neural networks (SLFNs). Compared with traditional neural networks algorithms, ELM is simpler in structure with higher learning speed and better generalization performance. Due to generating randomly input weights and biases of ELM, there can exist some non-optimal or unnecessary input weights and biases. In addition, ELM can need more hidden nodes which can make ELM respond slowly to unknown testing data. Consequently, a new NABC-ELM algorithm, which is optimized by a novel artificial bee colony called NABC, is proposed. To improve generalization performance of ELM, the NABC is applied to optimize input weights and biases. In NABC, the Tent chaotic opposition-based learning method is applied to initialize the population. Meanwhile, the self-adaptive search strategy is presented in the employed bee and onlooker bee phase. In addition, the Tent chaotic local search for scout bee is implemented. Finally, experiments on some popular classification data sets demonstrate that the proposed NABC-ELM can consistently get better generalization performance than some existing ELM variants.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Jain, A.K., Mao, J.: Artificial neural networks: a tutorial. IEEE Comput. 29, 31–44 (1996) Jain, A.K., Mao, J.: Artificial neural networks: a tutorial. IEEE Comput. 29, 31–44 (1996)
2.
Zurück zum Zitat Siniscalchi, S.M., Svendsen, T., Lee, C.H.: An artificial neural network approach to automatic speech processing. Neurocomputing 140, 326–338 (2014)CrossRef Siniscalchi, S.M., Svendsen, T., Lee, C.H.: An artificial neural network approach to automatic speech processing. Neurocomputing 140, 326–338 (2014)CrossRef
3.
Zurück zum Zitat Dai, Q., Liu, N.: Alleviating the problem of local minima in backpropagation through competetive learning. Neurocomputing 94, 152–158 (2012)CrossRef Dai, Q., Liu, N.: Alleviating the problem of local minima in backpropagation through competetive learning. Neurocomputing 94, 152–158 (2012)CrossRef
4.
Zurück zum Zitat Cortes, C., Vapnik, V.N.: Support vector networks. Mach. Learn. 20, 273–297 (1995)MATH Cortes, C., Vapnik, V.N.: Support vector networks. Mach. Learn. 20, 273–297 (1995)MATH
5.
Zurück zum Zitat Huang, G.B., Zhu, Q.Y., Siew, C.K.: Extreme learning machine: theory and applications. Neurocomputing 70, 489–501 (2006)CrossRef Huang, G.B., Zhu, Q.Y., Siew, C.K.: Extreme learning machine: theory and applications. Neurocomputing 70, 489–501 (2006)CrossRef
6.
Zurück zum Zitat Huang, G.B., Ding, X., Zhou, H.: Optimization method based extreme learning machine for classification. Neurocomputing 74, 155–163 (2010)CrossRef Huang, G.B., Ding, X., Zhou, H.: Optimization method based extreme learning machine for classification. Neurocomputing 74, 155–163 (2010)CrossRef
7.
Zurück zum Zitat Li, L.N., et al.: A computer aided diagnosis system for thyroid disease using extreme learning machine. J. Med. Syst. 36(5), 3327–3337 (2012)CrossRef Li, L.N., et al.: A computer aided diagnosis system for thyroid disease using extreme learning machine. J. Med. Syst. 36(5), 3327–3337 (2012)CrossRef
8.
Zurück zum Zitat Zhao, X., Wang, G., Bi, X., Gong, P., Zhao, Y.: XML document classification based on elm. Neurocomputing 74(16), 2444–2451 (2011)CrossRef Zhao, X., Wang, G., Bi, X., Gong, P., Zhao, Y.: XML document classification based on elm. Neurocomputing 74(16), 2444–2451 (2011)CrossRef
9.
Zurück zum Zitat Kennedy, J., Eberhart, R.: Particle swarm optimization. In: IEEE Int. Conf. Neural Networks, pp. 1942–1948 (1995) Kennedy, J., Eberhart, R.: Particle swarm optimization. In: IEEE Int. Conf. Neural Networks, pp. 1942–1948 (1995)
10.
Zurück zum Zitat Dorigo, M., Stutzle, T.: Ant colony optimization. MIT Press, Cambridge, MA (2004)MATH Dorigo, M., Stutzle, T.: Ant colony optimization. MIT Press, Cambridge, MA (2004)MATH
11.
Zurück zum Zitat Tang, K.S., Man, K.F., Kwong, S., He, Q.: Genetic algorithms and their applications. IEEE Signal Process. Mag. 13, 22–37 (1996)CrossRef Tang, K.S., Man, K.F., Kwong, S., He, Q.: Genetic algorithms and their applications. IEEE Signal Process. Mag. 13, 22–37 (1996)CrossRef
12.
Zurück zum Zitat Karaboga, D.: An idea based on honey bee swarm for numerical optimization. Technical Report-tr06, Erciyes University, Engineering Faculty, Computer Engineering Department (2005) Karaboga, D.: An idea based on honey bee swarm for numerical optimization. Technical Report-tr06, Erciyes University, Engineering Faculty, Computer Engineering Department (2005)
13.
Zurück zum Zitat Karaboga, D., Basturk, B.: On the performance of artificial bee colony (ABC) algorithm. Appl. Soft Comput. 8, 687–697 (2008)CrossRef Karaboga, D., Basturk, B.: On the performance of artificial bee colony (ABC) algorithm. Appl. Soft Comput. 8, 687–697 (2008)CrossRef
14.
Zurück zum Zitat Karaboga, D., Basturk, B.: A comparative study of artificial bee colony algorithm. Appl. Math. Comput. 214, 108–132 (2009)MathSciNetMATH Karaboga, D., Basturk, B.: A comparative study of artificial bee colony algorithm. Appl. Math. Comput. 214, 108–132 (2009)MathSciNetMATH
15.
Zurück zum Zitat Huang, Y.M., Lin, J.C.: A new bee colony optimization algorithm with idle-time-based filtering scheme for open shop-scheduling problems. Expert Syst. Appl. 38, 5438–5447 (2011)CrossRef Huang, Y.M., Lin, J.C.: A new bee colony optimization algorithm with idle-time-based filtering scheme for open shop-scheduling problems. Expert Syst. Appl. 38, 5438–5447 (2011)CrossRef
16.
Zurück zum Zitat Karaboga, D., Ozturk, C., Karaboga, N., Gorkemli, B.: Artificial bee colony programming for symbolic regression. Inf. Sci. 209, 1–15 (2012)CrossRef Karaboga, D., Ozturk, C., Karaboga, N., Gorkemli, B.: Artificial bee colony programming for symbolic regression. Inf. Sci. 209, 1–15 (2012)CrossRef
17.
Zurück zum Zitat Shayeghi, H., Ghasemi, A.: A modified artificial bee colony based on chaos theory for solving non-convex emission/economic dispatch. Energy Convers. Manage 79, 344–354 (2014)CrossRef Shayeghi, H., Ghasemi, A.: A modified artificial bee colony based on chaos theory for solving non-convex emission/economic dispatch. Energy Convers. Manage 79, 344–354 (2014)CrossRef
18.
Zurück zum Zitat Singh, A., Sundar, S.: An artificial bee colony algorithm for the minimum routing cost spanning tree problem. Soft Comput. 15, 2489–2499 (2011)CrossRef Singh, A., Sundar, S.: An artificial bee colony algorithm for the minimum routing cost spanning tree problem. Soft Comput. 15, 2489–2499 (2011)CrossRef
19.
Zurück zum Zitat Xiang, W.L., An, M.Q.: An efficient and robust artificial bee colony algorithm for numerical optimization. Comput. Oper. Res. 40, 1256–1265 (2013)MathSciNetCrossRefMATH Xiang, W.L., An, M.Q.: An efficient and robust artificial bee colony algorithm for numerical optimization. Comput. Oper. Res. 40, 1256–1265 (2013)MathSciNetCrossRefMATH
20.
Zurück zum Zitat Basturk, B., Karaboga, D.: A modified artificial bee colony algorithm for real-parameter optimization. Inf. Sci. 192, 120–142 (2012)CrossRef Basturk, B., Karaboga, D.: A modified artificial bee colony algorithm for real-parameter optimization. Inf. Sci. 192, 120–142 (2012)CrossRef
21.
Zurück zum Zitat Zhu, G., Kwong, S.: Gbest-guided artificial bee colony algorithm for numerical function optimization. Appl. Math. Comput. 217, 3166–3173 (2010)MathSciNetMATH Zhu, G., Kwong, S.: Gbest-guided artificial bee colony algorithm for numerical function optimization. Appl. Math. Comput. 217, 3166–3173 (2010)MathSciNetMATH
22.
Zurück zum Zitat Gao, W.F., Liu, S.Y.: Improved artificial bee colony algorithm for global optimization. Inf. Process. Lett. 111, 871–882 (2011)MathSciNetCrossRefMATH Gao, W.F., Liu, S.Y.: Improved artificial bee colony algorithm for global optimization. Inf. Process. Lett. 111, 871–882 (2011)MathSciNetCrossRefMATH
23.
Zurück zum Zitat Li, G., Niu, P., Xiao, X.: Development and investigation of efficient artificial bee colony algorithm for numerical function optimization. Appl. Soft Comput. 12, 320–332 (2012)CrossRef Li, G., Niu, P., Xiao, X.: Development and investigation of efficient artificial bee colony algorithm for numerical function optimization. Appl. Soft Comput. 12, 320–332 (2012)CrossRef
24.
Zurück zum Zitat Yurtkuran, A., Emel, E.: An adaptive artificial bee colony algorithm for global optimization. Appl. Math. Comput. 271, 1004–1023 (2015)MathSciNet Yurtkuran, A., Emel, E.: An adaptive artificial bee colony algorithm for global optimization. Appl. Math. Comput. 271, 1004–1023 (2015)MathSciNet
25.
Zurück zum Zitat Maeda, M., Tsuda, S.: Reduction of artificial bee colony algorithm for global optimization. Neurocomputing 148, 70–74 (2015)CrossRef Maeda, M., Tsuda, S.: Reduction of artificial bee colony algorithm for global optimization. Neurocomputing 148, 70–74 (2015)CrossRef
26.
Zurück zum Zitat Gao, W.F., Huang, L.L., et al.: Artificial bee colony algorithm with multiple search strategies. Appl. Math. Comput. 271, 269–287 (2015)MathSciNet Gao, W.F., Huang, L.L., et al.: Artificial bee colony algorithm with multiple search strategies. Appl. Math. Comput. 271, 269–287 (2015)MathSciNet
27.
Zurück zum Zitat Shan, L., Qiang, H., Li, J., et al.: Chaotic optimization algorithm based on Tent map. Control Decis. 20(2), 179–182 (2005)MATH Shan, L., Qiang, H., Li, J., et al.: Chaotic optimization algorithm based on Tent map. Control Decis. 20(2), 179–182 (2005)MATH
28.
Zurück zum Zitat Rahnamayan, S., Tizhoosh, H.R., Salama, M.M.A.: Opposition versus randomness in soft computing techniques. Appl. Soft Comput. 8, 906–918 (2008)CrossRef Rahnamayan, S., Tizhoosh, H.R., Salama, M.M.A.: Opposition versus randomness in soft computing techniques. Appl. Soft Comput. 8, 906–918 (2008)CrossRef
29.
Zurück zum Zitat Alatas, B.: Chaotic bee colony algorithms for global numerical optimization. Expert Syst. Appl. 37, 5682–5687 (2010)CrossRef Alatas, B.: Chaotic bee colony algorithms for global numerical optimization. Expert Syst. Appl. 37, 5682–5687 (2010)CrossRef
30.
Zurück zum Zitat Gao, W.F., Liu, S.Y.: A modified artificial bee colony algorithm. Comput. Oper. Res. 39, 687–697 (2012)CrossRefMATH Gao, W.F., Liu, S.Y.: A modified artificial bee colony algorithm. Comput. Oper. Res. 39, 687–697 (2012)CrossRefMATH
31.
Zurück zum Zitat Liao, X., Zhou, J.Z., et al.: An adaptive chaotic artificial bee colony algorithm for short-term hydrothermal generation scheduling. Electr. Power Energy Syst. 53, 34–42 (2013)CrossRef Liao, X., Zhou, J.Z., et al.: An adaptive chaotic artificial bee colony algorithm for short-term hydrothermal generation scheduling. Electr. Power Energy Syst. 53, 34–42 (2013)CrossRef
32.
Zurück zum Zitat Banharnsakun, A., Achalakul, T., Sirinaovakul, B.: The best-so-far selection in artificial bee colony algorithm. Appl. Soft Comput. 11, 2888–2901 (2011) Banharnsakun, A., Achalakul, T., Sirinaovakul, B.: The best-so-far selection in artificial bee colony algorithm. Appl. Soft Comput. 11, 2888–2901 (2011)
33.
Zurück zum Zitat Gao, W.F., Liu, S.Y., Huang, L.L.: Enhancing artificial bee colony algorithm using more information-based search equations. Inf. Sci. 270, 112–133 (2014)MathSciNetCrossRefMATH Gao, W.F., Liu, S.Y., Huang, L.L.: Enhancing artificial bee colony algorithm using more information-based search equations. Inf. Sci. 270, 112–133 (2014)MathSciNetCrossRefMATH
34.
Zurück zum Zitat Bartlett, P.L.: The sample complexity of pattern classification with neural networks: the size of the weights is more important than the size of the network. IEEE Trans. Inf. Theory 44(2), 525–536 (1998)MathSciNetCrossRefMATH Bartlett, P.L.: The sample complexity of pattern classification with neural networks: the size of the weights is more important than the size of the network. IEEE Trans. Inf. Theory 44(2), 525–536 (1998)MathSciNetCrossRefMATH
35.
Zurück zum Zitat Han, F., Yao, H.F., Ling, Q.H.: An improved evolutionary extreme learning machine based on particle swarm optimization. Neurocomputing 116, 87–93 (2013)CrossRef Han, F., Yao, H.F., Ling, Q.H.: An improved evolutionary extreme learning machine based on particle swarm optimization. Neurocomputing 116, 87–93 (2013)CrossRef
36.
Zurück zum Zitat Gao, W.F., Liu, S.Y., Huang, L.L.: Inspired artificial bee colony algorithm for global optimization problems. Acta Electron. Sin. 40(12), 2396–2403 (2012) Gao, W.F., Liu, S.Y., Huang, L.L.: Inspired artificial bee colony algorithm for global optimization problems. Acta Electron. Sin. 40(12), 2396–2403 (2012)
Metadaten
Titel
A novel artificial bee colony optimization strategy-based extreme learning machine algorithm
verfasst von
Yang Wang
Anna Wang
Qing Ai
Haijing Sun
Publikationsdatum
04.10.2016
Verlag
Springer Berlin Heidelberg
Erschienen in
Progress in Artificial Intelligence / Ausgabe 1/2017
Print ISSN: 2192-6352
Elektronische ISSN: 2192-6360
DOI
https://doi.org/10.1007/s13748-016-0102-4

Weitere Artikel der Ausgabe 1/2017

Progress in Artificial Intelligence 1/2017 Zur Ausgabe