Skip to main content
Top
Published in: Arabian Journal for Science and Engineering 11/2019

13-07-2019 | Research Article - Computer Engineering and Computer Science

Prediction Using Cuckoo Search Optimized Echo State Network

Authors: Abubakar Bala, Idris Ismail, Rosdiazli Ibrahim, Sadiq M. Sait, Hamza Onoruoiza Salami

Published in: Arabian Journal for Science and Engineering | Issue 11/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The advent of internet of things has brought a revolution in the amount of data generated in industry. Researchers now have to develop ways to harness such huge amount of data. Thus, a new method called “predictive maintenance” was developed. In this technique, sensor data is used to predict failures so that appropriate actions are taken to save accidents and costs. Artificial neural networks have proven to be excellent tools for prediction. In this work, the echo state network (ESN), which is a new concept of recurrent neural network (RNN), is used to predict failures in turbofan engines. The ESN was developed to solve the complexities of earlier RNNs. However, choosing the right topology and parameters for the ESN is often a difficult problem. Hence, we develop a cuckoo search optimization-based algorithm to optimize the ESN. The approach is compared with three particle swarm optimization methods and two other methods, and it performed better.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Footnotes
1
For singular objective CS, the terms “egg” and “nest” are similar because one egg is assumed per nest.
 
2
The engine of modern airplanes, often placed under the plane’s wings and is responsible for the thrust of the airplane.
 
Literature
1.
go back to reference Vichare, N.M.; Pecht, M.G.: Prognostics and health management of electronics. IEEE Trans. Compon. Packag. Technol. 29(1), 222–229 (2006)CrossRef Vichare, N.M.; Pecht, M.G.: Prognostics and health management of electronics. IEEE Trans. Compon. Packag. Technol. 29(1), 222–229 (2006)CrossRef
2.
go back to reference Saxena, A.; Goebel, K.; Simon, D.; Eklund, N.: Damage propagation modeling for aircraft engine run-to-failure simulation. In: International Conference on Prognostics and Health Management, 2008. PHM 2008, pp. 1–9. IEEE (2008) Saxena, A.; Goebel, K.; Simon, D.; Eklund, N.: Damage propagation modeling for aircraft engine run-to-failure simulation. In: International Conference on Prognostics and Health Management, 2008. PHM 2008, pp. 1–9. IEEE (2008)
3.
go back to reference Verstraeten, D.; Schrauwen, B.; d’Haene, M.; Stroobandt, D.: An experimental unification of reservoir computing methods. Neural Netw. 20(3), 391–403 (2007)CrossRefMATH Verstraeten, D.; Schrauwen, B.; d’Haene, M.; Stroobandt, D.: An experimental unification of reservoir computing methods. Neural Netw. 20(3), 391–403 (2007)CrossRefMATH
4.
go back to reference Ferreira, A.A.; Ludermir, T.B.; De Aquino, R.R.B.: An approach to reservoir computing design and training. Expert Syst. Appl. 40(10), 4172–4182 (2013)CrossRef Ferreira, A.A.; Ludermir, T.B.; De Aquino, R.R.B.: An approach to reservoir computing design and training. Expert Syst. Appl. 40(10), 4172–4182 (2013)CrossRef
5.
go back to reference Jaeger, H.: The “echo state” approach to analysing and training recurrent neural networks—with an erratum note. Bonn, Germany: German National Research Center for Information Technology GMD Technical Report 148(34), 13 (2001) Jaeger, H.: The “echo state” approach to analysing and training recurrent neural networks—with an erratum note. Bonn, Germany: German National Research Center for Information Technology GMD Technical Report 148(34), 13 (2001)
6.
go back to reference Maass, W.; Natschläger, T.; Markram, H.: Real-time computing without stable states: a new framework for neural computation based on perturbations. Neural Comput. 14(11), 2531–2560 (2002)CrossRefMATH Maass, W.; Natschläger, T.; Markram, H.: Real-time computing without stable states: a new framework for neural computation based on perturbations. Neural Comput. 14(11), 2531–2560 (2002)CrossRefMATH
7.
go back to reference Steil, J.J: Backpropagation–decorrelation: online recurrent learning with O(N) complexity. In: 2004 IEEE International Joint Conference on Neural Networks, 2004. Proceedings, vol. 2, pp. 843–848. IEEE (2004) Steil, J.J: Backpropagation–decorrelation: online recurrent learning with O(N) complexity. In: 2004 IEEE International Joint Conference on Neural Networks, 2004. Proceedings, vol. 2, pp. 843–848. IEEE (2004)
8.
go back to reference Sait, S.M.; Youssef, S.M.: Iterative Computer Algorithms with Applications in Engineering: Solving Combinatorial Optimization problems. Wiley, Hoboken (1999)MATH Sait, S.M.; Youssef, S.M.: Iterative Computer Algorithms with Applications in Engineering: Solving Combinatorial Optimization problems. Wiley, Hoboken (1999)MATH
9.
go back to reference Bala, A.; Ismail, I.; Ibrahim, R.; Sait, S.M.: Applications of metaheuristics in reservoir computing techniques: a review. IEEE Access 6, 58012–58029 (2018)CrossRef Bala, A.; Ismail, I.; Ibrahim, R.; Sait, S.M.: Applications of metaheuristics in reservoir computing techniques: a review. IEEE Access 6, 58012–58029 (2018)CrossRef
10.
go back to reference Ferreira, A.A; Ludermir, T.B.: Genetic algorithm for reservoir computing optimization. In: International Joint Conference on Neural Networks, 2009. IJCNN 2009, pp. 811–815. IEEE (2009) Ferreira, A.A; Ludermir, T.B.: Genetic algorithm for reservoir computing optimization. In: International Joint Conference on Neural Networks, 2009. IJCNN 2009, pp. 811–815. IEEE (2009)
11.
go back to reference Ma, Q.; Shen, L.; Cottrell, G.W: Deep-esn: a multiple projection-encoding hierarchical reservoir computing framework (2017). arXiv preprint arXiv:1711.05255 Ma, Q.; Shen, L.; Cottrell, G.W: Deep-esn: a multiple projection-encoding hierarchical reservoir computing framework (2017). arXiv preprint arXiv:​1711.​05255
12.
go back to reference Zhong, S.; Xie, X.; Lin, L.; Wang, F.: Genetic algorithm optimized double-reservoir echo state network for multi-regime time series prediction. Neurocomputing 238, 191–204 (2017)CrossRef Zhong, S.; Xie, X.; Lin, L.; Wang, F.: Genetic algorithm optimized double-reservoir echo state network for multi-regime time series prediction. Neurocomputing 238, 191–204 (2017)CrossRef
13.
go back to reference Wang, H.; Yan, X.: Optimizing the echo state network with a binary particle swarm optimization algorithm. Knowl Based Syst 86, 182–193 (2015)CrossRef Wang, H.; Yan, X.: Optimizing the echo state network with a binary particle swarm optimization algorithm. Knowl Based Syst 86, 182–193 (2015)CrossRef
14.
go back to reference Basterrech, S.; Alba, E.; Snášel, V.: An experimental analysis of the echo state network initialization using the particle swarm optimization. In: 2014 Sixth World Congress on Nature and Biologically Inspired Computing (NaBIC), pp. 214–219. IEEE (2014) Basterrech, S.; Alba, E.; Snášel, V.: An experimental analysis of the echo state network initialization using the particle swarm optimization. In: 2014 Sixth World Congress on Nature and Biologically Inspired Computing (NaBIC), pp. 214–219. IEEE (2014)
15.
go back to reference Chouikhi, N.; Ammar, B.; Rokbani, N.; Alimi, A.M.: PSO-based analysis of echo state network parameters for time series forecasting. Appl. Soft Comput. 55, 211–225 (2017)CrossRef Chouikhi, N.; Ammar, B.; Rokbani, N.; Alimi, A.M.: PSO-based analysis of echo state network parameters for time series forecasting. Appl. Soft Comput. 55, 211–225 (2017)CrossRef
16.
go back to reference Amaya, E.J.; Alvares, A.J.: Prognostic of RUL based on echo state network optimized by artificial bee colony. Int. J. Progn. Health Manag. 7, 12 (2016) Amaya, E.J.; Alvares, A.J.: Prognostic of RUL based on echo state network optimized by artificial bee colony. Int. J. Progn. Health Manag. 7, 12 (2016)
17.
go back to reference Yang, X.-S.; Deb, S.: Cuckoo search via Lévy flights. In: World Congress on Nature & Biologically Inspired Computing, 2009. NaBIC 2009, pp. 210–214. IEEE (2009) Yang, X.-S.; Deb, S.: Cuckoo search via Lévy flights. In: World Congress on Nature & Biologically Inspired Computing, 2009. NaBIC 2009, pp. 210–214. IEEE (2009)
18.
go back to reference Bala, A.; Ismail, I.; Ibrahim, R.: Cuckoo search based optimization of echo state network for time series prediction. In: 2018 International Conference on Intelligent and Advanced System (ICIAS), pp. 1–6. IEEE (2018) Bala, A.; Ismail, I.; Ibrahim, R.: Cuckoo search based optimization of echo state network for time series prediction. In: 2018 International Conference on Intelligent and Advanced System (ICIAS), pp. 1–6. IEEE (2018)
19.
go back to reference Jaeger, H.: Tutorial on training recurrent neural networks, covering BPPT, RTRL, EKF and the “echo state network” approach, vol. 5. GMD-Forschungszentrum Informationstechnik, Bonn (2002) Jaeger, H.: Tutorial on training recurrent neural networks, covering BPPT, RTRL, EKF and the “echo state network” approach, vol. 5. GMD-Forschungszentrum Informationstechnik, Bonn (2002)
20.
go back to reference Jaeger, H.; Lukoševičius, M.; Popovici, D.; Siewert, U.: Optimization and applications of echo state networks with leaky-integrator neurons. Neural Netw. 20(3), 335–352 (2007)CrossRefMATH Jaeger, H.; Lukoševičius, M.; Popovici, D.; Siewert, U.: Optimization and applications of echo state networks with leaky-integrator neurons. Neural Netw. 20(3), 335–352 (2007)CrossRefMATH
21.
go back to reference Dybiec, B.; Gudowska-Nowak, E.; Barkai, E.; Dubkov, A.A.: Lévy flights versus Lévy walks in bounded domains. Phys. Rev. E 95(5), 052102 (2017)MathSciNetCrossRef Dybiec, B.; Gudowska-Nowak, E.; Barkai, E.; Dubkov, A.A.: Lévy flights versus Lévy walks in bounded domains. Phys. Rev. E 95(5), 052102 (2017)MathSciNetCrossRef
22.
go back to reference Rhee, I.; Shin, M.; Hong, S.; Lee, K.; Kim, S.J.; Chong, S.: On the Lévy-walk nature of human mobility. IEEE/ACM Trans. Netw. (TON) 19(3), 630–643 (2011)CrossRef Rhee, I.; Shin, M.; Hong, S.; Lee, K.; Kim, S.J.; Chong, S.: On the Lévy-walk nature of human mobility. IEEE/ACM Trans. Netw. (TON) 19(3), 630–643 (2011)CrossRef
23.
go back to reference Chiroma, H.; Herawan, T.; Fister Jr., I.; Fister, I.; Abdulkareem, S.; Shuib, L.; Hamza, M.F.; Saadi, Y.; Abubakar, A.: Bio-inspired computation: recent development on the modifications of the cuckoo search algorithm. Appl. Soft Comput. 61, 149–173 (2017)CrossRef Chiroma, H.; Herawan, T.; Fister Jr., I.; Fister, I.; Abdulkareem, S.; Shuib, L.; Hamza, M.F.; Saadi, Y.; Abubakar, A.: Bio-inspired computation: recent development on the modifications of the cuckoo search algorithm. Appl. Soft Comput. 61, 149–173 (2017)CrossRef
24.
go back to reference Walton, S.; Hassan, O.; Morgan, K.; Brown, M.R.: Modified cuckoo search: a new gradient free optimisation algorithm. Chaos Solitons Fractals 44(9), 710–718 (2011)CrossRef Walton, S.; Hassan, O.; Morgan, K.; Brown, M.R.: Modified cuckoo search: a new gradient free optimisation algorithm. Chaos Solitons Fractals 44(9), 710–718 (2011)CrossRef
25.
go back to reference Sait, S.M.; Bala, A.; El-Maleh, A.H.: Cuckoo search based resource optimization of datacenters. Appl. Intell. 44(3), 489–506 (2016)CrossRef Sait, S.M.; Bala, A.; El-Maleh, A.H.: Cuckoo search based resource optimization of datacenters. Appl. Intell. 44(3), 489–506 (2016)CrossRef
26.
go back to reference El-Maleh, A.H.; Sait, S.M.; Bala, A.: State assignment for area minimization of sequential circuits based on cuckoo search optimization. Comput. Electr. Eng. 44, 13–23 (2015)CrossRef El-Maleh, A.H.; Sait, S.M.; Bala, A.: State assignment for area minimization of sequential circuits based on cuckoo search optimization. Comput. Electr. Eng. 44, 13–23 (2015)CrossRef
27.
go back to reference Mathew, V.; Toby, T.; Singh, V.; Rao, B.M.; Kumar, M.G.: Prediction of remaining useful lifetime (RUL) of turbofan engine using machine learning. In: 2017 IEEE International Conference on Circuits and Systems (ICCS), pp. 306–311. IEEE (2017) Mathew, V.; Toby, T.; Singh, V.; Rao, B.M.; Kumar, M.G.: Prediction of remaining useful lifetime (RUL) of turbofan engine using machine learning. In: 2017 IEEE International Conference on Circuits and Systems (ICCS), pp. 306–311. IEEE (2017)
28.
go back to reference Ramasso, E.; Saxena, A.: Performance benchmarking and analysis of prognostic methods for C-MAPSS datasets. Int. J. Progn. Health Manag. 5(2), 1–15 (2014) Ramasso, E.; Saxena, A.: Performance benchmarking and analysis of prognostic methods for C-MAPSS datasets. Int. J. Progn. Health Manag. 5(2), 1–15 (2014)
29.
go back to reference Li, X.; Ding, Q.; Sun, J.-Q.: Remaining useful life estimation in prognostics using deep convolution neural networks. Reliab. Eng. Syst. Saf. 172, 1–11 (2018)CrossRef Li, X.; Ding, Q.; Sun, J.-Q.: Remaining useful life estimation in prognostics using deep convolution neural networks. Reliab. Eng. Syst. Saf. 172, 1–11 (2018)CrossRef
30.
go back to reference Heimes, F.O.: Recurrent neural networks for remaining useful life estimation. In: International Conference on Prognostics and Health Management, 2008. PHM 2008, pp. 1–6. IEEE (2008) Heimes, F.O.: Recurrent neural networks for remaining useful life estimation. In: International Conference on Prognostics and Health Management, 2008. PHM 2008, pp. 1–6. IEEE (2008)
31.
go back to reference Zhang, C.; Lim, P.; Qin, A.K.; Tan, K.C.: Multiobjective deep belief networks ensemble for remaining useful life estimation in prognostics. IEEE Trans. Neural Netw. Learn. Syst. 28(10), 2306–2318 (2017)CrossRef Zhang, C.; Lim, P.; Qin, A.K.; Tan, K.C.: Multiobjective deep belief networks ensemble for remaining useful life estimation in prognostics. IEEE Trans. Neural Netw. Learn. Syst. 28(10), 2306–2318 (2017)CrossRef
32.
go back to reference Ramasso, E.: Investigating computational geometry for failure prognostics. Int. J. Progn. Health Manag. 5(1), 005 (2014) Ramasso, E.: Investigating computational geometry for failure prognostics. Int. J. Progn. Health Manag. 5(1), 005 (2014)
33.
go back to reference Zhao, Z.; Liang, B.; Wang, X.; Weining, L.: Remaining useful life prediction of aircraft engine based on degradation pattern learning. Reliab. Eng. Syst. Saf. 164, 74–83 (2017)CrossRef Zhao, Z.; Liang, B.; Wang, X.; Weining, L.: Remaining useful life prediction of aircraft engine based on degradation pattern learning. Reliab. Eng. Syst. Saf. 164, 74–83 (2017)CrossRef
Metadata
Title
Prediction Using Cuckoo Search Optimized Echo State Network
Authors
Abubakar Bala
Idris Ismail
Rosdiazli Ibrahim
Sadiq M. Sait
Hamza Onoruoiza Salami
Publication date
13-07-2019
Publisher
Springer Berlin Heidelberg
Published in
Arabian Journal for Science and Engineering / Issue 11/2019
Print ISSN: 2193-567X
Electronic ISSN: 2191-4281
DOI
https://doi.org/10.1007/s13369-019-04008-0

Other articles of this Issue 11/2019

Arabian Journal for Science and Engineering 11/2019 Go to the issue

Research Article - Computer Engineering and Computer Science

Bayesian Versus Convolutional Networks for Arabic Handwriting Recognition

Research Article - Computer Engineering and Computer Science

Multi-criteria-Based Energy-Efficient Framework for VM Placement in Cloud Data Centers

Research Article - Computer Engineering and Computer Science

Passage-Based Text Summarization for Legal Information Retrieval

Research Article - Computer Engineering and Computer Science

Hybrid Filter–Wrapper Feature Selection Method for Sentiment Classification

Premium Partners