Skip to main content
Top
Published in: Granular Computing 4/2022

27-10-2021 | Original Paper

A Pi-Sigma artificial neural network based on sine cosine optimization algorithm

Authors: Eren Bas, Erol Egrioglu, Ozlem Karahasan

Published in: Granular Computing | Issue 4/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Pi-Sigma artificial neural network, which is a special artificial neural network model, is an artificial neural network that can be thought as a combination of different types of neuron models. Since Pi-Sigma artificial neural networks contain both additive and multiplicative structures, it can also be expressed as an artificial neural network model in which both multiplicative neuron model and perceptron are used together. One of the most important success criteria of the Pi-Sigma artificial neural networks is the optimization algorithm used in the training of the network, as in many artificial neural networks. The optimization algorithms used in the training of the network are divided into two parts as derivative-based algorithms and artificial intelligence optimization method-based algorithms. The artificial intelligence optimization algorithms have been used frequently in recent years compared with derivative-based algorithms due to many advantages. As known, one of the success criteria of an artificial neural network model is its training algorithm. Although many optimization algorithms are used in the training of Pi-Sigma artificial neural networks in the literature, the sine cosine algorithm, which is simpler, understandable, and easy to use, has not yet been used compared with many artificial intelligence optimization algorithms. In this study, the sine cosine algorithm is used for the first time in the training of Pi-Sigma artificial neural networks. The motivation of the paper is the about the evaluation of sine cosine algorithm performance in the training of Pi-Sigma artificial neural networks. The reason for the preference of using sine cosine algorithm is that the algorithm has not some specific operators that many artificial optimizations have and it uses the advantages of sine cosine functions easily. The performance of the proposed method is compared with many methods that are frequently used in the forecasting literature, especially many artificial neural networks models that use different optimization algorithms in the training process. Some popular time series, which are frequently used in the forecasting literature, are used in the analysis process, and as a result of the analysis process, it is concluded that the proposed method has better performance than other methods.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Akdeniz E, Egrioglu E, Bas E, Yolcu U (2018) An ARMA type Pi-Sigma artificial neural network for nonlinear time series forecasting. J Artif Intell Soft Comput 8:121–132 Akdeniz E, Egrioglu E, Bas E, Yolcu U (2018) An ARMA type Pi-Sigma artificial neural network for nonlinear time series forecasting. J Artif Intell Soft Comput 8:121–132
go back to reference Akram U, Ghazali R, Mushtaq MF (2017) A comprehensive survey on Pi-Sigma neural network for time series prediction. J Telecommun Electron Comput Eng 9(3–3):57–62 Akram U, Ghazali R, Mushtaq MF (2017) A comprehensive survey on Pi-Sigma neural network for time series prediction. J Telecommun Electron Comput Eng 9(3–3):57–62
go back to reference Aladag CH, Yolcu U, Egrioglu E (2013) A new multiplicative seasonal neural network model based on particle swarm optimization. Neural Process Lett 37(3):251–262CrossRef Aladag CH, Yolcu U, Egrioglu E (2013) A new multiplicative seasonal neural network model based on particle swarm optimization. Neural Process Lett 37(3):251–262CrossRef
go back to reference Bas E (2016) The training of multiplicative neuron model based artificial neural networks with differential evolution algorithm for forecasting. J Artif Intell Soft Comput Res 6(1):5–11CrossRef Bas E (2016) The training of multiplicative neuron model based artificial neural networks with differential evolution algorithm for forecasting. J Artif Intell Soft Comput Res 6(1):5–11CrossRef
go back to reference Bas E, Egrioglu E, Aladag CH, Yolcu U (2015) Fuzzy-time-series network used to forecast linear and nonlinear time series. Appl Intell 43(2):343–355CrossRef Bas E, Egrioglu E, Aladag CH, Yolcu U (2015) Fuzzy-time-series network used to forecast linear and nonlinear time series. Appl Intell 43(2):343–355CrossRef
go back to reference Bas E, Yolcu U, Egrioglu E, Cagcag Yolcu O, Dalar AZ (2016) Single multiplicative neuron model artificial neuron network trained by bat algorithm for time series forecasting. Am J Intell Syst 6(3):74–77 Bas E, Yolcu U, Egrioglu E, Cagcag Yolcu O, Dalar AZ (2016) Single multiplicative neuron model artificial neuron network trained by bat algorithm for time series forecasting. Am J Intell Syst 6(3):74–77
go back to reference Bas E, Grosan C, Egrioglu E, Yolcu U (2018) High order fuzzy time series method based on pi-sigma neural network. Eng Appl Artif Intell 72:350–356CrossRef Bas E, Grosan C, Egrioglu E, Yolcu U (2018) High order fuzzy time series method based on pi-sigma neural network. Eng Appl Artif Intell 72:350–356CrossRef
go back to reference Bisht K, Kumar S (2019) Hesitant fuzzy set based computational method for financial time series forecasting. Granul Comput 4(4):655–669CrossRef Bisht K, Kumar S (2019) Hesitant fuzzy set based computational method for financial time series forecasting. Granul Comput 4(4):655–669CrossRef
go back to reference Cagcag Yolcu O, Bas E, Egrioglu E, Yolcu U (2018) Single multiplicative neuron model artificial neural network with autoregressive coefficient for time series modelling. Neural Process Lett 47:1133–1147CrossRef Cagcag Yolcu O, Bas E, Egrioglu E, Yolcu U (2018) Single multiplicative neuron model artificial neural network with autoregressive coefficient for time series modelling. Neural Process Lett 47:1133–1147CrossRef
go back to reference Dash R, Rautray R, Dash R (2020) Utility of a shuffled differential evolution algorithm in designing of a Pi-Sigma neural network-based predictor model. Appl Comput Inform Dash R, Rautray R, Dash R (2020) Utility of a shuffled differential evolution algorithm in designing of a Pi-Sigma neural network-based predictor model. Appl Comput Inform
go back to reference Egrioglu E, Aladag CH, Yolcu U, Bas E (2015) Recurrent multiplicative neuron model artificial neural network for non-linear time series forecasting. Neural Process Lett 41(2):249–258CrossRef Egrioglu E, Aladag CH, Yolcu U, Bas E (2015) Recurrent multiplicative neuron model artificial neural network for non-linear time series forecasting. Neural Process Lett 41(2):249–258CrossRef
go back to reference Egrioglu E, Yolcu U, Bas E (2019) Intuitionistic high-order fuzzy time series forecasting method based on pi-sigma artificial neural networks trained by artificial bee colony. Granul Comput 4(4):639–654CrossRef Egrioglu E, Yolcu U, Bas E (2019) Intuitionistic high-order fuzzy time series forecasting method based on pi-sigma artificial neural networks trained by artificial bee colony. Granul Comput 4(4):639–654CrossRef
go back to reference Gundogdu O, Egrioglu E, Aladag CH, Yolcu U (2015) Multiplicative neuron model artificial neural network based on gauss activation function. Neural Comput Appl 27(4):927–935CrossRef Gundogdu O, Egrioglu E, Aladag CH, Yolcu U (2015) Multiplicative neuron model artificial neural network based on gauss activation function. Neural Comput Appl 27(4):927–935CrossRef
go back to reference Gupta KK, Kumar S (2019) A novel high-order fuzzy time series forecasting method based on probabilistic fuzzy sets. Granul Comput 4(4):699–713CrossRef Gupta KK, Kumar S (2019) A novel high-order fuzzy time series forecasting method based on probabilistic fuzzy sets. Granul Comput 4(4):699–713CrossRef
go back to reference Liu Y, Song M (2021) Few samples learning based on granular neural networks. Granul Comput 1–13 Liu Y, Song M (2021) Few samples learning based on granular neural networks. Granul Comput 1–13
go back to reference Mirjalili S (2016) SCA: a sine cosine algorithm for solving optimization problems. Knowl-Based Syst 96:120–133CrossRef Mirjalili S (2016) SCA: a sine cosine algorithm for solving optimization problems. Knowl-Based Syst 96:120–133CrossRef
go back to reference Nayak J, Naik B, Behera HS (2014) A hybrid PSO-GA based Pi sigma neural network (PSNN) with standard back propagation gradient descent learning for classification. In: 2014 international conference on control, instrumentation, communication and computational technologies (ICCICCT), IEEE, pp 878–885 Nayak J, Naik B, Behera HS (2014) A hybrid PSO-GA based Pi sigma neural network (PSNN) with standard back propagation gradient descent learning for classification. In: 2014 international conference on control, instrumentation, communication and computational technologies (ICCICCT), IEEE, pp 878–885
go back to reference Nayak J, Naik B, Behera HS (2015) A novel chemical reaction optimization based higher order neural network (CRO-HONN) for nonlinear classification. Ain Shams Eng J 6(3):1069–1091CrossRef Nayak J, Naik B, Behera HS (2015) A novel chemical reaction optimization based higher order neural network (CRO-HONN) for nonlinear classification. Ain Shams Eng J 6(3):1069–1091CrossRef
go back to reference Nayak SC (2020) A fireworks algorithm based Pi-Sigma neural network (FWA-PSNN) for modelling and forecasting chaotic crude oil price time series. EAI Endorsed Trans Energy Web 7(28) Nayak SC (2020) A fireworks algorithm based Pi-Sigma neural network (FWA-PSNN) for modelling and forecasting chaotic crude oil price time series. EAI Endorsed Trans Energy Web 7(28)
go back to reference Nie Y, Deng W (2008) A hybrid genetic learning algorithm for Pi-sigma neural network and the analysis of its convergence. In 2008 fourth international conference on natural computation, vol 3, IEEE, pp 19–23 Nie Y, Deng W (2008) A hybrid genetic learning algorithm for Pi-sigma neural network and the analysis of its convergence. In 2008 fourth international conference on natural computation, vol 3, IEEE, pp 19–23
go back to reference Panda N, Majhi SK (2020) Improved spotted hyena optimizer with space transformational search for training pi-sigma higher order neural network. Comput Intell 36(1):320–350MathSciNetCrossRef Panda N, Majhi SK (2020) Improved spotted hyena optimizer with space transformational search for training pi-sigma higher order neural network. Comput Intell 36(1):320–350MathSciNetCrossRef
go back to reference Panda N, Majhi SK (2021) Oppositional salp swarm algorithm with mutation operator for global optimization and application in training higher order neural networks. Multimed Tools Appl 1–25 Panda N, Majhi SK (2021) Oppositional salp swarm algorithm with mutation operator for global optimization and application in training higher order neural networks. Multimed Tools Appl 1–25
go back to reference Panigrahi S, Bhoi AK, Karali Y (2013) A modified differential evolution algorithm trained pi-sigma neural network for pattern classification. Int J Soft Comput Eng 3(5):133–136 Panigrahi S, Bhoi AK, Karali Y (2013) A modified differential evolution algorithm trained pi-sigma neural network for pattern classification. Int J Soft Comput Eng 3(5):133–136
go back to reference Pant M, Kumar S (2021) Particle swarm optimization and intuitionistic fuzzy set-based novel method for fuzzy time series forecasting. Granul Comput 1–19. Pant M, Kumar S (2021) Particle swarm optimization and intuitionistic fuzzy set-based novel method for fuzzy time series forecasting. Granul Comput 1–19.
go back to reference Rumelhart E, Hinton GE, Williams RJ (1986) Learning internal representations by error propagation, Chapter 8. The M.I.T. Press, Cambridge, pp 318–362 Rumelhart E, Hinton GE, Williams RJ (1986) Learning internal representations by error propagation, Chapter 8. The M.I.T. Press, Cambridge, pp 318–362
go back to reference Shin Y, Ghosh J (1991) The Pi-Sigma network: an efficient higher order neural network for pattern classification and function approximation. In: Proceedings of the international joint conference on neural networks, Seattle, pp 13–18 Shin Y, Ghosh J (1991) The Pi-Sigma network: an efficient higher order neural network for pattern classification and function approximation. In: Proceedings of the international joint conference on neural networks, Seattle, pp 13–18
go back to reference Yadav RN, Kalra PK, John J (2007) Time series prediction with single multiplicative neuron model. Appl Soft Comput 7:1157–1163CrossRef Yadav RN, Kalra PK, John J (2007) Time series prediction with single multiplicative neuron model. Appl Soft Comput 7:1157–1163CrossRef
go back to reference Yildirim AN, Bas E, Egrioglu (2021) Threshold single multiplicative neuron artificial neural networks for non-linear time series forecasting. J Appl Stat 1–17. Yildirim AN, Bas E, Egrioglu (2021) Threshold single multiplicative neuron artificial neural networks for non-linear time series forecasting. J Appl Stat 1–17.
go back to reference Yolcu U, Egrioglu E, Aladag CH (2013) A new linear & nonlinear artificial neural network model for time series forecasting. Decis Support Syst 54:1340–2134CrossRef Yolcu U, Egrioglu E, Aladag CH (2013) A new linear & nonlinear artificial neural network model for time series forecasting. Decis Support Syst 54:1340–2134CrossRef
go back to reference YU, Xin, Fei DENG, Li-xia TANG (2011) Training Pi-sigma neural network by stochastic simple point online gradient algorithm with Lagrange multiplier method. Appl Res Comput 2011:11 YU, Xin, Fei DENG, Li-xia TANG (2011) Training Pi-sigma neural network by stochastic simple point online gradient algorithm with Lagrange multiplier method. Appl Res Comput 2011:11
go back to reference Zhao L, Yang Y (2009) PSO-based single multiplicative neuron model for time series prediction. Expert Syst Appl 36:2805–2812CrossRef Zhao L, Yang Y (2009) PSO-based single multiplicative neuron model for time series prediction. Expert Syst Appl 36:2805–2812CrossRef
Metadata
Title
A Pi-Sigma artificial neural network based on sine cosine optimization algorithm
Authors
Eren Bas
Erol Egrioglu
Ozlem Karahasan
Publication date
27-10-2021
Publisher
Springer International Publishing
Published in
Granular Computing / Issue 4/2022
Print ISSN: 2364-4966
Electronic ISSN: 2364-4974
DOI
https://doi.org/10.1007/s41066-021-00297-9

Other articles of this Issue 4/2022

Granular Computing 4/2022 Go to the issue

Premium Partner