Skip to main content
Top
Published in: Arabian Journal for Science and Engineering 4/2020

07-11-2019 | Research Article - Computer Engineering and Computer Science

Estimation of the Smoothing Parameter in Probabilistic Neural Network Using Evolutionary Algorithms

Authors: Shraddha M. Naik, Ravi Prasad K. Jagannath, Venkatanareshbabu Kuppili

Published in: Arabian Journal for Science and Engineering | Issue 4/2020

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The probabilistic neural network (PNN) is an efficient approach that can compute nonlinear decision boundaries, widely used for classification. In this paper, the often used Gaussian distribution function is replaced by a new probability density function which provides a new variant of the PNN method. Most of the higher-dimensional data are statistically found to be not from the normal distribution, and hence, we have replaced it by the symmetric Laplace distribution. Further, the estimation of the smoothing parameter in the proposed PNN model is carried out with three different evolutionary algorithms, namely bat algorithm (BA), grey wolf optimizer (GWO), and whale optimization algorithm (WOA) with a novel fitness function. These different proposed PNN models with variable smoothing parameter estimation methods are tested on five different benchmark data sets. The performance of proposed three Laplace distribution-based variants of PNN incorporated with BA, GWO, and WOA are reported and compared with Gaussian-based variants of PNN and also other commonly used classifiers: the conventional PNN, extreme learning machine, and K-nearest neighbor in terms of measurement accuracy. The results demonstrate that the proposed approaches using evolutionary algorithms can provide as much as a ten percent increase in accuracy over the conventional PNN method.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Specht, D.F.: Probabilistic neural networks. Neural Netw. 3(1), 109–118 (1990)CrossRef Specht, D.F.: Probabilistic neural networks. Neural Netw. 3(1), 109–118 (1990)CrossRef
3.
go back to reference Kotz, S.; Kozubowski, T.; Podgorski, K.: The Laplace Distribution and Generalizations: A Revisit with Applications to Communications, Economics, Engineering, and Finance. Springer, Berlin (2012)MATH Kotz, S.; Kozubowski, T.; Podgorski, K.: The Laplace Distribution and Generalizations: A Revisit with Applications to Communications, Economics, Engineering, and Finance. Springer, Berlin (2012)MATH
4.
go back to reference Draper, N.R.; Smith, H.: Applied Regression Analysis, vol. 326. Wiley, New York (2014)MATH Draper, N.R.; Smith, H.: Applied Regression Analysis, vol. 326. Wiley, New York (2014)MATH
5.
go back to reference Song, W.; Yao, W.; Xing, Y.: Robust mixture regression model fitting by Laplace distribution. Comput. Stat. Data Anal. 71, 128–137 (2014)MathSciNetMATHCrossRef Song, W.; Yao, W.; Xing, Y.: Robust mixture regression model fitting by Laplace distribution. Comput. Stat. Data Anal. 71, 128–137 (2014)MathSciNetMATHCrossRef
6.
go back to reference Huda, A.R.; Nadia, J.A.; Al-Baldawi, T.H.K.: Some Bayes’ estimators for laplace distribution under different loss functions. J. Babylon Univ. 22, 975–983 (2014) Huda, A.R.; Nadia, J.A.; Al-Baldawi, T.H.K.: Some Bayes’ estimators for laplace distribution under different loss functions. J. Babylon Univ. 22, 975–983 (2014)
7.
go back to reference Specht, D.F.: Probabilistic neural networks and the polynomial adaline as complementary techniques for classification. IEEE Trans. Neural Netw. 1(1), 111–121 (1990)CrossRef Specht, D.F.: Probabilistic neural networks and the polynomial adaline as complementary techniques for classification. IEEE Trans. Neural Netw. 1(1), 111–121 (1990)CrossRef
8.
go back to reference Chtioui, Y.; Panigrahi, S.; Francl, L.: A generalized regression neural network and its application for leaf wetness prediction to forecast plant disease. Chemom. Intell. Lab. Syst. 48(1), 47–58 (1999)CrossRef Chtioui, Y.; Panigrahi, S.; Francl, L.: A generalized regression neural network and its application for leaf wetness prediction to forecast plant disease. Chemom. Intell. Lab. Syst. 48(1), 47–58 (1999)CrossRef
9.
go back to reference Chtioui, Y.; Panigrahi, S.; Marsh, R. A.: Conjugate gradient and approximate Newton methods for an optimal probablilistic neural network for food color classification. Opt. Eng. 37, 1–19 (1998) Chtioui, Y.; Panigrahi, S.; Marsh, R. A.: Conjugate gradient and approximate Newton methods for an optimal probablilistic neural network for food color classification. Opt. Eng. 37, 1–19 (1998)
10.
go back to reference Georgiou, V.L.; Pavlidis, N.G.; Parsopoulos, K.E.; Alevizos, P.D.; Vrahatis, M.N.: New self-adaptive probabilistic neural networks in bioinformatic and medical tasks. Int. J. Artif. Intell. Tools 15(03), 371–396 (2006)CrossRef Georgiou, V.L.; Pavlidis, N.G.; Parsopoulos, K.E.; Alevizos, P.D.; Vrahatis, M.N.: New self-adaptive probabilistic neural networks in bioinformatic and medical tasks. Int. J. Artif. Intell. Tools 15(03), 371–396 (2006)CrossRef
11.
go back to reference Kusy, M.; Zajdel, R.: Application of reinforcement learning algorithms for the adaptive computation of the smoothing parameter for probabilistic neural network. IEEE Trans. Neural Netw. Learn. Syst. 26(9), 2163–2175 (2014)MathSciNetCrossRef Kusy, M.; Zajdel, R.: Application of reinforcement learning algorithms for the adaptive computation of the smoothing parameter for probabilistic neural network. IEEE Trans. Neural Netw. Learn. Syst. 26(9), 2163–2175 (2014)MathSciNetCrossRef
12.
go back to reference Montana, D.: A weighted probabilistic neural network. In: Mozer, M.C., Jordan, M.I., Petsche, T. (eds.) Advances in Neural Information Processing Systems, pp. 1110–1117. MIT Press, Cambridge (1992) Montana, D.: A weighted probabilistic neural network. In: Mozer, M.C., Jordan, M.I., Petsche, T. (eds.) Advances in Neural Information Processing Systems, pp. 1110–1117. MIT Press, Cambridge (1992)
13.
go back to reference Georgiou, V.L.; Malefaki, S.N.; Alevizos, Ph.D.; Vrahatis, M.N.: Evolutionary Bayesian probabilistic neural networks. In: International Conference on Numerical Analysis and Applied Mathematics (ICNAAM 2006), pp. 393–396 (2006) Georgiou, V.L.; Malefaki, S.N.; Alevizos, Ph.D.; Vrahatis, M.N.: Evolutionary Bayesian probabilistic neural networks. In: International Conference on Numerical Analysis and Applied Mathematics (ICNAAM 2006), pp. 393–396 (2006)
14.
go back to reference Wei, X.; Diao, M.; Hu, Z.; Hu, X.; Gao, Y.; Huang, R.: QoE prediction for IPTV based on imbalanced dataset by the PNN-PSO algorithm. In: 2018 14th International Wireless Communications and Mobile Computing Conference (IWCMC), pp. 112–117. IEEE (2018) Wei, X.; Diao, M.; Hu, Z.; Hu, X.; Gao, Y.; Huang, R.: QoE prediction for IPTV based on imbalanced dataset by the PNN-PSO algorithm. In: 2018 14th International Wireless Communications and Mobile Computing Conference (IWCMC), pp. 112–117. IEEE (2018)
15.
go back to reference Mao, K.Z.; Tan, K.-C.; Ser, W.: Probabilistic neural-network structure determination for pattern classification. IEEE Trans. Neural Netw. 11(4), 1009–1016 (2000)CrossRef Mao, K.Z.; Tan, K.-C.; Ser, W.: Probabilistic neural-network structure determination for pattern classification. IEEE Trans. Neural Netw. 11(4), 1009–1016 (2000)CrossRef
16.
go back to reference Song, T.; Jamshidi, M.; Lee, R.R.; Huang, M.: A novel weighted probabilistic neural network for MR image segmentation. In: 2005 IEEE International Conference on Systems, Man and Cybernetics, vol. 3, pp. 2501–2506. IEEE (2005) Song, T.; Jamshidi, M.; Lee, R.R.; Huang, M.: A novel weighted probabilistic neural network for MR image segmentation. In: 2005 IEEE International Conference on Systems, Man and Cybernetics, vol. 3, pp. 2501–2506. IEEE (2005)
17.
go back to reference Ramakrishnan, S.; El Emary, I.M.M.: Comparative study between traditional and modified probabilistic neural networks. Telecommun. Syst. 40(1–2), 67–74 (2009)CrossRef Ramakrishnan, S.; El Emary, I.M.M.: Comparative study between traditional and modified probabilistic neural networks. Telecommun. Syst. 40(1–2), 67–74 (2009)CrossRef
19.
go back to reference Yang, X.-S.: A new metaheuristic bat-inspired algorithm. In: Cruz, C., González, J.R., Krasnogor, N., Pelta, D.A., Terrazas, G. (eds.) Nature Inspired Cooperative Strategies for Optimization (NICSO 2010), pp. 65–74. Springer, Berlin (2010)CrossRef Yang, X.-S.: A new metaheuristic bat-inspired algorithm. In: Cruz, C., González, J.R., Krasnogor, N., Pelta, D.A., Terrazas, G. (eds.) Nature Inspired Cooperative Strategies for Optimization (NICSO 2010), pp. 65–74. Springer, Berlin (2010)CrossRef
20.
go back to reference Mirjalili, S.; Mirjalili, S.M.; Lewis, A.: Grey wolf optimizer. Adv. Eng. Softw. 69, 46–61 (2014)CrossRef Mirjalili, S.; Mirjalili, S.M.; Lewis, A.: Grey wolf optimizer. Adv. Eng. Softw. 69, 46–61 (2014)CrossRef
21.
go back to reference Mirjalili, S.; Lewis, A.: The whale optimization algorithm. Adv. Eng. Softw. 95, 51–67 (2016)CrossRef Mirjalili, S.; Lewis, A.: The whale optimization algorithm. Adv. Eng. Softw. 95, 51–67 (2016)CrossRef
22.
go back to reference Sokolova, M.; Lapalme, G.: A systematic analysis of performance measures for classification tasks. Inf. Process. Manag. 45(4), 427–437 (2009)CrossRef Sokolova, M.; Lapalme, G.: A systematic analysis of performance measures for classification tasks. Inf. Process. Manag. 45(4), 427–437 (2009)CrossRef
23.
go back to reference Youden, W.J.: Index for rating diagnostic tests. Cancer 3(1), 32–35 (1950)CrossRef Youden, W.J.: Index for rating diagnostic tests. Cancer 3(1), 32–35 (1950)CrossRef
25.
go back to reference McDermott, J.; Forsyth, R.S.: Diagnosing a disorder in a classification benchmark. Pattern Recognit. Lett. 73, 41–43 (2016)CrossRef McDermott, J.; Forsyth, R.S.: Diagnosing a disorder in a classification benchmark. Pattern Recognit. Lett. 73, 41–43 (2016)CrossRef
26.
go back to reference Jain, A.; Nandakumar, K.; Ross, A.: Score normalization in multimodal biometric systems. Pattern Recognit. 38(12), 2270–2285 (2005)CrossRef Jain, A.; Nandakumar, K.; Ross, A.: Score normalization in multimodal biometric systems. Pattern Recognit. 38(12), 2270–2285 (2005)CrossRef
27.
go back to reference Kohavi, R et al.: A study of cross-validation and bootstrap for accuracy estimation and model selection. In: IJCAI, vol. 14, pp. 1137–1145. Montreal, Canada (1995) Kohavi, R et al.: A study of cross-validation and bootstrap for accuracy estimation and model selection. In: IJCAI, vol. 14, pp. 1137–1145. Montreal, Canada (1995)
28.
go back to reference Huang, G.-B.; Zhu, Q.-Y.; Siew, C.-K.: Extreme learning machine: a new learning scheme of feedforward neural networks. In: Proceedings of the 2004 IEEE International Joint Conference on Neural Networks, 2004, vol. 2, pp. 985–990. IEEE (2004) Huang, G.-B.; Zhu, Q.-Y.; Siew, C.-K.: Extreme learning machine: a new learning scheme of feedforward neural networks. In: Proceedings of the 2004 IEEE International Joint Conference on Neural Networks, 2004, vol. 2, pp. 985–990. IEEE (2004)
29.
go back to reference Nanjundappan, D.; et al.: Hybrid weighted probabilistic neural network and biogeography based optimization for dynamic economic dispatch of integrated multiple-fuel and wind power plants. Int. J. Electr. Power Energy Syst. 77, 385–394 (2016)CrossRef Nanjundappan, D.; et al.: Hybrid weighted probabilistic neural network and biogeography based optimization for dynamic economic dispatch of integrated multiple-fuel and wind power plants. Int. J. Electr. Power Energy Syst. 77, 385–394 (2016)CrossRef
30.
go back to reference Royston, J.P.: Some techniques for assessing multivarate normality based on the Shapiro-Wilk w. Appl. Stat. 32, 121–133 (1983)MATHCrossRef Royston, J.P.: Some techniques for assessing multivarate normality based on the Shapiro-Wilk w. Appl. Stat. 32, 121–133 (1983)MATHCrossRef
31.
go back to reference Henze, N.; Zirkler, B.: A class of invariant consistent tests for multivariate normality. Commun. Stat. Theory Methods 19(10), 3595–3617 (1990)MathSciNetMATHCrossRef Henze, N.; Zirkler, B.: A class of invariant consistent tests for multivariate normality. Commun. Stat. Theory Methods 19(10), 3595–3617 (1990)MathSciNetMATHCrossRef
32.
go back to reference Kundu, D.: Discriminating between normal and Laplace distributions. In: Advances in Ranking and Selection, Multiplecomparisons, and Reliability, pp. 65–79. Birkhäuser, Boston (2005) Kundu, D.: Discriminating between normal and Laplace distributions. In: Advances in Ranking and Selection, Multiplecomparisons, and Reliability, pp. 65–79. Birkhäuser, Boston (2005)
33.
go back to reference Friedman, M.: A comparison of alternative tests of significance for the problem of m rankings. Ann. Math. Stat. 11(1), 86–92 (1940)MathSciNetMATHCrossRef Friedman, M.: A comparison of alternative tests of significance for the problem of m rankings. Ann. Math. Stat. 11(1), 86–92 (1940)MathSciNetMATHCrossRef
Metadata
Title
Estimation of the Smoothing Parameter in Probabilistic Neural Network Using Evolutionary Algorithms
Authors
Shraddha M. Naik
Ravi Prasad K. Jagannath
Venkatanareshbabu Kuppili
Publication date
07-11-2019
Publisher
Springer Berlin Heidelberg
Published in
Arabian Journal for Science and Engineering / Issue 4/2020
Print ISSN: 2193-567X
Electronic ISSN: 2191-4281
DOI
https://doi.org/10.1007/s13369-019-04227-5

Other articles of this Issue 4/2020

Arabian Journal for Science and Engineering 4/2020 Go to the issue

Research Article - Computer Engineering and Computer Science

An Efficient Language-Independent Acoustic Emotion Classification System

Research Article - Special Issue - Intelligent Computing And Interdisciplinary Applications

An Adaptive Spiking Neural P System for Solving Vehicle Routing Problems

Research Article - Computer Engineering and Computer Science

A Novel Short Text Clustering Model Based on Grey System Theory

Research Article - Special Issue - Intelligent Computing and Interdisciplinary Applications

Hiding Shares of Counting-Based Secret Sharing via Arabic Text Steganography for Personal Usage

Research Article-Computer Engineering and Computer Science

Effective Removal of Privacy Breaches in Disassociated Transactional Datasets

Premium Partners