Skip to main content
Top

2016 | OriginalPaper | Chapter

An Improved Self-Structuring Neural Network

Authors : Rami M. Mohammad, Fadi Thabtah, Lee McCluskey

Published in: Trends and Applications in Knowledge Discovery and Data Mining

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Creating a neural network based classification model is traditionally accomplished using the trial and error technique. However, the trial and error structuring method nornally suffers from several difficulties including overtraining. In this article, a new algorithm that simplifies structuring neural network classification models has been proposed. It aims at creating a large structure to derive classifiers from the training dataset that have generally good predictive accuracy performance on domain applications. The proposed algorithm tunes crucial NN model thresholds during the training phase in order to cope with dynamic behavior of the learning process. This indeed may reduce the chance of overfitting the training dataset or early convergence of the model. Several experiments using our algorithm as well as other classification algorithms, have been conducted against a number of datasets from University of California Irvine (UCI) repository. The experiments’ are performed to assess the pros and cons of our proposed NN method. The derived results show that our algorithm outperformed the compared classification algorithms with respect to several performance measures.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Abdelhamid, N., Ayesh, A., Thabtah, F.: Phishing detection based associative classification data mining. Expert Syst. Appl. 41(13), 5948–5959 (2014)CrossRef Abdelhamid, N., Ayesh, A., Thabtah, F.: Phishing detection based associative classification data mining. Expert Syst. Appl. 41(13), 5948–5959 (2014)CrossRef
2.
go back to reference Ash, T.: Dynamic node creation in backpropagation networks. Connect. Sci. 1(4), 365–375 (1989)CrossRef Ash, T.: Dynamic node creation in backpropagation networks. Connect. Sci. 1(4), 365–375 (1989)CrossRef
3.
go back to reference Fahlman, S.E., Lebiere, C.: The cascade-correlation learning architecture. In: Advances in Neural Information Processing Systems, pp. 524–532 (1990) Fahlman, S.E., Lebiere, C.: The cascade-correlation learning architecture. In: Advances in Neural Information Processing Systems, pp. 524–532 (1990)
4.
go back to reference Ma, L., Khorasani, K.: A new strategy for adaptively constructing multilayer feedforward neural networks. Neurocomputing 51(1), 361–385 (2003)CrossRef Ma, L., Khorasani, K.: A new strategy for adaptively constructing multilayer feedforward neural networks. Neurocomputing 51(1), 361–385 (2003)CrossRef
5.
go back to reference Basheer, I.A., Hajmeer, M.: Artificial neural networks: fundamentals, computing, design, and application. J. Microbiol. Methods 43(1), 3–31 (2000)CrossRef Basheer, I.A., Hajmeer, M.: Artificial neural networks: fundamentals, computing, design, and application. J. Microbiol. Methods 43(1), 3–31 (2000)CrossRef
7.
go back to reference Duffner, S., Garcia, C.: An online backpropagation algorithm with validation error-based adaptive learning rate. In: de Sá, J.M., Alexandre, L.A., Duch, W., Mandic, D.P. (eds.) ICANN 2007. LNCS, vol. 4668, pp. 249–258. Springer, Heidelberg (2007)CrossRef Duffner, S., Garcia, C.: An online backpropagation algorithm with validation error-based adaptive learning rate. In: de Sá, J.M., Alexandre, L.A., Duch, W., Mandic, D.P. (eds.) ICANN 2007. LNCS, vol. 4668, pp. 249–258. Springer, Heidelberg (2007)CrossRef
8.
go back to reference Riley, M., Karl, J., Chris, T.: A study of early stopping, ensembling, and patchworking for cascade correlation neural networks. IAENG Int. J. Appl. Math. 40(4), 307–316 (2010) Riley, M., Karl, J., Chris, T.: A study of early stopping, ensembling, and patchworking for cascade correlation neural networks. IAENG Int. J. Appl. Math. 40(4), 307–316 (2010)
9.
go back to reference Quinlan, J.: Data mining tools See5 and C5.0 (1998) Quinlan, J.: Data mining tools See5 and C5.0 (1998)
10.
go back to reference Friedman, N., Geiger, D., Goldszmidt, M.: Bayesian network classifiers. Mach. Learn. - Spec. Issue Learn. Probab. Represent. 29(2–3), 131–163 (1997)MATH Friedman, N., Geiger, D., Goldszmidt, M.: Bayesian network classifiers. Mach. Learn. - Spec. Issue Learn. Probab. Represent. 29(2–3), 131–163 (1997)MATH
11.
go back to reference Witten, I.H., Frank, E., Hall, M.A.: Data Mining: Practical Machine Learning Tools and Techniques with Java Implementations, 3rd edn. Morgan Kaufmann, Boston (2011) Witten, I.H., Frank, E., Hall, M.A.: Data Mining: Practical Machine Learning Tools and Techniques with Java Implementations, 3rd edn. Morgan Kaufmann, Boston (2011)
12.
go back to reference Hinton, G., et al.: Deep neural networks for acoustic modeling in speech recognition. IEEE Signal Process. Mag. 29(6), 82–97 (2012)CrossRef Hinton, G., et al.: Deep neural networks for acoustic modeling in speech recognition. IEEE Signal Process. Mag. 29(6), 82–97 (2012)CrossRef
13.
go back to reference Ganatra, A., Kosta, Y.P., Panchal, G., Gajjar, C.: Initial classification through back propagation in a neural network following optimization through GA to evaluate the fitness of an algorithm. Int. J. Comput. Sci. Inf. Technol. 3(1), 98–116 (2011) Ganatra, A., Kosta, Y.P., Panchal, G., Gajjar, C.: Initial classification through back propagation in a neural network following optimization through GA to evaluate the fitness of an algorithm. Int. J. Comput. Sci. Inf. Technol. 3(1), 98–116 (2011)
14.
go back to reference Insung, J., Wang, G.-N.: Pattern classification of back-propagation algorithm using exclusive connecting network. World Acad. Sci. 36(1), 189–193 (2007) Insung, J., Wang, G.-N.: Pattern classification of back-propagation algorithm using exclusive connecting network. World Acad. Sci. 36(1), 189–193 (2007)
15.
go back to reference Mohammad, R.M., Thabtah, F., McCluskey, L.: Predicting phishing websites using neural network trained with back-propagation. In: ICAI, Las Vigas, pp. 682–686 (2013) Mohammad, R.M., Thabtah, F., McCluskey, L.: Predicting phishing websites using neural network trained with back-propagation. In: ICAI, Las Vigas, pp. 682–686 (2013)
Metadata
Title
An Improved Self-Structuring Neural Network
Authors
Rami M. Mohammad
Fadi Thabtah
Lee McCluskey
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-42996-0_4

Premium Partner