Skip to main content
Erschienen in:
Buchtitelbild

2016 | OriginalPaper | Buchkapitel

Shallow Network Performance in an Increasing Image Dimension

verfasst von : Mohd Razif Shamsuddin, Shuzlina Abdul-Rahman, Azlinah Mohamed

Erschienen in: Soft Computing in Data Science

Verlag: Springer Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper describes the performance of a shallow network towards increasing complexity of dimension in an image input representation. This paper will highlight the generalization problem in Shallow Neural Network despite its extensive usage. In this experiment, a backpropagation algorithm is chosen to test the network as it is widely used in many classification problems. A set of three different size of binary images are used in this experiment. The idea is to assess how the network performs as the scale of the input dimension increases. In addition, a benchmark MNIST handwritten digit sampling is also used to test the performance of the shallow network. The result of the experiment shows the network performance as the scale of input increases. The result is then discussed and explained. From the conducted experiments it is believed that the complexity of the input size and breadth of the network affects the performance of the Neural Network. Such results can be as a reference and guidance to people that is interested in doing research using backpropagation algorithm.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Mona, M.M., Amr, B., Abdelhalim, M.B.: Image classification and retrieval using optimized pulse-coupled neural network. Expert Syst. Appl. 42(11), 4927–4936 (2015)CrossRef Mona, M.M., Amr, B., Abdelhalim, M.B.: Image classification and retrieval using optimized pulse-coupled neural network. Expert Syst. Appl. 42(11), 4927–4936 (2015)CrossRef
2.
Zurück zum Zitat Tara, N.S., Brian, K., George, S., Hagen, S., Abdel-rahman, M., George, D., Bhuvana, R.: Deep convolutional neural networks for large-scale speech tasks. Neural Netw. 64, 39–48 (2014) Tara, N.S., Brian, K., George, S., Hagen, S., Abdel-rahman, M., George, D., Bhuvana, R.: Deep convolutional neural networks for large-scale speech tasks. Neural Netw. 64, 39–48 (2014)
3.
Zurück zum Zitat Iturriaga, F.J.L., Sanz, I.P.: Bankruptcy visualization and prediction using neural networks: a study of U.S. commercial banks. Expert Syst. Appl. 42(6), 2857–2869 (2015)CrossRef Iturriaga, F.J.L., Sanz, I.P.: Bankruptcy visualization and prediction using neural networks: a study of U.S. commercial banks. Expert Syst. Appl. 42(6), 2857–2869 (2015)CrossRef
4.
Zurück zum Zitat Khosravi, A., Nahavandi, S., Creighton, D., Atiya, A.F.: Comprehensive review of neural network-based prediction intervals and new advances. IEEE Trans. Neural Netw. 22(9), 1341–1356 (2011)CrossRef Khosravi, A., Nahavandi, S., Creighton, D., Atiya, A.F.: Comprehensive review of neural network-based prediction intervals and new advances. IEEE Trans. Neural Netw. 22(9), 1341–1356 (2011)CrossRef
5.
Zurück zum Zitat Kumar, K., Thakur, G.S.M.: Advanced applications of neural networks and artificial intelligence: a review. Int. J. Inf. Technol. Comput. Sci. 6, 57–68 (2012)CrossRef Kumar, K., Thakur, G.S.M.: Advanced applications of neural networks and artificial intelligence: a review. Int. J. Inf. Technol. Comput. Sci. 6, 57–68 (2012)CrossRef
6.
Zurück zum Zitat Rolls, E.T., Deco, G.: Networks for memory, perception, and decision-making, and beyond to how the syntax for language might be implemented in the brain. Brain Res. 1621, 316–334 (2014)CrossRef Rolls, E.T., Deco, G.: Networks for memory, perception, and decision-making, and beyond to how the syntax for language might be implemented in the brain. Brain Res. 1621, 316–334 (2014)CrossRef
7.
Zurück zum Zitat Hardalaç, F.: Classification of educational backgrounds of students using musical intelligence and perception with the help of genetic neural networks. Expert Syst. Appl. 36(3, Part 2), 6708–6713 (2009)CrossRef Hardalaç, F.: Classification of educational backgrounds of students using musical intelligence and perception with the help of genetic neural networks. Expert Syst. Appl. 36(3, Part 2), 6708–6713 (2009)CrossRef
8.
Zurück zum Zitat Biswas, S.K., Sinha, N., Purakayastha, B., Marbaniang, L.: Hybrid expert system using case based reasoning and neural network for classification. Biologically Inspired Cogn. Architectures 9, 57–70 (2014)CrossRef Biswas, S.K., Sinha, N., Purakayastha, B., Marbaniang, L.: Hybrid expert system using case based reasoning and neural network for classification. Biologically Inspired Cogn. Architectures 9, 57–70 (2014)CrossRef
9.
Zurück zum Zitat Farahani, M.: Intelligent control of SVC using wavelet neural network to enhance transient stability. Eng. Appl. Artif. Intell. 26(1), 273–280 (2013)CrossRef Farahani, M.: Intelligent control of SVC using wavelet neural network to enhance transient stability. Eng. Appl. Artif. Intell. 26(1), 273–280 (2013)CrossRef
10.
Zurück zum Zitat Miljković, Z., Mitić, M., Lazarević, M., Babić, B.: Neural network reinforcement Learning for visual control of robot manipulators. Expert Syst. Appl. 40(5), 1721–1736 (2013)CrossRef Miljković, Z., Mitić, M., Lazarević, M., Babić, B.: Neural network reinforcement Learning for visual control of robot manipulators. Expert Syst. Appl. 40(5), 1721–1736 (2013)CrossRef
11.
Zurück zum Zitat Khan, M.N.A.: Performance analysis of Bayesian networks and neural networks in classification of file system activities. Comput. Secur. 31, 391–401 (2012)CrossRef Khan, M.N.A.: Performance analysis of Bayesian networks and neural networks in classification of file system activities. Comput. Secur. 31, 391–401 (2012)CrossRef
12.
Zurück zum Zitat Fausett, L.: Fundamentals of Neural Network. Prentice-Hall, Upper Saddle River (1994)MATH Fausett, L.: Fundamentals of Neural Network. Prentice-Hall, Upper Saddle River (1994)MATH
14.
Zurück zum Zitat Hopfield, J.J.: Neural networks and physical systems with emergent collective computational abilities. Proc. Nat. Acad. Sci. 79, 2554–2558 (1982)MathSciNetCrossRef Hopfield, J.J.: Neural networks and physical systems with emergent collective computational abilities. Proc. Nat. Acad. Sci. 79, 2554–2558 (1982)MathSciNetCrossRef
15.
Zurück zum Zitat LeCun, Y., Boser, B., Denker, J.S., Henderson, D., Howard, R.E., Hubbard, W., Jackel, L.D.: Back-propagation applied to handwritten zip code recognition. Neural Comput. 1(4), 541–551 (1989)CrossRef LeCun, Y., Boser, B., Denker, J.S., Henderson, D., Howard, R.E., Hubbard, W., Jackel, L.D.: Back-propagation applied to handwritten zip code recognition. Neural Comput. 1(4), 541–551 (1989)CrossRef
16.
Zurück zum Zitat LeCun, Y., Boser, B., Denker, J.S., Henderson, D., Howard, R.E., Hubbard, W., Jackel, L.D.: Handwritten digit recognition with a back-propagation network. In: Touretzky, D.S. (ed.) Advances in Neural Information Processing Systems, vol. 2, pp. 396–404 (1990) LeCun, Y., Boser, B., Denker, J.S., Henderson, D., Howard, R.E., Hubbard, W., Jackel, L.D.: Handwritten digit recognition with a back-propagation network. In: Touretzky, D.S. (ed.) Advances in Neural Information Processing Systems, vol. 2, pp. 396–404 (1990)
17.
Zurück zum Zitat LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (2006)CrossRef LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (2006)CrossRef
18.
Zurück zum Zitat Hinton, G.E., Osindero, S., Teh, Y.-W.: A fast learning algorithm for deep belief nets. Neural Comput. 18(7), 1527–1554 (2006)MathSciNetCrossRefMATH Hinton, G.E., Osindero, S., Teh, Y.-W.: A fast learning algorithm for deep belief nets. Neural Comput. 18(7), 1527–1554 (2006)MathSciNetCrossRefMATH
19.
Zurück zum Zitat Warren, S., Mcculloch, W.P.: A logical calculus of the ideas immanent in nervous activity 5, 115–133 (1943) Warren, S., Mcculloch, W.P.: A logical calculus of the ideas immanent in nervous activity 5, 115–133 (1943)
20.
Zurück zum Zitat Jeff, H.: Introduction to Neural Networks for Java, 2nd edn., pp. 1–440 (2008) Jeff, H.: Introduction to Neural Networks for Java, 2nd edn., pp. 1–440 (2008)
21.
Zurück zum Zitat Abdul-Rahman, S., Bakar, A.A., Mohamed-Hussein, Z.-A.: An intelligent data pre-processing of complex datasets. Intell. Data Anal. 16, 305–325 (2012) Abdul-Rahman, S., Bakar, A.A., Mohamed-Hussein, Z.-A.: An intelligent data pre-processing of complex datasets. Intell. Data Anal. 16, 305–325 (2012)
Metadaten
Titel
Shallow Network Performance in an Increasing Image Dimension
verfasst von
Mohd Razif Shamsuddin
Shuzlina Abdul-Rahman
Azlinah Mohamed
Copyright-Jahr
2016
Verlag
Springer Singapore
DOI
https://doi.org/10.1007/978-981-10-2777-2_1