Skip to main content
Top
Published in:
Cover of the book

2016 | OriginalPaper | Chapter

Shallow Network Performance in an Increasing Image Dimension

Authors : Mohd Razif Shamsuddin, Shuzlina Abdul-Rahman, Azlinah Mohamed

Published in: Soft Computing in Data Science

Publisher: Springer Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper describes the performance of a shallow network towards increasing complexity of dimension in an image input representation. This paper will highlight the generalization problem in Shallow Neural Network despite its extensive usage. In this experiment, a backpropagation algorithm is chosen to test the network as it is widely used in many classification problems. A set of three different size of binary images are used in this experiment. The idea is to assess how the network performs as the scale of the input dimension increases. In addition, a benchmark MNIST handwritten digit sampling is also used to test the performance of the shallow network. The result of the experiment shows the network performance as the scale of input increases. The result is then discussed and explained. From the conducted experiments it is believed that the complexity of the input size and breadth of the network affects the performance of the Neural Network. Such results can be as a reference and guidance to people that is interested in doing research using backpropagation algorithm.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Mona, M.M., Amr, B., Abdelhalim, M.B.: Image classification and retrieval using optimized pulse-coupled neural network. Expert Syst. Appl. 42(11), 4927–4936 (2015)CrossRef Mona, M.M., Amr, B., Abdelhalim, M.B.: Image classification and retrieval using optimized pulse-coupled neural network. Expert Syst. Appl. 42(11), 4927–4936 (2015)CrossRef
2.
go back to reference Tara, N.S., Brian, K., George, S., Hagen, S., Abdel-rahman, M., George, D., Bhuvana, R.: Deep convolutional neural networks for large-scale speech tasks. Neural Netw. 64, 39–48 (2014) Tara, N.S., Brian, K., George, S., Hagen, S., Abdel-rahman, M., George, D., Bhuvana, R.: Deep convolutional neural networks for large-scale speech tasks. Neural Netw. 64, 39–48 (2014)
3.
go back to reference Iturriaga, F.J.L., Sanz, I.P.: Bankruptcy visualization and prediction using neural networks: a study of U.S. commercial banks. Expert Syst. Appl. 42(6), 2857–2869 (2015)CrossRef Iturriaga, F.J.L., Sanz, I.P.: Bankruptcy visualization and prediction using neural networks: a study of U.S. commercial banks. Expert Syst. Appl. 42(6), 2857–2869 (2015)CrossRef
4.
go back to reference Khosravi, A., Nahavandi, S., Creighton, D., Atiya, A.F.: Comprehensive review of neural network-based prediction intervals and new advances. IEEE Trans. Neural Netw. 22(9), 1341–1356 (2011)CrossRef Khosravi, A., Nahavandi, S., Creighton, D., Atiya, A.F.: Comprehensive review of neural network-based prediction intervals and new advances. IEEE Trans. Neural Netw. 22(9), 1341–1356 (2011)CrossRef
5.
go back to reference Kumar, K., Thakur, G.S.M.: Advanced applications of neural networks and artificial intelligence: a review. Int. J. Inf. Technol. Comput. Sci. 6, 57–68 (2012)CrossRef Kumar, K., Thakur, G.S.M.: Advanced applications of neural networks and artificial intelligence: a review. Int. J. Inf. Technol. Comput. Sci. 6, 57–68 (2012)CrossRef
6.
go back to reference Rolls, E.T., Deco, G.: Networks for memory, perception, and decision-making, and beyond to how the syntax for language might be implemented in the brain. Brain Res. 1621, 316–334 (2014)CrossRef Rolls, E.T., Deco, G.: Networks for memory, perception, and decision-making, and beyond to how the syntax for language might be implemented in the brain. Brain Res. 1621, 316–334 (2014)CrossRef
7.
go back to reference Hardalaç, F.: Classification of educational backgrounds of students using musical intelligence and perception with the help of genetic neural networks. Expert Syst. Appl. 36(3, Part 2), 6708–6713 (2009)CrossRef Hardalaç, F.: Classification of educational backgrounds of students using musical intelligence and perception with the help of genetic neural networks. Expert Syst. Appl. 36(3, Part 2), 6708–6713 (2009)CrossRef
8.
go back to reference Biswas, S.K., Sinha, N., Purakayastha, B., Marbaniang, L.: Hybrid expert system using case based reasoning and neural network for classification. Biologically Inspired Cogn. Architectures 9, 57–70 (2014)CrossRef Biswas, S.K., Sinha, N., Purakayastha, B., Marbaniang, L.: Hybrid expert system using case based reasoning and neural network for classification. Biologically Inspired Cogn. Architectures 9, 57–70 (2014)CrossRef
9.
go back to reference Farahani, M.: Intelligent control of SVC using wavelet neural network to enhance transient stability. Eng. Appl. Artif. Intell. 26(1), 273–280 (2013)CrossRef Farahani, M.: Intelligent control of SVC using wavelet neural network to enhance transient stability. Eng. Appl. Artif. Intell. 26(1), 273–280 (2013)CrossRef
10.
go back to reference Miljković, Z., Mitić, M., Lazarević, M., Babić, B.: Neural network reinforcement Learning for visual control of robot manipulators. Expert Syst. Appl. 40(5), 1721–1736 (2013)CrossRef Miljković, Z., Mitić, M., Lazarević, M., Babić, B.: Neural network reinforcement Learning for visual control of robot manipulators. Expert Syst. Appl. 40(5), 1721–1736 (2013)CrossRef
11.
go back to reference Khan, M.N.A.: Performance analysis of Bayesian networks and neural networks in classification of file system activities. Comput. Secur. 31, 391–401 (2012)CrossRef Khan, M.N.A.: Performance analysis of Bayesian networks and neural networks in classification of file system activities. Comput. Secur. 31, 391–401 (2012)CrossRef
12.
go back to reference Fausett, L.: Fundamentals of Neural Network. Prentice-Hall, Upper Saddle River (1994)MATH Fausett, L.: Fundamentals of Neural Network. Prentice-Hall, Upper Saddle River (1994)MATH
14.
go back to reference Hopfield, J.J.: Neural networks and physical systems with emergent collective computational abilities. Proc. Nat. Acad. Sci. 79, 2554–2558 (1982)MathSciNetCrossRef Hopfield, J.J.: Neural networks and physical systems with emergent collective computational abilities. Proc. Nat. Acad. Sci. 79, 2554–2558 (1982)MathSciNetCrossRef
15.
go back to reference LeCun, Y., Boser, B., Denker, J.S., Henderson, D., Howard, R.E., Hubbard, W., Jackel, L.D.: Back-propagation applied to handwritten zip code recognition. Neural Comput. 1(4), 541–551 (1989)CrossRef LeCun, Y., Boser, B., Denker, J.S., Henderson, D., Howard, R.E., Hubbard, W., Jackel, L.D.: Back-propagation applied to handwritten zip code recognition. Neural Comput. 1(4), 541–551 (1989)CrossRef
16.
go back to reference LeCun, Y., Boser, B., Denker, J.S., Henderson, D., Howard, R.E., Hubbard, W., Jackel, L.D.: Handwritten digit recognition with a back-propagation network. In: Touretzky, D.S. (ed.) Advances in Neural Information Processing Systems, vol. 2, pp. 396–404 (1990) LeCun, Y., Boser, B., Denker, J.S., Henderson, D., Howard, R.E., Hubbard, W., Jackel, L.D.: Handwritten digit recognition with a back-propagation network. In: Touretzky, D.S. (ed.) Advances in Neural Information Processing Systems, vol. 2, pp. 396–404 (1990)
17.
go back to reference LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (2006)CrossRef LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (2006)CrossRef
18.
19.
go back to reference Warren, S., Mcculloch, W.P.: A logical calculus of the ideas immanent in nervous activity 5, 115–133 (1943) Warren, S., Mcculloch, W.P.: A logical calculus of the ideas immanent in nervous activity 5, 115–133 (1943)
20.
go back to reference Jeff, H.: Introduction to Neural Networks for Java, 2nd edn., pp. 1–440 (2008) Jeff, H.: Introduction to Neural Networks for Java, 2nd edn., pp. 1–440 (2008)
21.
go back to reference Abdul-Rahman, S., Bakar, A.A., Mohamed-Hussein, Z.-A.: An intelligent data pre-processing of complex datasets. Intell. Data Anal. 16, 305–325 (2012) Abdul-Rahman, S., Bakar, A.A., Mohamed-Hussein, Z.-A.: An intelligent data pre-processing of complex datasets. Intell. Data Anal. 16, 305–325 (2012)
Metadata
Title
Shallow Network Performance in an Increasing Image Dimension
Authors
Mohd Razif Shamsuddin
Shuzlina Abdul-Rahman
Azlinah Mohamed
Copyright Year
2016
Publisher
Springer Singapore
DOI
https://doi.org/10.1007/978-981-10-2777-2_1

Premium Partner