Skip to main content

2018 | OriginalPaper | Buchkapitel

Fast Image Recognition with Gabor Filter and Pseudoinverse Learning AutoEncoders

verfasst von : Xiaodan Deng, Sibo Feng, Ping Guo, Qian Yin

Erschienen in: Neural Information Processing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Deep neural network has been successfully used in various fields, and it has received significant results in some typical tasks, especially in computer vision. However, deep neural network are usually trained by using gradient descent based algorithm, which results in gradient vanishing and gradient explosion problems. And it requires expert level professional knowledge to design the structure of the deep neural network and find the optimal hyper parameters for a given task. Consequently, training a deep neural network becomes a very time consuming problem. To overcome the shortcomings mentioned above, we present a model which combining Gabor filter and pseudoinverse learning autoencoders. The method referred in model optimization is a non-gradient descent algorithm. Besides, we presented the empirical formula to set the number of hidden neurons and the number of hidden layers in the entire training process. The experimental results show that our model is better than existing benchmark methods in speed, at same time it has the comparative recognition accuracy also.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998)CrossRef LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998)CrossRef
2.
Zurück zum Zitat Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012) Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)
3.
Zurück zum Zitat He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016) He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
4.
5.
Zurück zum Zitat Tai, S.L.: Image representation using 2D Gabor wavelets. IEEE Trans. Pattern Anal. Mach. Intell. 18(10), 959–971 (1996)CrossRef Tai, S.L.: Image representation using 2D Gabor wavelets. IEEE Trans. Pattern Anal. Mach. Intell. 18(10), 959–971 (1996)CrossRef
6.
Zurück zum Zitat Wang, K., Guo, P., Yin, Q., et al.: A pseudoinverse incremental algorithm for fast training deep neural networks with application to spectra pattern recognition. In: 2016 International Joint Conference on Neural Networks (IJCNN), pp. 3453–3460. IEEE (2016) Wang, K., Guo, P., Yin, Q., et al.: A pseudoinverse incremental algorithm for fast training deep neural networks with application to spectra pattern recognition. In: 2016 International Joint Conference on Neural Networks (IJCNN), pp. 3453–3460. IEEE (2016)
7.
Zurück zum Zitat Feng, S., Li, S., Guo, P., Yin, Q.: Image recognition with histogram of oriented gradient feature and pseudoinverse learning autoencoders. In: 24th International Conference on Neural Information Processing (ICONIP 2017), pp. 740–749. Springer, Cham (2017)CrossRef Feng, S., Li, S., Guo, P., Yin, Q.: Image recognition with histogram of oriented gradient feature and pseudoinverse learning autoencoders. In: 24th International Conference on Neural Information Processing (ICONIP 2017), pp. 740–749. Springer, Cham (2017)CrossRef
8.
Zurück zum Zitat Gabor, D.: Theory of communication. J. Inst. Electr. Eng. I Gen. 93(26), 429–441 (1946) Gabor, D.: Theory of communication. J. Inst. Electr. Eng. I Gen. 93(26), 429–441 (1946)
9.
Zurück zum Zitat Daugman, J.D.: Two dimensional spectral analysis of cortical receptive field profiles. Vision Res. 20(10), 847–856 (1980)CrossRef Daugman, J.D.: Two dimensional spectral analysis of cortical receptive field profiles. Vision Res. 20(10), 847–856 (1980)CrossRef
10.
Zurück zum Zitat Jones, J., Palmer, L.: An evaluation of the two-dimensional Gabor filter model of simple receptive fields in cat striate cortex. J. Neurophysiol. 58(6), 1233–1258 (1987)CrossRef Jones, J., Palmer, L.: An evaluation of the two-dimensional Gabor filter model of simple receptive fields in cat striate cortex. J. Neurophysiol. 58(6), 1233–1258 (1987)CrossRef
11.
Zurück zum Zitat Kruizinga, P., Petkov, N.: Nonlinear operator for oriented texture. IEEE Trans. Image Process. 8(10), 1395–1407 (1999)CrossRef Kruizinga, P., Petkov, N.: Nonlinear operator for oriented texture. IEEE Trans. Image Process. 8(10), 1395–1407 (1999)CrossRef
12.
Zurück zum Zitat Fazli, S., Afrouzian, R., Seyedarabi, H.: High-performance facial expression recognition using gabor filter and probabilistic neural network. In: 2009 IEEE International Conference on Intelligent Computing and Intelligent Systems, pp. 93–96 (2009) Fazli, S., Afrouzian, R., Seyedarabi, H.: High-performance facial expression recognition using gabor filter and probabilistic neural network. In: 2009 IEEE International Conference on Intelligent Computing and Intelligent Systems, pp. 93–96 (2009)
13.
Zurück zum Zitat Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning representations by back-propagating errors. Nature 323(6088), 533–536 (1986)CrossRef Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning representations by back-propagating errors. Nature 323(6088), 533–536 (1986)CrossRef
14.
Zurück zum Zitat Hinton, G.E., Osindero, S., Teh, Y.W.: A fast learning algorithm for deep belief nets. Neural Comput. 18(7), 1527–1554 (2006)MathSciNetCrossRef Hinton, G.E., Osindero, S., Teh, Y.W.: A fast learning algorithm for deep belief nets. Neural Comput. 18(7), 1527–1554 (2006)MathSciNetCrossRef
15.
Zurück zum Zitat Guo, P., Chen, P.C.L., Sun, Y.: An exact supervised learning for a three-layer supervised neural network. In: Second International Conference on Neural Information Processing (ICONIP 1995), pp. 1041–1044 (1995) Guo, P., Chen, P.C.L., Sun, Y.: An exact supervised learning for a three-layer supervised neural network. In: Second International Conference on Neural Information Processing (ICONIP 1995), pp. 1041–1044 (1995)
16.
Zurück zum Zitat Guo, P., Lyu, M.R., Mastorakis, N.E.: Pseudoinverse learning algorithm for feedforward neural networks. In: Advances in Neural Networks and Applications, pp. 321–326 (2001) Guo, P., Lyu, M.R., Mastorakis, N.E.: Pseudoinverse learning algorithm for feedforward neural networks. In: Advances in Neural Networks and Applications, pp. 321–326 (2001)
17.
Zurück zum Zitat Guo, P., Lyu, M.R.: A pseudoinverse learning algorithm for feedforward neural networks with stacked generalization applications to software reliability growth data. Neurocomputing 56, 101–121 (2004)CrossRef Guo, P., Lyu, M.R.: A pseudoinverse learning algorithm for feedforward neural networks with stacked generalization applications to software reliability growth data. Neurocomputing 56, 101–121 (2004)CrossRef
18.
Zurück zum Zitat Wang, K., Guo, P., Xin, X., Ye, Z.: Autoencoder, low rank approximation and pseudoinverse learning algorithm. In: 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 948–953. IEEE (2017) Wang, K., Guo, P., Xin, X., Ye, Z.: Autoencoder, low rank approximation and pseudoinverse learning algorithm. In: 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 948–953. IEEE (2017)
19.
Zurück zum Zitat Guo, P., Lyu, M., Chen, P.: Regularization parameter estimation for feedforward neural networks. IEEE Trans. Syst. Man Cybern. B 33(1), 35–44 (2003)CrossRef Guo, P., Lyu, M., Chen, P.: Regularization parameter estimation for feedforward neural networks. IEEE Trans. Syst. Man Cybern. B 33(1), 35–44 (2003)CrossRef
Metadaten
Titel
Fast Image Recognition with Gabor Filter and Pseudoinverse Learning AutoEncoders
verfasst von
Xiaodan Deng
Sibo Feng
Ping Guo
Qian Yin
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-030-04224-0_43