Skip to main content

2015 | OriginalPaper | Buchkapitel

Multiple Convolutional Neural Network for Feature Extraction

verfasst von : Guo-Wei Yang, Hui-Fang Jing

Erschienen in: Intelligent Computing Theories and Methodologies

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Recent theoretical studies indicate that Deep Neural Network has been applied to many image processing tasks. However, learning in deep architectures is still difficult. One of the neural network, Convolutional Neural Network (CNN) has gained great success in image recognition and it builds features by automatic learning. More importantly, CNN can operate directly on the gray image, so it can be directly used for processing classification of the image. In order to utilize CNN to recognize plant leaf, a hierarchical model based on CNN is proposed in this paper. We firstly do some pre-processing, such as illumination changes, rotation and leaf distortion. After that, we applied the method of CNN to extract the features of leaves pictures. One focus on our network is about the depth of CNN, which affects the ability of capability of convolution. Thus, we try our best to choose the best depth of CNN with several experiments. Moreover, in order to destroy the symmetry of networks, the strategies used in this paper is to add a mathematical formula for feature map connection between convolutional layer and sampling layer. The experimental results show that the proposed method is quite effective and feasible. And we also applied other classification methods to the ICL dataset. By contrast, our classification is much better than other methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Cai, C.Z., et al.: SVM-Prot: web-based support vector machine software for functional classification of a protein from its primary sequence. Nucleic Acids Res. 31(13), 3692–3697 (2003)CrossRef Cai, C.Z., et al.: SVM-Prot: web-based support vector machine software for functional classification of a protein from its primary sequence. Nucleic Acids Res. 31(13), 3692–3697 (2003)CrossRef
2.
Zurück zum Zitat Christian, S., Laptev, I., Caputo, B.: Recognizing human actions: a local SVM approach. In: Proceedings of the 17th International Conference on Pattern Recognition, 2004, ICPR 2004. vol. 3, IEEE (2004) Christian, S., Laptev, I., Caputo, B.: Recognizing human actions: a local SVM approach. In: Proceedings of the 17th International Conference on Pattern Recognition, 2004, ICPR 2004. vol. 3, IEEE (2004)
3.
Zurück zum Zitat Mavroforakis, M.E., Theodoridis, S.: A geometric approach to support vector machine (SVM) classification. IEEE Trans. Neural Netw. 17(3), 671–682 (2006)CrossRef Mavroforakis, M.E., Theodoridis, S.: A geometric approach to support vector machine (SVM) classification. IEEE Trans. Neural Netw. 17(3), 671–682 (2006)CrossRef
4.
Zurück zum Zitat Hinton, G.E., Salakhutdinov, R.R.: Reducing the dimensionality of data with neural networks. Science 313(5786), 504–507 (2006)MathSciNetCrossRefMATH Hinton, G.E., Salakhutdinov, R.R.: Reducing the dimensionality of data with neural networks. Science 313(5786), 504–507 (2006)MathSciNetCrossRefMATH
6.
Zurück zum Zitat Bengio, Y., Courville, A., Vincent, P.: Representation learning: a review and new perspectives, 1–1 (2013) Bengio, Y., Courville, A., Vincent, P.: Representation learning: a review and new perspectives, 1–1 (2013)
7.
Zurück zum Zitat Lecun, Y., Bottou, L., Bengio, Y.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998)CrossRef Lecun, Y., Bottou, L., Bengio, Y.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998)CrossRef
8.
Zurück zum Zitat Simard, P.Y., Steinkraus, D., Platt, J.C.: Best practice for convolutional neural networks applied to visual document analysis. In: ICDAR, pp. 958–962. IEEE, Los Alamitos (2003) Simard, P.Y., Steinkraus, D., Platt, J.C.: Best practice for convolutional neural networks applied to visual document analysis. In: ICDAR, pp. 958–962. IEEE, Los Alamitos (2003)
9.
Zurück zum Zitat Cires, D.C., Meier, U., Masci, J.: Flexible, high performance convolutional neural networks for image classification. In: Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence, vol. 2, pp. 1237–1242 (2011) Cires, D.C., Meier, U., Masci, J.: Flexible, high performance convolutional neural networks for image classification. In: Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence, vol. 2, pp. 1237–1242 (2011)
10.
Zurück zum Zitat Cires, D.C., Meier, U., Schmidhuber, et al.: Multi-column deep neural networks for image classification. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 3642–3649, New York (2012) Cires, D.C., Meier, U., Schmidhuber, et al.: Multi-column deep neural networks for image classification. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 3642–3649, New York (2012)
11.
Zurück zum Zitat Baum, E., Haussler, D.: What size net gives valid generalization (J). Neural Comput. 1, 151–160 (1989)CrossRef Baum, E., Haussler, D.: What size net gives valid generalization (J). Neural Comput. 1, 151–160 (1989)CrossRef
12.
Zurück zum Zitat Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet Classification with Deep Convolutional Neural Networks. In: NIPS (2012) Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet Classification with Deep Convolutional Neural Networks. In: NIPS (2012)
13.
Zurück zum Zitat Duda, R., Hard, P., Stork, D.: Pattern Recognition, 2nd edn. Wiley-Interscience, New York (2000) Duda, R., Hard, P., Stork, D.: Pattern Recognition, 2nd edn. Wiley-Interscience, New York (2000)
14.
Zurück zum Zitat Behnke, S.: Hierarchical Neural Networks for Image Interpretation [M], 1(4), 541–551 (1989) Behnke, S.: Hierarchical Neural Networks for Image Interpretation [M], 1(4), 541–551 (1989)
15.
Zurück zum Zitat Lippmann, R.: An introduction to computing with neural nets [J]. IEEE ASSP Magazine 4, 22 (1987)CrossRef Lippmann, R.: An introduction to computing with neural nets [J]. IEEE ASSP Magazine 4, 22 (1987)CrossRef
16.
Zurück zum Zitat Bourlard, H., Kamp, Y.: Auto-association by multilayer perceptrons and singular value decomposition. Biol. Cybern. 59(4–5), 291–294 (1988)MathSciNetCrossRefMATH Bourlard, H., Kamp, Y.: Auto-association by multilayer perceptrons and singular value decomposition. Biol. Cybern. 59(4–5), 291–294 (1988)MathSciNetCrossRefMATH
17.
Zurück zum Zitat Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning representations by back-propagating errors. Nature 323(6088), 533–536 (1986)CrossRef Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning representations by back-propagating errors. Nature 323(6088), 533–536 (1986)CrossRef
18.
Zurück zum Zitat Vincent, P., Larochelle, H., Bengio, Y., Manzagol, P.-A.: Extracting and composing robust features with denoising AEs. In: ICML (2008) Vincent, P., Larochelle, H., Bengio, Y., Manzagol, P.-A.: Extracting and composing robust features with denoising AEs. In: ICML (2008)
19.
Zurück zum Zitat Vincent, P., Larochelle, H., Lajoie, I., Bengio, Y., Manzagol, P.-A.: Stackeddenoising AEs: learning useful representations in a deep network with a local denoising criterion. J. Mach. Learn. Res. 11, 3371–3408 (2010)MathSciNetMATH Vincent, P., Larochelle, H., Lajoie, I., Bengio, Y., Manzagol, P.-A.: Stackeddenoising AEs: learning useful representations in a deep network with a local denoising criterion. J. Mach. Learn. Res. 11, 3371–3408 (2010)MathSciNetMATH
21.
Zurück zum Zitat Li, B., Huang, D.S.: Locally linear discriminant embedding: an efficient method for face recognition. Pattern Recogn. 41(12), 3813–3821 (2008)CrossRefMATH Li, B., Huang, D.S.: Locally linear discriminant embedding: an efficient method for face recognition. Pattern Recogn. 41(12), 3813–3821 (2008)CrossRefMATH
22.
Zurück zum Zitat Huang, D.S., Du, J.-X.: A constructive hybrid structure optimization methodology for radial basis probabilistic neural networks. IEEE Trans. Neural Netw. 19(12), 2099–2115 (2008)CrossRef Huang, D.S., Du, J.-X.: A constructive hybrid structure optimization methodology for radial basis probabilistic neural networks. IEEE Trans. Neural Netw. 19(12), 2099–2115 (2008)CrossRef
23.
Zurück zum Zitat Huang, D.S., Horace, H.S.Ip, Chi, Z.-R.: A neural root finder of polynomials based on root moments. Neural Comput. 16(8), 1721–1762 (2004)CrossRefMATH Huang, D.S., Horace, H.S.Ip, Chi, Z.-R.: A neural root finder of polynomials based on root moments. Neural Comput. 16(8), 1721–1762 (2004)CrossRefMATH
24.
Zurück zum Zitat Huang, D.S., Jiang, W.: A general CPL-AdS methodology for fixing dynamic parameters in dual environments. IEEE Trans. Syst. Man Cybern. Part B 42(5), 1489–1500 (2012)CrossRef Huang, D.S., Jiang, W.: A general CPL-AdS methodology for fixing dynamic parameters in dual environments. IEEE Trans. Syst. Man Cybern. Part B 42(5), 1489–1500 (2012)CrossRef
25.
Zurück zum Zitat Huang, D.S.: Systematic Theory of Neural Networks for Pattern Recognition (in Chinese). Publishing House of Electronic Industry of China, Beijing (1996) Huang, D.S.: Systematic Theory of Neural Networks for Pattern Recognition (in Chinese). Publishing House of Electronic Industry of China, Beijing (1996)
26.
Zurück zum Zitat Huang, D.S.: Radial basis probabilistic neural networks: model and application. Int. J. Pattern Recogn. Artif. Intell. 13(7), 1083–1101 (1999)CrossRef Huang, D.S.: Radial basis probabilistic neural networks: model and application. Int. J. Pattern Recogn. Artif. Intell. 13(7), 1083–1101 (1999)CrossRef
27.
Zurück zum Zitat Wang, X.-F., Huang, D.S.: A novel density-based clustering framework by using level set method. IEEE Trans. Knowl. Data Eng. 21(11), 1515–1531 (2009)CrossRef Wang, X.-F., Huang, D.S.: A novel density-based clustering framework by using level set method. IEEE Trans. Knowl. Data Eng. 21(11), 1515–1531 (2009)CrossRef
Metadaten
Titel
Multiple Convolutional Neural Network for Feature Extraction
verfasst von
Guo-Wei Yang
Hui-Fang Jing
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-22186-1_10