Skip to main content
Top

2017 | OriginalPaper | Chapter

Differential-Weighted Global Optimum of BP Neural Network on Image Classification

Authors : Lin Ma, Xiao Lin, Linhua Jiang

Published in: Information Science and Applications 2017

Publisher: Springer Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper investigates the problem of image classification with limited or no annotations, but abundant unlabelled data. We propose the DBP (Differential-weighted Global Optimum of BP Neural Network) to make the performance of the BP Neural Network to become more stable. In details, the optimal weights will be saved as potential global optimum during the process of iteration and then we combine the BP Neural Network with the potential global weights to adjust parameters in the backward feedback process for the first time. As the model has fallen into local optimization, we replace the present parameters with the potential global optimal weights to optimize our model. Besides, we consider EP, CNN, SIFT image features and conduct several experiments on eight standard datasets. The results show that DBP mostly outperforms other supervised and semi-supervised learning methods in the state of the art.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Coates, A., Ng, A.Y., Lee, H.: An analysis of single-layer networks in unsupervised feature learning. J. Mach. Learn. Res. 15, 215–223 (2011) Coates, A., Ng, A.Y., Lee, H.: An analysis of single-layer networks in unsupervised feature learning. J. Mach. Learn. Res. 15, 215–223 (2011)
2.
go back to reference Dosovitskiy, A., Springenberg, J., Riedmiller, M., Brox, T.: Discriminative unsupervised feature learning with convolutional neural networks. In: Neural Information Processing System, Montreal, Canada, pp. 766–774, December 2014 Dosovitskiy, A., Springenberg, J., Riedmiller, M., Brox, T.: Discriminative unsupervised feature learning with convolutional neural networks. In: Neural Information Processing System, Montreal, Canada, pp. 766–774, December 2014
3.
go back to reference Doersch, C., Gupta, A., Efros, A.A.: Unsupervised visual representation learning by context prediction. In: International Conference on Computer Vision, Santiago, Chile, pp. 1422–1430, December 2015 Doersch, C., Gupta, A., Efros, A.A.: Unsupervised visual representation learning by context prediction. In: International Conference on Computer Vision, Santiago, Chile, pp. 1422–1430, December 2015
4.
go back to reference Srivastava, N., Mansimov, E., Salakhudinov, R.: Unsupervised learning of video representations using LSTMs. In: Computer Science (2015) Srivastava, N., Mansimov, E., Salakhudinov, R.: Unsupervised learning of video representations using LSTMs. In: Computer Science (2015)
5.
go back to reference Fergus, R., Weiss, Y., Torralba, A.: Semi-supervised learning in gigantic image collections. In: Neural Information Processing System, Vancouver, Canada, pp. 522–530, December 2009 Fergus, R., Weiss, Y., Torralba, A.: Semi-supervised learning in gigantic image collections. In: Neural Information Processing System, Vancouver, Canada, pp. 522–530, December 2009
6.
go back to reference Guillaumin, M., Verbeek, J.J., Schmid, C.: Multi-model semi-supervised learning for image classification. In: IEEE Conference on Computer Vision and Pattern Recognition, San Francisco, America, pp. 902–909, June 2010 Guillaumin, M., Verbeek, J.J., Schmid, C.: Multi-model semi-supervised learning for image classification. In: IEEE Conference on Computer Vision and Pattern Recognition, San Francisco, America, pp. 902–909, June 2010
7.
go back to reference Dai, D., Van Gool, L.: Ensemble projection for semi-supervised image classification. In: International Conference on Computer Vision, Sydney, Australia, pp. 2072–2079, December 2013 Dai, D., Van Gool, L.: Ensemble projection for semi-supervised image classification. In: International Conference on Computer Vision, Sydney, Australia, pp. 2072–2079, December 2013
8.
go back to reference Sivic, J., Russell, B.C., Efros, A.A., Zisserman, A.: Discovering objects and their location in images. In: International Conference on Computer Vision, Beijing, China, pp. 370–377, October 2005 Sivic, J., Russell, B.C., Efros, A.A., Zisserman, A.: Discovering objects and their location in images. In: International Conference on Computer Vision, Beijing, China, pp. 370–377, October 2005
9.
go back to reference Dai, D., Wu, T., Zhu, S.C.: Discovering scene categories by information projection and cluster sampling. In: IEEE Conference on Computer Vision and Pattern Recognition, San Francisco, America, pp. 483–497, June 2010 Dai, D., Wu, T., Zhu, S.C.: Discovering scene categories by information projection and cluster sampling. In: IEEE Conference on Computer Vision and Pattern Recognition, San Francisco, America, pp. 483–497, June 2010
10.
go back to reference Chapelle, O., Schölkopf, B., Zien, A., et al.: Semi-Supervised Learning. MIT Press, Cambridge (2006)CrossRef Chapelle, O., Schölkopf, B., Zien, A., et al.: Semi-Supervised Learning. MIT Press, Cambridge (2006)CrossRef
11.
go back to reference Elgammal, A., Lee, C.S.: Separating style and content on a nonlinear manifold. In: Computer Vision and Pattern Recognition, Washington, DC, America, pp. 478–485, June 2004 Elgammal, A., Lee, C.S.: Separating style and content on a nonlinear manifold. In: Computer Vision and Pattern Recognition, Washington, DC, America, pp. 478–485, June 2004
12.
13.
go back to reference Zhu, P., Zhang, L., Zuo, W., Zhang, D.: From point to set: extend the learning of distance metrics. In: International Conference on Computer Vision, Sydney, Australia, pp. 2664–2671, December 2013 Zhu, P., Zhang, L., Zuo, W., Zhang, D.: From point to set: extend the learning of distance metrics. In: International Conference on Computer Vision, Sydney, Australia, pp. 2664–2671, December 2013
14.
go back to reference Huang, G.B., Lee, H., Learned-Miller, E.: Learning hierarchical representations for face verification with convolutional deep belief networks. In: Computer Vision Pattern Recognition, Providence, Rhode Island, pp. 2518–2525, June 2012 Huang, G.B., Lee, H., Learned-Miller, E.: Learning hierarchical representations for face verification with convolutional deep belief networks. In: Computer Vision Pattern Recognition, Providence, Rhode Island, pp. 2518–2525, June 2012
15.
go back to reference Dai, D., Gool, L.V.: Unsupervised high-level feature learning by ensemble projection for semi-supervised image classification and image clustering. In: Computer Vision & Pattern Recognition, Las Vegas, America, pp. 254–260, June 2016 Dai, D., Gool, L.V.: Unsupervised high-level feature learning by ensemble projection for semi-supervised image classification and image clustering. In: Computer Vision & Pattern Recognition, Las Vegas, America, pp. 254–260, June 2016
16.
go back to reference Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. Adv. Neural Inf. Process. Syst. 25(2), 1097–1105 (2012) Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. Adv. Neural Inf. Process. Syst. 25(2), 1097–1105 (2012)
17.
go back to reference Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., et al.: DeCAF: a deep convolutional activation feature for genetic visual recognition. Comput. Sci. 50(1), 815–830 (2014) Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., et al.: DeCAF: a deep convolutional activation feature for genetic visual recognition. Comput. Sci. 50(1), 815–830 (2014)
18.
go back to reference Girshick, R., Donahue, J., Darrell, T., Malik, J.: Rich feature hierarchies for accurate object detection and semantic segmentation. In: IEEE Conference on Computer Vision and Pattern Recognition, Columbus, America, pp. 580–587, June 2014 Girshick, R., Donahue, J., Darrell, T., Malik, J.: Rich feature hierarchies for accurate object detection and semantic segmentation. In: IEEE Conference on Computer Vision and Pattern Recognition, Columbus, America, pp. 580–587, June 2014
19.
go back to reference Lazebnik, S., Schmid, C., Ponce, J.: A sparse texture representation using local affine regions. IEEE Pattern Anal. Mach. Intell. 27(8), 1265–1278 (2005)CrossRef Lazebnik, S., Schmid, C., Ponce, J.: A sparse texture representation using local affine regions. IEEE Pattern Anal. Mach. Intell. 27(8), 1265–1278 (2005)CrossRef
20.
go back to reference Li, F.F., Fergus, R., Perona, P.: Learning generative visual models from few training examples: an incremental Bayesian approach tested on 101 object categories. In: IEEE Conference on Computer Vision and Pattern Recognition, Washington DC, USA, pp. 59–70, June 2004 Li, F.F., Fergus, R., Perona, P.: Learning generative visual models from few training examples: an incremental Bayesian approach tested on 101 object categories. In: IEEE Conference on Computer Vision and Pattern Recognition, Washington DC, USA, pp. 59–70, June 2004
21.
go back to reference Coates, A., Ng, A.Y., Lee, H.: An analysis of single-layer networks in unsupervised feature learning. Int. Conf. Artif. Intell. Stat. 15, 215–223 (2011) Coates, A., Ng, A.Y., Lee, H.: An analysis of single-layer networks in unsupervised feature learning. Int. Conf. Artif. Intell. Stat. 15, 215–223 (2011)
22.
go back to reference Lazebnik, S., Schmid, C., Ponce, J.: Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In: IEEE Conference on Computer Vision and Pattern Recognition, New York, USA, pp. 17–22, June 2006 Lazebnik, S., Schmid, C., Ponce, J.: Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In: IEEE Conference on Computer Vision and Pattern Recognition, New York, USA, pp. 17–22, June 2006
23.
go back to reference Quattoni, A., Torralba, A.: Recognizing indoor scenes, In: IEEE Conference on Computer Vision and Pattern Recognition, Florida, USA, pp. 413–420, June 2009 Quattoni, A., Torralba, A.: Recognizing indoor scenes, In: IEEE Conference on Computer Vision and Pattern Recognition, Florida, USA, pp. 413–420, June 2009
24.
go back to reference Li, L.J., Li, F.F.: What, where, and who? Classifying event by scene and object recognition. In: International Conference on Computer Vision, Rio de Janeiro, Brazil, pp. 1–8, October 2007 Li, L.J., Li, F.F.: What, where, and who? Classifying event by scene and object recognition. In: International Conference on Computer Vision, Rio de Janeiro, Brazil, pp. 1–8, October 2007
25.
go back to reference Xu, Z., Tao, D., Zhang, Y., Wu, J., Tsoi, A.: Architectural style classification using multinomial latent logistic regression, European Conference on Computer Vision, Zurich, Swiss, pp. 600–615, September 2014 Xu, Z., Tao, D., Zhang, Y., Wu, J., Tsoi, A.: Architectural style classification using multinomial latent logistic regression, European Conference on Computer Vision, Zurich, Swiss, pp. 600–615, September 2014
26.
go back to reference Yang, Y., Newsam, S.: Bag-of-visual-words and spatial extensions for land-use classification. In: International Conference on Advances in Geographic Information Systems, pp. 270–279. ACM, San Jose, November 2010 Yang, Y., Newsam, S.: Bag-of-visual-words and spatial extensions for land-use classification. In: International Conference on Advances in Geographic Information Systems, pp. 270–279. ACM, San Jose, November 2010
Metadata
Title
Differential-Weighted Global Optimum of BP Neural Network on Image Classification
Authors
Lin Ma
Xiao Lin
Linhua Jiang
Copyright Year
2017
Publisher
Springer Singapore
DOI
https://doi.org/10.1007/978-981-10-4154-9_63