Skip to main content
Top

2016 | OriginalPaper | Chapter

Multithreading Incremental Learning Scheme for Embedded System to Realize a High-Throughput

Authors : Daisuke Nishio, Koichiro Yamauchi

Published in: Neural Information Processing

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Recent improvement of the microcomputer enables it to execute complex intelligent algorithms on embedded systems. However, when using conventional incremental learning methods, its resources are often increased with learning, and continuing the execution of the incremental learning becomes difficult on small embedded systems. Moreover, for real applications, the response time should be reduced. This paper proposes a technique for implementing incremental learning methods on a budget. Normally, they proceed online learning by alternating recognition and learning, so that they cannot respond to the next new instance until the previous learning is finished. Unfortunately, their computational learining complexities are extremely high to realize a quick response to new input. Therefore, this paper introduces a multithreading technique for such learning schemes. The recognition and learning threads are executed in parallel so that the system can respond to a new instance even when it is in the progress of learning. Moreover, this paper shows that such multithreading learning schemes sometime need a “sleep-period” to complete the learning similar to a biological brain. During the “sleep-period,” the leaning system prohibits the receival of any sensory inputs and yielding outputs.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
Semaphore is the most commonly used method of performing an exclusive control.
 
2
Although the LGRNN output for the i-th kernel center is recovered through the linear combination of the other kernels, there are no guarantees that the outputs for the other inputs are not changed.
 
Literature
1.
go back to reference Dekel, O., Shalev-Shwartz, S., Singer, Y.: The forgetron: a kernel-based perceptron on a budget. SIAM J. Comput. (SICOMP) 37(5), 1342–1372 (2008)MathSciNetCrossRefMATH Dekel, O., Shalev-Shwartz, S., Singer, Y.: The forgetron: a kernel-based perceptron on a budget. SIAM J. Comput. (SICOMP) 37(5), 1342–1372 (2008)MathSciNetCrossRefMATH
2.
go back to reference Orabona, F., Keshet, J., Caputo, B.: The projectron: a bounded kernel-based perceptron. In: ICML, pp. 720–727 (2008) Orabona, F., Keshet, J., Caputo, B.: The projectron: a bounded kernel-based perceptron. In: ICML, pp. 720–727 (2008)
3.
go back to reference Yamauchi, K.: Pruning with replacement and automatic distance metric detection in limited general regression neural networks. In: Proceedings of International Joint Conference on Neural Networks, San Jose, California, USA, July 31 - August 5, 2011, pp. 899–906. The Institute of Electrical and Electronics Engineers, Inc., New York, July 2011 Yamauchi, K.: Pruning with replacement and automatic distance metric detection in limited general regression neural networks. In: Proceedings of International Joint Conference on Neural Networks, San Jose, California, USA, July 31 - August 5, 2011, pp. 899–906. The Institute of Electrical and Electronics Engineers, Inc., New York, July 2011
4.
go back to reference He, W., Si, W.: A kernel-based perceptron with dynamic memory. Neural Netw. 25, 105–113 (2011) He, W., Si, W.: A kernel-based perceptron with dynamic memory. Neural Netw. 25, 105–113 (2011)
5.
go back to reference Yamauchi, K.: Incremental learning on a budget and its application to quick maximum power point tracking of photovoltaic systems. J. Adv. Comput. Intell. Intell. Inf. 18(4), 682–696 (2014)MathSciNetCrossRef Yamauchi, K.: Incremental learning on a budget and its application to quick maximum power point tracking of photovoltaic systems. J. Adv. Comput. Intell. Intell. Inf. 18(4), 682–696 (2014)MathSciNetCrossRef
6.
go back to reference Genov, R., Cauwenberghs, G.: Kerneltron: support vector “machine” in silicon. IEEE Trans. Neural Netw. 14(5), 1426–1434 (2003)CrossRefMATH Genov, R., Cauwenberghs, G.: Kerneltron: support vector “machine” in silicon. IEEE Trans. Neural Netw. 14(5), 1426–1434 (2003)CrossRefMATH
7.
go back to reference Hikawa, H., Kaida, K.: Novel FPGA implementation of hand sign recognition system with SOM-Hebb classifier. IEEE Trans. Circ. Syst. Video Technol. 25(1), 153–166 (2015)CrossRef Hikawa, H., Kaida, K.: Novel FPGA implementation of hand sign recognition system with SOM-Hebb classifier. IEEE Trans. Circ. Syst. Video Technol. 25(1), 153–166 (2015)CrossRef
8.
go back to reference Webb, A.R.: Functional approximation by feed-forward networks: a least-squares approach to generalization. IEEE Trans. Neural Netw. 5(3), 363–371 (1994)CrossRef Webb, A.R.: Functional approximation by feed-forward networks: a least-squares approach to generalization. IEEE Trans. Neural Netw. 5(3), 363–371 (1994)CrossRef
9.
go back to reference Garcìa, S., Derrac, J., Cano, J., Herrera, F.: Prototype selection for nearest neighbor classification: taxonomy and empirical study. IEEE Trans. Pattern Anal. Mach. Intell. 34(3), 417–435 (2012)CrossRef Garcìa, S., Derrac, J., Cano, J., Herrera, F.: Prototype selection for nearest neighbor classification: taxonomy and empirical study. IEEE Trans. Pattern Anal. Mach. Intell. 34(3), 417–435 (2012)CrossRef
Metadata
Title
Multithreading Incremental Learning Scheme for Embedded System to Realize a High-Throughput
Authors
Daisuke Nishio
Koichiro Yamauchi
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-46672-9_24

Premium Partner