Skip to main content

2015 | OriginalPaper | Buchkapitel

A Dual Network for Transfer Learning with Spike Train Data

verfasst von : Keith Johnson, Wei Liu

Erschienen in: AI 2015: Advances in Artificial Intelligence

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

A massive amount of data is being produced in a continual stream, in real time, which renders traditional batch processing based data mining and neural network techniques as incapable. In this paper we focus on transfer learning from Spike Train Data, for which traditional techniques often require tasks to be distinctively identified during the training phase. We propose a novel dual network model that demonstrates transfer learning from spike train data without explicit task specification. An implementation of the proposed approach was tested experimentally to evaluate its ability to use previously learned knowledge to improve the learning of new tasks.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Fahlman, S.E., Lebiere, C.: The cascade-correlation learning architecture. In: Touretzky, D.S. (ed.) Advances in Neural Information Processing Systems, vol. 2, pp. 524–532, Denver 1989. Morgan Kaufmann, San Mateo (1990) Fahlman, S.E., Lebiere, C.: The cascade-correlation learning architecture. In: Touretzky, D.S. (ed.) Advances in Neural Information Processing Systems, vol. 2, pp. 524–532, Denver 1989. Morgan Kaufmann, San Mateo (1990)
2.
Zurück zum Zitat Geramifard, A., Doshi, F., Redding, J., Roy, N., How, J.: Online discovery of feature dependencies. In: Proceedings of the 28th International Conference on Machine Learning (ICML 2011), pp. 881–888 (2011) Geramifard, A., Doshi, F., Redding, J., Roy, N., How, J.: Online discovery of feature dependencies. In: Proceedings of the 28th International Conference on Machine Learning (ICML 2011), pp. 881–888 (2011)
4.
Zurück zum Zitat Maass, W.: Networks of spiking neurons: the third generation of neural network models. Neural Netw. 10(9), 1659–1671 (1997)CrossRef Maass, W.: Networks of spiking neurons: the third generation of neural network models. Neural Netw. 10(9), 1659–1671 (1997)CrossRef
5.
Zurück zum Zitat Mitchell, T.: The need for biases in learning generalizations. In: Readings in Machine Learning, pp. 184–191 (1980) Mitchell, T.: The need for biases in learning generalizations. In: Readings in Machine Learning, pp. 184–191 (1980)
6.
Zurück zum Zitat Pratt, L., Jennings, B.: A survey of transfer between connectionist networks. Connection Sci. 8(2), 163–184 (1996)CrossRef Pratt, L., Jennings, B.: A survey of transfer between connectionist networks. Connection Sci. 8(2), 163–184 (1996)CrossRef
7.
Zurück zum Zitat Pratt, L.Y.: Discriminability-based transfer between neural networks. In: Advances in Neural Information Processing Systems 5, [NIPS Conference], pp. 204–211. Morgan Kaufmann Publishers Inc., San Francisco (1993) Pratt, L.Y.: Discriminability-based transfer between neural networks. In: Advances in Neural Information Processing Systems 5, [NIPS Conference], pp. 204–211. Morgan Kaufmann Publishers Inc., San Francisco (1993)
8.
Zurück zum Zitat Pratt, L.Y.: Transferring previously learned back-propagation neural networks to new learning tasks. Ph.D. thesis, Rutgers University, Department of Computer Science (1993) Pratt, L.Y.: Transferring previously learned back-propagation neural networks to new learning tasks. Ph.D. thesis, Rutgers University, Department of Computer Science (1993)
9.
Zurück zum Zitat Pratt, L.Y., Mostow, J., Kamm, C.A.: Direct transfer of learned information among neural networks. In: Proceedings of the Ninth National Conference on Artificial Intelligence, AAAI 1991, vol. 2, pp. 584–589. AAAI Press (1991) Pratt, L.Y., Mostow, J., Kamm, C.A.: Direct transfer of learned information among neural networks. In: Proceedings of the Ninth National Conference on Artificial Intelligence, AAAI 1991, vol. 2, pp. 584–589. AAAI Press (1991)
10.
Zurück zum Zitat Shultz, T.R., Rivest, F.: Knowledge-based cascade-correlation: using knowledge to speed learning. Connection Sci. 13(1), 43–72 (2001)CrossRefMATH Shultz, T.R., Rivest, F.: Knowledge-based cascade-correlation: using knowledge to speed learning. Connection Sci. 13(1), 43–72 (2001)CrossRefMATH
11.
Zurück zum Zitat Silver, D.L.: Selective transfer of neural network task knowledge. Ph.D. thesis, The University of Western Ontario, AAINQ58190 (2000) Silver, D.L.: Selective transfer of neural network task knowledge. Ph.D. thesis, The University of Western Ontario, AAINQ58190 (2000)
12.
Zurück zum Zitat Waibel, A., Sawai, H., Shikano, K.: Modularity and scaling in large phonemic neural networks. IEEE Trans. Acoust. Speech Signal Process. 37(12), 1888–1898 (1989)CrossRef Waibel, A., Sawai, H., Shikano, K.: Modularity and scaling in large phonemic neural networks. IEEE Trans. Acoust. Speech Signal Process. 37(12), 1888–1898 (1989)CrossRef
Metadaten
Titel
A Dual Network for Transfer Learning with Spike Train Data
verfasst von
Keith Johnson
Wei Liu
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-26350-2_25