Skip to main content
Erschienen in: Neural Processing Letters 3/2018

13.04.2017

Random Pattern and Frequency Generation Using a Photonic Reservoir Computer with Output Feedback

verfasst von: Piotr Antonik, Michiel Hermans, Marc Haelterman, Serge Massar

Erschienen in: Neural Processing Letters | Ausgabe 3/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Reservoir computing is a bio-inspired computing paradigm for processing time dependent signals. The performance of its analogue implementations matches other digital algorithms on a series of benchmark tasks. Their potential can be further increased by feeding the output signal back into the reservoir, which would allow to apply the algorithm to time series generation. This requires, in principle, implementing a sufficiently fast readout layer for real-time output computation. Here we achieve this with a digital output layer driven by a FPGA chip. We demonstrate the first opto-electronic reservoir computer with output feedback and test it on two examples of time series generation tasks: frequency and random pattern generation. We obtain very good results on the first task, similar to idealised numerical simulations. The performance on the second one, however, suffers from the experimental noise. We illustrate this point with a detailed investigation of the consequences of noise on the performance of a physical reservoir computer with output feedback. Our work thus opens new possible applications for analogue reservoir computing and brings new insights on the impact of noise on the output feedback.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Aldridge I (2009) High-frequency trading: a practical guide to algorithmic strategies and trading systems. Wiley, Hoboken Aldridge I (2009) High-frequency trading: a practical guide to algorithmic strategies and trading systems. Wiley, Hoboken
3.
Zurück zum Zitat Antonik P, Duport F, Hermans M, Smerieri A, Haelterman M, Massar S (2016) Online training of an opto-electronic reservoir computer applied to real-time channel equalization. IEEE Trans Neural Netw Learn Syst PP(99):1–13 Antonik P, Duport F, Hermans M, Smerieri A, Haelterman M, Massar S (2016) Online training of an opto-electronic reservoir computer applied to real-time channel equalization. IEEE Trans Neural Netw Learn Syst PP(99):1–13
4.
Zurück zum Zitat Antonik P, Haelterman M, Massar S (2017) Online training for high-performance analogue readout layers in photonic reservoir computers. Cognit Comput. doi:10.1007/s12559-017-9459-3 Antonik P, Haelterman M, Massar S (2017) Online training for high-performance analogue readout layers in photonic reservoir computers. Cognit Comput. doi:10.​1007/​s12559-017-9459-3
5.
Zurück zum Zitat Antonik P, Hermans M, Duport F, Haelterman M, Massar S (2016) Towards pattern generation and chaotic series prediction with photonic reservoir computers. In: SPIE’s 2016 Laser Technology and Industrial Laser Conference, vol. 9732, p 97320B Antonik P, Hermans M, Duport F, Haelterman M, Massar S (2016) Towards pattern generation and chaotic series prediction with photonic reservoir computers. In: SPIE’s 2016 Laser Technology and Industrial Laser Conference, vol. 9732, p 97320B
6.
Zurück zum Zitat Antonik P, Hermans M, Haelterman M, Massar S (2016) Pattern and frequency generation using an opto-electronic reservoir computer with output feedback. In: APNNS’s 23th international conference on neural information processing, LNCS, vol. 9948, pp 318–325 Antonik P, Hermans M, Haelterman M, Massar S (2016) Pattern and frequency generation using an opto-electronic reservoir computer with output feedback. In: APNNS’s 23th international conference on neural information processing, LNCS, vol. 9948, pp 318–325
7.
Zurück zum Zitat Antonik P, Hermans M, Haelterman M, Massar S (2016) Towards adjustable signal generation with photonic reservoir computers. In: 25th international conference on artificial neural networks, vol. 9886 Antonik P, Hermans M, Haelterman M, Massar S (2016) Towards adjustable signal generation with photonic reservoir computers. In: 25th international conference on artificial neural networks, vol. 9886
8.
Zurück zum Zitat Appeltant L, Soriano MC, Van der Sande G, Danckaert J, Massar S, Dambre J, Schrauwen B, Mirasso CR, Fischer I (2011) Information processing using a single dynamical node as complex system. Nat. Commun. 2:468CrossRef Appeltant L, Soriano MC, Van der Sande G, Danckaert J, Massar S, Dambre J, Schrauwen B, Mirasso CR, Fischer I (2011) Information processing using a single dynamical node as complex system. Nat. Commun. 2:468CrossRef
9.
Zurück zum Zitat Arsenault H (2012) Optical processing and computing. Elsevier, Amsterdam Arsenault H (2012) Optical processing and computing. Elsevier, Amsterdam
10.
Zurück zum Zitat Brunner D, Soriano MC, Mirasso CR, Fischer I (2012) Parallel photonic information processing at gigabyte per second data rates using transient states. Nat. Commun. 4:1364CrossRef Brunner D, Soriano MC, Mirasso CR, Fischer I (2012) Parallel photonic information processing at gigabyte per second data rates using transient states. Nat. Commun. 4:1364CrossRef
11.
Zurück zum Zitat Caluwaerts K, D’Haene M, Verstraeten D, Schrauwen B (2013) Locomotion without a brain: Physical reservoir computing in tensegrity structures. Artif Life 19(1):35–66CrossRef Caluwaerts K, D’Haene M, Verstraeten D, Schrauwen B (2013) Locomotion without a brain: Physical reservoir computing in tensegrity structures. Artif Life 19(1):35–66CrossRef
12.
Zurück zum Zitat Duport F, Schneider B, Smerieri A, Haelterman M, Massar S (2012) All-optical reservoir computing. Opt Express 20:22783–22795CrossRef Duport F, Schneider B, Smerieri A, Haelterman M, Massar S (2012) All-optical reservoir computing. Opt Express 20:22783–22795CrossRef
13.
Zurück zum Zitat Duport F, Smerieri A, Akrout A, Haelterman M, Massar S (2016) Fully analogue photonic reservoir computer. Sci Rep 6:22381CrossRef Duport F, Smerieri A, Akrout A, Haelterman M, Massar S (2016) Fully analogue photonic reservoir computer. Sci Rep 6:22381CrossRef
14.
Zurück zum Zitat Jaeger H (2001) Short term memory in echo state networks. Technical GMD Report, vol 152 Jaeger H (2001) Short term memory in echo state networks. Technical GMD Report, vol 152
15.
16.
Zurück zum Zitat Jaeger H, Haas H (2004) Harnessing nonlinearity: predicting chaotic systems and saving energy in wireless communication. Science 304:78–80CrossRef Jaeger H, Haas H (2004) Harnessing nonlinearity: predicting chaotic systems and saving energy in wireless communication. Science 304:78–80CrossRef
17.
Zurück zum Zitat Larger L, Soriano M, Brunner D, Appeltant L, Gutiérrez JM, Pesquera L, Mirasso CR, Fischer I (2012) Photonic information processing beyond Turing: an optoelectronic implementation of reservoir computing. Opt Express 20:3241–3249CrossRef Larger L, Soriano M, Brunner D, Appeltant L, Gutiérrez JM, Pesquera L, Mirasso CR, Fischer I (2012) Photonic information processing beyond Turing: an optoelectronic implementation of reservoir computing. Opt Express 20:3241–3249CrossRef
18.
Zurück zum Zitat Lukoševičius M, Jaeger H (2009) Reservoir computing approaches to recurrent neural network training. Comp Sci Rev 3:127–149CrossRefMATH Lukoševičius M, Jaeger H (2009) Reservoir computing approaches to recurrent neural network training. Comp Sci Rev 3:127–149CrossRefMATH
19.
Zurück zum Zitat Maass W, Natschläger T, Markram H (2002) Real-time computing without stable states: a new framework for neural computation based on perturbations. Neural Comput 14:2531–2560CrossRefMATH Maass W, Natschläger T, Markram H (2002) Real-time computing without stable states: a new framework for neural computation based on perturbations. Neural Comput 14:2531–2560CrossRefMATH
20.
Zurück zum Zitat Martinenghi R, Rybalko S, Jacquot M, Chembo YK, Larger L (2012) Photonic nonlinear transient computing with multiple-delay wavelength dynamics. Phys Rev Lett 108:244101CrossRef Martinenghi R, Rybalko S, Jacquot M, Chembo YK, Larger L (2012) Photonic nonlinear transient computing with multiple-delay wavelength dynamics. Phys Rev Lett 108:244101CrossRef
21.
Zurück zum Zitat Paquot Y, Duport F, Smerieri A, Dambre J, Schrauwen B, Haelterman M, Massar S (2012) Optoelectronic reservoir computing. Sci Rep 2:287CrossRef Paquot Y, Duport F, Smerieri A, Dambre J, Schrauwen B, Haelterman M, Massar S (2012) Optoelectronic reservoir computing. Sci Rep 2:287CrossRef
22.
Zurück zum Zitat Reinhart RF, Steil JJ (2012) Regularization and stability in reservoir networks with output feedback. Neurocomputing 90:96–105CrossRef Reinhart RF, Steil JJ (2012) Regularization and stability in reservoir networks with output feedback. Neurocomputing 90:96–105CrossRef
23.
Zurück zum Zitat Rodan A, Tino P (2011) Minimum complexity echo state network. IEEE Trans Neural Netw 22:131–144CrossRef Rodan A, Tino P (2011) Minimum complexity echo state network. IEEE Trans Neural Netw 22:131–144CrossRef
25.
Zurück zum Zitat Sussillo D, Abbott L (2009) Generating coherent patterns of activity from chaotic neural networks. Neuron 63(4):544–557CrossRef Sussillo D, Abbott L (2009) Generating coherent patterns of activity from chaotic neural networks. Neuron 63(4):544–557CrossRef
26.
Zurück zum Zitat Tikhonov AN, Goncharsky A, Stepanov V, Yagola AG (1995) Numerical methods for the solution of ill-posed problems, vol 328. Springer, BerlinCrossRefMATH Tikhonov AN, Goncharsky A, Stepanov V, Yagola AG (1995) Numerical methods for the solution of ill-posed problems, vol 328. Springer, BerlinCrossRefMATH
27.
Zurück zum Zitat Triefenbach F, Jalalvand A, Schrauwen B, Martens JP (2010) Phoneme recognition with large hierarchical reservoirs. Adv Neural Inf Process Syst 23:2307–2315 Triefenbach F, Jalalvand A, Schrauwen B, Martens JP (2010) Phoneme recognition with large hierarchical reservoirs. Adv Neural Inf Process Syst 23:2307–2315
28.
Zurück zum Zitat Vandoorne K, Mechet P, Van Vaerenbergh T, Fiers M, Morthier G, Verstraeten D, Schrauwen B, Dambre J, Bienstman P (2014) Experimental demonstration of reservoir computing on a silicon photonics chip. Nat Commun 5:3541CrossRef Vandoorne K, Mechet P, Van Vaerenbergh T, Fiers M, Morthier G, Verstraeten D, Schrauwen B, Dambre J, Bienstman P (2014) Experimental demonstration of reservoir computing on a silicon photonics chip. Nat Commun 5:3541CrossRef
29.
Zurück zum Zitat Vinckier Q, Bouwens A, Haelterman M, Massar S (2016) Autonomous all-photonic processor based on reservoir computing paradigm. p SF1F.1. Optical Society of America Vinckier Q, Bouwens A, Haelterman M, Massar S (2016) Autonomous all-photonic processor based on reservoir computing paradigm. p SF1F.1. Optical Society of America
30.
Zurück zum Zitat Vinckier Q, Duport F, Smerieri A, Vandoorne K, Bienstman P, Haelterman M, Massar S (2015) High-performance photonic reservoir computer based on a coherently driven passive cavity. Optica 2(5):438–446CrossRef Vinckier Q, Duport F, Smerieri A, Vandoorne K, Bienstman P, Haelterman M, Massar S (2015) High-performance photonic reservoir computer based on a coherently driven passive cavity. Optica 2(5):438–446CrossRef
31.
Zurück zum Zitat Wyffels F, Li J, Waegeman T, Schrauwen B, Jaeger H (2014) Frequency modulation of large oscillatory neural networks. Biol Cybern 108(2):145–157MathSciNetCrossRef Wyffels F, Li J, Waegeman T, Schrauwen B, Jaeger H (2014) Frequency modulation of large oscillatory neural networks. Biol Cybern 108(2):145–157MathSciNetCrossRef
32.
Zurück zum Zitat Wyffels F, Schrauwen B, Stroobandt D (2008) Stable output feedback in reservoir computing using ridge regression. In: International conference on artificial neural networks, pp 808–817. Springer, Berlin Wyffels F, Schrauwen B, Stroobandt D (2008) Stable output feedback in reservoir computing using ridge regression. In: International conference on artificial neural networks, pp 808–817. Springer, Berlin
Metadaten
Titel
Random Pattern and Frequency Generation Using a Photonic Reservoir Computer with Output Feedback
verfasst von
Piotr Antonik
Michiel Hermans
Marc Haelterman
Serge Massar
Publikationsdatum
13.04.2017
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 3/2018
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-017-9628-0

Weitere Artikel der Ausgabe 3/2018

Neural Processing Letters 3/2018 Zur Ausgabe

Neuer Inhalt