Skip to main content
Erschienen in: Neural Computing and Applications 1/2017

22.08.2015 | Original Article

Automatic general-purpose neural hardware generator

verfasst von: Fábio D. Baptista, Fernando Morgado-Dias

Erschienen in: Neural Computing and Applications | Ausgabe 1/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Artificial neural networks have a wide range of applications. In some applications, specific hardware is necessary when a PC cannot be connected or due to other factors such as speed, price and fault tolerance. The difficulty in producing hardware for neural networks is associated with price, accuracy and development time. Most users also prefer the network trained with a high-level tool without reducing resolution and simplifying the activation function for hardware implementation. This paper proposes an automatic general-purpose neural hardware generator, simple to use, with adjustable accuracy that provides direct hardware implementation for neural networks with FPGAs without further development.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Abreu S, Freitas F, Baptista FD, Vasconcelos R, Morgado-Dias F (2013) A survey of software and hardware use in artificial neural networks. Neural Comput Appl 23(3–4):591–599 Abreu S, Freitas F, Baptista FD, Vasconcelos R, Morgado-Dias F (2013) A survey of software and hardware use in artificial neural networks. Neural Comput Appl 23(3–4):591–599
2.
Zurück zum Zitat Lippmann RP (1987) An introduction to computing with neural nets. IEEE ASSP Mag 4–22 Lippmann RP (1987) An introduction to computing with neural nets. IEEE ASSP Mag 4–22
3.
Zurück zum Zitat Morgado Dias F, Antunes A, Mota A (2004) Artificial neural networks: a review of commercial hardware. Eng Appl Artifi Intell 17:945–952CrossRef Morgado Dias F, Antunes A, Mota A (2004) Artificial neural networks: a review of commercial hardware. Eng Appl Artifi Intell 17:945–952CrossRef
4.
Zurück zum Zitat Stieglitz T, Meyer J (2006) Biomedical microdevices for neural implants. Biomems Microsyst 16:71–137CrossRef Stieglitz T, Meyer J (2006) Biomedical microdevices for neural implants. Biomems Microsyst 16:71–137CrossRef
5.
Zurück zum Zitat Ferreira P, Ribeiro P, Antunes A, Morgado F (2007) A high bit resolution FPGA implementation of a FNN with a new algorithm for the activation function. Neurocomputing 71(1–3):71–77CrossRef Ferreira P, Ribeiro P, Antunes A, Morgado F (2007) A high bit resolution FPGA implementation of a FNN with a new algorithm for the activation function. Neurocomputing 71(1–3):71–77CrossRef
6.
Zurück zum Zitat Leon M, Castro A, Ascenccio R (1999) An artificial neural network on a field programmable gate array as a virtual sensor. In Proceedings of the third international workshop on design of mixed-mode integrated circuits and applications, Puerto Vallarta, Mexico, pp. 114–117 Leon M, Castro A, Ascenccio R (1999) An artificial neural network on a field programmable gate array as a virtual sensor. In Proceedings of the third international workshop on design of mixed-mode integrated circuits and applications, Puerto Vallarta, Mexico, pp. 114–117
7.
Zurück zum Zitat Ayala JL, Lomena AG, López-Vallejo M, Fernández A (2002) Design of a pipelined hardware architecture for real-time neural network computations. IEEE Midwest Symposium on Circuits and Systems, USACrossRef Ayala JL, Lomena AG, López-Vallejo M, Fernández A (2002) Design of a pipelined hardware architecture for real-time neural network computations. IEEE Midwest Symposium on Circuits and Systems, USACrossRef
8.
Zurück zum Zitat Soares AM, Pinto JOP, Bose BK, Leite LC, da Silva LEB, Romero ME (2006) Field programmable gate array (FPGA) Based neural network implementation of stator flux oriented vector control of induction motor drive. In: IEEE international conference on industrial technology Soares AM, Pinto JOP, Bose BK, Leite LC, da Silva LEB, Romero ME (2006) Field programmable gate array (FPGA) Based neural network implementation of stator flux oriented vector control of induction motor drive. In: IEEE international conference on industrial technology
9.
Zurück zum Zitat Chen X, Wang G, Zhou W, Chang S, Sun S (2006) Efficient sigmoid function for neural networks based FPGA design, ICIC 2006, LNCS 4113, Springer, Berlin p 672–677 Chen X, Wang G, Zhou W, Chang S, Sun S (2006) Efficient sigmoid function for neural networks based FPGA design, ICIC 2006, LNCS 4113, Springer, Berlin p 672–677
10.
Zurück zum Zitat Baptista D, Morgado-Dias F (2012) A hyperbolic tangent replacement by third order polynomial approximation. In: CONTROLO’12–10th Portuguese conference on automatic control Baptista D, Morgado-Dias F (2012) A hyperbolic tangent replacement by third order polynomial approximation. In: CONTROLO’12–10th Portuguese conference on automatic control
11.
Zurück zum Zitat Ghariani M, Kharrat MW, Masmoudin N, Kamoun L (2004) Electronic implementation of a neural observer in FPGA technology: application to the control of electric vehicle. In: 16th international conference on microelectronics Ghariani M, Kharrat MW, Masmoudin N, Kamoun L (2004) Electronic implementation of a neural observer in FPGA technology: application to the control of electric vehicle. In: 16th international conference on microelectronics
12.
Zurück zum Zitat Qian M (2006) Application of CORDIC algorithm to neural networks VLSI Design. In: IMACS multiconference on computational engineering in systems applications Qian M (2006) Application of CORDIC algorithm to neural networks VLSI Design. In: IMACS multiconference on computational engineering in systems applications
13.
Zurück zum Zitat Pérez-Suárez ST, Travieso-González CM, Alonso-Hernández JB (2013) Design methodology of an equalizer for unipolar non return to zero binary signals in the presence of additive white gaussian noise using a time delay neural network on a field programmable gate array. Sensors 13(12):16829–16850CrossRef Pérez-Suárez ST, Travieso-González CM, Alonso-Hernández JB (2013) Design methodology of an equalizer for unipolar non return to zero binary signals in the presence of additive white gaussian noise using a time delay neural network on a field programmable gate array. Sensors 13(12):16829–16850CrossRef
14.
Zurück zum Zitat Baptista FD, Morgado-Dias F (2013) Low-resource hardware implementation of the hyperbolic tangent for artificial neural networks. Neural Comput Appl 23(3–4):601–607CrossRef Baptista FD, Morgado-Dias F (2013) Low-resource hardware implementation of the hyperbolic tangent for artificial neural networks. Neural Comput Appl 23(3–4):601–607CrossRef
15.
Zurück zum Zitat Nascimento I, Jardim R, Morgado-Dias F (2013) Hyperbolic tangent implementation in hardware: a new solution using polynomial modeling of the fractional exponential part. Neural Comput Appl 23(2):363–369CrossRef Nascimento I, Jardim R, Morgado-Dias F (2013) Hyperbolic tangent implementation in hardware: a new solution using polynomial modeling of the fractional exponential part. Neural Comput Appl 23(2):363–369CrossRef
16.
Zurück zum Zitat Le Ly D, Chow P (2010) High-performance reconfigurable hardware architecture for restricted boltzmann machines. IEEE Trans Neural Netw 21(11):1780–1792CrossRef Le Ly D, Chow P (2010) High-performance reconfigurable hardware architecture for restricted boltzmann machines. IEEE Trans Neural Netw 21(11):1780–1792CrossRef
17.
Zurück zum Zitat Ormondi AR, Rajapakse J (2006) FPGA implementations of neural networks. Springer, New YorkCrossRef Ormondi AR, Rajapakse J (2006) FPGA implementations of neural networks. Springer, New YorkCrossRef
18.
Zurück zum Zitat Gomperts A, Ukil A, Zurfluh F (2011) Development and implementation of parameterized FPGA based general purpose neural networks for online applications. IEEE Trans Industr Inf 7(1):78–89CrossRef Gomperts A, Ukil A, Zurfluh F (2011) Development and implementation of parameterized FPGA based general purpose neural networks for online applications. IEEE Trans Industr Inf 7(1):78–89CrossRef
19.
Zurück zum Zitat Orlowska-Kowalska T, Kaminski M (2011) FPGA implementation of the multilayer neural network for the speed estimation of the two-mass drive system. IEEE Trans Industr Inf 7(3):436–445CrossRef Orlowska-Kowalska T, Kaminski M (2011) FPGA implementation of the multilayer neural network for the speed estimation of the two-mass drive system. IEEE Trans Industr Inf 7(3):436–445CrossRef
20.
Zurück zum Zitat Dinu A, Cirstea MN, Cirstea SE (2010) Direct neural-network hardware-implementation algorithm. IEEE Trans Industr Electron 57(5):1845–1848CrossRef Dinu A, Cirstea MN, Cirstea SE (2010) Direct neural-network hardware-implementation algorithm. IEEE Trans Industr Electron 57(5):1845–1848CrossRef
21.
Zurück zum Zitat Oniga S (2005) A new method for FPGA implementation of artificial neural network used in smart devices. In: international computer science conference microCAD, p 31–36 Oniga S (2005) A new method for FPGA implementation of artificial neural network used in smart devices. In: international computer science conference microCAD, p 31–36
22.
Zurück zum Zitat Tisan A, Cirstea M (2013) SOM neural network design: a new simulink library based approach targeting FPGA implementation. Math Comput Simul 91:134–149MathSciNetCrossRef Tisan A, Cirstea M (2013) SOM neural network design: a new simulink library based approach targeting FPGA implementation. Math Comput Simul 91:134–149MathSciNetCrossRef
23.
Zurück zum Zitat Morgado Dias F, Mota A (2009) Direct inverse control of a Kiln. In 4th Portuguese conference on automatic control Morgado Dias F, Mota A (2009) Direct inverse control of a Kiln. In 4th Portuguese conference on automatic control
24.
Zurück zum Zitat Maxfield C (2004) The design warrior’s guide to FPGAs. Elsevier, ISBN 0750676043, New York, USA Maxfield C (2004) The design warrior’s guide to FPGAs. Elsevier, ISBN 0750676043, New York, USA
26.
Zurück zum Zitat Reis L, Aguiar L, Baptista D, Morgado-Dias F (2011) ANGE-automatic neural generator. International conference on artificial neural network—ICANN’11, Espoo, Finland Reis L, Aguiar L, Baptista D, Morgado-Dias F (2011) ANGE-automatic neural generator. International conference on artificial neural network—ICANN’11, Espoo, Finland
27.
Zurück zum Zitat Reis L, Aguiar L, Baptista FD, Morgado-Dias F (2013) A software tool for automatic generation of neural hardware. Int Arab J Inf Technol, 11(3) Reis L, Aguiar L, Baptista FD, Morgado-Dias F (2013) A software tool for automatic generation of neural hardware. Int Arab J Inf Technol, 11(3)
28.
Zurück zum Zitat Wright S, Marwala T (2007) Artificial intelligence techniques for steam generator modelling. School of Electrical and Information Engineering, P/Bag x3, Wits, South Africa Wright S, Marwala T (2007) Artificial intelligence techniques for steam generator modelling. School of Electrical and Information Engineering, P/Bag x3, Wits, South Africa
29.
Zurück zum Zitat Baptista D, Morgado-Dias F (2012) On the implementation of different hyperbolic tangent solutions in FPGA. In 10th Portuguese conference on automatic control—CONTROLO’12, Funchal, Portugal Baptista D, Morgado-Dias F (2012) On the implementation of different hyperbolic tangent solutions in FPGA. In 10th Portuguese conference on automatic control—CONTROLO’12, Funchal, Portugal
Metadaten
Titel
Automatic general-purpose neural hardware generator
verfasst von
Fábio D. Baptista
Fernando Morgado-Dias
Publikationsdatum
22.08.2015
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 1/2017
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-015-2034-5

Weitere Artikel der Ausgabe 1/2017

Neural Computing and Applications 1/2017 Zur Ausgabe