Skip to main content
Erschienen in: Neural Computing and Applications 10/2020

16.03.2019 | Original Article

FEMa: a finite element machine for fast learning

verfasst von: Danilo R. Pereira, Marco Antonio Piteri, André N. Souza, João Paulo Papa, Hojjat Adeli

Erschienen in: Neural Computing and Applications | Ausgabe 10/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Machine learning has played an essential role in the past decades and has been in lockstep with the main advances in computer technology. Given the massive amount of data generated daily, there is a need for even faster and more effective machine learning algorithms that can provide updated models for real-time applications and on-demand tools. This paper presents FEMa—a finite element machine classifier—for supervised learning problems, where each training sample is the center of a basis function, and the whole training set is modeled as a probabilistic manifold for classification purposes. FEMa has its theoretical basis in the finite element method, which is widely used for numeral analysis in engineering problems. It is shown FEMa is parameterless and has a quadratic complexity for both training and classification phases when basis functions are used that satisfy certain properties. The proposed classifier yields very competitive results when compared to some state-of-the-art supervised pattern recognition techniques.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Adeli H, Hung SL (1993) A concurrent adaptive conjugate gradient learning algorithm on MIMD machines. J Supercomput Appl 7:155–166 Adeli H, Hung SL (1993) A concurrent adaptive conjugate gradient learning algorithm on MIMD machines. J Supercomput Appl 7:155–166
2.
Zurück zum Zitat Adeli H, Hung SL (1994) An adaptive conjugate gradient learning algorithm for effective training of multilayer neural networks. Applied Mathematics and Computation 62:81–102MATH Adeli H, Hung SL (1994) An adaptive conjugate gradient learning algorithm for effective training of multilayer neural networks. Applied Mathematics and Computation 62:81–102MATH
3.
Zurück zum Zitat Adeli H, Hung SL (1994) Machine learning: neural networks, genetic algorithms, and fuzzy systems. Wiley, New YorkMATH Adeli H, Hung SL (1994) Machine learning: neural networks, genetic algorithms, and fuzzy systems. Wiley, New YorkMATH
4.
Zurück zum Zitat Adeli H, Karim A (2000) Fuzzy-wavelet RBFNN model for freeway incident detection. J Transp Eng 126:464–471 Adeli H, Karim A (2000) Fuzzy-wavelet RBFNN model for freeway incident detection. J Transp Eng 126:464–471
5.
Zurück zum Zitat Adeli H, Kumar S (1955) Distributed finite element analysis on a network of workstations---implementation and applications. J Struct Eng 121:1456–1462 Adeli H, Kumar S (1955) Distributed finite element analysis on a network of workstations---implementation and applications. J Struct Eng 121:1456–1462
6.
Zurück zum Zitat Adeli H, Kumar S (1995) Distributed finite element analysis on a network of workstations—algorithms. J Struct Eng 121:1448–1455 Adeli H, Kumar S (1995) Distributed finite element analysis on a network of workstations—algorithms. J Struct Eng 121:1448–1455
7.
Zurück zum Zitat Ahmadlou M, Adeli H (2010) Enhanced probabilistic neural network with local decision circles: a robust classifier. Integr Comput Aided Eng 17(3):197–210 Ahmadlou M, Adeli H (2010) Enhanced probabilistic neural network with local decision circles: a robust classifier. Integr Comput Aided Eng 17(3):197–210
8.
Zurück zum Zitat Cha YJ, Choi W, Buyukozturk O (2017) Deep learning-based crack damage detection using convolutional neural networks. Comput Aided Civ Infrastruct Eng 32:361–378 Cha YJ, Choi W, Buyukozturk O (2017) Deep learning-based crack damage detection using convolutional neural networks. Comput Aided Civ Infrastruct Eng 32:361–378
9.
Zurück zum Zitat Chou JS, Pham AD (2015) Smart artificial firefly colony-based support vector regression for enhanced forecasting in civil engineering. Comput Aided Civ Infrastruct Eng 30:715–732 Chou JS, Pham AD (2015) Smart artificial firefly colony-based support vector regression for enhanced forecasting in civil engineering. Comput Aided Civ Infrastruct Eng 30:715–732
10.
Zurück zum Zitat Coppersmith D, Winograd S (1990) Matrix multiplication via arithmetic progressions. J Symb Comput 9:251–280MathSciNetMATH Coppersmith D, Winograd S (1990) Matrix multiplication via arithmetic progressions. J Symb Comput 9:251–280MathSciNetMATH
11.
Zurück zum Zitat Cortes C, Vapnik V (1995) Support vector networks. Mach Learn 20:273–297MATH Cortes C, Vapnik V (1995) Support vector networks. Mach Learn 20:273–297MATH
12.
Zurück zum Zitat Dai H, Cao Z (2017) A wavelet support vector machine-based neural network metamodel for structural reliability assessment. Comput Aided Civ Infrastruct Eng 32(4):344–357 Dai H, Cao Z (2017) A wavelet support vector machine-based neural network metamodel for structural reliability assessment. Comput Aided Civ Infrastruct Eng 32(4):344–357
13.
Zurück zum Zitat Guo L, Wang Z, Cabrerizo M, Adjouadi MA (2017) cross-correlated delay shift supervised learning method for spiking neurons with application to interictal spike detection in epilepsy. Int J Neural Syst 27:1750002 Guo L, Wang Z, Cabrerizo M, Adjouadi MA (2017) cross-correlated delay shift supervised learning method for spiking neurons with application to interictal spike detection in epilepsy. Int J Neural Syst 27:1750002
14.
Zurück zum Zitat Hirschauer TJ, Adeli H, Buford JA (2015) Computer-aided diagnosis of Parkinson’s disease using enhanced probabilistic neural network. J Med Syst 39:1–12 Hirschauer TJ, Adeli H, Buford JA (2015) Computer-aided diagnosis of Parkinson’s disease using enhanced probabilistic neural network. J Med Syst 39:1–12
15.
Zurück zum Zitat Hung SL, Adeli H (1993) Parallel backpropagation learning algorithms on CRAY y-mp8/864 supercomputer. Neurocomputing 5:287–302 Hung SL, Adeli H (1993) Parallel backpropagation learning algorithms on CRAY y-mp8/864 supercomputer. Neurocomputing 5:287–302
16.
Zurück zum Zitat Karim A, Adeli H (2003) Comparison of the fuzzy - wavelet RBFNN freeway incident detection model with the california algorithm. J Transp Eng 128:21–30 Karim A, Adeli H (2003) Comparison of the fuzzy - wavelet RBFNN freeway incident detection model with the california algorithm. J Transp Eng 128:21–30
17.
Zurück zum Zitat Karim A, Adeli H (2003) Radial basis function neural network for work zone capacity and queue estimation. J Transp Eng 129:494–503 Karim A, Adeli H (2003) Radial basis function neural network for work zone capacity and queue estimation. J Transp Eng 129:494–503
18.
Zurück zum Zitat Khan S, Naseem I, Togneri R, Bennamoun M (2017) A novel adaptive kernel for the rbf neural networks. Circuits Syst Signal Process 36(4):1639–1653 Khan S, Naseem I, Togneri R, Bennamoun M (2017) A novel adaptive kernel for the rbf neural networks. Circuits Syst Signal Process 36(4):1639–1653
19.
Zurück zum Zitat Koziarski M, Cyganek B (2017) Image recognition with deep neural networks in presence of noise—dealing with and taking advantage of distortions. Integr Comput Aided Eng 24:337–350 Koziarski M, Cyganek B (2017) Image recognition with deep neural networks in presence of noise—dealing with and taking advantage of distortions. Integr Comput Aided Eng 24:337–350
20.
Zurück zum Zitat LeCun Y, Bengio Y, Hinton GE (2015) Deep learning. Nature 521:436–444 LeCun Y, Bengio Y, Hinton GE (2015) Deep learning. Nature 521:436–444
21.
Zurück zum Zitat Lehtinen J, Zwicker M, Turquin E, Kontkanen J, Durand F, Sillion F, Aila T (2008) A meshless hierarchical representation for light transport. ACM Trans Graph 17(37):1–9 Lehtinen J, Zwicker M, Turquin E, Kontkanen J, Durand F, Sillion F, Aila T (2008) A meshless hierarchical representation for light transport. ACM Trans Graph 17(37):1–9
22.
Zurück zum Zitat Lin CM, Boldbaatar EA (2015) Autolanding control using recurrent wavelet Elman neural network. IEEE Trans Syst Man Cybern Syst 45:1281–1291 Lin CM, Boldbaatar EA (2015) Autolanding control using recurrent wavelet Elman neural network. IEEE Trans Syst Man Cybern Syst 45:1281–1291
23.
Zurück zum Zitat Lin CT, Prasad M, Saxena A (2015) An improved polynomial neural network classifier using real-coded genetic algorithm. IEEE Trans Syst Man Cybern Syst 45:1389–1401 Lin CT, Prasad M, Saxena A (2015) An improved polynomial neural network classifier using real-coded genetic algorithm. IEEE Trans Syst Man Cybern Syst 45:1389–1401
24.
Zurück zum Zitat Lin YZ, Nie ZH, Ma HW (2017) Structural damage detection with automatic feature-extraction through deep learning. Comput Aided Civ Infrastruct Eng 32:1025–1046 Lin YZ, Nie ZH, Ma HW (2017) Structural damage detection with automatic feature-extraction through deep learning. Comput Aided Civ Infrastruct Eng 32:1025–1046
25.
Zurück zum Zitat Liu P, Zeng Z, Wang J (2016) Multistability of recurrent neural networks with nonmonotonic activation functions and mixed time delays. IEEE Trans Syst Man Cybern Syst 46:512–523 Liu P, Zeng Z, Wang J (2016) Multistability of recurrent neural networks with nonmonotonic activation functions and mixed time delays. IEEE Trans Syst Man Cybern Syst 46:512–523
26.
Zurück zum Zitat Morabito FC, Campolo M, Mammone N, Versaci M, Franceschetti S, Tagliavini F, Sofia V, Fatuzzo D, Gambardella A, Labate A, Mumolia L, Tripodi GG, Gasparini S, Cianci V, Sueri C, Ferlazzo E, Aguglia U (2017) Deep learning representation from electroencephalography of early-stage Creutzfeld–Jakob disease and features for differentiation from rapidly progressive dementia. Int J Neural Syst 27:1650039 Morabito FC, Campolo M, Mammone N, Versaci M, Franceschetti S, Tagliavini F, Sofia V, Fatuzzo D, Gambardella A, Labate A, Mumolia L, Tripodi GG, Gasparini S, Cianci V, Sueri C, Ferlazzo E, Aguglia U (2017) Deep learning representation from electroencephalography of early-stage Creutzfeld–Jakob disease and features for differentiation from rapidly progressive dementia. Int J Neural Syst 27:1650039
27.
Zurück zum Zitat Nunes TM, Coelho ALV, Lima CAM, Papa JP, Albuquerque VHC (2014) EEG signal classification for epilepsy diagnosis via optimum path forest—a systematic assessment. Neurocomputing 136:103–123 Nunes TM, Coelho ALV, Lima CAM, Papa JP, Albuquerque VHC (2014) EEG signal classification for epilepsy diagnosis via optimum path forest—a systematic assessment. Neurocomputing 136:103–123
28.
Zurück zum Zitat Ortega-Zamorano F, Jerez JM, Gómez I, Franco L (2017) Layer multiplexing FPGA implementation for deep back-propagation learning. Integr Comput Aided Eng 24:171–185 Ortega-Zamorano F, Jerez JM, Gómez I, Franco L (2017) Layer multiplexing FPGA implementation for deep back-propagation learning. Integr Comput Aided Eng 24:171–185
29.
Zurück zum Zitat Ortiz A, Munilla J, Gorriz JM, Ramirez J (2016) Ensembles of deep learning architectures for the early diagnosis of Alzheimer’s disease. Int J Neural Syst 27:1650025 Ortiz A, Munilla J, Gorriz JM, Ramirez J (2016) Ensembles of deep learning architectures for the early diagnosis of Alzheimer’s disease. Int J Neural Syst 27:1650025
30.
Zurück zum Zitat Palomo EJ, Lopez-Rubio E (2016) Learning topologies with the growing neural forest. Int J Neural Syst 23:1650019 Palomo EJ, Lopez-Rubio E (2016) Learning topologies with the growing neural forest. Int J Neural Syst 23:1650019
31.
Zurück zum Zitat Papa JP, Falcão AX, Albuquerque VHC, Tavares JMRS (2012) Efficient supervised optimum-path forest classification for large datasets. Pattern Recognit 45(1):512–520 Papa JP, Falcão AX, Albuquerque VHC, Tavares JMRS (2012) Efficient supervised optimum-path forest classification for large datasets. Pattern Recognit 45(1):512–520
32.
Zurück zum Zitat Papa JP, Falcão AX, Suzuki CTN (2009) Supervised pattern classification based on optimum-path forest. Int J Imaging Syst Technol 19(2):120–131 Papa JP, Falcão AX, Suzuki CTN (2009) Supervised pattern classification based on optimum-path forest. Int J Imaging Syst Technol 19(2):120–131
33.
Zurück zum Zitat Papa JP, Fernandes SEN, Falcão AX (2017) Optimum-path forest based on k-connectivity: theory and applications. Pattern Recognit Lett 87:117–126 Papa JP, Fernandes SEN, Falcão AX (2017) Optimum-path forest based on k-connectivity: theory and applications. Pattern Recognit Lett 87:117–126
34.
Zurück zum Zitat Pisani RJ, Nakamura RYM, Riedel PS, Zimback CRL, Falcao AX, Papa JP (2014) Toward satellite-based land cover classification through optimum-path forest. IEEE Trans Geosci Remote Sens 52(10):6075–6085 Pisani RJ, Nakamura RYM, Riedel PS, Zimback CRL, Falcao AX, Papa JP (2014) Toward satellite-based land cover classification through optimum-path forest. IEEE Trans Geosci Remote Sens 52(10):6075–6085
35.
Zurück zum Zitat Rafiei MH, Adeli H (2016) A novel machine learning model for estimation of sale prices of real estate units. J Constr Eng Manag 42:04015066 Rafiei MH, Adeli H (2016) A novel machine learning model for estimation of sale prices of real estate units. J Constr Eng Manag 42:04015066
36.
Zurück zum Zitat Rafiei MH, Adeli H (2017) A novel machine learning based algorithm to detect damage in highrise building structures. Struct Des Tall Spec Build 26:e1400 Rafiei MH, Adeli H (2017) A novel machine learning based algorithm to detect damage in highrise building structures. Struct Des Tall Spec Build 26:e1400
37.
Zurück zum Zitat Rafiei MH, Khushefati WH, Demirboga R, Adeli H (2017) Supervised deep restricted boltzmann machine for estimation of concrete compressive strength. ACI Mater J 114:237–244 Rafiei MH, Khushefati WH, Demirboga R, Adeli H (2017) Supervised deep restricted boltzmann machine for estimation of concrete compressive strength. ACI Mater J 114:237–244
38.
Zurück zum Zitat Rocha LM, Cappabianco FAM, Falcão AX (2009) Data clustering as an optimum-path forest problem with applications in image analysis. Int J Imaging Syst Technol 19(2):50–68 Rocha LM, Cappabianco FAM, Falcão AX (2009) Data clustering as an optimum-path forest problem with applications in image analysis. Int J Imaging Syst Technol 19(2):50–68
39.
40.
Zurück zum Zitat Sankari Z, Adeli H (2011) Probabilistic neural networks for diagnosis of Alzheimer’s disease using conventional and wavelet coherence. J Neurosci Methods 197:165–170 Sankari Z, Adeli H (2011) Probabilistic neural networks for diagnosis of Alzheimer’s disease using conventional and wavelet coherence. J Neurosci Methods 197:165–170
41.
Zurück zum Zitat Shepard D (1968) A two-dimensional interpolation function for irregularly-spaced data. In: Proceedings of the 23rd ACM national conference. ACM Press, pp 517–524 Shepard D (1968) A two-dimensional interpolation function for irregularly-spaced data. In: Proceedings of the 23rd ACM national conference. ACM Press, pp 517–524
42.
Zurück zum Zitat Specht DF (1990) Probabilistic neural networks. Neural Netw 3:109–118 Specht DF (1990) Probabilistic neural networks. Neural Netw 3:109–118
43.
Zurück zum Zitat Wilcoxon F (1945) Individual comparisons by ranking methods. Biom Bull 1(6):80–83 Wilcoxon F (1945) Individual comparisons by ranking methods. Biom Bull 1(6):80–83
44.
Zurück zum Zitat Yu G, Adeli H (1993) Object-oriented finite element analysis using EER model. J Struct Eng 119:2763–2781 Yu G, Adeli H (1993) Object-oriented finite element analysis using EER model. J Struct Eng 119:2763–2781
45.
Zurück zum Zitat Zhang A, Wang KCP, Li B, Yang E, Dai X, Peng Y, Fei Y, Liu Y, Li JQ, Chen C (2017) Automated pixel-level pavement crack detection on 3d asphalt surfaces using a deep-learning network. Comput Aided Civ Infrastruct Eng 32:805–819 Zhang A, Wang KCP, Li B, Yang E, Dai X, Peng Y, Fei Y, Liu Y, Li JQ, Chen C (2017) Automated pixel-level pavement crack detection on 3d asphalt surfaces using a deep-learning network. Comput Aided Civ Infrastruct Eng 32:805–819
Metadaten
Titel
FEMa: a finite element machine for fast learning
verfasst von
Danilo R. Pereira
Marco Antonio Piteri
André N. Souza
João Paulo Papa
Hojjat Adeli
Publikationsdatum
16.03.2019
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 10/2020
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-019-04146-4

Weitere Artikel der Ausgabe 10/2020

Neural Computing and Applications 10/2020 Zur Ausgabe

Advances in Parallel and Distributed Computing for Neural Computing

Multi-task cascade deep convolutional neural networks for large-scale commodity recognition