Skip to main content
Erschienen in: International Journal of Machine Learning and Cybernetics 7/2019

15.06.2018 | Original Article

A reinforced fuzzy ARTMAP model for data classification

verfasst von: Farhad Pourpanah, Chee Peng Lim, Qi Hao

Erschienen in: International Journal of Machine Learning and Cybernetics | Ausgabe 7/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper presents a hybrid model consisting of fuzzy ARTMAP (FAM) and reinforcement learning (RL) for tackling data classification problems. RL is used as a feedback mechanism to reward the prototype nodes of data samples established by FAM. Specifically, Q-learning is adopted to develop the hybrid model known as QFAM. A Q-value is assigned to each prototype node, which is updated incrementally based on the prediction accuracy of the node pertaining to each data sample. To evaluate the performance of the proposed QFAM model, a series of experiments with benchmark problems and a real-world case study, i.e., human motion recognition, are conducted. The bootstrap method is used to quantify the results with the 95% confidence interval estimates. The results are also compared with those from FAM as well as other models reported in the literature. The outcomes indicate the effectiveness of QFAM in tackling data classification tasks.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Literatur
1.
Zurück zum Zitat Banharnsakun A (2017) Hybrid ABC–ANN for pavement surface distress detection and classification. Int J Mach Learn Cybern 8:699–710CrossRef Banharnsakun A (2017) Hybrid ABC–ANN for pavement surface distress detection and classification. Int J Mach Learn Cybern 8:699–710CrossRef
2.
Zurück zum Zitat Elamvazuthi I, Duy NHX, Ali Z, Su SW, Khan MKAA, Parasuraman S (2015) Electromyography (EMG) based classification of neuromuscular disorders using multi-layer perceptron. Procedia Comput Sci 76:223–228CrossRef Elamvazuthi I, Duy NHX, Ali Z, Su SW, Khan MKAA, Parasuraman S (2015) Electromyography (EMG) based classification of neuromuscular disorders using multi-layer perceptron. Procedia Comput Sci 76:223–228CrossRef
3.
Zurück zum Zitat Sun X, Kang F, Wang M, Bian J, Cheng J, Zou DH (2016) Improved probabilistic neural network PNN and its application to defect recognition in rock bolts. Int J Mach Learn Cybern 7:909–919CrossRef Sun X, Kang F, Wang M, Bian J, Cheng J, Zou DH (2016) Improved probabilistic neural network PNN and its application to defect recognition in rock bolts. Int J Mach Learn Cybern 7:909–919CrossRef
4.
Zurück zum Zitat Raitoharju J, Kiranyaz S, Gabbouj M (2016) Training radial basis function neural networks for classification via class-specific clustering. IEEE Trans Neural Networks Learn Syst 27:2458–2471CrossRef Raitoharju J, Kiranyaz S, Gabbouj M (2016) Training radial basis function neural networks for classification via class-specific clustering. IEEE Trans Neural Networks Learn Syst 27:2458–2471CrossRef
5.
Zurück zum Zitat Carpenter GA, Grossberg S (1987) A massively parallel architecture for a self-organizing neural pattern recognition machine. Comput Vis Graph Image Process 37:54–115CrossRefMATH Carpenter GA, Grossberg S (1987) A massively parallel architecture for a self-organizing neural pattern recognition machine. Comput Vis Graph Image Process 37:54–115CrossRefMATH
6.
Zurück zum Zitat Subhi MAB, Mat INA, Zamli KZ, Azizli KA (2010) Modified recursive least squares algorithm to train the hybrid multilayered perceptron (HMLP) network. Appl Soft Comput 10:236–244CrossRef Subhi MAB, Mat INA, Zamli KZ, Azizli KA (2010) Modified recursive least squares algorithm to train the hybrid multilayered perceptron (HMLP) network. Appl Soft Comput 10:236–244CrossRef
7.
Zurück zum Zitat Simpson PK (1992) Fuzzy min-max neural networks. I. Classification. IEEE Trans neural networks 3:776–786CrossRef Simpson PK (1992) Fuzzy min-max neural networks. I. Classification. IEEE Trans neural networks 3:776–786CrossRef
8.
Zurück zum Zitat Seera M, Chee P Lim (2014) Online motor fault detection and diagnosis using a hybrid FMM-CART model. IEEE Trans Neural Netw Learn Syst 25:806–812CrossRef Seera M, Chee P Lim (2014) Online motor fault detection and diagnosis using a hybrid FMM-CART model. IEEE Trans Neural Netw Learn Syst 25:806–812CrossRef
9.
Zurück zum Zitat Pratama M, Lu J, Anavatti S, Lughofer E, Lim C-P (2016) An incremental meta-cognitive-based scaffolding fuzzy neural network. Neurocomputing 171:89–105CrossRef Pratama M, Lu J, Anavatti S, Lughofer E, Lim C-P (2016) An incremental meta-cognitive-based scaffolding fuzzy neural network. Neurocomputing 171:89–105CrossRef
10.
Zurück zum Zitat Jain LC, Seera M, Lim CP, Balasubramaniam P (2014) A review of online learning in supervised neural networks. Neural Comput Appl 25:491–509CrossRef Jain LC, Seera M, Lim CP, Balasubramaniam P (2014) A review of online learning in supervised neural networks. Neural Comput Appl 25:491–509CrossRef
11.
Zurück zum Zitat Carpenter GA, Grossberg S, Markuzon N, Reynolds JH, Rosen DB (1992) Fuzzy ARTMAP: a neural network architecture for incremental supervised learning of analog multidimensional maps. IEEE Trans Neural Netw 3:698–713CrossRef Carpenter GA, Grossberg S, Markuzon N, Reynolds JH, Rosen DB (1992) Fuzzy ARTMAP: a neural network architecture for incremental supervised learning of analog multidimensional maps. IEEE Trans Neural Netw 3:698–713CrossRef
12.
Zurück zum Zitat Ananthi VP, Balasubramaniam P, Lim CP (2014) Segmentation of gray scale image based on intuitionistic fuzzy sets constructed from several membership functions. Pattern Recognit 47:3870–3880CrossRef Ananthi VP, Balasubramaniam P, Lim CP (2014) Segmentation of gray scale image based on intuitionistic fuzzy sets constructed from several membership functions. Pattern Recognit 47:3870–3880CrossRef
13.
Zurück zum Zitat Ashfaq RAR, Wang X-Z (2017) Impact of fuzziness categorization on divide and conquer strategy for instance selection. J Intell Fuzzy Syst 33:1007–1018CrossRef Ashfaq RAR, Wang X-Z (2017) Impact of fuzziness categorization on divide and conquer strategy for instance selection. J Intell Fuzzy Syst 33:1007–1018CrossRef
14.
Zurück zum Zitat Wang X-Z, Xing H-J, Li Y, Hua Q, Dong C-R, Pedrycz W (2015) A study on relationship between generalization abilities and fuzziness of base classifiers in ensemble learning. IEEE Trans Fuzzy Syst 23:1638–1654CrossRef Wang X-Z, Xing H-J, Li Y, Hua Q, Dong C-R, Pedrycz W (2015) A study on relationship between generalization abilities and fuzziness of base classifiers in ensemble learning. IEEE Trans Fuzzy Syst 23:1638–1654CrossRef
15.
Zurück zum Zitat Wang R, Wang X-Z, Kwong S, Xu C (2017) Incorporating diversity and informativeness in multiple-instance active learning. IEEE Trans Fuzzy Syst 25:1460–1475CrossRef Wang R, Wang X-Z, Kwong S, Xu C (2017) Incorporating diversity and informativeness in multiple-instance active learning. IEEE Trans Fuzzy Syst 25:1460–1475CrossRef
16.
17.
Zurück zum Zitat Mohammed MF, Chee P, Lim (2015) An enhanced fuzzy min–max neural network for pattern classification. IEEE Trans Neural Netw Learn Syst 26:417–429MathSciNetCrossRef Mohammed MF, Chee P, Lim (2015) An enhanced fuzzy min–max neural network for pattern classification. IEEE Trans Neural Netw Learn Syst 26:417–429MathSciNetCrossRef
18.
Zurück zum Zitat Williamson JR (1996) Gaussian ARTMAP: a neural network for fast incremental learning of noisy multidimensional maps. Neural Netw 9:881–897CrossRef Williamson JR (1996) Gaussian ARTMAP: a neural network for fast incremental learning of noisy multidimensional maps. Neural Netw 9:881–897CrossRef
19.
Zurück zum Zitat Daraiseh AA, Georgiopoulos M, Anagnostopoulos G, Wu AS, Mollaghasemi M (2006) GFAM: a genetic algorithm optimization of fuzzy ARTMAP. In: IEEE international conference on fuzzy systems, pp 315–322 Daraiseh AA, Georgiopoulos M, Anagnostopoulos G, Wu AS, Mollaghasemi M (2006) GFAM: a genetic algorithm optimization of fuzzy ARTMAP. In: IEEE international conference on fuzzy systems, pp 315–322
20.
Zurück zum Zitat Barto A, Sutton RS (1998) Reinforcement learning: an introduction. MIT Press, CambridgeMATH Barto A, Sutton RS (1998) Reinforcement learning: an introduction. MIT Press, CambridgeMATH
21.
Zurück zum Zitat Wang X-Z, Wang R, Xu C (2018) Discovering the relationship between generalization and uncertainty by incorporating complexity of classification. IEEE Trans Cybern 48:703–715CrossRef Wang X-Z, Wang R, Xu C (2018) Discovering the relationship between generalization and uncertainty by incorporating complexity of classification. IEEE Trans Cybern 48:703–715CrossRef
22.
Zurück zum Zitat Barto A, Sutton RS, Anderson CW (1983) Neuronlike adaptive elements that can solve difficult learning control problems. IEEE Trans Syst Man Cybern 13:834–846CrossRef Barto A, Sutton RS, Anderson CW (1983) Neuronlike adaptive elements that can solve difficult learning control problems. IEEE Trans Syst Man Cybern 13:834–846CrossRef
23.
Zurück zum Zitat Tesauro G (1994) TD-Gammon, a self-teaching Backgammon program, achieves master-level play. Neural Comput 6:215–219CrossRef Tesauro G (1994) TD-Gammon, a self-teaching Backgammon program, achieves master-level play. Neural Comput 6:215–219CrossRef
24.
Zurück zum Zitat Fauber S, Schwenker F (2013) Neural network ensembles in reinforcement learning. Neural Process Lett 41:55–69 Fauber S, Schwenker F (2013) Neural network ensembles in reinforcement learning. Neural Process Lett 41:55–69
25.
Zurück zum Zitat Barto A, Crites RH (1996) Improving elevator performance using reinforcement learning. Adv Neural Inf Process Syst 8:1017–1023 Barto A, Crites RH (1996) Improving elevator performance using reinforcement learning. Adv Neural Inf Process Syst 8:1017–1023
26.
Zurück zum Zitat Likas A, Blekas K (1996) A reinforcement learning approach based on the fuzzy Min–Max neural network. Neural Process Lett 4:167–172CrossRef Likas A, Blekas K (1996) A reinforcement learning approach based on the fuzzy Min–Max neural network. Neural Process Lett 4:167–172CrossRef
27.
Zurück zum Zitat Likas A (2001) Reinforcement learning using the stochastic fuzzy Min–Max neural network. 13:213–220 Likas A (2001) Reinforcement learning using the stochastic fuzzy Min–Max neural network. 13:213–220
28.
Zurück zum Zitat Quah KH, Quek C, Leedham G (2005) Reinforcement learning combined with a fuzzy adaptive learning control network (FALCON-R) for pattern classification. Pattern Recognit 38:513–526CrossRef Quah KH, Quek C, Leedham G (2005) Reinforcement learning combined with a fuzzy adaptive learning control network (FALCON-R) for pattern classification. Pattern Recognit 38:513–526CrossRef
29.
Zurück zum Zitat Wong WC, Cho SY, Quek C (2009) R-POPTVR: a novel reinforcement-based POPTVR fuzzy neural network for pattern classification. IEEE Trans Neural Netw 20:1740–1755CrossRef Wong WC, Cho SY, Quek C (2009) R-POPTVR: a novel reinforcement-based POPTVR fuzzy neural network for pattern classification. IEEE Trans Neural Netw 20:1740–1755CrossRef
30.
Zurück zum Zitat Zheng L, Cho S-Y (2011) A modified memory-based reinforcement learning method for solving POMDP problems. Neural Process Lett 33:187–200CrossRef Zheng L, Cho S-Y (2011) A modified memory-based reinforcement learning method for solving POMDP problems. Neural Process Lett 33:187–200CrossRef
31.
Zurück zum Zitat Lim CP, Harrison RF (1997) An incremental adaptive network for on-line supervised learning and probability estimation. Neural Netw 10:925–939CrossRef Lim CP, Harrison RF (1997) An incremental adaptive network for on-line supervised learning and probability estimation. Neural Netw 10:925–939CrossRef
32.
Zurück zum Zitat Lim CP, Leong JH, Kuan MM (2005) A hybrid neural network system for pattern classification tasks with missing features. IEEE Trans Pattern Anal Mach Intell 27:648–653CrossRef Lim CP, Leong JH, Kuan MM (2005) A hybrid neural network system for pattern classification tasks with missing features. IEEE Trans Pattern Anal Mach Intell 27:648–653CrossRef
33.
Zurück zum Zitat Tan SC, Rao MVC, Lim CP (2008) Fuzzy ARTMAP dynamic decay adjustment: an improved fuzzy ARTMAP model with a conflict resolving facility. Appl Soft Comput 8:543–554CrossRef Tan SC, Rao MVC, Lim CP (2008) Fuzzy ARTMAP dynamic decay adjustment: an improved fuzzy ARTMAP model with a conflict resolving facility. Appl Soft Comput 8:543–554CrossRef
34.
Zurück zum Zitat Tan SC, Lim CP (2010) Evolutionary fuzzy ARTMAP neural networks and their applications to fault detection and diagnosis. Neural Process Lett 31:219–242CrossRef Tan SC, Lim CP (2010) Evolutionary fuzzy ARTMAP neural networks and their applications to fault detection and diagnosis. Neural Process Lett 31:219–242CrossRef
35.
Zurück zum Zitat Wong SY, Yap KS, Yap HJ, Tan SC (2014) A truly online learning algorithm using hybrid fuzzy ARTMAP and online extreme learning machine for pattern classification. Neural Process Lett 42:585–602CrossRef Wong SY, Yap KS, Yap HJ, Tan SC (2014) A truly online learning algorithm using hybrid fuzzy ARTMAP and online extreme learning machine for pattern classification. Neural Process Lett 42:585–602CrossRef
37.
Zurück zum Zitat Carpenter GA, Grossberg S, Reynolds JH (1995) A fuzzy ARTMAP nonparametric probability estimator for nonstationary pattern recognition problems. IEEE Trans Neural Netw 6:1330–1336CrossRef Carpenter GA, Grossberg S, Reynolds JH (1995) A fuzzy ARTMAP nonparametric probability estimator for nonstationary pattern recognition problems. IEEE Trans Neural Netw 6:1330–1336CrossRef
38.
Zurück zum Zitat Lim CP, Harrison RF (1997) Modified fuzzy ARTMAP approaches Bayes optimal classification rates: an empirical demonstration. Neural Netw 10:755–774CrossRef Lim CP, Harrison RF (1997) Modified fuzzy ARTMAP approaches Bayes optimal classification rates: an empirical demonstration. Neural Netw 10:755–774CrossRef
39.
Zurück zum Zitat Xu Z, Xuan J, Shi T, Wu B, Hu Y (2009) A novel fault diagnosis method of bearing based on improved fuzzy ARTMAP and modified distance discriminant technique. Expert Syst Appl 36:11801–11807CrossRef Xu Z, Xuan J, Shi T, Wu B, Hu Y (2009) A novel fault diagnosis method of bearing based on improved fuzzy ARTMAP and modified distance discriminant technique. Expert Syst Appl 36:11801–11807CrossRef
40.
Zurück zum Zitat Gharavian D, Sheikhan M, Nazerieh A, Garoucy S (2011) Speech emotion recognition using FCBF feature selection method and GA-optimized fuzzy ARTMAP neural network. Neural Comput Appl 21:2115–2126CrossRef Gharavian D, Sheikhan M, Nazerieh A, Garoucy S (2011) Speech emotion recognition using FCBF feature selection method and GA-optimized fuzzy ARTMAP neural network. Neural Comput Appl 21:2115–2126CrossRef
41.
Zurück zum Zitat Zhang Y, Ji H, Zhang W (2014) TPPFAM: use of threshold and posterior probability for category reduction in fuzzy ARTMAP. Neurocomputing 124:63–71CrossRef Zhang Y, Ji H, Zhang W (2014) TPPFAM: use of threshold and posterior probability for category reduction in fuzzy ARTMAP. Neurocomputing 124:63–71CrossRef
42.
Zurück zum Zitat Lee JH, Oh SY, Choi DH (1998) TD based reinforcement learning using neural networks in control problems with continuous action space. In: IEEE international joint conference on neural networks proceedings. IEEE world congress on computational intelligence, pp 2028–2033 Lee JH, Oh SY, Choi DH (1998) TD based reinforcement learning using neural networks in control problems with continuous action space. In: IEEE international joint conference on neural networks proceedings. IEEE world congress on computational intelligence, pp 2028–2033
43.
Zurück zum Zitat Gullapalli V (1990) A stochastic reinforcement learning algorithm for learning real-valued functions. Neural Netw 3:671–692CrossRef Gullapalli V (1990) A stochastic reinforcement learning algorithm for learning real-valued functions. Neural Netw 3:671–692CrossRef
44.
Zurück zum Zitat Lin CJ, Lin CT (1997) An ART-based fuzzy adaptive learning control network. IEEE Trans Fuzzy Syst 5:477–496CrossRef Lin CJ, Lin CT (1997) An ART-based fuzzy adaptive learning control network. IEEE Trans Fuzzy Syst 5:477–496CrossRef
45.
Zurück zum Zitat Zhou RW, Quek C (1996) POPFNN: a pseudo outer-product based fuzzy neural network. Neural Netw 9:1569–1581CrossRefMATH Zhou RW, Quek C (1996) POPFNN: a pseudo outer-product based fuzzy neural network. Neural Netw 9:1569–1581CrossRefMATH
46.
Zurück zum Zitat Howard RA (1960) Dynamic programming and markov processes. Published jointly by the Technology Press of the Massachusetts Institute of Technology and Wiley, New York Howard RA (1960) Dynamic programming and markov processes. Published jointly by the Technology Press of the Massachusetts Institute of Technology and Wiley, New York
47.
Zurück zum Zitat Sutton RS (1988) Learning to predict by the methods of temporal differences. Mach Learn 3:9–44 Sutton RS (1988) Learning to predict by the methods of temporal differences. Mach Learn 3:9–44
48.
Zurück zum Zitat Irodova M, Sloan R (2005) Reinforcement learning and function approximation. FLAIRS Conference, Melbourne Irodova M, Sloan R (2005) Reinforcement learning and function approximation. FLAIRS Conference, Melbourne
50.
Zurück zum Zitat Örkcü HH, Bal H (2011) Comparing performances of backpropagation and genetic algorithms in the data classification. Expert Syst Appl 38:3703–3709CrossRef Örkcü HH, Bal H (2011) Comparing performances of backpropagation and genetic algorithms in the data classification. Expert Syst Appl 38:3703–3709CrossRef
51.
Zurück zum Zitat Fallahnezhad M, Moradi MH, Zaferanlouei S (2011) A hybrid higher order neural classifier for handling classification problems. Expert Syst Appl 38:386–393CrossRef Fallahnezhad M, Moradi MH, Zaferanlouei S (2011) A hybrid higher order neural classifier for handling classification problems. Expert Syst Appl 38:386–393CrossRef
52.
Zurück zum Zitat Jamshidi Y, Nezamabadi-pour H (2014) Rule inducing by fuzzy lattice reasoning classifier based on metric distances (FLRC-MD). Appl Soft Comput 24:603–611CrossRef Jamshidi Y, Nezamabadi-pour H (2014) Rule inducing by fuzzy lattice reasoning classifier based on metric distances (FLRC-MD). Appl Soft Comput 24:603–611CrossRef
53.
Zurück zum Zitat Cai LY, Kwan HK (1998) Fuzzy classifications using fuzzy inference networks. IEEE Trans Syst Man Cybern Part B Cybern A 28:334–347CrossRef Cai LY, Kwan HK (1998) Fuzzy classifications using fuzzy inference networks. IEEE Trans Syst Man Cybern Part B Cybern A 28:334–347CrossRef
55.
Zurück zum Zitat John GH, Langley P (1995) Estimating continuous distributions in Bayesian classifiers. In: Proceedings of the eleventh conference on uncertainty in artificial intelligence. Morgan Kaufmann Publishers Inc, pp 338–345 John GH, Langley P (1995) Estimating continuous distributions in Bayesian classifiers. In: Proceedings of the eleventh conference on uncertainty in artificial intelligence. Morgan Kaufmann Publishers Inc, pp 338–345
56.
Zurück zum Zitat Chen SM, Shie JD (2009) Fuzzy classification systems based on fuzzy information gain measures. Expert Syst Appl 36:4517–4522CrossRef Chen SM, Shie JD (2009) Fuzzy classification systems based on fuzzy information gain measures. Expert Syst Appl 36:4517–4522CrossRef
57.
Zurück zum Zitat Tan CJ, Lim CP, Cheah Y (2014) A multi-objective evolutionary algorithm-based ensemble optimizer for feature selection and classification with neural network models. Neurocomputing 125:217–228CrossRef Tan CJ, Lim CP, Cheah Y (2014) A multi-objective evolutionary algorithm-based ensemble optimizer for feature selection and classification with neural network models. Neurocomputing 125:217–228CrossRef
Metadaten
Titel
A reinforced fuzzy ARTMAP model for data classification
verfasst von
Farhad Pourpanah
Chee Peng Lim
Qi Hao
Publikationsdatum
15.06.2018
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Machine Learning and Cybernetics / Ausgabe 7/2019
Print ISSN: 1868-8071
Elektronische ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-018-0843-4

Weitere Artikel der Ausgabe 7/2019

International Journal of Machine Learning and Cybernetics 7/2019 Zur Ausgabe

Neuer Inhalt