Skip to main content
Erschienen in: Neural Computing and Applications 8/2015

01.11.2015 | Original Article

A hybrid FAM–CART model and its application to medical data classification

verfasst von: Manjeevan Seera, Chee Peng Lim, Shing Chiang Tan, Chu Kiong Loo

Erschienen in: Neural Computing and Applications | Ausgabe 8/2015

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, a hybrid model consisting of the fuzzy ARTMAP (FAM) neural network and the classification and regression tree (CART) is formulated. FAM is useful for tackling the stability–plasticity dilemma pertaining to data-based learning systems, while CART is useful for depicting its learned knowledge explicitly in a tree structure. By combining the benefits of both models, FAM–CART is capable of learning data samples stably and, at the same time, explaining its predictions with a set of decision rules. In other words, FAM–CART possesses two important properties of an intelligent system, i.e., learning in a stable manner (by overcoming the stability–plasticity dilemma) and extracting useful explanatory rules (by overcoming the opaqueness issue). To evaluate the usefulness of FAM–CART, six benchmark medical data sets from the UCI repository of machine learning and a real-world medical data classification problem are used for evaluation. For performance comparison, a number of performance metrics which include accuracy, specificity, sensitivity, and the area under the receiver operation characteristic curve are computed. The results are quantified with statistical indicators and compared with those reported in the literature. The outcomes positively indicate that FAM–CART is effective for undertaking data classification tasks. In addition to producing good results, it provides justifications of the predictions in the form of a decision tree so that domain users can easily understand the predictions, therefore making it a useful decision support tool.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Stylios CD, Georgopoulos VC, Malandraki GA, Chouliara S (2008) Fuzzy cognitive map architectures for medical decision support systems. Appl Soft Comput 8(3):1243–1251CrossRef Stylios CD, Georgopoulos VC, Malandraki GA, Chouliara S (2008) Fuzzy cognitive map architectures for medical decision support systems. Appl Soft Comput 8(3):1243–1251CrossRef
2.
Zurück zum Zitat Uzoka FME, Obot O, Barker K, Osuji J (2011) An experimental comparison of fuzzy logic and analytic hierarchy process for medical decision support systems. Comput Methods Programs Biomed 103(1):10–27CrossRef Uzoka FME, Obot O, Barker K, Osuji J (2011) An experimental comparison of fuzzy logic and analytic hierarchy process for medical decision support systems. Comput Methods Programs Biomed 103(1):10–27CrossRef
3.
Zurück zum Zitat Azar AT, El-Metwally SM (2013) Decision tree classifiers for automated medical diagnosis. Neural Comput Appl 23(7–8):2387–2403CrossRef Azar AT, El-Metwally SM (2013) Decision tree classifiers for automated medical diagnosis. Neural Comput Appl 23(7–8):2387–2403CrossRef
4.
Zurück zum Zitat Yan H, Jiang Y, Zheng J, Peng C, Li Q (2006) A multilayer perceptron-based medical decision support system for heart disease diagnosis. Expert Syst Appl 30(2):272–281CrossRef Yan H, Jiang Y, Zheng J, Peng C, Li Q (2006) A multilayer perceptron-based medical decision support system for heart disease diagnosis. Expert Syst Appl 30(2):272–281CrossRef
5.
Zurück zum Zitat Lisboa PJ, Taktak AF (2006) The use of artificial neural networks in decision support in cancer: a systematic review. Neural Netw 19(4):408–415MATHCrossRef Lisboa PJ, Taktak AF (2006) The use of artificial neural networks in decision support in cancer: a systematic review. Neural Netw 19(4):408–415MATHCrossRef
6.
Zurück zum Zitat Lim CP, Leong JH, Kuan MM (2005) A hybrid neural network system for pattern classification tasks with missing features. IEEE Trans Pattern Anal Mach Intell 27(4):648–653CrossRef Lim CP, Leong JH, Kuan MM (2005) A hybrid neural network system for pattern classification tasks with missing features. IEEE Trans Pattern Anal Mach Intell 27(4):648–653CrossRef
7.
Zurück zum Zitat Vigdor B, Lerner B (2006) Accurate and fast off and online fuzzy ARTMAP-based image classification with application to genetic abnormality diagnosis. IEEE Trans Neural Netw 17(5):1288–1300CrossRef Vigdor B, Lerner B (2006) Accurate and fast off and online fuzzy ARTMAP-based image classification with application to genetic abnormality diagnosis. IEEE Trans Neural Netw 17(5):1288–1300CrossRef
8.
Zurück zum Zitat Loo CK, Rao MVC (2005) Accurate and reliable diagnosis and classification using probabilistic ensemble simplified fuzzy ARTMAP. IEEE Trans Knowl Data Eng 17(11):1589–1593CrossRef Loo CK, Rao MVC (2005) Accurate and reliable diagnosis and classification using probabilistic ensemble simplified fuzzy ARTMAP. IEEE Trans Knowl Data Eng 17(11):1589–1593CrossRef
9.
Zurück zum Zitat Tan SC, Rao MVC, Lim CP (2009) An online pruning strategy for supervised ARTMAP-based neural networks. Neural Comput Appl 18(4):387–395CrossRef Tan SC, Rao MVC, Lim CP (2009) An online pruning strategy for supervised ARTMAP-based neural networks. Neural Comput Appl 18(4):387–395CrossRef
10.
Zurück zum Zitat Kolman E, Margaliot M (2005) Are artificial neural networks white boxes? IEEE Trans Neural Netw 16(4):844–852CrossRef Kolman E, Margaliot M (2005) Are artificial neural networks white boxes? IEEE Trans Neural Netw 16(4):844–852CrossRef
11.
Zurück zum Zitat Basak J, Krishnapuram R (2005) Interpretable hierarchical clustering by constructing an unsupervised decision tree. IEEE Trans Knowl Data Eng 17(1):121–132CrossRef Basak J, Krishnapuram R (2005) Interpretable hierarchical clustering by constructing an unsupervised decision tree. IEEE Trans Knowl Data Eng 17(1):121–132CrossRef
12.
Zurück zum Zitat Hullermeier E, Vanderlooy S (2009) Why fuzzy decision trees are good rankers. IEEE Trans Fuzzy Syst 17(6):1233–1244CrossRef Hullermeier E, Vanderlooy S (2009) Why fuzzy decision trees are good rankers. IEEE Trans Fuzzy Syst 17(6):1233–1244CrossRef
13.
Zurück zum Zitat Young WA II, Weckman GR, Hari V, Whiting HS II, Snow AP (2012) Using artificial neural networks to enhance CART. Neural Comput Appl 21(7):1477–1489CrossRef Young WA II, Weckman GR, Hari V, Whiting HS II, Snow AP (2012) Using artificial neural networks to enhance CART. Neural Comput Appl 21(7):1477–1489CrossRef
14.
Zurück zum Zitat Steinberg D, Colla P (1995) CART: tree-structured non-parametric data analysis. Salford Systems, San Diego Steinberg D, Colla P (1995) CART: tree-structured non-parametric data analysis. Salford Systems, San Diego
15.
Zurück zum Zitat Economou GP, Goumas PD, Spiropoulos K (1996) A novel medical decision support system. Comput Control Eng J 7(4):177–183CrossRef Economou GP, Goumas PD, Spiropoulos K (1996) A novel medical decision support system. Comput Control Eng J 7(4):177–183CrossRef
16.
Zurück zum Zitat Jin M, Li R, Xu Z, Zhao X (2014) Reliable fault diagnosis method using ensemble fuzzy ARTMAP based on improved Bayesian belief method. Neurocomputing 133:309–316CrossRef Jin M, Li R, Xu Z, Zhao X (2014) Reliable fault diagnosis method using ensemble fuzzy ARTMAP based on improved Bayesian belief method. Neurocomputing 133:309–316CrossRef
17.
Zurück zum Zitat Decanini JGMS, Tonelli-Neto MS, Minussi CR (2012) Robust fault diagnosis in power distribution systems based on fuzzy ARTMAP neural network-aided evidence theory. Gener Transm Distrib IET 6(11):1112–1120CrossRef Decanini JGMS, Tonelli-Neto MS, Minussi CR (2012) Robust fault diagnosis in power distribution systems based on fuzzy ARTMAP neural network-aided evidence theory. Gener Transm Distrib IET 6(11):1112–1120CrossRef
18.
Zurück zum Zitat Haque AU, Mandal P, Meng J, Srivastava AK, Tseng TL, Senjyu T (2013) A novel hybrid approach based on wavelet transform and fuzzy ARTMAP network for predicting wind farm power production. IEEE Trans Ind Appl 49(5):2253–2261CrossRef Haque AU, Mandal P, Meng J, Srivastava AK, Tseng TL, Senjyu T (2013) A novel hybrid approach based on wavelet transform and fuzzy ARTMAP network for predicting wind farm power production. IEEE Trans Ind Appl 49(5):2253–2261CrossRef
19.
Zurück zum Zitat Liang Z, Xu B, Chi Z, Feng D (2012) Intelligent characterization and evaluation of yarn surface appearance using saliency map analysis, wavelet transform and fuzzy ARTMAP neural network. Expert Syst Appl 39(4):4201–4212CrossRef Liang Z, Xu B, Chi Z, Feng D (2012) Intelligent characterization and evaluation of yarn surface appearance using saliency map analysis, wavelet transform and fuzzy ARTMAP neural network. Expert Syst Appl 39(4):4201–4212CrossRef
20.
Zurück zum Zitat Gharavian D, Sheikhan M, Nazerieh A, Garoucy S (2012) Speech emotion recognition using FCBF feature selection method and GA-optimized fuzzy ARTMAP neural network. Neural Comput Appl 21(8):2115–2126CrossRef Gharavian D, Sheikhan M, Nazerieh A, Garoucy S (2012) Speech emotion recognition using FCBF feature selection method and GA-optimized fuzzy ARTMAP neural network. Neural Comput Appl 21(8):2115–2126CrossRef
21.
Zurück zum Zitat Loo CK, Liew WS, Seera M, Lim E (2014) Probabilistic ensemble Fuzzy ARTMAP optimization using hierarchical parallel genetic algorithms. Neural Comput Appl. doi:10.1007/s00521-014-1632-y Loo CK, Liew WS, Seera M, Lim E (2014) Probabilistic ensemble Fuzzy ARTMAP optimization using hierarchical parallel genetic algorithms. Neural Comput Appl. doi:10.​1007/​s00521-014-1632-y
22.
Zurück zum Zitat Navarro Silvera SA, Mayne ST, Gammon MD, Vaughan TL, Chow WH, Dubin JA, Risch HA (2014) Diet and lifestyle factors and risk of subtypes of esophageal and gastric cancers: classification tree analysis. Ann Epidemiol 24(1):50–57CrossRef Navarro Silvera SA, Mayne ST, Gammon MD, Vaughan TL, Chow WH, Dubin JA, Risch HA (2014) Diet and lifestyle factors and risk of subtypes of esophageal and gastric cancers: classification tree analysis. Ann Epidemiol 24(1):50–57CrossRef
23.
Zurück zum Zitat Mohanty AK, Senapati MR, Beberta S, Lenka SK (2013) Texture-based features for classification of mammograms using decision tree. Neural Comput Appl 23(3–4):1011–1017CrossRef Mohanty AK, Senapati MR, Beberta S, Lenka SK (2013) Texture-based features for classification of mammograms using decision tree. Neural Comput Appl 23(3–4):1011–1017CrossRef
24.
Zurück zum Zitat Mohanty AK, Senapati MR, Lenka SK (2013) A novel image mining technique for classification of mammograms using hybrid feature selection. Neural Comput Appl 22(6):1151–1161CrossRef Mohanty AK, Senapati MR, Lenka SK (2013) A novel image mining technique for classification of mammograms using hybrid feature selection. Neural Comput Appl 22(6):1151–1161CrossRef
25.
Zurück zum Zitat Xing JJ, Liu YF, Li YQ, Gong H, Zhou YP (2014) QSAR classification model for diverse series of antimicrobial agents using classification tree configured by modified particle swarm optimization. Chemometr Intell Lab Syst 137:82–90CrossRef Xing JJ, Liu YF, Li YQ, Gong H, Zhou YP (2014) QSAR classification model for diverse series of antimicrobial agents using classification tree configured by modified particle swarm optimization. Chemometr Intell Lab Syst 137:82–90CrossRef
26.
Zurück zum Zitat Yu H, Song Y, Liu R, Pan H, Xiang L, Qian F (2014) Identifying changes in dissolved organic matter content and characteristics by fluorescence spectroscopy coupled with self-organizing map and classification and regression tree analysis during wastewater treatment. Chemosphere 113:79–86CrossRef Yu H, Song Y, Liu R, Pan H, Xiang L, Qian F (2014) Identifying changes in dissolved organic matter content and characteristics by fluorescence spectroscopy coupled with self-organizing map and classification and regression tree analysis during wastewater treatment. Chemosphere 113:79–86CrossRef
27.
28.
Zurück zum Zitat Romano R, Davino C, Næs T (2014) Classification trees in consumer studies for combining both product attributes and consumer preferences with additional consumer characteristics. Food Qual Prefer 33:27–36CrossRef Romano R, Davino C, Næs T (2014) Classification trees in consumer studies for combining both product attributes and consumer preferences with additional consumer characteristics. Food Qual Prefer 33:27–36CrossRef
29.
Zurück zum Zitat Carpenter GA, Tan AH (1995) Rule extraction: from neural architecture to symbolic representation. Connect Sci 7(1):3–27CrossRef Carpenter GA, Tan AH (1995) Rule extraction: from neural architecture to symbolic representation. Connect Sci 7(1):3–27CrossRef
30.
Zurück zum Zitat Carpenter GA, Grossberg S, Markuzon N, Reynolds JH, Rosen DB (1992) Fuzzy artmap: a neural network architecture for incremental supervised learning of analog multidimensional maps. IEEE Trans Neural Netw 3(5):98–713CrossRef Carpenter GA, Grossberg S, Markuzon N, Reynolds JH, Rosen DB (1992) Fuzzy artmap: a neural network architecture for incremental supervised learning of analog multidimensional maps. IEEE Trans Neural Netw 3(5):98–713CrossRef
32.
Zurück zum Zitat Lim CP, Harrison RF (1997) An incremental adaptive network for on-line supervised learning and probability estimation. Neural Netw 10(5):925–939CrossRef Lim CP, Harrison RF (1997) An incremental adaptive network for on-line supervised learning and probability estimation. Neural Netw 10(5):925–939CrossRef
33.
Zurück zum Zitat Pasiouras F, Tanna S, Zopounidis C (2005) Application of quantitative techniques for the prediction of bank acquisition targets, vol 5. World Scientific, SingaporeMATHCrossRef Pasiouras F, Tanna S, Zopounidis C (2005) Application of quantitative techniques for the prediction of bank acquisition targets, vol 5. World Scientific, SingaporeMATHCrossRef
34.
Zurück zum Zitat Chen Y, Wang S, Shen CH, Choy FK (2012) Matrix decomposition based feature extraction for murmur classification. Med Eng Phys 34(6):756–761CrossRef Chen Y, Wang S, Shen CH, Choy FK (2012) Matrix decomposition based feature extraction for murmur classification. Med Eng Phys 34(6):756–761CrossRef
35.
Zurück zum Zitat Waheed T, Bonnell RB, Prasher SO, Paulet E (2006) Measuring performance in precision agriculture: CART—a decision tree approach. Agric Water Manag 84(1):173–185CrossRef Waheed T, Bonnell RB, Prasher SO, Paulet E (2006) Measuring performance in precision agriculture: CART—a decision tree approach. Agric Water Manag 84(1):173–185CrossRef
36.
Zurück zum Zitat Han J, Kamber M, Pei J (2012) Data mining: concepts and techniques, 3rd edn. Morgan Kaufmann, MA Han J, Kamber M, Pei J (2012) Data mining: concepts and techniques, 3rd edn. Morgan Kaufmann, MA
37.
Zurück zum Zitat Yohannes Y, Webb P (1999) Classification and regression trees. International Food Policy Research Institute, USA Yohannes Y, Webb P (1999) Classification and regression trees. International Food Policy Research Institute, USA
39.
Zurück zum Zitat Delen D, Walker G, Kadam A (2005) Predicting breast cancer survivability: a comparison of three data mining methods. Artif Intell Med 34(2):113–127CrossRef Delen D, Walker G, Kadam A (2005) Predicting breast cancer survivability: a comparison of three data mining methods. Artif Intell Med 34(2):113–127CrossRef
40.
Zurück zum Zitat Loo CK (2005) Accurate and reliable diagnosis and classification using probabilistic ensemble simplified fuzzy ARTMAP. IEEE Trans Knowl Data Eng 17(11):1589–1593CrossRef Loo CK (2005) Accurate and reliable diagnosis and classification using probabilistic ensemble simplified fuzzy ARTMAP. IEEE Trans Knowl Data Eng 17(11):1589–1593CrossRef
41.
Zurück zum Zitat Hanley JA, McNeil BJ (1982) The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 143(1):29–36CrossRef Hanley JA, McNeil BJ (1982) The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 143(1):29–36CrossRef
43.
Zurück zum Zitat Zoubir AM, Boashash B (1998) The bootstrap and its application in signal processing. Sig Process Mag IEEE 15(1):56–76CrossRef Zoubir AM, Boashash B (1998) The bootstrap and its application in signal processing. Sig Process Mag IEEE 15(1):56–76CrossRef
44.
Zurück zum Zitat Efron B, Tibshirani R (1993) An introduction to the bootstrap. Chapman and Hall, New YorkMATHCrossRef Efron B, Tibshirani R (1993) An introduction to the bootstrap. Chapman and Hall, New YorkMATHCrossRef
45.
Zurück zum Zitat Örkcü HH, Bal H (2011) Comparing performances of backpropagation and genetic algorithms in the data classification. Expert Syst Appl 38(4):3703–3709CrossRef Örkcü HH, Bal H (2011) Comparing performances of backpropagation and genetic algorithms in the data classification. Expert Syst Appl 38(4):3703–3709CrossRef
46.
Zurück zum Zitat Stoean R, Stoean C (2013) Modeling medical decision making by support vector machines, explaining by rules of evolutionary algorithms with feature selection. Expert Syst Appl 40(7):2677–2686MathSciNetCrossRef Stoean R, Stoean C (2013) Modeling medical decision making by support vector machines, explaining by rules of evolutionary algorithms with feature selection. Expert Syst Appl 40(7):2677–2686MathSciNetCrossRef
47.
Zurück zum Zitat Luukka P (2011) Feature selection using fuzzy entropy measures with similarity classifier. Expert Syst Appl 38(4):4600–4607CrossRef Luukka P (2011) Feature selection using fuzzy entropy measures with similarity classifier. Expert Syst Appl 38(4):4600–4607CrossRef
48.
Zurück zum Zitat Çalişir D, Dogantekin E (2011) A new intelligent hepatitis diagnosis system: PCA–LSSVM. Expert Syst Appl 38(8):10705–10708CrossRef Çalişir D, Dogantekin E (2011) A new intelligent hepatitis diagnosis system: PCA–LSSVM. Expert Syst Appl 38(8):10705–10708CrossRef
49.
Zurück zum Zitat Chen HL, Liu DY, Yang B, Liu J, Wang G (2011) A new hybrid method based on local fisher discriminant analysis and support vector machines for hepatitis disease diagnosis. Expert Syst Appl 38(9):11796–11803CrossRef Chen HL, Liu DY, Yang B, Liu J, Wang G (2011) A new hybrid method based on local fisher discriminant analysis and support vector machines for hepatitis disease diagnosis. Expert Syst Appl 38(9):11796–11803CrossRef
50.
Zurück zum Zitat Dayanik A (2012) Learning feature-projection based classifiers. Expert Syst Appl 39(4):4532–4544CrossRef Dayanik A (2012) Learning feature-projection based classifiers. Expert Syst Appl 39(4):4532–4544CrossRef
51.
Zurück zum Zitat Özşen S, Güneş S (2009) Attribute weighting via genetic algorithms for attribute weighted artificial immune system (AWAIS) and its application to heart disease and liver disorders problems. Expert Syst Appl 36(1):386–392CrossRef Özşen S, Güneş S (2009) Attribute weighting via genetic algorithms for attribute weighted artificial immune system (AWAIS) and its application to heart disease and liver disorders problems. Expert Syst Appl 36(1):386–392CrossRef
52.
Zurück zum Zitat Nahar J, Imam T, Tickle KS, Chen YPP (2013) Computational intelligence for heart disease diagnosis: a medical knowledge driven approach. Expert Syst Appl 40(1):96–104CrossRef Nahar J, Imam T, Tickle KS, Chen YPP (2013) Computational intelligence for heart disease diagnosis: a medical knowledge driven approach. Expert Syst Appl 40(1):96–104CrossRef
53.
Zurück zum Zitat Çomak E, Polat K, Güneş S, Arslan A (2007) A new medical decision making system: least square support vector machine (LSSVM) with fuzzy weighting pre-processing. Expert Syst Appl 32(2):409–414CrossRef Çomak E, Polat K, Güneş S, Arslan A (2007) A new medical decision making system: least square support vector machine (LSSVM) with fuzzy weighting pre-processing. Expert Syst Appl 32(2):409–414CrossRef
Metadaten
Titel
A hybrid FAM–CART model and its application to medical data classification
verfasst von
Manjeevan Seera
Chee Peng Lim
Shing Chiang Tan
Chu Kiong Loo
Publikationsdatum
01.11.2015
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 8/2015
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-015-1852-9

Weitere Artikel der Ausgabe 8/2015

Neural Computing and Applications 8/2015 Zur Ausgabe

Premium Partner