Skip to main content
Erschienen in: Neural Processing Letters 2/2015

01.10.2015

Fuzzy Min–Max Neural Network for Learning a Classifier with Symmetric Margin

verfasst von: Yahya Forghani, Hadi Sadoghi Yazdi

Erschienen in: Neural Processing Letters | Ausgabe 2/2015

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

A fuzzy min–max neural network with symmetric margin (FMNWSM) is proposed in this paper. Therefore, its probability of misclassification is lower than traditional fuzzy min–max neural networks if both training and test samples are from identical probability distribution. Meanwhile, data is classified with symmetric margin by the use of a non-linear program which is solved analytically. In other words, to decrease learning time, no numerical optimization algorithm is used to solve the non-linear program. Only hyperbox expansion is performed in training phase of FMNWSM. On the contrary, in training phase of traditional fuzzy min–max neural networks, another process also is performed for each overlapped region such as (a) contraction process or (b) creating an especial node. Therefore, learning time of FMNWSM is less than that of traditional fuzzy min–max neural networks and since FMNWSM does not create any special node for overlapped regions, the space complexity of FMNWSM is better than those that create an especial node for an overlapped region. It is shown also that the test time complexity of FMNWSM is much better than that of traditional fuzzy min–max neural networks because of the use of a simpler activation function in its hyperbox node. Finally, the proposed fuzzy min–max neural networks, namely FMNWSM, is compared with some of traditional fuzzy min–max neural networks (i.e. FMNN, GFMN, FMCN and DCFMN) empirically (by using some real datasets) and also analytically to show the superiority of FMNWSM.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
1
\(N\) hyperboxes of other classes are contained in the hyperbox expanded in previous step and \(n\)th dimension has the smallest overlap.
 
Literatur
2.
Zurück zum Zitat Carpenter G, Grossberg S, Rosen DB (1991) Fuzzy ART: an adaptive resonance algorithm for rapid, stable classification of analog patterns. Presented at the international joint conference on neural networks, Seattle, WA Carpenter G, Grossberg S, Rosen DB (1991) Fuzzy ART: an adaptive resonance algorithm for rapid, stable classification of analog patterns. Presented at the international joint conference on neural networks, Seattle, WA
3.
Zurück zum Zitat Carpenter GA, Grossberg S (1987) A massively parallel architecture for a self-organizing neural pattern recognition machine. Comput Vis Graph Image Process 37:54–115CrossRef Carpenter GA, Grossberg S (1987) A massively parallel architecture for a self-organizing neural pattern recognition machine. Comput Vis Graph Image Process 37:54–115CrossRef
4.
Zurück zum Zitat Simpson PK (1993) Fuzzy min–max neural network—part II: clustering. IEEE Trans Fuzzy Syst 1:32–45CrossRef Simpson PK (1993) Fuzzy min–max neural network—part II: clustering. IEEE Trans Fuzzy Syst 1:32–45CrossRef
5.
Zurück zum Zitat Hu J, Yang J, Gao J (2007) An ordination-fuzzy min–max neural network classifier on unlabelled pattern classification. Pattern recognition and artificial intelligence, pp 173–179 Hu J, Yang J, Gao J (2007) An ordination-fuzzy min–max neural network classifier on unlabelled pattern classification. Pattern recognition and artificial intelligence, pp 173–179
6.
Zurück zum Zitat Simpson PK (1992) Fuzzy min–max neural network-part I: classification. IEEE Trans Neural Netw 3:776–786CrossRef Simpson PK (1992) Fuzzy min–max neural network-part I: classification. IEEE Trans Neural Netw 3:776–786CrossRef
7.
Zurück zum Zitat Alpern B, Carter L (1991) The hyperbox. In: IEEE conference on visualization, San Diego, CA, pp 133–139 Alpern B, Carter L (1991) The hyperbox. In: IEEE conference on visualization, San Diego, CA, pp 133–139
8.
Zurück zum Zitat Joshi A, Ramakrishman N, Houstis EN, Rice JR (1997) On neurobiological, neuro-fuzzy, machine learning, and statistical pattern recognition techniques. IEEE Trans Neural Netw 8:18–31CrossRef Joshi A, Ramakrishman N, Houstis EN, Rice JR (1997) On neurobiological, neuro-fuzzy, machine learning, and statistical pattern recognition techniques. IEEE Trans Neural Netw 8:18–31CrossRef
9.
Zurück zum Zitat Xi C, Dongming J, Zhijian L (2001) Recursive training for multi-resolution fuzzy min-max neural network classifier. In: 6th International conference on solid–state and integrated-circuit technology, Shanghai, China, pp 131–134 Xi C, Dongming J, Zhijian L (2001) Recursive training for multi-resolution fuzzy min-max neural network classifier. In: 6th International conference on solid–state and integrated-circuit technology, Shanghai, China, pp 131–134
10.
Zurück zum Zitat Gabrys B, Bargiela A (2000) General fuzzy min–max neural network for clustering and classification. IEEE Trans Neural Netw 11:769–783CrossRef Gabrys B, Bargiela A (2000) General fuzzy min–max neural network for clustering and classification. IEEE Trans Neural Netw 11:769–783CrossRef
11.
Zurück zum Zitat Mascioli FMF, Martinelli G (1998) A constructive approach to neurofuzzy networks. Sig Process 64:347–358CrossRefMATH Mascioli FMF, Martinelli G (1998) A constructive approach to neurofuzzy networks. Sig Process 64:347–358CrossRefMATH
12.
Zurück zum Zitat Abe S, Lan MS (1995) A method for fuzzy rules extraction directly from numerical data and its application to pattern classification. IEEE Trans Fuzzy Syst 3:18–28CrossRef Abe S, Lan MS (1995) A method for fuzzy rules extraction directly from numerical data and its application to pattern classification. IEEE Trans Fuzzy Syst 3:18–28CrossRef
13.
Zurück zum Zitat Meneganti M, Saviello FS, Tagliaferri R (1998) Fuzzy neural networks for classification and detection of anomalies. IEEE Trans Neural Netw 9:848–861CrossRef Meneganti M, Saviello FS, Tagliaferri R (1998) Fuzzy neural networks for classification and detection of anomalies. IEEE Trans Neural Netw 9:848–861CrossRef
14.
Zurück zum Zitat Rizzi A, Panella M, Mascioli FMF (2002) Adaptive resolution min–max classifiers. IEEE Trans Neural Netw 13:402–414CrossRef Rizzi A, Panella M, Mascioli FMF (2002) Adaptive resolution min–max classifiers. IEEE Trans Neural Netw 13:402–414CrossRef
15.
Zurück zum Zitat Rizzi A, Panella M, Mascioli FMF, Martinelli G (2000) A recursive algorithm for fuzzy min–max networks. In: International joint conference on neural networks, pp 541–546 Rizzi A, Panella M, Mascioli FMF, Martinelli G (2000) A recursive algorithm for fuzzy min–max networks. In: International joint conference on neural networks, pp 541–546
16.
Zurück zum Zitat Tagliaferri R, Eleuteri A, Meneganti M, Barone F (2001) Fuzzy min–max neural networks: from classification to regression. Soft Comput 5:69–76CrossRef Tagliaferri R, Eleuteri A, Meneganti M, Barone F (2001) Fuzzy min–max neural networks: from classification to regression. Soft Comput 5:69–76CrossRef
17.
Zurück zum Zitat Quteishat A, Lim CP, Tan KS (2010) A modified fuzzy min–max neural network with a genetic-algorithm-based rule extractor for pattern classification. IEEE Trans Syst Man Cybern Part A Syst Humans 40:641–650CrossRefMATH Quteishat A, Lim CP, Tan KS (2010) A modified fuzzy min–max neural network with a genetic-algorithm-based rule extractor for pattern classification. IEEE Trans Syst Man Cybern Part A Syst Humans 40:641–650CrossRefMATH
18.
Zurück zum Zitat Quteishat A, Lim CP (2008) A modified fuzzy min–max neural network with rule extraction and its application to fault detection and classification. Appl Soft Comput 8:985–995CrossRef Quteishat A, Lim CP (2008) A modified fuzzy min–max neural network with rule extraction and its application to fault detection and classification. Appl Soft Comput 8:985–995CrossRef
19.
Zurück zum Zitat Bargiela A, Pedrycz W, Tanaka M (2003) Exclusion/inclusion fuzzy classification network. In: Palade V, Howlett R, Jain L (eds) Knowledge-based intelligent information and engineering systems, vol 2773. Springer, Berlin, pp 1236–1241 Bargiela A, Pedrycz W, Tanaka M (2003) Exclusion/inclusion fuzzy classification network. In: Palade V, Howlett R, Jain L (eds) Knowledge-based intelligent information and engineering systems, vol 2773. Springer, Berlin, pp 1236–1241
20.
Zurück zum Zitat Bargiela A, Pedrycz W, Tanaka H (2004) An inclusion/exclusion fuzzy hyperbox classifier. Int J Knowl Based Intell Eng Syst 8:91–98 Bargiela A, Pedrycz W, Tanaka H (2004) An inclusion/exclusion fuzzy hyperbox classifier. Int J Knowl Based Intell Eng Syst 8:91–98
21.
Zurück zum Zitat Bargiela A, Tanaka M, Castellano G, Fanelli AM (2004) Adaptation of exclusion/inclusion hyperboxes for classification of complex data. In: 5th Asia Pacific industrial engineering and management systems conference. Brisbane, Australia Bargiela A, Tanaka M, Castellano G, Fanelli AM (2004) Adaptation of exclusion/inclusion hyperboxes for classification of complex data. In: 5th Asia Pacific industrial engineering and management systems conference. Brisbane, Australia
22.
Zurück zum Zitat Nandedkar AV, Biswas PK (2007) A fuzzy min–max neural network classifier with compensatory neuron architecture. IEEE Trans Neural Netw 18:42–54CrossRef Nandedkar AV, Biswas PK (2007) A fuzzy min–max neural network classifier with compensatory neuron architecture. IEEE Trans Neural Netw 18:42–54CrossRef
23.
Zurück zum Zitat Nandedkar AV, Biswas PK (2009) A granular reflex fuzzy min–max neural network for classification. IEEE Trans Neural Netw 20:1117–1134CrossRef Nandedkar AV, Biswas PK (2009) A granular reflex fuzzy min–max neural network for classification. IEEE Trans Neural Netw 20:1117–1134CrossRef
24.
Zurück zum Zitat Rey-del-Castillo P, Cardeñosa J (2012) Fuzzy min–max neural networks for categorical data: application to missing data imputation. Neural Comput Appl 21:1349–1362CrossRef Rey-del-Castillo P, Cardeñosa J (2012) Fuzzy min–max neural networks for categorical data: application to missing data imputation. Neural Comput Appl 21:1349–1362CrossRef
25.
Zurück zum Zitat Vapnik VN (1995) The nature of statistical learning theory. Springer, New YorkCrossRef Vapnik VN (1995) The nature of statistical learning theory. Springer, New YorkCrossRef
26.
Zurück zum Zitat Vapnik VN (1998) Statistical learning theory. Wiley, New YorkMATH Vapnik VN (1998) Statistical learning theory. Wiley, New YorkMATH
27.
Zurück zum Zitat Zhang H, Liu J, Ma D, Wang Z (2011) Data-core-based fuzzy min–max neural network for pattern classification. IEEE Trans Neural Netw Part 2 22:2339–2352CrossRefMATH Zhang H, Liu J, Ma D, Wang Z (2011) Data-core-based fuzzy min–max neural network for pattern classification. IEEE Trans Neural Netw Part 2 22:2339–2352CrossRefMATH
28.
Zurück zum Zitat Ma D, Liu J, Wang Z (2012) The pattern classification based on fuzzy min–max neural network with new algorithm. In: Wang J, Yen G, Polycarpou M (eds) Advances in neural networks—ISNN 2012, vol 7368. Springer, Berlin, pp 1–9 Ma D, Liu J, Wang Z (2012) The pattern classification based on fuzzy min–max neural network with new algorithm. In: Wang J, Yen G, Polycarpou M (eds) Advances in neural networks—ISNN 2012, vol 7368. Springer, Berlin, pp 1–9
29.
Zurück zum Zitat Bazara MS, Sherali HD, Shetty CM (2006) Nonlinear programming, 3rd edn. Willey, New York Bazara MS, Sherali HD, Shetty CM (2006) Nonlinear programming, 3rd edn. Willey, New York
31.
Zurück zum Zitat Loh WY, Shih YS (1997) Split selection methods for classification trees. Stat Sinica 7:815–840MathSciNet Loh WY, Shih YS (1997) Split selection methods for classification trees. Stat Sinica 7:815–840MathSciNet
32.
Zurück zum Zitat Hong ZQ, Yang JY (1991) Optimal discriminant plane for a small number of samples and design method of classifier on the plane. Pattern Recogn 24:317–324MathSciNetCrossRef Hong ZQ, Yang JY (1991) Optimal discriminant plane for a small number of samples and design method of classifier on the plane. Pattern Recogn 24:317–324MathSciNetCrossRef
33.
Zurück zum Zitat Detrano R, Janosi A, Steinbrunn W, Pfisterer M, Schmid J, Sandhu S, et al (1989) International application of a new probability algorithm for the diagnosis of coronary artery disease. Am J Cardiol 64:304–310 Detrano R, Janosi A, Steinbrunn W, Pfisterer M, Schmid J, Sandhu S, et al (1989) International application of a new probability algorithm for the diagnosis of coronary artery disease. Am J Cardiol 64:304–310
34.
Zurück zum Zitat Fisher RA (1936) The use of multiple measurements in taxonomic problems. Ann Eugen 7:179–188CrossRef Fisher RA (1936) The use of multiple measurements in taxonomic problems. Ann Eugen 7:179–188CrossRef
35.
Zurück zum Zitat Jossinet J (1996) Variability of impedivity in normal and pathological breast tissue. Med Biol Eng Comput 34:346–350CrossRef Jossinet J (1996) Variability of impedivity in normal and pathological breast tissue. Med Biol Eng Comput 34:346–350CrossRef
36.
Zurück zum Zitat Bareiss ER, Porter B (1987) Protos: an exemplar-based learning apprentice. In: 4th International workshop on machine learning. CA, Irvine, pp 12–23 Bareiss ER, Porter B (1987) Protos: an exemplar-based learning apprentice. In: 4th International workshop on machine learning. CA, Irvine, pp 12–23
37.
Zurück zum Zitat Wolberg WH, Street WN, Heisey DN, Mangasarian OL (1995) Computerized breast cancer diagnosis and prognosis from fine-needle aspirates. Arch Surg 130:511–516CrossRef Wolberg WH, Street WN, Heisey DN, Mangasarian OL (1995) Computerized breast cancer diagnosis and prognosis from fine-needle aspirates. Arch Surg 130:511–516CrossRef
38.
Zurück zum Zitat Cendrowska J (1987) PRISM: an algorithm for inducing modular rules. Int J Man Mach Stud 27:349–370CrossRef Cendrowska J (1987) PRISM: an algorithm for inducing modular rules. Int J Man Mach Stud 27:349–370CrossRef
39.
Zurück zum Zitat Woolery L, Grzymala-Busse J, Summers S, Budihardjo A (1991) The use of machine learning program LERS\_LB 2.5 in knowledge acquisition for expert system development in nursing. Comput Nurs 9:227–234MATH Woolery L, Grzymala-Busse J, Summers S, Budihardjo A (1991) The use of machine learning program LERS\_LB 2.5 in knowledge acquisition for expert system development in nursing. Comput Nurs 9:227–234MATH
40.
Zurück zum Zitat Gorman RP, Sejnowski TJ (1988) Analysis of hidden units in a layered network trained to classify sonar targets. Neural Netw 1:75–89CrossRef Gorman RP, Sejnowski TJ (1988) Analysis of hidden units in a layered network trained to classify sonar targets. Neural Netw 1:75–89CrossRef
Metadaten
Titel
Fuzzy Min–Max Neural Network for Learning a Classifier with Symmetric Margin
verfasst von
Yahya Forghani
Hadi Sadoghi Yazdi
Publikationsdatum
01.10.2015
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 2/2015
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-014-9359-4

Weitere Artikel der Ausgabe 2/2015

Neural Processing Letters 2/2015 Zur Ausgabe

Neuer Inhalt