Skip to main content
Erschienen in: Soft Computing 12/2019

30.08.2018 | Methodologies and Application

AFCGD: an adaptive fuzzy classifier based on gradient descent

verfasst von: Homeira Shahparast, Eghbal G. Mansoori, Mansoor Zolghadri Jahromi

Erschienen in: Soft Computing | Ausgabe 12/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In traditional fuzzy classification systems, learning is done from a stationary data distribution. In online rule learning, however, data are non-stationary and change dynamically over time. It confronts the learning process with some new challenges including concept drift. Evolving fuzzy schemes are common solutions in this field which try to handle these issues by in-time modification of their structures. In this regard, a basic challenge is how to apply a fast and simple scheme to modify the rule-base regarding each new sample. This paper introduces an efficient adaptive mechanism named adaptive fuzzy classifier based on gradient descent (AFCGD) for online learning of an evolving fuzzy model. We derive online rule update formulas for modification of the classifier’s structure regarding the concept of data to minimize the misclassification error through gradient descent. The updating formulas, which are computationally cheap, allow AFCGD to adjust the rule-base after emergence of new incoming sample. Therefore, it always remains up-to-date and can handle any alteration in the concept of data. AFCGD has simple structure to build; thus, it is so effective in memory usage and computational time. The efficacy of our proposed algorithm has been assessed by some synthetic data and several real-world benchmark problems while comparing with some recent evolving and state-of-the-art classifiers. The proposed method achieves comparable and even better results against other fuzzy and non-fuzzy classifiers in terms of accuracy and run-time.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Almaksour A, Anquetil E (2010) Improving premise structure in evolving Takagi–Sugeno neuro-fuzzy classifiers. In: Ninth international conference on machine learning and applications (ICMLA), Washington, DC, USA, pp 25–33 Almaksour A, Anquetil E (2010) Improving premise structure in evolving Takagi–Sugeno neuro-fuzzy classifiers. In: Ninth international conference on machine learning and applications (ICMLA), Washington, DC, USA, pp 25–33
Zurück zum Zitat Amin F, Fahmi A, Abdullah S, Ali A, Ahmad R, Ghani F (2018) Triangular cubic linguistic hesitant fuzzy aggregation operators and their application in group decision making. J Intell Fuzzy Syst 34:2401–2416CrossRef Amin F, Fahmi A, Abdullah S, Ali A, Ahmad R, Ghani F (2018) Triangular cubic linguistic hesitant fuzzy aggregation operators and their application in group decision making. J Intell Fuzzy Syst 34:2401–2416CrossRef
Zurück zum Zitat Angelov P (2010) Evolving Takagi–Sugeno fuzzy systems from data streams (eTS+). In: Angelov P, Filev DP, Kasabov N (eds) Evolving intelligent systems: methodology and applications. IEEE Press series in Computational Intelligence, Wiley and IEEE Press, New York, USA, pp 21–50 Angelov P (2010) Evolving Takagi–Sugeno fuzzy systems from data streams (eTS+). In: Angelov P, Filev DP, Kasabov N (eds) Evolving intelligent systems: methodology and applications. IEEE Press series in Computational Intelligence, Wiley and IEEE Press, New York, USA, pp 21–50
Zurück zum Zitat Angelov P (2012) Autonomous learning systems from data streams to knowledge in real time. Wiley, West SussexCrossRef Angelov P (2012) Autonomous learning systems from data streams to knowledge in real time. Wiley, West SussexCrossRef
Zurück zum Zitat Angelov PP, Filev D (2004) An approach to online identification of Takagi–Sugeno fuzzy models. IEEE Trans Syst Man Cybern Part B Cybern 34(1):484–498CrossRef Angelov PP, Filev D (2004) An approach to online identification of Takagi–Sugeno fuzzy models. IEEE Trans Syst Man Cybern Part B Cybern 34(1):484–498CrossRef
Zurück zum Zitat Angelov PP, Filev D (2005) Simpl_eTS: a simplified method for learning evolving Takagi–Sugeno fuzzy models. IEEE, Reno Angelov PP, Filev D (2005) Simpl_eTS: a simplified method for learning evolving Takagi–Sugeno fuzzy models. IEEE, Reno
Zurück zum Zitat Angelov Filev DP, Kasabov N (2010) Evolving intelligent systems: methodology and applications. Wiley-IEEE Press, New YorkCrossRef Angelov Filev DP, Kasabov N (2010) Evolving intelligent systems: methodology and applications. Wiley-IEEE Press, New YorkCrossRef
Zurück zum Zitat Angelov PP, Zhou X (2008) Evolving fuzzy-rule-based classifiers from data streams. IEEE Trans Fuzzy Syst 16(6):1462–1475CrossRef Angelov PP, Zhou X (2008) Evolving fuzzy-rule-based classifiers from data streams. IEEE Trans Fuzzy Syst 16(6):1462–1475CrossRef
Zurück zum Zitat Bifet A, Holmes G, Kirkby R, Pfahringer B (2010) MOA: massive online analysis. J Mach Learn Res 99:1601–1604 Bifet A, Holmes G, Kirkby R, Pfahringer B (2010) MOA: massive online analysis. J Mach Learn Res 99:1601–1604
Zurück zum Zitat Bouchachia A, Mittermeir R (2007) Towards incremental fuzzy classifiers. Soft Comput 11(2):193–207CrossRef Bouchachia A, Mittermeir R (2007) Towards incremental fuzzy classifiers. Soft Comput 11(2):193–207CrossRef
Zurück zum Zitat Chen Z, Liu B (2016) Lifelong machine learning. Morgan & Claypool Publishers, San RafaelCrossRef Chen Z, Liu B (2016) Lifelong machine learning. Morgan & Claypool Publishers, San RafaelCrossRef
Zurück zum Zitat Chiu SL (1994) Fuzzy model identification based on cluster estimation. J Intell Fuzzy Syst 2(3):267–278 Chiu SL (1994) Fuzzy model identification based on cluster estimation. J Intell Fuzzy Syst 2(3):267–278
Zurück zum Zitat Elton L, Gomide F, Ballini R (2006) Participatory evolving fuzzy modeling. In: International symposium on evolving fuzzy systems, Ambleside, UK, pp 36–41 Elton L, Gomide F, Ballini R (2006) Participatory evolving fuzzy modeling. In: International symposium on evolving fuzzy systems, Ambleside, UK, pp 36–41
Zurück zum Zitat Esmaeilpour M, Mohammadi ARA (2016) Analyzing the EEG signals in order to estimate the depth of anesthesia using wavelet and fuzzy neural networks. Int J Interact Multimed Artif Intell 4(2):12–15 Esmaeilpour M, Mohammadi ARA (2016) Analyzing the EEG signals in order to estimate the depth of anesthesia using wavelet and fuzzy neural networks. Int J Interact Multimed Artif Intell 4(2):12–15
Zurück zum Zitat Fahmi A, Abdullah S, Amin F, Siddiqui N, Ali A (2017) Aggregation operators on triangular cubic fuzzy numbers and its application to multi-criteria decision making problems. J Intell Fuzzy Syst 33:3323–3337CrossRef Fahmi A, Abdullah S, Amin F, Siddiqui N, Ali A (2017) Aggregation operators on triangular cubic fuzzy numbers and its application to multi-criteria decision making problems. J Intell Fuzzy Syst 33:3323–3337CrossRef
Zurück zum Zitat Fahmi A, Abdullah S, Amin F, Ali A (2018) Weighted average rating (war) method for solving group decision making problem using triangular cubic fuzzy hybrid aggregation (TCFHA). Punjab Univ J Math 50(1):23–34MathSciNet Fahmi A, Abdullah S, Amin F, Ali A (2018) Weighted average rating (war) method for solving group decision making problem using triangular cubic fuzzy hybrid aggregation (TCFHA). Punjab Univ J Math 50(1):23–34MathSciNet
Zurück zum Zitat Fakhrahmad SM, Zolghadri Jahromi M (2009) A new rule-weight learning method based on gradient descent. In: Proceedings of the world congress on engineering, London, UK, pp 1–3 Fakhrahmad SM, Zolghadri Jahromi M (2009) A new rule-weight learning method based on gradient descent. In: Proceedings of the world congress on engineering, London, UK, pp 1–3
Zurück zum Zitat Gama J (2011) Knowledge discovery from data streams, 1st edn. Chapman and Hall/CRC, LondonMATH Gama J (2011) Knowledge discovery from data streams, 1st edn. Chapman and Hall/CRC, LondonMATH
Zurück zum Zitat Gama J, Medas P, Castillo G, Rodrigues P (2004) Learning with drift detection. In: SBIA Brazilian symposium on artificial intelligence, pp 286–295 Gama J, Medas P, Castillo G, Rodrigues P (2004) Learning with drift detection. In: SBIA Brazilian symposium on artificial intelligence, pp 286–295
Zurück zum Zitat Hamzeloo S, Zolghadri Jahromi M (2017) An incremental fuzzy controller for large dec-POMDPs. In: Artificial intelligence and signal processing conference (AISP), Shiraz, Iran Hamzeloo S, Zolghadri Jahromi M (2017) An incremental fuzzy controller for large dec-POMDPs. In: Artificial intelligence and signal processing conference (AISP), Shiraz, Iran
Zurück zum Zitat Harries M (1999) Splice-2 comparative evaluation: electricity pricing. Technical report, The University of South Wales Harries M (1999) Splice-2 comparative evaluation: electricity pricing. Technical report, The University of South Wales
Zurück zum Zitat Haykin S (1999) Neural networks: a comprehensive foundation, 2nd edn. Prentice-Hall, Upper Saddle RiverMATH Haykin S (1999) Neural networks: a comprehensive foundation, 2nd edn. Prentice-Hall, Upper Saddle RiverMATH
Zurück zum Zitat Hulten G, Spencer L, Domingos P (2001) Mining time-changing data streams. In: Proceedings of the seventh ACM SIGKDD international conference on knowledge discovery and data mining (KDD-2001), San Francisco, CA, pp 97–106 Hulten G, Spencer L, Domingos P (2001) Mining time-changing data streams. In: Proceedings of the seventh ACM SIGKDD international conference on knowledge discovery and data mining (KDD-2001), San Francisco, CA, pp 97–106
Zurück zum Zitat Juang C-F, Tsao Y-W (2008) A self-evolving interval type-2 fuzzy neural network with on-line structure and parameter learning. IEEE Trans Fuzzy Syst 16(6):1411–1424CrossRef Juang C-F, Tsao Y-W (2008) A self-evolving interval type-2 fuzzy neural network with on-line structure and parameter learning. IEEE Trans Fuzzy Syst 16(6):1411–1424CrossRef
Zurück zum Zitat Kasabov N (2001) Evolving fuzzy neural networks for supervised/unsupervised online knowledge-based learning. IEEE Trans Syst Man Cybern Part B Cybern 31(6):902–918CrossRef Kasabov N (2001) Evolving fuzzy neural networks for supervised/unsupervised online knowledge-based learning. IEEE Trans Syst Man Cybern Part B Cybern 31(6):902–918CrossRef
Zurück zum Zitat Kasabov N, Song Q (2002) DENFIS: dynamic evolving neural-fuzzy inference system and its application for time-series prediction. IEEE Trans Fuzzy Syst 10(2):144–154CrossRef Kasabov N, Song Q (2002) DENFIS: dynamic evolving neural-fuzzy inference system and its application for time-series prediction. IEEE Trans Fuzzy Syst 10(2):144–154CrossRef
Zurück zum Zitat Katakis I, Tsoumakas G, Banos E, Bassiliades N, Vlahavas I (2009) An adaptive personalized news dissemination system. J Intell Inf Syst 32(2):191–212CrossRef Katakis I, Tsoumakas G, Banos E, Bassiliades N, Vlahavas I (2009) An adaptive personalized news dissemination system. J Intell Inf Syst 32(2):191–212CrossRef
Zurück zum Zitat Liang N, Huang G, Saratchandran P, Sun N (2006) A fast and accurate on-line sequential learning algorithm for feedforward networks. IEEE Trans Neural Netw 17(6):1411–1423CrossRef Liang N, Huang G, Saratchandran P, Sun N (2006) A fast and accurate on-line sequential learning algorithm for feedforward networks. IEEE Trans Neural Netw 17(6):1411–1423CrossRef
Zurück zum Zitat Lima E, Hell M, Ballini R, Gomide F (2010) Evolving fuzzy modeling using participatory learning. In: Angelov P, Filev DP, Kasabov N (eds) Evolving intelligent systems: methodology and applications. Wiley, New York Lima E, Hell M, Ballini R, Gomide F (2010) Evolving fuzzy modeling using participatory learning. In: Angelov P, Filev DP, Kasabov N (eds) Evolving intelligent systems: methodology and applications. Wiley, New York
Zurück zum Zitat Lughofer E (2008a) Extensions of vector quantization for incremental clustering. Pattern Recognit 41(3):995–1011CrossRefMATH Lughofer E (2008a) Extensions of vector quantization for incremental clustering. Pattern Recognit 41(3):995–1011CrossRefMATH
Zurück zum Zitat Lughofer E (2008b) FLEXFIS: a robust incremental learning approach for evolving Takagi–Sugeno fuzzy models. IEEE Trans Fuzzy Syst 16(6):1393–1410CrossRef Lughofer E (2008b) FLEXFIS: a robust incremental learning approach for evolving Takagi–Sugeno fuzzy models. IEEE Trans Fuzzy Syst 16(6):1393–1410CrossRef
Zurück zum Zitat Lughofer E (2011) Evolving fuzzy systems—methodologies, advanced concepts and applications. Springer, BerlinCrossRefMATH Lughofer E (2011) Evolving fuzzy systems—methodologies, advanced concepts and applications. Springer, BerlinCrossRefMATH
Zurück zum Zitat Lughofer E, Angelov PP (2011) Handling drifts and shifts in on-line data streams with evolving fuzzy systems. Appl Soft Comput 11(2):2057–2068CrossRef Lughofer E, Angelov PP (2011) Handling drifts and shifts in on-line data streams with evolving fuzzy systems. Appl Soft Comput 11(2):2057–2068CrossRef
Zurück zum Zitat Maciel L, Gomide F, Ballini R (2014) Enhanced evolving participatory learning fuzzy modeling: an application for asset returns volatility forecasting. Evol Syst 5(2):75–88CrossRef Maciel L, Gomide F, Ballini R (2014) Enhanced evolving participatory learning fuzzy modeling: an application for asset returns volatility forecasting. Evol Syst 5(2):75–88CrossRef
Zurück zum Zitat Mansoori G (2014) GACH: a grid-based algorithm for hierarchical clustering of high-dimensional data. Soft Comput 18(5):905–922CrossRef Mansoori G (2014) GACH: a grid-based algorithm for hierarchical clustering of high-dimensional data. Soft Comput 18(5):905–922CrossRef
Zurück zum Zitat Mansoori EG, Zolghadri MJ, Katebi SD (2008) SGERD: a steady-state genetic algorithm for extracting fuzzy classification rules from data. IEEE Trans Fuzzy Syst 16(4):1061–1071CrossRef Mansoori EG, Zolghadri MJ, Katebi SD (2008) SGERD: a steady-state genetic algorithm for extracting fuzzy classification rules from data. IEEE Trans Fuzzy Syst 16(4):1061–1071CrossRef
Zurück zum Zitat Minku LL, Yao X (2012) DDD: a new ensemble approach for dealing with drifts. IEEE Trans Knowl Data Eng 24(4):619–633CrossRef Minku LL, Yao X (2012) DDD: a new ensemble approach for dealing with drifts. IEEE Trans Knowl Data Eng 24(4):619–633CrossRef
Zurück zum Zitat Minku LL, White AP, Yao X (2010) The impact of diversity on online ensemble learning in the presence concept of drift. IEEE Trans Knowl Data Eng 22(5):730–742CrossRef Minku LL, White AP, Yao X (2010) The impact of diversity on online ensemble learning in the presence concept of drift. IEEE Trans Knowl Data Eng 22(5):730–742CrossRef
Zurück zum Zitat Pelossof R, Jones M, Vovsha I, Rudin C (2010) Online coordinate boosting. In: 2009 IEEE 12th international conference on computer vision workshops (ICCV Workshops), Kyoto, Japan Pelossof R, Jones M, Vovsha I, Rudin C (2010) Online coordinate boosting. In: 2009 IEEE 12th international conference on computer vision workshops (ICCV Workshops), Kyoto, Japan
Zurück zum Zitat Pratama M, Anavatti SG, Lughofer E (2014) GENEFIS: toward an effective localist network. IEEE Trans Fuzzy Syst 22(3):547–562CrossRef Pratama M, Anavatti SG, Lughofer E (2014) GENEFIS: toward an effective localist network. IEEE Trans Fuzzy Syst 22(3):547–562CrossRef
Zurück zum Zitat Pratama M, Anavatti SG, Joo M, Lughofer E (2015) pClass: an effective classifier for streaming examples. IEEE Trans Fuzzy Syst 23(2):369–386CrossRef Pratama M, Anavatti SG, Joo M, Lughofer E (2015) pClass: an effective classifier for streaming examples. IEEE Trans Fuzzy Syst 23(2):369–386CrossRef
Zurück zum Zitat Rubio JDJ (2010) Stability analysis for an on-line evolving neuro-fuzzy recurrent network. In: Angelov P, Filev D, Kasabov N (eds) Evolving intelligent systems: methodology and applications. Wiley, New York Rubio JDJ (2010) Stability analysis for an on-line evolving neuro-fuzzy recurrent network. In: Angelov P, Filev D, Kasabov N (eds) Evolving intelligent systems: methodology and applications. Wiley, New York
Zurück zum Zitat Shahparast H, Mansoori EG (2017) FERHD: a feasible approach for extracting fuzzy classification rules from high-dimensional data. Intell Data Anal 21(1):63–75CrossRef Shahparast H, Mansoori EG (2017) FERHD: a feasible approach for extracting fuzzy classification rules from high-dimensional data. Intell Data Anal 21(1):63–75CrossRef
Zurück zum Zitat Shahparast H, Hamzeloo S, Zolghadri Jahromi M (2014) A self-tuning fuzzy rule-based classifier for data streams. Int J Uncertain Fuzziness Knowl Based Syst 22(2):293–304CrossRefMATH Shahparast H, Hamzeloo S, Zolghadri Jahromi M (2014) A self-tuning fuzzy rule-based classifier for data streams. Int J Uncertain Fuzziness Knowl Based Syst 22(2):293–304CrossRefMATH
Zurück zum Zitat Shaker A, Senge R, Hüllermeier E (2013) Evolving fuzzy pattern trees for binary classification on data streams. Inf Sci 220:34–45CrossRef Shaker A, Senge R, Hüllermeier E (2013) Evolving fuzzy pattern trees for binary classification on data streams. Inf Sci 220:34–45CrossRef
Zurück zum Zitat Shalev-Shwartz S, Singer Y, Srebro N, Cotter A (2011) Pegasos: primal estimated sub-GrAdient SOlver for SVM. Math Program 127(1):3–30MathSciNetCrossRefMATH Shalev-Shwartz S, Singer Y, Srebro N, Cotter A (2011) Pegasos: primal estimated sub-GrAdient SOlver for SVM. Math Program 127(1):3–30MathSciNetCrossRefMATH
Zurück zum Zitat Street N, Kim Y (2001) A streaming ensemble algorithm SEA for largescale classification. In: Proceedings of the seventh ACM SIGKDD international conference on knowledge discovery and data mining, pp 377–382 Street N, Kim Y (2001) A streaming ensemble algorithm SEA for largescale classification. In: Proceedings of the seventh ACM SIGKDD international conference on knowledge discovery and data mining, pp 377–382
Zurück zum Zitat Sugeno M, Takagi T (1983) Multi-dimensional fuzzy reasoning. Fuzzy Sets Syst 9(1–3):313–325CrossRefMATH Sugeno M, Takagi T (1983) Multi-dimensional fuzzy reasoning. Fuzzy Sets Syst 9(1–3):313–325CrossRefMATH
Zurück zum Zitat Suresh S, Dong K, Kim HJ (2010) A sequential learning algorithm for self-adaptive resource allocation network classifier. Neurocomputing 73(16–18):3012–3019CrossRef Suresh S, Dong K, Kim HJ (2010) A sequential learning algorithm for self-adaptive resource allocation network classifier. Neurocomputing 73(16–18):3012–3019CrossRef
Zurück zum Zitat Vigdor B, Lerner B (2007) The Bayesian ARTMAP. IEEE Trans Neural Netw 18(6):1628–1644CrossRef Vigdor B, Lerner B (2007) The Bayesian ARTMAP. IEEE Trans Neural Netw 18(6):1628–1644CrossRef
Zurück zum Zitat Wang H, Fan W, Yu PS, Han J (2003) Mining concept-drifting data streams using ensemble classifiers. In: 9th ACM international conference on knowledge discovery and data mining (SIGKDD), Washington DC, USA Wang H, Fan W, Yu PS, Han J (2003) Mining concept-drifting data streams using ensemble classifiers. In: 9th ACM international conference on knowledge discovery and data mining (SIGKDD), Washington DC, USA
Zurück zum Zitat Widmer G, Kubat M (1996) Learning in the presence of concept drift and hidden contexts. Mach Learn 23(1):69–101 Widmer G, Kubat M (1996) Learning in the presence of concept drift and hidden contexts. Mach Learn 23(1):69–101
Zurück zum Zitat Zhang K, Fan W, Yuan X, Davidson I, Li X (2006) Forecasting skewed biased stochastic ozone days: analyses and solutions. In: ICDM ‘06 proceedings of the sixth international conference on data mining, pp 753–764 Zhang K, Fan W, Yuan X, Davidson I, Li X (2006) Forecasting skewed biased stochastic ozone days: analyses and solutions. In: ICDM ‘06 proceedings of the sixth international conference on data mining, pp 753–764
Zurück zum Zitat Zliobaite I, Bifet A, Holmes G, Pfahringer B (2011) MOA concept drift active learning strategies for streaming data. In: 2nd Workshop on applications of pattern analysis, pp 48–55 Zliobaite I, Bifet A, Holmes G, Pfahringer B (2011) MOA concept drift active learning strategies for streaming data. In: 2nd Workshop on applications of pattern analysis, pp 48–55
Metadaten
Titel
AFCGD: an adaptive fuzzy classifier based on gradient descent
verfasst von
Homeira Shahparast
Eghbal G. Mansoori
Mansoor Zolghadri Jahromi
Publikationsdatum
30.08.2018
Verlag
Springer Berlin Heidelberg
Erschienen in
Soft Computing / Ausgabe 12/2019
Print ISSN: 1432-7643
Elektronische ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-018-3485-2

Weitere Artikel der Ausgabe 12/2019

Soft Computing 12/2019 Zur Ausgabe