Skip to main content
Top
Published in: Soft Computing 12/2019

30-08-2018 | Methodologies and Application

AFCGD: an adaptive fuzzy classifier based on gradient descent

Authors: Homeira Shahparast, Eghbal G. Mansoori, Mansoor Zolghadri Jahromi

Published in: Soft Computing | Issue 12/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In traditional fuzzy classification systems, learning is done from a stationary data distribution. In online rule learning, however, data are non-stationary and change dynamically over time. It confronts the learning process with some new challenges including concept drift. Evolving fuzzy schemes are common solutions in this field which try to handle these issues by in-time modification of their structures. In this regard, a basic challenge is how to apply a fast and simple scheme to modify the rule-base regarding each new sample. This paper introduces an efficient adaptive mechanism named adaptive fuzzy classifier based on gradient descent (AFCGD) for online learning of an evolving fuzzy model. We derive online rule update formulas for modification of the classifier’s structure regarding the concept of data to minimize the misclassification error through gradient descent. The updating formulas, which are computationally cheap, allow AFCGD to adjust the rule-base after emergence of new incoming sample. Therefore, it always remains up-to-date and can handle any alteration in the concept of data. AFCGD has simple structure to build; thus, it is so effective in memory usage and computational time. The efficacy of our proposed algorithm has been assessed by some synthetic data and several real-world benchmark problems while comparing with some recent evolving and state-of-the-art classifiers. The proposed method achieves comparable and even better results against other fuzzy and non-fuzzy classifiers in terms of accuracy and run-time.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Almaksour A, Anquetil E (2010) Improving premise structure in evolving Takagi–Sugeno neuro-fuzzy classifiers. In: Ninth international conference on machine learning and applications (ICMLA), Washington, DC, USA, pp 25–33 Almaksour A, Anquetil E (2010) Improving premise structure in evolving Takagi–Sugeno neuro-fuzzy classifiers. In: Ninth international conference on machine learning and applications (ICMLA), Washington, DC, USA, pp 25–33
go back to reference Amin F, Fahmi A, Abdullah S, Ali A, Ahmad R, Ghani F (2018) Triangular cubic linguistic hesitant fuzzy aggregation operators and their application in group decision making. J Intell Fuzzy Syst 34:2401–2416CrossRef Amin F, Fahmi A, Abdullah S, Ali A, Ahmad R, Ghani F (2018) Triangular cubic linguistic hesitant fuzzy aggregation operators and their application in group decision making. J Intell Fuzzy Syst 34:2401–2416CrossRef
go back to reference Angelov P (2010) Evolving Takagi–Sugeno fuzzy systems from data streams (eTS+). In: Angelov P, Filev DP, Kasabov N (eds) Evolving intelligent systems: methodology and applications. IEEE Press series in Computational Intelligence, Wiley and IEEE Press, New York, USA, pp 21–50 Angelov P (2010) Evolving Takagi–Sugeno fuzzy systems from data streams (eTS+). In: Angelov P, Filev DP, Kasabov N (eds) Evolving intelligent systems: methodology and applications. IEEE Press series in Computational Intelligence, Wiley and IEEE Press, New York, USA, pp 21–50
go back to reference Angelov P (2012) Autonomous learning systems from data streams to knowledge in real time. Wiley, West SussexCrossRef Angelov P (2012) Autonomous learning systems from data streams to knowledge in real time. Wiley, West SussexCrossRef
go back to reference Angelov PP, Filev D (2004) An approach to online identification of Takagi–Sugeno fuzzy models. IEEE Trans Syst Man Cybern Part B Cybern 34(1):484–498CrossRef Angelov PP, Filev D (2004) An approach to online identification of Takagi–Sugeno fuzzy models. IEEE Trans Syst Man Cybern Part B Cybern 34(1):484–498CrossRef
go back to reference Angelov PP, Filev D (2005) Simpl_eTS: a simplified method for learning evolving Takagi–Sugeno fuzzy models. IEEE, Reno Angelov PP, Filev D (2005) Simpl_eTS: a simplified method for learning evolving Takagi–Sugeno fuzzy models. IEEE, Reno
go back to reference Angelov Filev DP, Kasabov N (2010) Evolving intelligent systems: methodology and applications. Wiley-IEEE Press, New YorkCrossRef Angelov Filev DP, Kasabov N (2010) Evolving intelligent systems: methodology and applications. Wiley-IEEE Press, New YorkCrossRef
go back to reference Angelov PP, Zhou X (2008) Evolving fuzzy-rule-based classifiers from data streams. IEEE Trans Fuzzy Syst 16(6):1462–1475CrossRef Angelov PP, Zhou X (2008) Evolving fuzzy-rule-based classifiers from data streams. IEEE Trans Fuzzy Syst 16(6):1462–1475CrossRef
go back to reference Bifet A, Holmes G, Kirkby R, Pfahringer B (2010) MOA: massive online analysis. J Mach Learn Res 99:1601–1604 Bifet A, Holmes G, Kirkby R, Pfahringer B (2010) MOA: massive online analysis. J Mach Learn Res 99:1601–1604
go back to reference Bouchachia A, Mittermeir R (2007) Towards incremental fuzzy classifiers. Soft Comput 11(2):193–207CrossRef Bouchachia A, Mittermeir R (2007) Towards incremental fuzzy classifiers. Soft Comput 11(2):193–207CrossRef
go back to reference Chen Z, Liu B (2016) Lifelong machine learning. Morgan & Claypool Publishers, San RafaelCrossRef Chen Z, Liu B (2016) Lifelong machine learning. Morgan & Claypool Publishers, San RafaelCrossRef
go back to reference Chiu SL (1994) Fuzzy model identification based on cluster estimation. J Intell Fuzzy Syst 2(3):267–278 Chiu SL (1994) Fuzzy model identification based on cluster estimation. J Intell Fuzzy Syst 2(3):267–278
go back to reference Elton L, Gomide F, Ballini R (2006) Participatory evolving fuzzy modeling. In: International symposium on evolving fuzzy systems, Ambleside, UK, pp 36–41 Elton L, Gomide F, Ballini R (2006) Participatory evolving fuzzy modeling. In: International symposium on evolving fuzzy systems, Ambleside, UK, pp 36–41
go back to reference Esmaeilpour M, Mohammadi ARA (2016) Analyzing the EEG signals in order to estimate the depth of anesthesia using wavelet and fuzzy neural networks. Int J Interact Multimed Artif Intell 4(2):12–15 Esmaeilpour M, Mohammadi ARA (2016) Analyzing the EEG signals in order to estimate the depth of anesthesia using wavelet and fuzzy neural networks. Int J Interact Multimed Artif Intell 4(2):12–15
go back to reference Fahmi A, Abdullah S, Amin F, Siddiqui N, Ali A (2017) Aggregation operators on triangular cubic fuzzy numbers and its application to multi-criteria decision making problems. J Intell Fuzzy Syst 33:3323–3337CrossRef Fahmi A, Abdullah S, Amin F, Siddiqui N, Ali A (2017) Aggregation operators on triangular cubic fuzzy numbers and its application to multi-criteria decision making problems. J Intell Fuzzy Syst 33:3323–3337CrossRef
go back to reference Fahmi A, Abdullah S, Amin F, Ali A (2018) Weighted average rating (war) method for solving group decision making problem using triangular cubic fuzzy hybrid aggregation (TCFHA). Punjab Univ J Math 50(1):23–34MathSciNet Fahmi A, Abdullah S, Amin F, Ali A (2018) Weighted average rating (war) method for solving group decision making problem using triangular cubic fuzzy hybrid aggregation (TCFHA). Punjab Univ J Math 50(1):23–34MathSciNet
go back to reference Fakhrahmad SM, Zolghadri Jahromi M (2009) A new rule-weight learning method based on gradient descent. In: Proceedings of the world congress on engineering, London, UK, pp 1–3 Fakhrahmad SM, Zolghadri Jahromi M (2009) A new rule-weight learning method based on gradient descent. In: Proceedings of the world congress on engineering, London, UK, pp 1–3
go back to reference Gama J (2011) Knowledge discovery from data streams, 1st edn. Chapman and Hall/CRC, LondonMATH Gama J (2011) Knowledge discovery from data streams, 1st edn. Chapman and Hall/CRC, LondonMATH
go back to reference Gama J, Medas P, Castillo G, Rodrigues P (2004) Learning with drift detection. In: SBIA Brazilian symposium on artificial intelligence, pp 286–295 Gama J, Medas P, Castillo G, Rodrigues P (2004) Learning with drift detection. In: SBIA Brazilian symposium on artificial intelligence, pp 286–295
go back to reference Hamzeloo S, Zolghadri Jahromi M (2017) An incremental fuzzy controller for large dec-POMDPs. In: Artificial intelligence and signal processing conference (AISP), Shiraz, Iran Hamzeloo S, Zolghadri Jahromi M (2017) An incremental fuzzy controller for large dec-POMDPs. In: Artificial intelligence and signal processing conference (AISP), Shiraz, Iran
go back to reference Harries M (1999) Splice-2 comparative evaluation: electricity pricing. Technical report, The University of South Wales Harries M (1999) Splice-2 comparative evaluation: electricity pricing. Technical report, The University of South Wales
go back to reference Haykin S (1999) Neural networks: a comprehensive foundation, 2nd edn. Prentice-Hall, Upper Saddle RiverMATH Haykin S (1999) Neural networks: a comprehensive foundation, 2nd edn. Prentice-Hall, Upper Saddle RiverMATH
go back to reference Hulten G, Spencer L, Domingos P (2001) Mining time-changing data streams. In: Proceedings of the seventh ACM SIGKDD international conference on knowledge discovery and data mining (KDD-2001), San Francisco, CA, pp 97–106 Hulten G, Spencer L, Domingos P (2001) Mining time-changing data streams. In: Proceedings of the seventh ACM SIGKDD international conference on knowledge discovery and data mining (KDD-2001), San Francisco, CA, pp 97–106
go back to reference Juang C-F, Tsao Y-W (2008) A self-evolving interval type-2 fuzzy neural network with on-line structure and parameter learning. IEEE Trans Fuzzy Syst 16(6):1411–1424CrossRef Juang C-F, Tsao Y-W (2008) A self-evolving interval type-2 fuzzy neural network with on-line structure and parameter learning. IEEE Trans Fuzzy Syst 16(6):1411–1424CrossRef
go back to reference Kasabov N (2001) Evolving fuzzy neural networks for supervised/unsupervised online knowledge-based learning. IEEE Trans Syst Man Cybern Part B Cybern 31(6):902–918CrossRef Kasabov N (2001) Evolving fuzzy neural networks for supervised/unsupervised online knowledge-based learning. IEEE Trans Syst Man Cybern Part B Cybern 31(6):902–918CrossRef
go back to reference Kasabov N, Song Q (2002) DENFIS: dynamic evolving neural-fuzzy inference system and its application for time-series prediction. IEEE Trans Fuzzy Syst 10(2):144–154CrossRef Kasabov N, Song Q (2002) DENFIS: dynamic evolving neural-fuzzy inference system and its application for time-series prediction. IEEE Trans Fuzzy Syst 10(2):144–154CrossRef
go back to reference Katakis I, Tsoumakas G, Banos E, Bassiliades N, Vlahavas I (2009) An adaptive personalized news dissemination system. J Intell Inf Syst 32(2):191–212CrossRef Katakis I, Tsoumakas G, Banos E, Bassiliades N, Vlahavas I (2009) An adaptive personalized news dissemination system. J Intell Inf Syst 32(2):191–212CrossRef
go back to reference Liang N, Huang G, Saratchandran P, Sun N (2006) A fast and accurate on-line sequential learning algorithm for feedforward networks. IEEE Trans Neural Netw 17(6):1411–1423CrossRef Liang N, Huang G, Saratchandran P, Sun N (2006) A fast and accurate on-line sequential learning algorithm for feedforward networks. IEEE Trans Neural Netw 17(6):1411–1423CrossRef
go back to reference Lima E, Hell M, Ballini R, Gomide F (2010) Evolving fuzzy modeling using participatory learning. In: Angelov P, Filev DP, Kasabov N (eds) Evolving intelligent systems: methodology and applications. Wiley, New York Lima E, Hell M, Ballini R, Gomide F (2010) Evolving fuzzy modeling using participatory learning. In: Angelov P, Filev DP, Kasabov N (eds) Evolving intelligent systems: methodology and applications. Wiley, New York
go back to reference Lughofer E (2008a) Extensions of vector quantization for incremental clustering. Pattern Recognit 41(3):995–1011CrossRefMATH Lughofer E (2008a) Extensions of vector quantization for incremental clustering. Pattern Recognit 41(3):995–1011CrossRefMATH
go back to reference Lughofer E (2008b) FLEXFIS: a robust incremental learning approach for evolving Takagi–Sugeno fuzzy models. IEEE Trans Fuzzy Syst 16(6):1393–1410CrossRef Lughofer E (2008b) FLEXFIS: a robust incremental learning approach for evolving Takagi–Sugeno fuzzy models. IEEE Trans Fuzzy Syst 16(6):1393–1410CrossRef
go back to reference Lughofer E (2011) Evolving fuzzy systems—methodologies, advanced concepts and applications. Springer, BerlinCrossRefMATH Lughofer E (2011) Evolving fuzzy systems—methodologies, advanced concepts and applications. Springer, BerlinCrossRefMATH
go back to reference Lughofer E, Angelov PP (2011) Handling drifts and shifts in on-line data streams with evolving fuzzy systems. Appl Soft Comput 11(2):2057–2068CrossRef Lughofer E, Angelov PP (2011) Handling drifts and shifts in on-line data streams with evolving fuzzy systems. Appl Soft Comput 11(2):2057–2068CrossRef
go back to reference Maciel L, Gomide F, Ballini R (2014) Enhanced evolving participatory learning fuzzy modeling: an application for asset returns volatility forecasting. Evol Syst 5(2):75–88CrossRef Maciel L, Gomide F, Ballini R (2014) Enhanced evolving participatory learning fuzzy modeling: an application for asset returns volatility forecasting. Evol Syst 5(2):75–88CrossRef
go back to reference Mansoori G (2014) GACH: a grid-based algorithm for hierarchical clustering of high-dimensional data. Soft Comput 18(5):905–922CrossRef Mansoori G (2014) GACH: a grid-based algorithm for hierarchical clustering of high-dimensional data. Soft Comput 18(5):905–922CrossRef
go back to reference Mansoori EG, Zolghadri MJ, Katebi SD (2008) SGERD: a steady-state genetic algorithm for extracting fuzzy classification rules from data. IEEE Trans Fuzzy Syst 16(4):1061–1071CrossRef Mansoori EG, Zolghadri MJ, Katebi SD (2008) SGERD: a steady-state genetic algorithm for extracting fuzzy classification rules from data. IEEE Trans Fuzzy Syst 16(4):1061–1071CrossRef
go back to reference Minku LL, Yao X (2012) DDD: a new ensemble approach for dealing with drifts. IEEE Trans Knowl Data Eng 24(4):619–633CrossRef Minku LL, Yao X (2012) DDD: a new ensemble approach for dealing with drifts. IEEE Trans Knowl Data Eng 24(4):619–633CrossRef
go back to reference Minku LL, White AP, Yao X (2010) The impact of diversity on online ensemble learning in the presence concept of drift. IEEE Trans Knowl Data Eng 22(5):730–742CrossRef Minku LL, White AP, Yao X (2010) The impact of diversity on online ensemble learning in the presence concept of drift. IEEE Trans Knowl Data Eng 22(5):730–742CrossRef
go back to reference Pelossof R, Jones M, Vovsha I, Rudin C (2010) Online coordinate boosting. In: 2009 IEEE 12th international conference on computer vision workshops (ICCV Workshops), Kyoto, Japan Pelossof R, Jones M, Vovsha I, Rudin C (2010) Online coordinate boosting. In: 2009 IEEE 12th international conference on computer vision workshops (ICCV Workshops), Kyoto, Japan
go back to reference Pratama M, Anavatti SG, Lughofer E (2014) GENEFIS: toward an effective localist network. IEEE Trans Fuzzy Syst 22(3):547–562CrossRef Pratama M, Anavatti SG, Lughofer E (2014) GENEFIS: toward an effective localist network. IEEE Trans Fuzzy Syst 22(3):547–562CrossRef
go back to reference Pratama M, Anavatti SG, Joo M, Lughofer E (2015) pClass: an effective classifier for streaming examples. IEEE Trans Fuzzy Syst 23(2):369–386CrossRef Pratama M, Anavatti SG, Joo M, Lughofer E (2015) pClass: an effective classifier for streaming examples. IEEE Trans Fuzzy Syst 23(2):369–386CrossRef
go back to reference Rubio JDJ (2010) Stability analysis for an on-line evolving neuro-fuzzy recurrent network. In: Angelov P, Filev D, Kasabov N (eds) Evolving intelligent systems: methodology and applications. Wiley, New York Rubio JDJ (2010) Stability analysis for an on-line evolving neuro-fuzzy recurrent network. In: Angelov P, Filev D, Kasabov N (eds) Evolving intelligent systems: methodology and applications. Wiley, New York
go back to reference Shahparast H, Mansoori EG (2017) FERHD: a feasible approach for extracting fuzzy classification rules from high-dimensional data. Intell Data Anal 21(1):63–75CrossRef Shahparast H, Mansoori EG (2017) FERHD: a feasible approach for extracting fuzzy classification rules from high-dimensional data. Intell Data Anal 21(1):63–75CrossRef
go back to reference Shahparast H, Hamzeloo S, Zolghadri Jahromi M (2014) A self-tuning fuzzy rule-based classifier for data streams. Int J Uncertain Fuzziness Knowl Based Syst 22(2):293–304CrossRefMATH Shahparast H, Hamzeloo S, Zolghadri Jahromi M (2014) A self-tuning fuzzy rule-based classifier for data streams. Int J Uncertain Fuzziness Knowl Based Syst 22(2):293–304CrossRefMATH
go back to reference Shaker A, Senge R, Hüllermeier E (2013) Evolving fuzzy pattern trees for binary classification on data streams. Inf Sci 220:34–45CrossRef Shaker A, Senge R, Hüllermeier E (2013) Evolving fuzzy pattern trees for binary classification on data streams. Inf Sci 220:34–45CrossRef
go back to reference Shalev-Shwartz S, Singer Y, Srebro N, Cotter A (2011) Pegasos: primal estimated sub-GrAdient SOlver for SVM. Math Program 127(1):3–30MathSciNetCrossRefMATH Shalev-Shwartz S, Singer Y, Srebro N, Cotter A (2011) Pegasos: primal estimated sub-GrAdient SOlver for SVM. Math Program 127(1):3–30MathSciNetCrossRefMATH
go back to reference Street N, Kim Y (2001) A streaming ensemble algorithm SEA for largescale classification. In: Proceedings of the seventh ACM SIGKDD international conference on knowledge discovery and data mining, pp 377–382 Street N, Kim Y (2001) A streaming ensemble algorithm SEA for largescale classification. In: Proceedings of the seventh ACM SIGKDD international conference on knowledge discovery and data mining, pp 377–382
go back to reference Sugeno M, Takagi T (1983) Multi-dimensional fuzzy reasoning. Fuzzy Sets Syst 9(1–3):313–325CrossRefMATH Sugeno M, Takagi T (1983) Multi-dimensional fuzzy reasoning. Fuzzy Sets Syst 9(1–3):313–325CrossRefMATH
go back to reference Suresh S, Dong K, Kim HJ (2010) A sequential learning algorithm for self-adaptive resource allocation network classifier. Neurocomputing 73(16–18):3012–3019CrossRef Suresh S, Dong K, Kim HJ (2010) A sequential learning algorithm for self-adaptive resource allocation network classifier. Neurocomputing 73(16–18):3012–3019CrossRef
go back to reference Vigdor B, Lerner B (2007) The Bayesian ARTMAP. IEEE Trans Neural Netw 18(6):1628–1644CrossRef Vigdor B, Lerner B (2007) The Bayesian ARTMAP. IEEE Trans Neural Netw 18(6):1628–1644CrossRef
go back to reference Wang H, Fan W, Yu PS, Han J (2003) Mining concept-drifting data streams using ensemble classifiers. In: 9th ACM international conference on knowledge discovery and data mining (SIGKDD), Washington DC, USA Wang H, Fan W, Yu PS, Han J (2003) Mining concept-drifting data streams using ensemble classifiers. In: 9th ACM international conference on knowledge discovery and data mining (SIGKDD), Washington DC, USA
go back to reference Widmer G, Kubat M (1996) Learning in the presence of concept drift and hidden contexts. Mach Learn 23(1):69–101 Widmer G, Kubat M (1996) Learning in the presence of concept drift and hidden contexts. Mach Learn 23(1):69–101
go back to reference Zhang K, Fan W, Yuan X, Davidson I, Li X (2006) Forecasting skewed biased stochastic ozone days: analyses and solutions. In: ICDM ‘06 proceedings of the sixth international conference on data mining, pp 753–764 Zhang K, Fan W, Yuan X, Davidson I, Li X (2006) Forecasting skewed biased stochastic ozone days: analyses and solutions. In: ICDM ‘06 proceedings of the sixth international conference on data mining, pp 753–764
go back to reference Zliobaite I, Bifet A, Holmes G, Pfahringer B (2011) MOA concept drift active learning strategies for streaming data. In: 2nd Workshop on applications of pattern analysis, pp 48–55 Zliobaite I, Bifet A, Holmes G, Pfahringer B (2011) MOA concept drift active learning strategies for streaming data. In: 2nd Workshop on applications of pattern analysis, pp 48–55
Metadata
Title
AFCGD: an adaptive fuzzy classifier based on gradient descent
Authors
Homeira Shahparast
Eghbal G. Mansoori
Mansoor Zolghadri Jahromi
Publication date
30-08-2018
Publisher
Springer Berlin Heidelberg
Published in
Soft Computing / Issue 12/2019
Print ISSN: 1432-7643
Electronic ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-018-3485-2

Other articles of this Issue 12/2019

Soft Computing 12/2019 Go to the issue

Premium Partner