Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Published in:
Prologue Read chapter Read first chapter

2012 | OriginalPaper | Chapter

9. Flexible Evolving Fuzzy Inference Systems from Data Streams (FLEXFIS++)

Author : Edwin Lughofer

Published in: Learning in Non-Stationary Environments

Publisher: Springer New York

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Data streams are usually characterized by an ordered sequence of samples recorded and loaded on-line with a certain frequency arriving continuously over time. Extracting models from such type of data within a reasonable on-line computational performance can be only achieved by a training procedure which is able to incrementally build up the models, ideally in a single-pass fashion (not using any prior samples). This chapter deals with data-driven design of fuzzy systems which are able to handle sample-wise loaded data within a streaming context. These are called flexible evolving fuzzy inference systems (FLEXFIS) as they may permanently change their structures and parameters with newly recorded data, achieving maximal flexibility according to new operating conditions, dynamic system behaviors, or exceptional occurrences. We are explaining how to deal with parameter adaptation and structure evolution on demand for regression as well as classification problems. In the second part of the chapter, several key extensions of the FLEXFIS family will be described (leading to the FLEXFIS + + and FLEXFIS-Class + + variants), including concepts for on-line rule merging, dealing with drifts, dynamically reducing the curse of dimensionality, as well as interpretability considerations and reliability in model predictions. Successful applications of the FLEXFIS family are summarized in a separate section. An extensive evaluation of the proposed methods and techniques will be demonstrated in a separate chapter (Chap. 14), when dealing with the application of flexible fuzzy systems in on-line quality-control systems.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
previous chapter Instance-Based Classification and Regression on Data Streams
next chapter Sequential Adaptive Fuzzy Inference System for Function Approximation Problems
Footnotes
Literature
1.
Abraham, W., Robins, A.: Memory retention - the synaptic stability versus plasticity dilemma. Trends in Neurosciences 28(2), 73–78 (2005)CrossRef
2.
Angelov, P., Filev, D., Kasabov, N.: Evolving Intelligent Systems—Methodology and Applications. John Wiley & Sons, New York (2010)CrossRef
3.
Angelov, P., Kasabov, N.: Evolving computational intelligence systems. In: Proceedings of the 1st International Workshop on Genetic Fuzzy Systems, pp. 76–82. Granada, Spain (2005)
4.
Angelov, P., Lughofer, E., Zhou, X.: Evolving fuzzy classifiers using different model architectures. Fuzzy Sets and Systems 159(23), 3160–3182 (2008)MathSciNetMATHCrossRef
5.
Aström, K., Wittenmark, B.: Adaptive Control - Second Edition. Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA (1994)
6.
Backer, S.D., Scheunders, P.: Texture segmentation by frequency-sensitive elliptical competitive learning. Image and Vision Computing 19(9–10), 639–648 (2001)CrossRef
7.
Basseville, M., Nikiforov, I.: Detection of Abrupt Changes. Prentice Hall Inc. (1993)
8.
Bifet, A., Holmes, G., Kirkby, R., Pfahringer, B.: MOA: Massive online analysis. Journal of Machine Learning Research 11, 1601–1604 (2010)
9.
Bifet, A., Kirkby, R.: Data stream mining — a practical approach. Tech. rep., Department of Computer Sciences, University of Waikato, Japan (2009)
10.
Carreira-Perpinan, M.: A review of dimension reduction techniques. Tech. Rep. CS-96-09, Dept. of Computer Science, University of Sheffield, Sheffield, U.K. (1997)
11.
Casillas, J., Cordon, O., Herrera, F., Magdalena, L.: Interpretability Issues in Fuzzy Modeling. Springer Verlag, Berlin Heidelberg (2003)MATH
12.
Casillas, J., Cordon, O., Jesus, M.D., Herrera, F.: Genetic feature selection in a fuzzy rule-based classification system learning process for high-dimensional problems. Information Sciences 136(1–4), 135–157 (2001)MATHCrossRef
13.
Castro, J., Delgado, M.: Fuzzy systems with defuzzification are universal approximators. IEEE Transactions on Systems, Man and Cybernetics, part B: Cybernetics 26(1), 149–152 (1996)CrossRef
14.
Cernuda, C., Lughofer, E., Suppan, L., Röder, T., Schmuck, R., Hintenaus, P., Märzinger, W., Kasberger, J.: Evolving Chemometric Models for Predicting Dynamic Process Parameters in Viscose Production. Analytica Chimica Acta online and in press, (2012), doi:​10.​1016/​j.​aca.​2012.​03.​012
15.
Cohn, D., Atlas, L., Ladner, R.: Improving generalization with active learning. Machine Learning 15(2), 201–221 (1994)
16.
Domingos, P., Hulten, G.: Mining high-speed data streams. In: Proceedings of the Sixth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 71–80. Boston, MA (2000)
17.
Draper, N., Smith, H.: Applied Regression Analysis. Probability and Mathematical Statistics. John Wiley & Sons, New York (1981)MATH
18.
Duda, R., Hart, P., Stork, D.: Pattern Classification - Second Edition. Wiley-Interscience (John Wiley & Sons), Southern Gate, Chichester, West Sussex, England (2000)
19.
Dy, J., Brodley, C.: Feature selection for unsupervised learning. Journal of Machine Learning Research 5, 845–889 (2004)MathSciNetMATH
20.
Freiheit, T., Koren, Y., Hu, S.: Productivity of parallel production lines with unreliable machines and material handling. IEEE Transactions on Automation Sciences and Engineering 1(1), 98–103 (2004)CrossRef
21.
Fürnkranz, J.: Round robin classification. Journal of Machine Learning Research 2, 721–747 (2002)MATH
22.
Gama, J.: Knowledge Discovery from Data Streams. Chapman & Hall/CRC, Boca Raton, Florida (2010)MATHCrossRef
23.
Gama, J., Gaber, M.M. (eds.): Learning from Data Streams: Processing Techniques in Sensor Networks. Springer-Verlag (2007)
24.
Gama, J., Medas, P., Rocha, R.: Forest trees for on-line data. In: Proceedings of the 2004 ACM symposium on Applied computing, pp. 632–636. New York (2004)
25.
26.
Hamker, F.: RBF learning in a non-stationary environment: the stability-plasticity dilemma. In: R. Howlett, L. Jain (eds.) Radial basis function networks 1: recent developments in theory and applications, pp. 219–251. Physica Verlag, Heidelberg, New York (2001)
27.
Hastie, T., Tibshirani, R., Friedman, J.: The Elements of Statistical Learning: Data Mining, Inference and Prediction. Springer Verlag, New York, Berlin, Heidelberg, Germany (2001)MATH
28.
Hastie, T., Tibshirani, R., Friedman, J.: The Elements of Statistical Learning: Data Mining, Inference and Prediction - Second Edition. Springer, New York Berlin Heidelberg (2009)MATHCrossRef
29.
Haykin, S.: Neural Networks: A Comprehensive Foundation (2nd Edition). Prentice Hall Inc., Upper Saddle River, New Jersey (1999)MATH
30.
Hühn, J., Hüllermeier, E.: FR3: A fuzzy rule learner for inducing reliable classifiers. IEEE Transactions on Fuzzy Systems 17(1), 138–149 (2009)CrossRef
31.
Kasabov, N.: Evolving Connectionist Systems: The Knowledge Engineering Approach - Second Edition. Springer Verlag, London (2007)
32.
Klinkenberg, R.: Learning drifting concepts: example selection vs. example weighting. Intelligent Data Analysis 8(3), 281–300 (2004)
33.
Koczy, L., Tikk, D., Gedeon, T.: On functional equivalence of certain fuzzy controllers and RBF type approximation schemes. International Journal of Fuzzy Systems 2(3), 164–175 (2000)
34.
Kruse, R., Gebhardt, J., Klawonn, F.: Foundations of Fuzzy Systems. John Wiley & Sons, New York (1994)
35.
Kuncheva, L.: Fuzzy Classifier Design. Physica-Verlag, Heidelberg (2000)MATH
36.
Kurzhanskiy, A.A., Varaiya, P.: Ellipsoidal toolbox. Tech. rep. (2006)
37.
Li, X., Wang, L., Sung, E.: Multilabel SVM active learning for image classification. In: Proceedings of the International Conference on Image Processing (ICIP) vol. 4, pp. 2207–2010. Singapore (2004)
38.
Ljung, L.: System Identification: Theory for the User. Prentice Hall PTR, Prentic Hall Inc., Upper Saddle River, New Jersey (1999)
39.
Lughofer, E.: Evolving vector quantization for classification of on-line data streams. In: Proc. of the Conference on Computational Intelligence for Modelling, Control and Automation (CIMCA 2008), pp. 780–786. Vienna, Austria (2008)
40.
Lughofer, E.: Extensions of vector quantization for incremental clustering. Pattern Recognition 41(3), 995–1011 (2008)MATHCrossRef
41.
Lughofer, E.: FLEXFIS: A robust incremental learning approach for evolving TS fuzzy models. IEEE Transactions on Fuzzy Systems 16(6), 1393–1410 (2008)CrossRef
42.
Lughofer, E.: On-line evolving image classifiers and their application to surface inspection. Image and Vision Computing 28(7), 1065–1079 (2010)CrossRef
43.
Lughofer, E.: All-pairs evolving fuzzy classifiers for on-line multi-class classification problems. In: Proceedings of the EUSFLAT 2011 Conference, pp. 372–379. Elsevier, Aix-Les-Bains, France (2011)
44.
Lughofer, E.: Evolving Fuzzy Systems — Methodologies, Advanced Concepts and Applications. Springer, Berlin Heidelberg (2011)MATHCrossRef
45.
Lughofer, E.: Hybrid active learning (HAL) for reducing the annotation efforts of operators in classification systems. Pattern Recognition 45(2), pp. 884–896 (2012)CrossRef
46.
47.
Lughofer, E., Angelov, P.: Handling drifts and shifts in on-line data streams with evolving fuzzy systems. Applied Soft Computing 11(2), 2057–2068 (2011)CrossRef
48.
Lughofer, E., Angelov, P., Zhou, X.: Evolving single- and multi-model fuzzy classifiers with FLEXFIS-Class. In: Proceedings of FUZZ-IEEE 2007, pp. 363–368. London, UK (2007)
49.
Lughofer, E., Bouchot, J.L., Shaker, A.: On-line elimination of local redundancies in evolving fuzzy systems. Evolving Systems 2(3), 165–187 (2011)CrossRef
50.
Lughofer, E., Guardiola, C.: Applying evolving fuzzy models with adaptive local error bars to on-line fault detection. In: Proceedings of Genetic and Evolving Fuzzy Systems 2008, pp. 35–40. Witten-Bommerholz, Germany (2008)
51.
Lughofer, E., Hüllermeier, E., Klement, E.: Improving the interpretability of data-driven evolving fuzzy systems. In: Proceedings of EUSFLAT 2005, pp. 28–33. Barcelona, Spain (2005)
52.
Lughofer, E., Kindermann, S.: SparseFIS: Data-driven learning of fuzzy systems with sparsity constraints. IEEE Transactions on Fuzzy Systems 18(2), 396–411 (2010)
53.
Lughofer, E., Macian, V., Guardiola, C., Klement, E.: Identifying static and dynamic prediction models for nox emissions with evolving fuzzy systems. Applied Soft Computing 11(2), 2487–2500 (2011)CrossRef
54.
Lughofer, E., Trawinski, B., Trawinski, K., Kempa, O., Lasota, T.: On employing fuzzy modeling algorithms for the valuation of residential premises. Information Sciences, 181(23), 5123–5142 (2011)CrossRef
55.
Mahalanobis, P.C.: On the generalised distance in statistics. In: Proceedings of the National Institute of Sciences of India, vol. 2 (1), pp. 49–55 (1936)MathSciNetMATH
56.
Mouss, H., Mouss, D., Mouss, N., Sefouhi, L.: Test of Page-Hinkley, an approach for fault detection in an agro-alimentary production system. In: Proceedings of the Asian Control Conference, Volume 2, pp. 815–818 (2004)
57.
Nelles, O.: Nonlinear System Identification. Springer, Berlin (2001)MATH
58.
Oza, N.C., Russell, S.: Online bagging and boosting. Artificial Intelligence and Statistics pp. 105–112 (2001)
59.
60.
Pang, S., Ozawa, S., Kasabov, N.: Incremental linear discriminant analysis for classification of data streams. IEEE Transaction on Systems, Men and Cybernetics, part B: Cybernetics 35(5), 905–914 (2005)CrossRef
61.
Qin, S., Li, W., Yue, H.: Recursive PCA for adaptive process monitoring. Journal of Process Control 10(5), 471–486 (2000)CrossRef
62.
Roubos, J., Setnes, M., Abonyi, J.: Learning fuzzy classification rules from data. Information Sciences 150(1–2), 77–93 (2003)MathSciNetCrossRef
63.
Sanchez, L., Suarez, M., Villar, J., Couso, I.: Mutual information-based feature selection and partition design in fuzzy rule-based classifiers from vague data. International Journal of Approximate Reasoning 49(3), 607–622 (2008)CrossRef
64.
Schölkopf, B., Smola, A.: Learning with Kernels - Support Vector Machines, Regularization, Optimization and Beyond. MIT Press, London, England (2002)
65.
Takagi, T., Sugeno, M.: Fuzzy identification of systems and its applications to modeling and control. IEEE Transactions on Systems, Man and Cybernetics 15(1), 116–132 (1985)MATH
66.
Thumfart, S., Jacobs, R., Lughofer, E., Cornelissen, F., Maak, H., Groissboeck, W., Richter, R.: Modelling human aesthetic perception of visual textures. ACM Transactions on Applied Perception, 8(4), (2011)
67.
Varmuza, K., Filzmoser, P.: Introduction to Multivariate Statistical Analysis in Chemometrics. CRC Press, Boca Raton (2009)CrossRef
68.
Wang, L., Mendel, J.: Fuzzy basis functions, universal approximation and orthogonal least-squares learning. IEEE Transactions on Neural Networks 3(5), 807–814 (1992)CrossRef
69.
Widmer, G., Kubat, M.: Learning in the presence of concept drift and hidden contexts. Machine Learning 23(1), 69–101 (1996)
70.
Yager, R.R.: A model of participatory learning. IEEE Transactions on Systems, Man and Cybernetics 20(5), 1229–1234 (1990)MathSciNetCrossRef
71.
Yen, J., Wang, L., Gillespie, C.: Improving the interpretability of TSK fuzzy models by combining global learning and local learning. IEEE Transactions on Fuzzy Systems 6(4), 530–537 (1998)CrossRef
72.
Zhou, S., Gan, J.: Low-level interpretability and high-level interpretability: a unified view of data-driven interpretable fuzzy systems modelling. Fuzzy Sets and Systems 159(23), 3091–3131 (2008)MathSciNetCrossRef
Metadata
Title
Flexible Evolving Fuzzy Inference Systems from Data Streams (FLEXFIS++)
Author
Edwin Lughofer
Copyright Year
2012
Publisher
Springer New York
Book
Learning in Non-Stationary Environments

Print ISBN: 978-1-4419-8019-9

Electronic ISBN: 978-1-4419-8020-5

Copyright Year: 2012

DOI
https://doi.org/10.1007/978-1-4419-8020-5_9

Premium Partner

    Image Credits