nach oben

Erschienen in:

2012 | OriginalPaper | Buchkapitel

9. Flexible Evolving Fuzzy Inference Systems from Data Streams (FLEXFIS++)

verfasst von : Edwin Lughofer

Erschienen in: Learning in Non-Stationary Environments

Verlag: Springer New York

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

Data streams are usually characterized by an ordered sequence of samples recorded and loaded on-line with a certain frequency arriving continuously over time. Extracting models from such type of data within a reasonable on-line computational performance can be only achieved by a training procedure which is able to incrementally build up the models, ideally in a single-pass fashion (not using any prior samples). This chapter deals with data-driven design of fuzzy systems which are able to handle sample-wise loaded data within a streaming context. These are called flexible evolving fuzzy inference systems (FLEXFIS) as they may permanently change their structures and parameters with newly recorded data, achieving maximal flexibility according to new operating conditions, dynamic system behaviors, or exceptional occurrences. We are explaining how to deal with parameter adaptation and structure evolution on demand for regression as well as classification problems. In the second part of the chapter, several key extensions of the FLEXFIS family will be described (leading to the FLEXFIS + + and FLEXFIS-Class + + variants), including concepts for on-line rule merging, dealing with drifts, dynamically reducing the curse of dimensionality, as well as interpretability considerations and reliability in model predictions. Successful applications of the FLEXFIS family are summarized in a separate section. An extensive evaluation of the proposed methods and techniques will be demonstrated in a separate chapter (Chap. 14), when dealing with the application of flexible fuzzy systems in on-line quality-control systems.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

http://en.wikipedia.org/wiki/Very\_large\_database.

http://moa.cs.waikato.ac.nz/.

Abraham, W., Robins, A.: Memory retention - the synaptic stability versus plasticity dilemma. Trends in Neurosciences 28(2), 73–78 (2005)CrossRef

Angelov, P., Filev, D., Kasabov, N.: Evolving Intelligent Systems—Methodology and Applications. John Wiley & Sons, New York (2010)CrossRef

Angelov, P., Kasabov, N.: Evolving computational intelligence systems. In: Proceedings of the 1st International Workshop on Genetic Fuzzy Systems, pp. 76–82. Granada, Spain (2005)

Angelov, P., Lughofer, E., Zhou, X.: Evolving fuzzy classifiers using different model architectures. Fuzzy Sets and Systems 159(23), 3160–3182 (2008)MathSciNetMATHCrossRef

Aström, K., Wittenmark, B.: Adaptive Control - Second Edition. Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA (1994)

Backer, S.D., Scheunders, P.: Texture segmentation by frequency-sensitive elliptical competitive learning. Image and Vision Computing 19(9–10), 639–648 (2001)CrossRef

Basseville, M., Nikiforov, I.: Detection of Abrupt Changes. Prentice Hall Inc. (1993)

Bifet, A., Holmes, G., Kirkby, R., Pfahringer, B.: MOA: Massive online analysis. Journal of Machine Learning Research 11, 1601–1604 (2010)

Bifet, A., Kirkby, R.: Data stream mining — a practical approach. Tech. rep., Department of Computer Sciences, University of Waikato, Japan (2009)

10.

Carreira-Perpinan, M.: A review of dimension reduction techniques. Tech. Rep. CS-96-09, Dept. of Computer Science, University of Sheffield, Sheffield, U.K. (1997)

11.

Casillas, J., Cordon, O., Herrera, F., Magdalena, L.: Interpretability Issues in Fuzzy Modeling. Springer Verlag, Berlin Heidelberg (2003)MATH

12.

Casillas, J., Cordon, O., Jesus, M.D., Herrera, F.: Genetic feature selection in a fuzzy rule-based classification system learning process for high-dimensional problems. Information Sciences 136(1–4), 135–157 (2001)MATHCrossRef

13.

Castro, J., Delgado, M.: Fuzzy systems with defuzzification are universal approximators. IEEE Transactions on Systems, Man and Cybernetics, part B: Cybernetics 26(1), 149–152 (1996)CrossRef

14.

Cernuda, C., Lughofer, E., Suppan, L., Röder, T., Schmuck, R., Hintenaus, P., Märzinger, W., Kasberger, J.: Evolving Chemometric Models for Predicting Dynamic Process Parameters in Viscose Production. Analytica Chimica Acta online and in press, (2012), doi:10.1016/j.aca.2012.03.012

15.

Cohn, D., Atlas, L., Ladner, R.: Improving generalization with active learning. Machine Learning 15(2), 201–221 (1994)

16.

Domingos, P., Hulten, G.: Mining high-speed data streams. In: Proceedings of the Sixth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 71–80. Boston, MA (2000)

17.

Draper, N., Smith, H.: Applied Regression Analysis. Probability and Mathematical Statistics. John Wiley & Sons, New York (1981)MATH

18.

Duda, R., Hart, P., Stork, D.: Pattern Classification - Second Edition. Wiley-Interscience (John Wiley & Sons), Southern Gate, Chichester, West Sussex, England (2000)

19.

Dy, J., Brodley, C.: Feature selection for unsupervised learning. Journal of Machine Learning Research 5, 845–889 (2004)MathSciNetMATH

20.

Freiheit, T., Koren, Y., Hu, S.: Productivity of parallel production lines with unreliable machines and material handling. IEEE Transactions on Automation Sciences and Engineering 1(1), 98–103 (2004)CrossRef

21.

Fürnkranz, J.: Round robin classification. Journal of Machine Learning Research 2, 721–747 (2002)MATH

22.

Gama, J.: Knowledge Discovery from Data Streams. Chapman & Hall/CRC, Boca Raton, Florida (2010)MATHCrossRef

23.

Gama, J., Gaber, M.M. (eds.): Learning from Data Streams: Processing Techniques in Sensor Networks. Springer-Verlag (2007)

24.

Gama, J., Medas, P., Rocha, R.: Forest trees for on-line data. In: Proceedings of the 2004 ACM symposium on Applied computing, pp. 632–636. New York (2004)

25.

Gray, R.: Vector quantization. IEEE ASSP Magazine 1(2), 4–29 (1984)CrossRef

26.

Hamker, F.: RBF learning in a non-stationary environment: the stability-plasticity dilemma. In: R. Howlett, L. Jain (eds.) Radial basis function networks 1: recent developments in theory and applications, pp. 219–251. Physica Verlag, Heidelberg, New York (2001)

27.

Hastie, T., Tibshirani, R., Friedman, J.: The Elements of Statistical Learning: Data Mining, Inference and Prediction. Springer Verlag, New York, Berlin, Heidelberg, Germany (2001)MATH

28.

Hastie, T., Tibshirani, R., Friedman, J.: The Elements of Statistical Learning: Data Mining, Inference and Prediction - Second Edition. Springer, New York Berlin Heidelberg (2009)MATHCrossRef

29.

Haykin, S.: Neural Networks: A Comprehensive Foundation (2nd Edition). Prentice Hall Inc., Upper Saddle River, New Jersey (1999)MATH

30.

Hühn, J., Hüllermeier, E.: FR3: A fuzzy rule learner for inducing reliable classifiers. IEEE Transactions on Fuzzy Systems 17(1), 138–149 (2009)CrossRef

31.

Kasabov, N.: Evolving Connectionist Systems: The Knowledge Engineering Approach - Second Edition. Springer Verlag, London (2007)

32.

Klinkenberg, R.: Learning drifting concepts: example selection vs. example weighting. Intelligent Data Analysis 8(3), 281–300 (2004)

33.

Koczy, L., Tikk, D., Gedeon, T.: On functional equivalence of certain fuzzy controllers and RBF type approximation schemes. International Journal of Fuzzy Systems 2(3), 164–175 (2000)

34.

Kruse, R., Gebhardt, J., Klawonn, F.: Foundations of Fuzzy Systems. John Wiley & Sons, New York (1994)

35.

Kuncheva, L.: Fuzzy Classifier Design. Physica-Verlag, Heidelberg (2000)MATH

36.

Kurzhanskiy, A.A., Varaiya, P.: Ellipsoidal toolbox. Tech. rep. (2006)

37.

Li, X., Wang, L., Sung, E.: Multilabel SVM active learning for image classification. In: Proceedings of the International Conference on Image Processing (ICIP) vol. 4, pp. 2207–2010. Singapore (2004)

38.

Ljung, L.: System Identification: Theory for the User. Prentice Hall PTR, Prentic Hall Inc., Upper Saddle River, New Jersey (1999)

39.

Lughofer, E.: Evolving vector quantization for classification of on-line data streams. In: Proc. of the Conference on Computational Intelligence for Modelling, Control and Automation (CIMCA 2008), pp. 780–786. Vienna, Austria (2008)

40.

Lughofer, E.: Extensions of vector quantization for incremental clustering. Pattern Recognition 41(3), 995–1011 (2008)MATHCrossRef

41.

Lughofer, E.: FLEXFIS: A robust incremental learning approach for evolving TS fuzzy models. IEEE Transactions on Fuzzy Systems 16(6), 1393–1410 (2008)CrossRef

42.

Lughofer, E.: On-line evolving image classifiers and their application to surface inspection. Image and Vision Computing 28(7), 1065–1079 (2010)CrossRef

43.

Lughofer, E.: All-pairs evolving fuzzy classifiers for on-line multi-class classification problems. In: Proceedings of the EUSFLAT 2011 Conference, pp. 372–379. Elsevier, Aix-Les-Bains, France (2011)

44.

Lughofer, E.: Evolving Fuzzy Systems — Methodologies, Advanced Concepts and Applications. Springer, Berlin Heidelberg (2011)MATHCrossRef

45.

Lughofer, E.: Hybrid active learning (HAL) for reducing the annotation efforts of operators in classification systems. Pattern Recognition 45(2), pp. 884–896 (2012)CrossRef

46.

Lughofer, E.: On-line incremental feature weighting in evolving fuzzy classifiers. Fuzzy Sets and Systems 163(1), 1–23 (2011)MathSciNetMATHCrossRef

47.

Lughofer, E., Angelov, P.: Handling drifts and shifts in on-line data streams with evolving fuzzy systems. Applied Soft Computing 11(2), 2057–2068 (2011)CrossRef

48.

Lughofer, E., Angelov, P., Zhou, X.: Evolving single- and multi-model fuzzy classifiers with FLEXFIS-Class. In: Proceedings of FUZZ-IEEE 2007, pp. 363–368. London, UK (2007)

49.

Lughofer, E., Bouchot, J.L., Shaker, A.: On-line elimination of local redundancies in evolving fuzzy systems. Evolving Systems 2(3), 165–187 (2011)CrossRef

50.

Lughofer, E., Guardiola, C.: Applying evolving fuzzy models with adaptive local error bars to on-line fault detection. In: Proceedings of Genetic and Evolving Fuzzy Systems 2008, pp. 35–40. Witten-Bommerholz, Germany (2008)

51.

Lughofer, E., Hüllermeier, E., Klement, E.: Improving the interpretability of data-driven evolving fuzzy systems. In: Proceedings of EUSFLAT 2005, pp. 28–33. Barcelona, Spain (2005)

52.

Lughofer, E., Kindermann, S.: SparseFIS: Data-driven learning of fuzzy systems with sparsity constraints. IEEE Transactions on Fuzzy Systems 18(2), 396–411 (2010)

53.

Lughofer, E., Macian, V., Guardiola, C., Klement, E.: Identifying static and dynamic prediction models for nox emissions with evolving fuzzy systems. Applied Soft Computing 11(2), 2487–2500 (2011)CrossRef

54.

Lughofer, E., Trawinski, B., Trawinski, K., Kempa, O., Lasota, T.: On employing fuzzy modeling algorithms for the valuation of residential premises. Information Sciences, 181(23), 5123–5142 (2011)CrossRef

55.

Mahalanobis, P.C.: On the generalised distance in statistics. In: Proceedings of the National Institute of Sciences of India, vol. 2 (1), pp. 49–55 (1936)MathSciNetMATH

56.

Mouss, H., Mouss, D., Mouss, N., Sefouhi, L.: Test of Page-Hinkley, an approach for fault detection in an agro-alimentary production system. In: Proceedings of the Asian Control Conference, Volume 2, pp. 815–818 (2004)

57.

Nelles, O.: Nonlinear System Identification. Springer, Berlin (2001)MATH

58.

Oza, N.C., Russell, S.: Online bagging and boosting. Artificial Intelligence and Statistics pp. 105–112 (2001)

59.

Page, E.: Continuous inspection schemes. Biometrika 41(1-2), 100–115 (1954)MathSciNetMATH

60.

Pang, S., Ozawa, S., Kasabov, N.: Incremental linear discriminant analysis for classification of data streams. IEEE Transaction on Systems, Men and Cybernetics, part B: Cybernetics 35(5), 905–914 (2005)CrossRef

61.

Qin, S., Li, W., Yue, H.: Recursive PCA for adaptive process monitoring. Journal of Process Control 10(5), 471–486 (2000)CrossRef

62.

Roubos, J., Setnes, M., Abonyi, J.: Learning fuzzy classification rules from data. Information Sciences 150(1–2), 77–93 (2003)MathSciNetCrossRef

63.

Sanchez, L., Suarez, M., Villar, J., Couso, I.: Mutual information-based feature selection and partition design in fuzzy rule-based classifiers from vague data. International Journal of Approximate Reasoning 49(3), 607–622 (2008)CrossRef

64.

Schölkopf, B., Smola, A.: Learning with Kernels - Support Vector Machines, Regularization, Optimization and Beyond. MIT Press, London, England (2002)

65.

Takagi, T., Sugeno, M.: Fuzzy identification of systems and its applications to modeling and control. IEEE Transactions on Systems, Man and Cybernetics 15(1), 116–132 (1985)MATH

66.

Thumfart, S., Jacobs, R., Lughofer, E., Cornelissen, F., Maak, H., Groissboeck, W., Richter, R.: Modelling human aesthetic perception of visual textures. ACM Transactions on Applied Perception, 8(4), (2011)

67.

Varmuza, K., Filzmoser, P.: Introduction to Multivariate Statistical Analysis in Chemometrics. CRC Press, Boca Raton (2009)CrossRef

68.

Wang, L., Mendel, J.: Fuzzy basis functions, universal approximation and orthogonal least-squares learning. IEEE Transactions on Neural Networks 3(5), 807–814 (1992)CrossRef

69.

Widmer, G., Kubat, M.: Learning in the presence of concept drift and hidden contexts. Machine Learning 23(1), 69–101 (1996)

70.

Yager, R.R.: A model of participatory learning. IEEE Transactions on Systems, Man and Cybernetics 20(5), 1229–1234 (1990)MathSciNetCrossRef

71.

Yen, J., Wang, L., Gillespie, C.: Improving the interpretability of TSK fuzzy models by combining global learning and local learning. IEEE Transactions on Fuzzy Systems 6(4), 530–537 (1998)CrossRef

72.

Zhou, S., Gan, J.: Low-level interpretability and high-level interpretability: a unified view of data-driven interpretable fuzzy systems modelling. Fuzzy Sets and Systems 159(23), 3091–3131 (2008)MathSciNetCrossRef

Titel: Flexible Evolving Fuzzy Inference Systems from Data Streams (FLEXFIS++)
verfasst von: Edwin Lughofer
Verlag: Springer New York
Buch: Learning in Non-Stationary Environments
Print ISBN: 978-1-4419-8019-9

Electronic ISBN: 978-1-4419-8020-5

Copyright-Jahr: 2012
DOI: https://doi.org/10.1007/978-1-4419-8020-5_9

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner