nach oben

Erschienen in:

2016 | OriginalPaper | Buchkapitel

3. Handling Concept Drift

verfasst von : Moamar Sayed-Mouchaweh

Erschienen in: Learning from Data Streams in Dynamic Environments

Verlag: Springer International Publishing

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

In this chapter, the different methods and techniques used to learn from data streams in evolving and nonstationary environments will be presented, and their performances will be compared according to the generated drift characteristics as well as to the application context and objectives. The goal is to define the criteria to be used in order to help readers to efficiently design the suitable learning scheme for a particular application. For this aim, these methods and techniques are classified and compared according to a set of meaningful criteria. Several examples will be used to illustrate and discuss the principal and the performance of these methods and techniques.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Vorheriges Kapitel Learning in Dynamic Environments

Nächstes Kapitel Summary and Final Comments

13.

Shaker A, Lughofer E (2014) Self-adaptive and local strategies for a smooth treatment of drifts in data streams. Evol Syst 5(4):239–257CrossRef

18.

Minku LL, White AP, Yao X (2010) The impact of diversity on online ensemble learning in the presence of concept drift. IEEE Trans Knowl Data Eng 22(5):730–742CrossRef

20.

Khamassi I, Sayed-Mouchaweh M, Hammami M, Ghédira K (2015) Self-adaptive windowing approach for handling complex concept drift. Cogn Comput 2015:1–19

21.

Gama J, Žliobaitė I, Bifet A, Pechenizkiy M, Bouchachia A (2014) A survey on concept drift adaptation. ACM Comput Surv (CSUR) 46(4):44CrossRefMATH

31.

Vachtsevanos G, Lewis FL, Roemer M, Hess A, Wu B (2006) Intelligent fault diagnosis and prognosis for engineering systems. Wiley, New York, NYCrossRef

32.

Nishida K, Yamauchi K (2007) Detecting concept drift using statistical testing. In: Corruble V, Takeda M, Suzuki E (eds) Discovery science. Springer, Berlin, pp 264–269CrossRef

33.

Cieslak DA, Chawla NV (2009) A framework for monitoring classifiers’ performance: when and why failure occurs? Knowl Inf Syst 18(1):83–108CrossRef

34.

Lichtenwalter RN, Chawla NV (2010) Adaptive methods for classification in arbitrarily imbalanced and drifting data streams. In: Cao L, Huang JH, Bailey J, Koh YS, Luo J (eds) New frontiers in applied data mining. Springer, Berlin, pp 53–75CrossRef

35.

Hoens TR, Polikar R, Chawla NV (2012) Learning from streaming data with concept drift and imbalance: an overview. Prog Artif Intel 1(1):89–101CrossRef

36.

GonzáLez-Castro V, Alaiz-RodríGuez R, Alegre E (2013) Class distribution estimation based on the Hellinger distance. Inform Sci 218:146–164CrossRef

37.

Sayed-Mouchaweh M, Billaudel P (2012) Abrupt and drift-like fault diagnosis of concurent discrete event systems. In: Machine learning and applications (ICMLA), 2012 11th international conference, vol 2, Dec 2012. IEEE, pp 434–439

38.

Poggio T, Cauwenberghs G (2001) Incremental and decremental support vector machine learning. Adv Neural Inf Process Syst 13:409

39.

Minku LL, Yao X (2012) DDD: a new ensemble approach for dealing with concept drift. IEEE Trans Knowl Data Eng 24(4):619–633CrossRef

40.

Baena-Garcıa M, del Campo-Ávila J, Fidalgo R, Bifet A, Gavalda R, Morales-Bueno R (2006) Early drift detection method. In: Fourth international workshop on knowledge discovery from data streams, vol 6, Sept 2006, pp 77–86

41.

Žliobaitė I (2009) Combining time and space similarity for small size learning under concept drift. In: Foundations of intelligent systems. Springer, Berlin, pp 412–421

42.

Kuncheva LI (2009) Using control charts for detecting concept change in streaming data. Bangor University, Bangor

43.

Alippi C (2014) Learning in nonstationary and evolving environments. In: Intelligence for embedded systems. Springer, Berlin, pp 211–247

44.

Tran DH (2013) Automated change detection and reactive clustering in multivariate streaming data. arXiv, preprint arXiv:1311.0505

45.

Tsymbal A, Puuronen S (2000) Bagging and boosting with dynamic integration of classifiers. Data Min Knowl Discov 1910:195–206MATH

46.

Sobhani P, Beigy H (2011) New drift detection method for data streams. Springer, Berlin, pp 88–97

47.

Gonçalves PM, de Carvalho Santos SG, Barros RS, Vieira DC (2014) A comparative study on concept drift detectors. Expert Syst Appl 41(18):8144–8156CrossRef

48.

Toubakh H, Sayed-Mouchaweh M (2015) Hybrid dynamic data-driven approach for drift-like fault detection in wind turbines. Evol Syst 6(2):115–129CrossRef

49.

Cieslak DA, Chawla NV (2009) A framework for monitoring classifiers’ performance: when and why failure occurs? Knowl Inf Syst 18(1):83–108CrossRef

50.

Pagano C, Granger E, Sabourin R, Marcialis GL, Roli F (2014) Dynamic weighted fusion of adaptive classifier ensembles based on changing data streams. In: Artificial neural networks in pattern recognition. Springer, Berlin, pp 105–116

51.

Hoens TR, Chawla NV, Polikar R (2011) Heuristic updatable weighted random subspaces for non-stationary environments. In: Data mining (ICDM), 2011 I.E. 11th international conference, Dec 2011. IEEE, pp 241–250

52.

Ditzler G, Polikar R (2011) Hellinger distance based drift detection for nonstationary environments. In: Computational intelligence in dynamic and uncertain environments (CIDUE), 2011 I.E. Symposium, Apr 2011. IEEE, pp 41–48

53.

Vorburger P, Bernstein A (2006) Entropy-based detection of real and virtual concept shifts. Working paper – University of Zurich. Department of Informatics, Zurich

54.

Poggio T, Cauwenberghs G (2001) Incremental and decremental support vector machine learning. Adv Neural Inf Process Syst 13:409

55.

Di Marzo Serugendo G, Frei R, McWilliam R, Derrick B, Purvis A, Tiwari A (2013) Self-healing and self-repairing technologies. Int J Adv Manuf Technol 69(5):8

56.

Kolter JZ, Maloof MA (2007) Dynamic weighted majority: an ensemble method for drifting concepts. J Mach Learn Res 8:2755–2790MATH

57.

Yang P, Hwayang Y, Zhou BB, Zomaya AY (2010) A review of ensemble methods in bioinformatics. Curr Bioinform 5(4):296–308CrossRef

58.

Kuncheva LI, Whitaker CJ (2003) Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy. Mach Learn 51(2):181–207CrossRefMATH

59.

Polikar R, Upda L, Upda SS, Honavar V (2001) Learn++: an incremental learning algorithm for supervised neural networks. IEEE Trans Syst Man Cybernet C Appl Rev 31(4):497–508CrossRef

60.

Brzeziński D, Stefanowski J (2011) Accuracy updated ensemble for data streams with concept drift. In: Corchado E, Kurzynski M, Wozniak M (eds) Hybrid artificial intelligent systems. Springer, Berlin, pp 155–163CrossRef

61.

Masud MM, Gao J, Khan L, Han J, Thuraisingham B (2011) Classification and novel class detection in concept-drifting data streams under time constraints. IEEE Trans Knowl Data Eng 23(6):859–874CrossRef

62.

Oza NC (2005) Online bagging and boosting. In: Systems, man and cybernetics, 2005 I.E. international conference, vol 3, Oct, 2005. IEEE, pp 2340–2345

63.

Kuncheva LI (2004) Classifier ensembles for changing environments. In: Multiple classifier systems. Springer, Berlin, pp 1–15

64.

Masud MM, Gao J, Khan L, Han J, Thuraisingham B (2009) A multi-partition multi-chunk ensemble technique to classify concept-drifting data streams. In: Advances in knowledge discovery and data mining. Springer, Berlin, pp 363–375

65.

Wang H, Fan W, Yu PS, Han J (2003) Mining concept-drifting data streams using ensemble classifiers. In: Proceedings of the ninth ACM SIGKDD international conference on knowledge discovery and data mining, Aug 2003. ACM, pp 226–235

66.

BifetA, Holmes G, Pfahringer B (2010) Leveraging bagging for evolving data streams. In: Machine learning and knowledge discovery in databases. Springer, Berlin, pp 135–150

67.

Brzezinski D, Stefanowski J (2014) Combining block-based and online methods in learning ensembles from concept drifting data streams. Inform Sci 265:50–67MathSciNetCrossRefMATH

68.

Jackowski K (2014) Fixed-size ensemble classifier system evolutionarily adapted to a recurring context with an unlimited pool of classifiers. Pattern Anal Appl 17(4):709–724MathSciNetCrossRef

69.

Escovedo T, Abs da Cruz A, Koshiyama A, Melo R, Vellasco M (2014) NEVE++: a neuro-evolutionary unlimited ensemble for adaptive learning. In: Neural networks (IJCNN), 2014 international joint conference, July 2014. IEEE, pp 3331–3338

70.

Nishida K, Yamauchi K, Omori T (2005) Ace: adaptive classifiers-ensemble system for concept-drifting environments. In: Multiple classifier systems. Springer, Berlin, pp 176–185

71.

Brzezinski D, Stefanowski J (2014) Reacting to different types of concept drift: the accuracy updated ensemble algorithm. IEEE Trans Neural Networks Learn Syst 25(1):81–94CrossRef

72.

Sobolewski P, Wozniak M (2013) Concept drift detection and model selection with simulated recurrence and ensembles of statistical detectors. J Univ Comput Sci 19(4):462–483

74.

Tran DH (2013) Automated change detection and reactive clustering in multivariate streaming data. arXiv, preprint arXiv:1311.0505.

75.

Ross GJ, Adams NM, Tasoulis DK, Hand DJ (2012) Exponentially weighted moving average charts for detecting concept drift. Pattern Recognit Lett 33(2):191–198CrossRef

76.

Muthukrishnan S, van den Berg E, Wu Y (2007) Sequential change detection on data streams. In: Data mining workshops, 2007. ICDM workshops 2007. Seventh IEEE international conference, Oct 2007. IEEE, pp 551–550

77.

Dries A, Rückert U (2009) Adaptive concept drift detection. Stat Anal Data Min 2(5‐6):311–327MathSciNetCrossRef

78.

Luo Y, Li Z, Wang Z (2009) Adaptive CUSUM control chart with variable sampling intervals. Comput Stat Data Anal 53(7):2693–2701MathSciNetCrossRefMATH

79.

Babcock B, Babu S, Datar M, Motwani R, Widom J (2002) Models and issues in data stream systems. In: Proceedings of the twenty-first ACM SIGMOD-SIGACT-SIGART symposium on principles of database systems, June 2002. ACM, pp 1–16

80.

Widmer G, Kubat M (1996) Learning in the presence of concept drift and hidden contexts. Mach Learn 23(1):69–101

81.

Kifer D, Ben-David S, Gehrke J (2004) Detecting change in data streams. In: Proceedings of the thirtieth international conference on very large data bases, vol 30, Aug 2004. VLDB Endowment, pp 180–191

82.

Bifet A, Gavalda R (2007) Learning from time-changing data with adaptive windowing. In: SDM, vol 7

83.

Hulten G, Spencer L, Domingos P (2001) Mining time-changing data streams. In: Proceedings of the seventh ACM SIGKDD international conference on knowledge discovery and data mining, Aug 2001. ACM, pp. 97–106

84.

Bach SH, Maloof M (2008) Paired learners for concept drift. In: Data mining, 2008. ICDM'08. Eighth IEEE international conference, Dec 2008. IEEE, pp 23–32

85.

Klingenberg R, Renz I (1998) Adaptive information filtering: learning in the presence of concept drift. In: Proceedings of AAAI/ICML-98 workshop on learning for text categorization, Madison, WI, pp 33–40

86.

Lazarescu M, Venkatesh S, Bui HH (2004) Using multiple windows to track concept drift. Intel Data Anal 8(1):29–60

87.

Koychev I (2000) Gradual forgetting for adaptation to concept drift. In: Proceedings of ECAI 2000 workshop on current issues in spatio-temporal reasoning

88.

Boubacar HA, Lecoeuche S, Maouche S (2005) Audyc neural network using a new gaussian densities merge mechanism. In: Adaptive and natural computing algorithms. Springer, Vienna, pp 155–158

89.

AlZoubi O, Fossati D, D’Mello S, Calvo RA (2014) Affect detection from non-stationary physiological data using ensemble classifiers. Evol Syst 6(2):79–92CrossRef

90.

Wang S, Minku LL, Yao X (2013) Online class imbalance learning and its applications in fault detection. Int J Comput Intel Appl 12(04):1340001CrossRef

Titel: Handling Concept Drift
verfasst von: Moamar Sayed-Mouchaweh
Verlag: Springer International Publishing
Buch: Learning from Data Streams in Dynamic Environments
Print ISBN: 978-3-319-25665-8

Electronic ISBN: 978-3-319-25667-2

Copyright-Jahr: 2016
DOI: https://doi.org/10.1007/978-3-319-25667-2_3

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"