Skip to main content
Top

2018 | OriginalPaper | Chapter

Concept Tracking and Adaptation for Drifting Data Streams under Extreme Verification Latency

Authors : Maria Arostegi, Ana I. Torre-Bastida, Jesus L. Lobo, Miren Nekane Bilbao, Javier Del Ser

Published in: Intelligent Distributed Computing XII

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

When analyzing large-scale streaming data towards resolving classification problems, it is often assumed that true labels of the incoming data are available right after being predicted. This assumption allows online learning models to efficiently detect and accommodate non-stationarities in the distribution of the arriving data (concept drift). However, this assumption does not hold in many practical scenarios where a delay exists between predicted and class labels, to the point of lacking this supervision for an infinite period of time (extreme verification latency). In this case, the development of learning algorithms capable of adapting to drifting environments without any external supervision remains a challenging research area to date. In this context, this work proposes a simple yet effective learning technique to classify non-stationary data streams under extreme verification latency. The intuition motivating the design of our technique is to predict the trajectory of concepts in the feature space. The estimation of the region where concepts may reside in the future can be then exploited for producing more updated predictions for newly arriving examples, ultimately enhancing its accuracy during this unsupervised drifting period. Our approach is compared to a benchmark of incremental and static learning methods over a set of public non-stationary synthetic datasets. Results obtained by our passive learning method are promising and encourage further research aimed at generalizing its applicability to other types of drifts.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Bose, R.J.C., van der Aalst, WM., Žliobaite, I., Pechenizkiy, M.: Handling concept drift in process mining. In: International Conference on Advanced Information Systems Engineering, pp. 391–405. Springer (2011) Bose, R.J.C., van der Aalst, WM., Žliobaite, I., Pechenizkiy, M.: Handling concept drift in process mining. In: International Conference on Advanced Information Systems Engineering, pp. 391–405. Springer (2011)
2.
go back to reference Dehghan, M., Beigy, H., ZareMoodi, P.: A novel concept drift detection method in data streams using ensemble classifiers. Intell. Data Anal. 20(6), 1329–1350 (2016)CrossRef Dehghan, M., Beigy, H., ZareMoodi, P.: A novel concept drift detection method in data streams using ensemble classifiers. Intell. Data Anal. 20(6), 1329–1350 (2016)CrossRef
3.
go back to reference Delany, S.J., Cunningham, P., Tsymbal, A., Coyle, L.: A case-based technique for tracking concept drift in spam filtering. Knowl.-Based Syst. 18(4–5), 187–195 (2005)CrossRef Delany, S.J., Cunningham, P., Tsymbal, A., Coyle, L.: A case-based technique for tracking concept drift in spam filtering. Knowl.-Based Syst. 18(4–5), 187–195 (2005)CrossRef
4.
go back to reference Ditzler, G., Roveri, M., Alippi, C., Polikar, R.: Learning in nonstationary environments: a survey. IEEE Comput. Intell. Mag. 10(4), 12–25 (2015)CrossRef Ditzler, G., Roveri, M., Alippi, C., Polikar, R.: Learning in nonstationary environments: a survey. IEEE Comput. Intell. Mag. 10(4), 12–25 (2015)CrossRef
5.
go back to reference Dyer, K.B., Capo, R., Polikar, R.: Compose: a semisupervised learning framework for initially labeled nonstationary streaming data. IEEE Trans. Neural Netw. Learn. Syst. 25(1), 12–26 (2014)CrossRef Dyer, K.B., Capo, R., Polikar, R.: Compose: a semisupervised learning framework for initially labeled nonstationary streaming data. IEEE Trans. Neural Netw. Learn. Syst. 25(1), 12–26 (2014)CrossRef
6.
go back to reference Elwell, R., Polikar, R.: Incremental learning of concept drift in nonstationary environments. IEEE Trans. Neural Netw. 22(10), 1517–1531 (2011)CrossRef Elwell, R., Polikar, R.: Incremental learning of concept drift in nonstationary environments. IEEE Trans. Neural Netw. 22(10), 1517–1531 (2011)CrossRef
7.
go back to reference Escovedo, T., Koshiyama, A., da Cruz, A.A., Vellasco, M.: DetectA: abrupt concept drift detection in non-stationary environments. Appl. Soft Comput. 62, 119–133 (2018)CrossRef Escovedo, T., Koshiyama, A., da Cruz, A.A., Vellasco, M.: DetectA: abrupt concept drift detection in non-stationary environments. Appl. Soft Comput. 62, 119–133 (2018)CrossRef
8.
go back to reference Fan, W., Bifet, A.: Mining big data: current status, and forecast to the future. ACM SIGKDD Explor. Newsl. 14(2), 1–5 (2013)CrossRef Fan, W., Bifet, A.: Mining big data: current status, and forecast to the future. ACM SIGKDD Explor. Newsl. 14(2), 1–5 (2013)CrossRef
9.
go back to reference Frederickson, C., Gracie, T., Portley, S., Moore, M., Cahall, D., Polikar, R.: Adding adaptive intelligence to sensor systems with mass. In: IEEE Sensors Applications Symposium (SAS), pp. 1–6 (2017) Frederickson, C., Gracie, T., Portley, S., Moore, M., Cahall, D., Polikar, R.: Adding adaptive intelligence to sensor systems with mass. In: IEEE Sensors Applications Symposium (SAS), pp. 1–6 (2017)
10.
go back to reference Fritzke, B.: A growing neural gas network learns topologies. In: Advances in Neural Information Processing Systems, pp. 625–632 (1995) Fritzke, B.: A growing neural gas network learns topologies. In: Advances in Neural Information Processing Systems, pp. 625–632 (1995)
11.
go back to reference Gaber, M.M., Zaslavsky, A., Krishnaswamy, S.: Mining data streams: a review. ACM Sigmod Rec. 34(2), 18–26 (2005)CrossRef Gaber, M.M., Zaslavsky, A., Krishnaswamy, S.: Mining data streams: a review. ACM Sigmod Rec. 34(2), 18–26 (2005)CrossRef
12.
go back to reference Gama, J., Žliobaite, I., Bifet, A., Pechenizkiy, M., Bouchachia, A.: A survey on concept drift adaptation. ACM Comput. Surv. 46(4), 44 (2014)CrossRef Gama, J., Žliobaite, I., Bifet, A., Pechenizkiy, M., Bouchachia, A.: A survey on concept drift adaptation. ACM Comput. Surv. 46(4), 44 (2014)CrossRef
13.
go back to reference Gonçalves Jr., P.M., De Barros, R.S.M.: RCD: a recurring concept drift framework. Pattern Recogn. Lett. 34(9), 1018–1025 (2013)CrossRef Gonçalves Jr., P.M., De Barros, R.S.M.: RCD: a recurring concept drift framework. Pattern Recogn. Lett. 34(9), 1018–1025 (2013)CrossRef
14.
go back to reference Hofer, V., Krempl, G.: Drift mining in data: a framework for addressing drift in classification. Comput. Stat. Data Anal. 57(1), 377–391 (2013)MathSciNetCrossRef Hofer, V., Krempl, G.: Drift mining in data: a framework for addressing drift in classification. Comput. Stat. Data Anal. 57(1), 377–391 (2013)MathSciNetCrossRef
15.
go back to reference Kambatla, K., Kollias, G., Kumar, V., Grama, A.: Trends in big data analytics. J. Parallel Distrib. Comput. 74(7), 2561–2573 (2014)CrossRef Kambatla, K., Kollias, G., Kumar, V., Grama, A.: Trends in big data analytics. J. Parallel Distrib. Comput. 74(7), 2561–2573 (2014)CrossRef
16.
go back to reference Khan, L., Fan, W.: Tutorial: data stream mining and its applications. In: International Conference on Database Systems for Advanced Applications, pp. 328–329 (2012)CrossRef Khan, L., Fan, W.: Tutorial: data stream mining and its applications. In: International Conference on Database Systems for Advanced Applications, pp. 328–329 (2012)CrossRef
17.
go back to reference Krempl, G.: The algorithm apt to classify in concurrence of latency and drift. In: International Symposium on Intelligent Data Analysis, pp. 222–233 (2011)CrossRef Krempl, G.: The algorithm apt to classify in concurrence of latency and drift. In: International Symposium on Intelligent Data Analysis, pp. 222–233 (2011)CrossRef
18.
go back to reference Krempl, G., Žliobaite, I., Brzeziński, D., Hüllermeier, E., Last, M., Lemaire, V., Noack, T., Shaker, A., Sievi, S., Spiliopoulou, M.: Open challenges for data stream mining research. ACM SIGKDD Explor. News. 16(1), 1–10 (2014)CrossRef Krempl, G., Žliobaite, I., Brzeziński, D., Hüllermeier, E., Last, M., Lemaire, V., Noack, T., Shaker, A., Sievi, S., Spiliopoulou, M.: Open challenges for data stream mining research. ACM SIGKDD Explor. News. 16(1), 1–10 (2014)CrossRef
19.
go back to reference Lobo, J.L., Del Ser, J., Bilbao, M.N., Perfecto, C., Salcedo-Sanz, S.: DRED: an evolutionary diversity generation method for concept drift adaptation in online learning environments. Appl. Soft Comput. 68, 693–709 (2018)CrossRef Lobo, J.L., Del Ser, J., Bilbao, M.N., Perfecto, C., Salcedo-Sanz, S.: DRED: an evolutionary diversity generation method for concept drift adaptation in online learning environments. Appl. Soft Comput. 68, 693–709 (2018)CrossRef
20.
go back to reference Losing, V., Hammer, B., Wersing, H.: Tackling heterogeneous concept drift with the self-adjusting memory (sam). Knowl. Inf. Syst. 1–31 (2018) Losing, V., Hammer, B., Wersing, H.: Tackling heterogeneous concept drift with the self-adjusting memory (sam). Knowl. Inf. Syst. 1–31 (2018)
21.
go back to reference Marrs, G.R., Hickey, R.J., Black, M.M.: The impact of latency on online classification learning with concept drift. International Conference on Knowledge Science, Engineering and Management, pp. 459–469. Springer (2010) Marrs, G.R., Hickey, R.J., Black, M.M.: The impact of latency on online classification learning with concept drift. International Conference on Knowledge Science, Engineering and Management, pp. 459–469. Springer (2010)
22.
go back to reference Minku, L.L., White, A.P., Yao, X.: The impact of diversity on online ensemble learning in the presence of concept drift. IEEE Trans. Knowl. Data Eng. 22(5), 730–742 (2010)CrossRef Minku, L.L., White, A.P., Yao, X.: The impact of diversity on online ensemble learning in the presence of concept drift. IEEE Trans. Knowl. Data Eng. 22(5), 730–742 (2010)CrossRef
23.
go back to reference Pang, S., Ozawa, S., Kasabov, N.: Incremental linear discriminant analysis for classification of data streams. IEEE Trans. Syst. Man Cybern. Part B (Cybern.) 35(5), 905–914 (2005)CrossRef Pang, S., Ozawa, S., Kasabov, N.: Incremental linear discriminant analysis for classification of data streams. IEEE Trans. Syst. Man Cybern. Part B (Cybern.) 35(5), 905–914 (2005)CrossRef
24.
go back to reference Souza, V.M., Silva, D.F., Gama, J., Batista, G.E.: Data stream classification guided by clustering on nonstationary environments and extreme verification latency. In: SIAM International Conference on Data Mining, pp. 873–881 (2015)CrossRef Souza, V.M., Silva, D.F., Gama, J., Batista, G.E.: Data stream classification guided by clustering on nonstationary environments and extreme verification latency. In: SIAM International Conference on Data Mining, pp. 873–881 (2015)CrossRef
25.
go back to reference Stanley, K.O.: Learning concept drift with a committee of decision trees. Report UT-AI-TR-03-302, Department of Computer Sciences, University of Texas at Austin, USA (2003) Stanley, K.O.: Learning concept drift with a committee of decision trees. Report UT-AI-TR-03-302, Department of Computer Sciences, University of Texas at Austin, USA (2003)
26.
go back to reference Street, W.N., Kim, Y.: A streaming ensemble algorithm (SEA) for large-scale classification. In: ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 377–382 (2001) Street, W.N., Kim, Y.: A streaming ensemble algorithm (SEA) for large-scale classification. In: ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 377–382 (2001)
27.
go back to reference Tsai, C.W., Lai, C.F., Chao, H.C., Vasilakos, A.V.: Big data analytics: a survey. J. Big Data 2(1), 21 (2015)CrossRef Tsai, C.W., Lai, C.F., Chao, H.C., Vasilakos, A.V.: Big data analytics: a survey. J. Big Data 2(1), 21 (2015)CrossRef
28.
go back to reference Tsymbal, A., Pechenizkiy, M., Cunningham, P., Puuronen, S.: Dynamic integration of classifiers for handling concept drift. Inf. Fusion 9(1), 56–68 (2008)CrossRef Tsymbal, A., Pechenizkiy, M., Cunningham, P., Puuronen, S.: Dynamic integration of classifiers for handling concept drift. Inf. Fusion 9(1), 56–68 (2008)CrossRef
29.
go back to reference Umer, M., Frederickson, C., Polikar, R.: Learning under extreme verification latency quickly: fast compose. In: IEEE Symposium Series on Computational Intelligence (SSCI), pp. 1–8. IEEE (2016) Umer, M., Frederickson, C., Polikar, R.: Learning under extreme verification latency quickly: fast compose. In: IEEE Symposium Series on Computational Intelligence (SSCI), pp. 1–8. IEEE (2016)
30.
go back to reference Widmer, G., Kubat, M.: Learning in the presence of concept drift and hidden contexts. Mach. Learn. 23(1), 69–101 (1996) Widmer, G., Kubat, M.: Learning in the presence of concept drift and hidden contexts. Mach. Learn. 23(1), 69–101 (1996)
31.
go back to reference Xioufis, E.S., Spiliopoulou, M., Tsoumakas, G., Vlahavas, IP.: Dealing with concept drift and class imbalance in multi-label stream classification. In: International Joint Conferences on Artificial Intelligence, pp. 1583–1588 (2011) Xioufis, E.S., Spiliopoulou, M., Tsoumakas, G., Vlahavas, IP.: Dealing with concept drift and class imbalance in multi-label stream classification. In: International Joint Conferences on Artificial Intelligence, pp. 1583–1588 (2011)
Metadata
Title
Concept Tracking and Adaptation for Drifting Data Streams under Extreme Verification Latency
Authors
Maria Arostegi
Ana I. Torre-Bastida
Jesus L. Lobo
Miren Nekane Bilbao
Javier Del Ser
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-319-99626-4_2

Premium Partner