Skip to main content

2021 | OriginalPaper | Buchkapitel

Hybrid Context-Aware Method for Quality Assessment of Data Streams

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Data quality is one of the most important issues that if not taken into consideration appropriately, results in the low reliability of the knowledge extracted through big data analytics. Furthermore, the challenges with data quality management are even greater with streaming data. Most of the methods introduced in the literature for processing streaming data do not use contextual information for the purpose of addressing data quality issues, however, it is possible to improve the performance of these methods by considering the contextual information, especially those obtained from the external resources. Based on this point of view, our main objective in this thesis is to propose a hybrid multivariate context-aware approach for data quality assessment in streaming environments, such as smart city applications.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
2
State of the Art on the Quality of Big Data: A Systematic Literature Review and Classification Framework.
 
3
Contextualization of Big Data Quality: A framework for comparison.
 
Literatur
1.
Zurück zum Zitat Perez-Castillo, R., et al.: DAQUA-MASS: an ISO 8000–61 based data quality management methodology for sensor data. Sensors 18(9), 3105 (2018)CrossRef Perez-Castillo, R., et al.: DAQUA-MASS: an ISO 8000–61 based data quality management methodology for sensor data. Sensors 18(9), 3105 (2018)CrossRef
2.
Zurück zum Zitat Bu, Y., Chen, L., Fu, A.W.-C., Liu, D.: Efficient anomaly monitoring over moving object trajectory streams. In: Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining - KDD 2009, p. 159 (2009) Bu, Y., Chen, L., Fu, A.W.-C., Liu, D.: Efficient anomaly monitoring over moving object trajectory streams. In: Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining - KDD 2009, p. 159 (2009)
3.
Zurück zum Zitat Sidi, F., Panahy, P.H.S., Affendey, L.S., Jabar, M.A., Ibrahim, H., Mustapha, A.: Data quality: a survey of data quality dimensions. In: Proceedings of 2012 International Conference on Information Retrieval and Knowledge Management CAMP 2012, pp. 300–304, June 2014 Sidi, F., Panahy, P.H.S., Affendey, L.S., Jabar, M.A., Ibrahim, H., Mustapha, A.: Data quality: a survey of data quality dimensions. In: Proceedings of 2012 International Conference on Information Retrieval and Knowledge Management CAMP 2012, pp. 300–304, June 2014
4.
Zurück zum Zitat Ardagna, D., Cappiello, C., Samá, W., Vitali, M.: Context-aware data quality assessment for big data. Future Gener. Comput. Syst. 89, 548–562 (2018)CrossRef Ardagna, D., Cappiello, C., Samá, W., Vitali, M.: Context-aware data quality assessment for big data. Future Gener. Comput. Syst. 89, 548–562 (2018)CrossRef
5.
Zurück zum Zitat Anusha, A., Rao, I.S., Student, M.T.: A study on outlier detection for temporal data. Int. J. Eng. Sci. Comput. 8(3), 16354–16356 (2018) Anusha, A., Rao, I.S., Student, M.T.: A study on outlier detection for temporal data. Int. J. Eng. Sci. Comput. 8(3), 16354–16356 (2018)
6.
Zurück zum Zitat Chen, L., Gao, S., Cao, X.: Research on real-time outlier detection over big data streams. Int. J. Comput. Appl. 42(8), 1–9 (2017) Chen, L., Gao, S., Cao, X.: Research on real-time outlier detection over big data streams. Int. J. Comput. Appl. 42(8), 1–9 (2017)
7.
Zurück zum Zitat Zhang, Y., Hamm, N.A.S., Meratnia, N., Stein, A., van de Voort, M., Havinga, P.J.M.: Statistics-based outlier detection for wireless sensor networks. Int. J. Geor. Inf. Sci. 26(8), 1373–1392 (2012)CrossRef Zhang, Y., Hamm, N.A.S., Meratnia, N., Stein, A., van de Voort, M., Havinga, P.J.M.: Statistics-based outlier detection for wireless sensor networks. Int. J. Geor. Inf. Sci. 26(8), 1373–1392 (2012)CrossRef
8.
Zurück zum Zitat Iyer, V.: Ensemble Stream Model for Data-Cleaning in Sensor Networks (2013) Iyer, V.: Ensemble Stream Model for Data-Cleaning in Sensor Networks (2013)
9.
Zurück zum Zitat Zhang, Y., Meratnia, N., Havinga, P.J.M.: Distributed online outlier detection in wireless sensor networks using ellipsoidal support vector machine. Ad Hoc Netw. 11(3), 1062–1074 (2013)CrossRef Zhang, Y., Meratnia, N., Havinga, P.J.M.: Distributed online outlier detection in wireless sensor networks using ellipsoidal support vector machine. Ad Hoc Netw. 11(3), 1062–1074 (2013)CrossRef
12.
Zurück zum Zitat Rassam, M.A., Maarof, M.A., Zainal, A.: A distributed anomaly detection model for wireless sensor networks based on the one-class principal component classifier. Int. J. Sens. Netw. 27(3), 200 (2018)CrossRef Rassam, M.A., Maarof, M.A., Zainal, A.: A distributed anomaly detection model for wireless sensor networks based on the one-class principal component classifier. Int. J. Sens. Netw. 27(3), 200 (2018)CrossRef
Metadaten
Titel
Hybrid Context-Aware Method for Quality Assessment of Data Streams
verfasst von
Mostafa Mirzaie
Copyright-Jahr
2021
DOI
https://doi.org/10.1007/978-3-030-76352-7_2