Skip to main content
Top

2019 | OriginalPaper | Chapter

A New Approach to Reduce Time Consumption of Data Quality Assessment in the Field of Energy Consumption

Authors : Alexander Sokolov, Maxim V. Shcherbakov, Anton Tyukov, Timur Janovsky

Published in: Creativity in Intelligent Technologies and Data Science

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper is devoted to solving the problem of reducing the time costs of the process of data quality assessment. The data describe energy resources consumption of various enterprises and institutions. The first part of the paper contains a review of recent data quality assessment studies was made. The analysis describes the problems of this process and the characteristics of the data, metadata and the algorithms used in it. The next part of the paper shows a new approach to reduce the time consumption of the process of assessing the data quality, which differs from the existing ones by the presence of a data-packaging and decision-making support using the oDMN+ notation. Finally, this paper presents an implementation example of the oDMN+ model for data on the energy consumption of the Volgograd hardware plant. The results showed that the use of data packaging and modeling the assessment process is a promising approach for modeling and reducing time costs in the process of data quality assessment for energy management systems used in the enterprises and institutions.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Tyukov, A., Brebels, A., Shcherbakov, M., Kamaev, V.: A concept of web-based energy data quality assurance and control system. In: 14th International Conference on Information Integration and Web-based Applications & Services (IIWAS 2012), pp. 267–271. ACM, New York, NY, USA (2012) Tyukov, A., Brebels, A., Shcherbakov, M., Kamaev, V.: A concept of web-based energy data quality assurance and control system. In: 14th International Conference on Information Integration and Web-based Applications & Services (IIWAS 2012), pp. 267–271. ACM, New York, NY, USA (2012)
2.
go back to reference Fu, Y., Li, Z., Feng, F., Xu, P.: Data-quality detection and recovery for building energy management and control systems: case study on submetering. Sci. Technol. Built. Environ. 22(6), 798–809 (2016)CrossRef Fu, Y., Li, Z., Feng, F., Xu, P.: Data-quality detection and recovery for building energy management and control systems: case study on submetering. Sci. Technol. Built. Environ. 22(6), 798–809 (2016)CrossRef
3.
go back to reference Mohammadi, M., Al-Fuqaha, A., Sorour, S., Guizani, M.: Deep learning for IoT big data and streaming analytics: a survey. IEEE Commun. Surv. Tutorials 20(4), 2923–2960 (2018)CrossRef Mohammadi, M., Al-Fuqaha, A., Sorour, S., Guizani, M.: Deep learning for IoT big data and streaming analytics: a survey. IEEE Commun. Surv. Tutorials 20(4), 2923–2960 (2018)CrossRef
4.
go back to reference Tyukov, A., Khrzhanovskaya, O., Sokolov, A., Shcherbakov, M., Kamaev, V.: Fast access to large timeseries datasets in SCADA systems. Res. J. Appl. Sci. 10(1), 12–16 (2015) Tyukov, A., Khrzhanovskaya, O., Sokolov, A., Shcherbakov, M., Kamaev, V.: Fast access to large timeseries datasets in SCADA systems. Res. J. Appl. Sci. 10(1), 12–16 (2015)
5.
go back to reference Aljumaili, M., Karim, R., Tretten, P.: Metadata-based data quality assessment. VINE J. Inf. Knowl. Manag. Syst. 46(2), 232–250 (2016)CrossRef Aljumaili, M., Karim, R., Tretten, P.: Metadata-based data quality assessment. VINE J. Inf. Knowl. Manag. Syst. 46(2), 232–250 (2016)CrossRef
6.
go back to reference Aquino, G., Farias, C.M., Pirmez, L.: Data Quality Assessment and Enhancement on Social and Sensor Data. BiDu-Posters@VLDB (2018) Aquino, G., Farias, C.M., Pirmez, L.: Data Quality Assessment and Enhancement on Social and Sensor Data. BiDu-Posters@VLDB (2018)
7.
go back to reference Kuemper, D., Iggena, T., Toenjes, R., Pulvermueller, E.: Valid.IoT: a framework for sensor data quality analysis and interpolation. In: 9th ACM Multimedia Systems Conference (MMSys 2018), pp. 294–303. ACM, New York, NY, USA (2018) Kuemper, D., Iggena, T., Toenjes, R., Pulvermueller, E.: Valid.IoT: a framework for sensor data quality analysis and interpolation. In: 9th ACM Multimedia Systems Conference (MMSys 2018), pp. 294–303. ACM, New York, NY, USA (2018)
8.
go back to reference do Nascimento, N.M., de Lucena, C.J.P.: FIoT: an agent-based framework for self-adaptive and self-organizing applications based on the Internet of Things. Inf. Sci. 378, 161–176 (2017)CrossRef do Nascimento, N.M., de Lucena, C.J.P.: FIoT: an agent-based framework for self-adaptive and self-organizing applications based on the Internet of Things. Inf. Sci. 378, 161–176 (2017)CrossRef
9.
go back to reference Timms, G.P., de Souza, P.A., Reznik Jr., L., Smith, D.V.: Automated data quality assessment of marine sensors. Sensors 11(10), 9589–9602 (2011)CrossRef Timms, G.P., de Souza, P.A., Reznik Jr., L., Smith, D.V.: Automated data quality assessment of marine sensors. Sensors 11(10), 9589–9602 (2011)CrossRef
10.
go back to reference Campbell, J.L., et al.: Quantity is nothing without quality: automated QA/QC for streaming environmental sensor data. Bioscience 63(7), 574–585 (2013)CrossRef Campbell, J.L., et al.: Quantity is nothing without quality: automated QA/QC for streaming environmental sensor data. Bioscience 63(7), 574–585 (2013)CrossRef
11.
go back to reference Sokolov, A., Scherbakov, M., Tyukov, A., Janovsky, T.: Data quality and assurance framework for sensor-driven applications. In: Mathematical Methods in Engineering and Technology (MMTT-31), pp. 87–97. St. Petersburg State Technological Institute, St. Petersburg (2017) Sokolov, A., Scherbakov, M., Tyukov, A., Janovsky, T.: Data quality and assurance framework for sensor-driven applications. In: Mathematical Methods in Engineering and Technology (MMTT-31), pp. 87–97. St. Petersburg State Technological Institute, St. Petersburg (2017)
14.
go back to reference Rahman, A., Smith, D.V., Timms, G.: A novel machine learning approach toward quality assessment of sensor data. IEEE Sens. J. 14(4), 1035–1047 (2014)CrossRef Rahman, A., Smith, D.V., Timms, G.: A novel machine learning approach toward quality assessment of sensor data. IEEE Sens. J. 14(4), 1035–1047 (2014)CrossRef
15.
go back to reference Kontokosta, C.E.: DataIQ – a machine learning approach to anomaly detection for energy performance data quality and reliability. In: ACEEE Summer Study on Energy Efficiency in Buildings (2016) Kontokosta, C.E.: DataIQ – a machine learning approach to anomaly detection for energy performance data quality and reliability. In: ACEEE Summer Study on Energy Efficiency in Buildings (2016)
16.
go back to reference Vale, S.: Statistical Data Quality in the UNECE. United Nations Statistics Division (2010) Vale, S.: Statistical Data Quality in the UNECE. United Nations Statistics Division (2010)
17.
go back to reference Vetrò, A., Canova, L., Torchiano, M., Minotas, C.O., Iemma, R., Morando, F.: Open data quality measurement framework: definition and application to open government data. Govern. Inf. Q. 33(2), 325–337 (2016)CrossRef Vetrò, A., Canova, L., Torchiano, M., Minotas, C.O., Iemma, R., Morando, F.: Open data quality measurement framework: definition and application to open government data. Govern. Inf. Q. 33(2), 325–337 (2016)CrossRef
18.
go back to reference Horita, F.E.A., de Albuquerque, J.P., Marchezini, V., Mendiondo, E.M.: Bridging the gap between decision-making and emerging big data sources: an application of a model-based framework to disaster management in Brazil. Decis. Support Syst. 97, 12–22 (2017)CrossRef Horita, F.E.A., de Albuquerque, J.P., Marchezini, V., Mendiondo, E.M.: Bridging the gap between decision-making and emerging big data sources: an application of a model-based framework to disaster management in Brazil. Decis. Support Syst. 97, 12–22 (2017)CrossRef
20.
go back to reference Dunning, T., Friedman, E.: Time Series Databases: New Ways to Store and Access Data, 1st edn. O’Reilly Media Inc, Sebastopol (2014) Dunning, T., Friedman, E.: Time Series Databases: New Ways to Store and Access Data, 1st edn. O’Reilly Media Inc, Sebastopol (2014)
Metadata
Title
A New Approach to Reduce Time Consumption of Data Quality Assessment in the Field of Energy Consumption
Authors
Alexander Sokolov
Maxim V. Shcherbakov
Anton Tyukov
Timur Janovsky
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-030-29743-5_4

Premium Partner