Skip to main content
Top

2019 | OriginalPaper | Chapter

Data Quality Management Framework for Smart Grid Systems

Authors : Mouzhi Ge, Stanislav Chren, Bruno Rossi, Tomas Pitner

Published in: Business Information Systems

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

New devices in smart grid such as smart meters and sensors have emerged to become a massive and complex network, where a large volume of data is flowing to the smart grid systems. Those data can be real-time, fast-moving, and originated from a vast variety of terminal devices. However, the big smart grid data also bring various data quality problems, which may cause the delayed, inaccurate analysis of results, even fatal errors in the smart grid system. This paper, therefore, identifies a comprehensive taxonomy of typical data quality problems in the smart grid. Based on the adaptation of established data quality research and frameworks, this paper proposes a new data quality management framework that classifies the typical data quality problems into related data quality dimensions, contexts, as well as countermeasures. Based on this framework, this paper not only provides a systematic overview of data quality in the smart grid domain, but also offers practical guidance to improve data quality in smart grids such as which data quality dimensions are critical and which data quality problems can be addressed in which context.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Abo, R., Even, A.: Managing the quality of smart grid data research in progress. In: IEEE International Conference on Emerging Technologies and Innovative Business Practices for the Transformation of Societies, pp. 5–8 (2016) Abo, R., Even, A.: Managing the quality of smart grid data research in progress. In: IEEE International Conference on Emerging Technologies and Innovative Business Practices for the Transformation of Societies, pp. 5–8 (2016)
2.
go back to reference Al-Omar, B., Al-Ali, A., Ahmed, R., Landolsi, T.: Role of information and communication technologies in the smart grid. J. Emerg. Trends Comput. Inf. Sci. 3(5), 707–716 (2012) Al-Omar, B., Al-Ali, A., Ahmed, R., Landolsi, T.: Role of information and communication technologies in the smart grid. J. Emerg. Trends Comput. Inf. Sci. 3(5), 707–716 (2012)
3.
go back to reference Alahakoon, D., Yu, X.: Smart electricity meter data intelligence for future energy systems: a survey. IEEE Trans. Industr. Inf. 12(1), 425–436 (2016)CrossRef Alahakoon, D., Yu, X.: Smart electricity meter data intelligence for future energy systems: a survey. IEEE Trans. Industr. Inf. 12(1), 425–436 (2016)CrossRef
4.
go back to reference Buchmann, E., Böhm, K., Burghardt, T., Kessler, S.: Re-identification of smart meter data. Pers. Ubiquit. Comput. 17(4), 653–662 (2013)CrossRef Buchmann, E., Böhm, K., Burghardt, T., Kessler, S.: Re-identification of smart meter data. Pers. Ubiquit. Comput. 17(4), 653–662 (2013)CrossRef
5.
go back to reference Burnett, R.O., Butts, M.M., Sterlina, P.S.: Power system applications for phasor measurement units. IEEE Comput. Appl. Power 7(1), 8–13 (1994)CrossRef Burnett, R.O., Butts, M.M., Sterlina, P.S.: Power system applications for phasor measurement units. IEEE Comput. Appl. Power 7(1), 8–13 (1994)CrossRef
6.
go back to reference Chen, J., Li, W., Lau, A., Cao, J., Wang, K.: Automated load curve data cleansing in power systems. IEEE Trans. Smart Grid 1(2), 213–221 (2010)CrossRef Chen, J., Li, W., Lau, A., Cao, J., Wang, K.: Automated load curve data cleansing in power systems. IEEE Trans. Smart Grid 1(2), 213–221 (2010)CrossRef
7.
go back to reference Chen, P.Y., Cheng, S.M., Chen, K.C.: Smart attacks in smart grid communication networks. IEEE Commun. Mag. 50(8), 24–29 (2012)CrossRef Chen, P.Y., Cheng, S.M., Chen, K.C.: Smart attacks in smart grid communication networks. IEEE Commun. Mag. 50(8), 24–29 (2012)CrossRef
8.
go back to reference Chen, W., Zhou, K., Yang, S., Wu, C.: Data quality of electricity consumption data in a smart grid environment. Renew. Sustain. Energy Rev. 75, 98–105 (2017)CrossRef Chen, W., Zhou, K., Yang, S., Wu, C.: Data quality of electricity consumption data in a smart grid environment. Renew. Sustain. Energy Rev. 75, 98–105 (2017)CrossRef
9.
go back to reference Chren, S., Rossi, B., Buhnova, B., Pitner, T.: Reliability data for smart grids: where the real data can be found. In: 2018 Smart City Symposium Prague, pp. 1–6 (2018) Chren, S., Rossi, B., Buhnova, B., Pitner, T.: Reliability data for smart grids: where the real data can be found. In: 2018 Smart City Symposium Prague, pp. 1–6 (2018)
10.
go back to reference Chren, S., Rossi, B., Pitner, T.: Smart grids deployments within EU projects: the role of smart meters. In: 2016 Smart Cities Symposium Prague, pp. 1–5. IEEE (2016) Chren, S., Rossi, B., Pitner, T.: Smart grids deployments within EU projects: the role of smart meters. In: 2016 Smart Cities Symposium Prague, pp. 1–5. IEEE (2016)
11.
go back to reference Daki, H., El Hannani, A., Aqqal, A., Haidine, A., Dahbi, A.: Big data management in smart grid: concepts, requirements and implementation. J. Big Data 4(1), 13 (2017)CrossRef Daki, H., El Hannani, A., Aqqal, A., Haidine, A., Dahbi, A.: Big data management in smart grid: concepts, requirements and implementation. J. Big Data 4(1), 13 (2017)CrossRef
12.
go back to reference Efthymiou, C., Kalogridis, G.: Smart grid privacy via anonymization of smart metering data. In: First IEEE International Conference on Smart Grid Communications, pp. 238–243. IEEE (2010) Efthymiou, C., Kalogridis, G.: Smart grid privacy via anonymization of smart metering data. In: First IEEE International Conference on Smart Grid Communications, pp. 238–243. IEEE (2010)
13.
go back to reference Eichinger, F., Pathmaperuma, D., Vogt, H., Müller, E.: Data analysis challenges in the future energy domain. In: Computational Intelligent Data Analysis for Sustainable Development, pp. 181–242 (2013) Eichinger, F., Pathmaperuma, D., Vogt, H., Müller, E.: Data analysis challenges in the future energy domain. In: Computational Intelligent Data Analysis for Sustainable Development, pp. 181–242 (2013)
14.
go back to reference Gao, J., Xiao, Y., Liu, J., Liang, W., Chen, C.P.: A survey of communication/networking in smart grids. Future Gener. Comput. Syst. 28(2), 391–404 (2012)CrossRef Gao, J., Xiao, Y., Liu, J., Liang, W., Chen, C.P.: A survey of communication/networking in smart grids. Future Gener. Comput. Syst. 28(2), 391–404 (2012)CrossRef
15.
go back to reference Ge, M., Helfert, M.: A framework to assess decision quality using information quality dimensions. In: Proceedings of the 11th International Conference on Information Quality, pp. 455–466. MIT, USA (2006) Ge, M., Helfert, M.: A framework to assess decision quality using information quality dimensions. In: Proceedings of the 11th International Conference on Information Quality, pp. 455–466. MIT, USA (2006)
16.
go back to reference Ge, M., Helfert, M.: Effects of information quality on inventory management. Int. J. Inf. Qual. 2(2), 177–191 (2008) Ge, M., Helfert, M.: Effects of information quality on inventory management. Int. J. Inf. Qual. 2(2), 177–191 (2008)
17.
go back to reference Ge, M., Helfert, M., Jannach, D.: Information quality assessment: validating measurement dimensions and processes. In: 19th European Conference on Information Systems, Helsinki, Finland, p. 75 (2011) Ge, M., Helfert, M., Jannach, D.: Information quality assessment: validating measurement dimensions and processes. In: 19th European Conference on Information Systems, Helsinki, Finland, p. 75 (2011)
19.
go back to reference Gellings, C.W., Samotyj, M., Howe, B.: The future’s smart delivery system. IEEE Power Energ. Mag. 2(5), 40–48 (2004)CrossRef Gellings, C.W., Samotyj, M., Howe, B.: The future’s smart delivery system. IEEE Power Energ. Mag. 2(5), 40–48 (2004)CrossRef
20.
go back to reference Jakkula, V., Cook, D.: Outlier detection in smart environment structured power datasets. In: Sixth International Conference on Intelligent Environments, pp. 29–33. IEEE (2010) Jakkula, V., Cook, D.: Outlier detection in smart environment structured power datasets. In: Sixth International Conference on Intelligent Environments, pp. 29–33. IEEE (2010)
21.
go back to reference Jawurek, M., Johns, M., Rieck, K.: Smart metering de-pseudonymization. In: 27th Annual Computer Security Applications Conference, pp. 227–236 (2011) Jawurek, M., Johns, M., Rieck, K.: Smart metering de-pseudonymization. In: 27th Annual Computer Security Applications Conference, pp. 227–236 (2011)
22.
go back to reference Kim, M., Park, S., Lee, J., Joo, Y., Choi, J.K.: Learning-based adaptive imputation methodwith kNN algorithm for missing power data. Energies 10(10), 1668 (2017)CrossRef Kim, M., Park, S., Lee, J., Joo, Y., Choi, J.K.: Learning-based adaptive imputation methodwith kNN algorithm for missing power data. Energies 10(10), 1668 (2017)CrossRef
23.
go back to reference Kosut, O., Jia, L., Thomas, R.J., Tong, L.: Malicious data attacks on the smart grid. IEEE Trans. Smart Grid 2(4), 645–658 (2011)CrossRef Kosut, O., Jia, L., Thomas, R.J., Tong, L.: Malicious data attacks on the smart grid. IEEE Trans. Smart Grid 2(4), 645–658 (2011)CrossRef
24.
go back to reference Leonardi, A., Ziekow, H., Strohbach, M., Kikiras, P.: Dealing with data quality in smart home environments lessons learned from a smart grid pilot. J. Sens. Actuator Netw. 5(1), 5 (2016)CrossRef Leonardi, A., Ziekow, H., Strohbach, M., Kikiras, P.: Dealing with data quality in smart home environments lessons learned from a smart grid pilot. J. Sens. Actuator Netw. 5(1), 5 (2016)CrossRef
25.
go back to reference Li, F., et al.: Smart transmission grid: vision and framework. IEEE Trans. Smart Grid 1(2), 168–177 (2010)CrossRef Li, F., et al.: Smart transmission grid: vision and framework. IEEE Trans. Smart Grid 1(2), 168–177 (2010)CrossRef
26.
go back to reference Li, F., Luo, B.: Preserving data integrity for smart grid data aggregation. In: 2012 IEEE Third International Conference on Smart Grid Communications, pp. 366–371. IEEE (2012) Li, F., Luo, B.: Preserving data integrity for smart grid data aggregation. In: 2012 IEEE Third International Conference on Smart Grid Communications, pp. 366–371. IEEE (2012)
27.
go back to reference Liu, Y., Ning, P., Reiter, M.K.: False data injection attacks against state estimation in electric power grids. ACM Trans. Inf. Syst. Secur. 14(1), 13 (2011)CrossRef Liu, Y., Ning, P., Reiter, M.K.: False data injection attacks against state estimation in electric power grids. ACM Trans. Inf. Syst. Secur. 14(1), 13 (2011)CrossRef
28.
go back to reference Matta, N., Rahim-Amoud, R., Merghem-Boulahia, L., Jrad, A.: Putting sensor data to the service of the smart grid: from the substation to the AMI. J. Netw. Syst. Manage. 26(1), 108–126 (2018)CrossRef Matta, N., Rahim-Amoud, R., Merghem-Boulahia, L., Jrad, A.: Putting sensor data to the service of the smart grid: from the substation to the AMI. J. Netw. Syst. Manage. 26(1), 108–126 (2018)CrossRef
29.
go back to reference Peppanen, J., Zhang, X., Grijalva, S., Reno, M.J.: Handling bad or missing smart meter data through advanced data imputation. In: IEEE Innovative Smart Grid Technologies Conference, pp. 1–5. IEEE (2016) Peppanen, J., Zhang, X., Grijalva, S., Reno, M.J.: Handling bad or missing smart meter data through advanced data imputation. In: IEEE Innovative Smart Grid Technologies Conference, pp. 1–5. IEEE (2016)
30.
go back to reference Rao, R., Akella, S., Guley, G.: Power line carrier (PLC) signal analysis of smart meters for outlier detection. In: IEEE International Conference on Smart Grid Communications, pp. 291–296. IEEE (2011) Rao, R., Akella, S., Guley, G.: Power line carrier (PLC) signal analysis of smart meters for outlier detection. In: IEEE International Conference on Smart Grid Communications, pp. 291–296. IEEE (2011)
31.
go back to reference Rossi, B., Chren, S., Buhnova, B., Pitner, T.: Anomaly detection in smart grid data: an experience report. In: IEEE International Conference on Systems, Man, and Cybernetics, pp. 2313–2318. IEEE (2016) Rossi, B., Chren, S., Buhnova, B., Pitner, T.: Anomaly detection in smart grid data: an experience report. In: IEEE International Conference on Systems, Man, and Cybernetics, pp. 2313–2318. IEEE (2016)
32.
go back to reference Shishido, J., Solutions, E.U.: Smart meter data quality insights. In: ACEEE Summer Study on Energy Efficiency in Buildings (2012) Shishido, J., Solutions, E.U.: Smart meter data quality insights. In: ACEEE Summer Study on Energy Efficiency in Buildings (2012)
33.
go back to reference Wang, R.Y., Strong, D.M.: Beyond accuracy: what data quality means to data consumers. J. Manag. Inf. Syst. 12(4), 5–33 (1996)CrossRef Wang, R.Y., Strong, D.M.: Beyond accuracy: what data quality means to data consumers. J. Manag. Inf. Syst. 12(4), 5–33 (1996)CrossRef
34.
go back to reference Zhang, Q., Luo, X., Bertagnolli, D., Maslennikov, S., Nubile, B.: PMU data validation at iso new england. In: 2013 IEEE Power and Energy Society General Meeting (PES), pp. 1–5. IEEE (2013) Zhang, Q., Luo, X., Bertagnolli, D., Maslennikov, S., Nubile, B.: PMU data validation at iso new england. In: 2013 IEEE Power and Energy Society General Meeting (PES), pp. 1–5. IEEE (2013)
35.
go back to reference Zhang, Y., Huang, T., Bompard, E.F.: Big data analytics in smart grids: a review. Energy Inform. 1(1), 8 (2018)CrossRef Zhang, Y., Huang, T., Bompard, E.F.: Big data analytics in smart grids: a review. Energy Inform. 1(1), 8 (2018)CrossRef
Metadata
Title
Data Quality Management Framework for Smart Grid Systems
Authors
Mouzhi Ge
Stanislav Chren
Bruno Rossi
Tomas Pitner
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-030-20482-2_24

Premium Partner