Skip to main content
Top

2019 | OriginalPaper | Chapter

Review of Power Spatio-Temporal Big Data Technologies, Applications, and Challenges

Authors : Ying Ma, Chao Huang, Yu Sun, Guang Zhao, Yunjie Lei

Published in: Security, Privacy, and Anonymity in Computation, Communication, and Storage

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The spatio-temporal big data of the power grid has experienced explosive growth, especially the development of various power sensors, smart devices, communication devices, and real-time processing hardware, which has led to unprecedented opportunities and challenges in this field. This paper firstly introduces Power Spatio-Temporal Big Data (PSTBD) technologies based on the characteristics of grid spatio-temporal big data, followed by a comprehensive survey of relevant articles analysis in this field. Then we compare the difference between traditional power grid and PSTBD platform, and focus on the key technologies of current PSTBD and corresponding typical applications. Finally, the development direction and challenges of PSTBD are given. Through data analysis and technical discussion, we provided technical supports and decision supports for relevant practitioners in PSTBD field.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Liu, D., Xu, P., Ren, L.: TPFlow: progressive partition and multidimensional pattern extraction for large-scale spatio-temporal data analysis. IEEE Trans. Vis. Comput. Graph. 25(1), 1–11 (2019)CrossRef Liu, D., Xu, P., Ren, L.: TPFlow: progressive partition and multidimensional pattern extraction for large-scale spatio-temporal data analysis. IEEE Trans. Vis. Comput. Graph. 25(1), 1–11 (2019)CrossRef
2.
go back to reference Lu, M., Pebesma, E., Sanchez, A., Verbesselt, J.: Spatio-temporal change detection from multidimensional arrays: detecting deforestation from MODIS time series. ISPRS J. Photogram. Remote Sens. 117, 227–236 (2016)CrossRef Lu, M., Pebesma, E., Sanchez, A., Verbesselt, J.: Spatio-temporal change detection from multidimensional arrays: detecting deforestation from MODIS time series. ISPRS J. Photogram. Remote Sens. 117, 227–236 (2016)CrossRef
3.
go back to reference Idehen, I., Wang, B., Shetye, K., Overbye, T., Weber, J.: Visualization of large-scale electric grid oscillation modes. In: 2018 IEEE North American Power Symposium (NAPS), pp. 1–6 (2018) Idehen, I., Wang, B., Shetye, K., Overbye, T., Weber, J.: Visualization of large-scale electric grid oscillation modes. In: 2018 IEEE North American Power Symposium (NAPS), pp. 1–6 (2018)
4.
go back to reference Li, Y., Wang, Z., Hao, Y.: A hierarchical visualization analysis model of power big data. In: IOP Conference Series: Earth and Environmental Science, vol. 108, no. 5, pp. 52–64 (2018)CrossRef Li, Y., Wang, Z., Hao, Y.: A hierarchical visualization analysis model of power big data. In: IOP Conference Series: Earth and Environmental Science, vol. 108, no. 5, pp. 52–64 (2018)CrossRef
5.
go back to reference Yu, N., Shah, S., Johnson, R., Sherick, R., Hong, M., Loparo, K.: Big data analytics in power distribution systems. In: 2015 IEEE Power and Energy Society Innovative Smart Grid Technologies Conference (ISGT), pp. 1–5 (2015) Yu, N., Shah, S., Johnson, R., Sherick, R., Hong, M., Loparo, K.: Big data analytics in power distribution systems. In: 2015 IEEE Power and Energy Society Innovative Smart Grid Technologies Conference (ISGT), pp. 1–5 (2015)
6.
go back to reference Sadiq, B., et al.: A spatio-temporal multimedia big data framework for a large crowd. In: 2015 IEEE International Conference on Big Data (Big Data), pp. 2742–2751 (2015) Sadiq, B., et al.: A spatio-temporal multimedia big data framework for a large crowd. In: 2015 IEEE International Conference on Big Data (Big Data), pp. 2742–2751 (2015)
7.
go back to reference Cai, H., Xu, B., Jiang, L., Vasilakos, A.V.: IoT-based big data storage systems in cloud computing: perspectives and challenges. IEEE Internet Things J. 4(1), 75–87 (2017) Cai, H., Xu, B., Jiang, L., Vasilakos, A.V.: IoT-based big data storage systems in cloud computing: perspectives and challenges. IEEE Internet Things J. 4(1), 75–87 (2017)
8.
go back to reference Zhong, R.Y., Newman, S.T., Huang, G.Q., Lan, S.: Big data for supply chain management in the service and manufacturing sectors: challenges, opportunities, and future perspectives. Comput. Ind. Eng. 101, 572–591 (2016)CrossRef Zhong, R.Y., Newman, S.T., Huang, G.Q., Lan, S.: Big data for supply chain management in the service and manufacturing sectors: challenges, opportunities, and future perspectives. Comput. Ind. Eng. 101, 572–591 (2016)CrossRef
9.
go back to reference Tao, F., Cheng, J., Qi, Q., et al.: Digital twin-driven product design, manufacturing and service with big data. Int. J. Adv. Manuf. Technol. 94(9–12), 3563–3576 (2018)CrossRef Tao, F., Cheng, J., Qi, Q., et al.: Digital twin-driven product design, manufacturing and service with big data. Int. J. Adv. Manuf. Technol. 94(9–12), 3563–3576 (2018)CrossRef
10.
go back to reference He, X., Ai, Q., Qiu, R.C., Huang, W., Piao, L., Liu, H.: A big data architecture design for smart grids based on random matrix theory. IEEE Trans. Smart Grid 8(2), 674–686 (2017) He, X., Ai, Q., Qiu, R.C., Huang, W., Piao, L., Liu, H.: A big data architecture design for smart grids based on random matrix theory. IEEE Trans. Smart Grid 8(2), 674–686 (2017)
11.
go back to reference Thusoo, A., Sarma, J., Jain, N., et al.: Hive warehousing solution over map-reduce framework. In: Proceedings of the 35th International Conference on Very Large Data Bases (VLDB), Lyon, France, pp. 1626–1629. VLDB (2009)CrossRef Thusoo, A., Sarma, J., Jain, N., et al.: Hive warehousing solution over map-reduce framework. In: Proceedings of the 35th International Conference on Very Large Data Bases (VLDB), Lyon, France, pp. 1626–1629. VLDB (2009)CrossRef
12.
go back to reference Christopher, O., Benjamin, R., Utkarsh, S.: Pig Latina not-so-foreign language for data processing. In: Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data, Vancouver, Canada, pp. 1099–1110. ACM (2008) Christopher, O., Benjamin, R., Utkarsh, S.: Pig Latina not-so-foreign language for data processing. In: Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data, Vancouver, Canada, pp. 1099–1110. ACM (2008)
13.
go back to reference Rob, P., Sean, D., Robert, G., et al.: Interpreting the dataparallel analysis with Sawzall. Sci. Program. 13(4), 277–298 (2005) Rob, P., Sean, D., Robert, G., et al.: Interpreting the dataparallel analysis with Sawzall. Sci. Program. 13(4), 277–298 (2005)
14.
go back to reference Prahlad, A., Gokhale, P., Kottomtharayil, R., et al.: Data mining systems and methods for heterogeneous data sources. U.S. Patent 9,405,632 (2016) Prahlad, A., Gokhale, P., Kottomtharayil, R., et al.: Data mining systems and methods for heterogeneous data sources. U.S. Patent 9,405,632 (2016)
16.
go back to reference Wang, Y., Chen, Q., Kang, C., et al.: Clustering of electricity consumption behavior dynamics toward big data applications. IEEE Trans. Smart Grid 7(5), 2437–2447 (2017)CrossRef Wang, Y., Chen, Q., Kang, C., et al.: Clustering of electricity consumption behavior dynamics toward big data applications. IEEE Trans. Smart Grid 7(5), 2437–2447 (2017)CrossRef
17.
go back to reference Marinakis, V., Doukas, H., Tsapelas, J., et al.: From big data to smart energy services: an application for intelligent energy management. Future Gener. Comput. Syst. (2018). S0167739X17318769 Marinakis, V., Doukas, H., Tsapelas, J., et al.: From big data to smart energy services: an application for intelligent energy management. Future Gener. Comput. Syst. (2018). S0167739X17318769
18.
go back to reference Shi, H., Xu, M., Ran, L.: Deep learning for household load forecasting novel pooling deep RNN. IEEE Trans. Smart Grid 99(1), 1 (2017) Shi, H., Xu, M., Ran, L.: Deep learning for household load forecasting novel pooling deep RNN. IEEE Trans. Smart Grid 99(1), 1 (2017)
19.
go back to reference Guo, B., Liu, Y., Ouyang, Y., et al.: Harnessing the power of the general public for crowdsourced business intelligence: a survey. IEEE Access 7, 26606–26630 (2019)CrossRef Guo, B., Liu, Y., Ouyang, Y., et al.: Harnessing the power of the general public for crowdsourced business intelligence: a survey. IEEE Access 7, 26606–26630 (2019)CrossRef
20.
go back to reference Zhang, Y., Wang, J.: A distributed approach for wind power probabilistic forecasting considering spatio-temporal correlation without direct access to off-site information. IEEE Trans. Power Syst. 33(5), 5714–5726 (2018)CrossRef Zhang, Y., Wang, J.: A distributed approach for wind power probabilistic forecasting considering spatio-temporal correlation without direct access to off-site information. IEEE Trans. Power Syst. 33(5), 5714–5726 (2018)CrossRef
21.
go back to reference Wang, J., Wang, Y., Zhang, D., et al.: Energy saving techniques in mobile crowd sensing: current state and future opportunities. IEEE Commun. Mag. 56(5), 164–169 (2018)CrossRef Wang, J., Wang, Y., Zhang, D., et al.: Energy saving techniques in mobile crowd sensing: current state and future opportunities. IEEE Commun. Mag. 56(5), 164–169 (2018)CrossRef
22.
go back to reference Hossain, E., Khan, I., Un-Noor, F., et al.: Application of big data and machine learning in smart grid, and associated security concerns: a review. IEEE Access 7, 13960–13988 (2019)CrossRef Hossain, E., Khan, I., Un-Noor, F., et al.: Application of big data and machine learning in smart grid, and associated security concerns: a review. IEEE Access 7, 13960–13988 (2019)CrossRef
Metadata
Title
Review of Power Spatio-Temporal Big Data Technologies, Applications, and Challenges
Authors
Ying Ma
Chao Huang
Yu Sun
Guang Zhao
Yunjie Lei
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-030-24900-7_16

Premium Partner