Skip to main content
Top

2017 | OriginalPaper | Chapter

PowerCast: Mining and Forecasting Power Grid Sequences

Authors : Hyun Ah Song, Bryan Hooi, Marko Jereminov, Amritanshu Pandey, Larry Pileggi, Christos Faloutsos

Published in: Machine Learning and Knowledge Discovery in Databases

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

What will be the power consumption of our institution at 8am for the upcoming days? What will happen to the power consumption of a small factory, if it wants to double (or half) its production? Technologies associated with the smart electrical grid are needed. Central to this process are algorithms that accurately model electrical load behavior, and forecast future electric power demand. However, existing power load models fail to accurately represent electrical load behavior in the grid. In this paper, we propose PowerCast, a novel domain-aware approach for forecasting the electrical power demand, by carefully incorporating domain knowledge. Our contributions are as follows: 1. Infusion of domain expert knowledge: We represent the time sequences using an equivalent circuit model, the “BIG” model, which allows for an intuitive interpretation of the power load, as the BIG model is derived from physics-based first principles. 2. Forecasting of the power load: Our PowerCast uses the BIG model, and provides (a) accurate prediction in multi-step-ahead forecasting, and (b) extrapolations, under what-if scenarios, such as variation in the demand (say, due to increase in the count of people on campus, or a decision to half the production in our factory etc.) 3. Anomaly detection: PowerCast can spot and, even explain, anomalies in the given time sequences. The experimental results based on two real world datasets of up to three weeks duration, demonstrate that PowerCast is able to forecast several steps ahead, with 59% error reduction, compared to the competitors. Moreover, it is fast, and scales linearly with the duration of the sequences.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
2.
go back to reference Bader, B.W., Kolda, T.G.: Algorithm 862: MATLAB tensor classes for fast algorithm prototyping. ACM Trans. Math. Softw. 32(4), 635–653 (2006)MathSciNetCrossRefMATH Bader, B.W., Kolda, T.G.: Algorithm 862: MATLAB tensor classes for fast algorithm prototyping. ACM Trans. Math. Softw. 32(4), 635–653 (2006)MathSciNetCrossRefMATH
4.
go back to reference Beran, J.: Statistics for Long-Memory Processes, vol. 61. CRC Press, Boca Raton (1994)MATH Beran, J.: Statistics for Long-Memory Processes, vol. 61. CRC Press, Boca Raton (1994)MATH
5.
go back to reference Box, G.E., Jenkins, G.M., Reinsel, G.C., Ljung, G.M.: Time Series Analysis: Forecasting and Control. Wiley, Hoboken (2015)MATH Box, G.E., Jenkins, G.M., Reinsel, G.C., Ljung, G.M.: Time Series Analysis: Forecasting and Control. Wiley, Hoboken (2015)MATH
6.
go back to reference Bromberg, D.M., Jereminov, M., Li, X., Hug, G., Pileggi, L.: An equivalent circuit formulation of the power flow problem with current and voltage state variables. In: PowerTech, 2015 IEEE Eindhoven, pp. 1–6 (2015) Bromberg, D.M., Jereminov, M., Li, X., Hug, G., Pileggi, L.: An equivalent circuit formulation of the power flow problem with current and voltage state variables. In: PowerTech, 2015 IEEE Eindhoven, pp. 1–6 (2015)
7.
go back to reference Brown, R.G.: Statistical Forecasting for Inventory Control. McGraw/Hill, New York City (1959)MATH Brown, R.G.: Statistical Forecasting for Inventory Control. McGraw/Hill, New York City (1959)MATH
8.
go back to reference Bunn, D., Farmer, E.D.: Comparative Models for Electrical Load Forecasting (1985) Bunn, D., Farmer, E.D.: Comparative Models for Electrical Load Forecasting (1985)
9.
go back to reference De Livera, A.M., Hyndman, R.J., Snyder, R.D.: Forecasting time series with complex seasonal patterns using exponential smoothing. J. Am. Stat. Assoc. 106(496), 1513–1527 (2011)MathSciNetCrossRefMATH De Livera, A.M., Hyndman, R.J., Snyder, R.D.: Forecasting time series with complex seasonal patterns using exponential smoothing. J. Am. Stat. Assoc. 106(496), 1513–1527 (2011)MathSciNetCrossRefMATH
10.
go back to reference Ho, J.C., Ghosh, J., Sun, J.: Marble: high-throughput phenotyping from electronic health records via sparse nonnegative tensor factorization. In: ACM SIGKDD, pp. 115–124 (2014) Ho, J.C., Ghosh, J., Sun, J.: Marble: high-throughput phenotyping from electronic health records via sparse nonnegative tensor factorization. In: ACM SIGKDD, pp. 115–124 (2014)
11.
go back to reference Hyndman, R.J., Fan, S.: Density forecasting for long-term peak electricity demand. IEEE Trans. Power Syst. 25(2), 1142–1153 (2010)CrossRef Hyndman, R.J., Fan, S.: Density forecasting for long-term peak electricity demand. IEEE Trans. Power Syst. 25(2), 1142–1153 (2010)CrossRef
12.
go back to reference Jain, A., Chang, E.Y., Wang, Y.F.: Adaptive stream resource management using kalman filters. In: ACM SIGMOD, pp. 11–22 (2004) Jain, A., Chang, E.Y., Wang, Y.F.: Adaptive stream resource management using kalman filters. In: ACM SIGMOD, pp. 11–22 (2004)
13.
go back to reference Jereminov, M., Bromberg, D.M., Li, X., Hug, G., Pileggi, L.: Improving robustness and modeling generality for power flow analysis. In: 2016 IEEE/PES Transmission and Distribution Conference and Exposition (T&D), pp. 1–5 (2016) Jereminov, M., Bromberg, D.M., Li, X., Hug, G., Pileggi, L.: Improving robustness and modeling generality for power flow analysis. In: 2016 IEEE/PES Transmission and Distribution Conference and Exposition (T&D), pp. 1–5 (2016)
14.
go back to reference Jereminov, M., Pandey, A., Song, H.A., Hooi, B., Faloutsos, C., Pileggi, L.: Linear load model for robust power system analysis. In: IEEE PES Innovative Smart Grid Technologies (2017, p. (submitted)) Jereminov, M., Pandey, A., Song, H.A., Hooi, B., Faloutsos, C., Pileggi, L.: Linear load model for robust power system analysis. In: IEEE PES Innovative Smart Grid Technologies (2017, p. (submitted))
15.
go back to reference Kalman, R.E.: A new approach to linear filtering and prediction problems. J. Basic Eng. 82(1), 35–45 (1960)CrossRef Kalman, R.E.: A new approach to linear filtering and prediction problems. J. Basic Eng. 82(1), 35–45 (1960)CrossRef
16.
go back to reference Kang, U., Papalexakis, E., Harpale, A., Faloutsos, C.: Gigatensor: scaling tensor analysis up by 100 times-algorithms and discoveries. In: ACM SIGKDD, pp. 316–324 (2012) Kang, U., Papalexakis, E., Harpale, A., Faloutsos, C.: Gigatensor: scaling tensor analysis up by 100 times-algorithms and discoveries. In: ACM SIGKDD, pp. 316–324 (2012)
18.
go back to reference Kolda, T.G., Sun, J.: Scalable tensor decompositions for multi-aspect data mining. In: ICDM, pp. 363–372 (2008) Kolda, T.G., Sun, J.: Scalable tensor decompositions for multi-aspect data mining. In: ICDM, pp. 363–372 (2008)
19.
go back to reference Letchner, J., Re, C., Balazinska, M., Philipose, M.: Access methods for markovian streams. In: ICDE, pp. 246–257 (2009) Letchner, J., Re, C., Balazinska, M., Philipose, M.: Access methods for markovian streams. In: ICDE, pp. 246–257 (2009)
20.
go back to reference Lin, Y.R., Sun, J., Sundaram, H., Kelliher, A., Castro, P., Konuru, R.: Community discovery via metagraph factorization. ACM Trans. Knowl. Discov. Data (TKDD) 5(3), 17 (2011) Lin, Y.R., Sun, J., Sundaram, H., Kelliher, A., Castro, P., Konuru, R.: Community discovery via metagraph factorization. ACM Trans. Knowl. Discov. Data (TKDD) 5(3), 17 (2011)
21.
go back to reference Lu, H., Plataniotis, K.N., Venetsanopoulos, A.N.: Multilinear principal component analysis of tensor objects for recognition. In: ICPR, vol. 2, pp. 776–779 (2006) Lu, H., Plataniotis, K.N., Venetsanopoulos, A.N.: Multilinear principal component analysis of tensor objects for recognition. In: ICPR, vol. 2, pp. 776–779 (2006)
22.
go back to reference Martí, J.R., Ahmadi, H., Bashualdo, L.: Linear power-flow formulation based on a voltage-dependent load model. IEEE Trans. Power Deliv. 28(3), 1682–1690 (2013)CrossRef Martí, J.R., Ahmadi, H., Bashualdo, L.: Linear power-flow formulation based on a voltage-dependent load model. IEEE Trans. Power Deliv. 28(3), 1682–1690 (2013)CrossRef
23.
go back to reference Matsubara, Y., Sakurai, Y.: Regime shifts in streams: Real-time forecasting of co-evolving time sequences. In: ACM SIGKDD, pp. 1045–1054 (2016) Matsubara, Y., Sakurai, Y.: Regime shifts in streams: Real-time forecasting of co-evolving time sequences. In: ACM SIGKDD, pp. 1045–1054 (2016)
24.
go back to reference Matsubara, Y., Sakurai, Y., Faloutsos, C., Iwata, T., Yoshikawa, M.: Fast mining and forecasting of complex time-stamped events. In: ACM SIGKDD, pp. 271–279 (2012) Matsubara, Y., Sakurai, Y., Faloutsos, C., Iwata, T., Yoshikawa, M.: Fast mining and forecasting of complex time-stamped events. In: ACM SIGKDD, pp. 271–279 (2012)
25.
go back to reference Matsubara, Y., Sakurai, Y., Van Panhuis, W.G., Faloutsos, C.: Funnel: automatic mining of spatially coevolving epidemics. In: ACM SIGKDD, pp. 105–114 (2014) Matsubara, Y., Sakurai, Y., Van Panhuis, W.G., Faloutsos, C.: Funnel: automatic mining of spatially coevolving epidemics. In: ACM SIGKDD, pp. 105–114 (2014)
26.
go back to reference Nowicka-Zagrajek, J., Weron, R.: Modeling electricity loads in california: ARMA models with hyperbolic noise. Sig. Process. 82(12), 1903–1915 (2002)CrossRefMATH Nowicka-Zagrajek, J., Weron, R.: Modeling electricity loads in california: ARMA models with hyperbolic noise. Sig. Process. 82(12), 1903–1915 (2002)CrossRefMATH
27.
go back to reference Pandey, A., Jereminov, M., Hug, G., Pileggi, L.: Improving power flow robustness via circuit simulation methods. In: PES General Meeting (2017) Pandey, A., Jereminov, M., Hug, G., Pileggi, L.: Improving power flow robustness via circuit simulation methods. In: PES General Meeting (2017)
28.
go back to reference Pandey, A., Jereminov, M., Li, X., Hug, G., Pileggi, L.: Aggregated load and generation equivalent circuit models with semi-empirical data fitting. In: 2016 IEEE Green Energy and Systems Conference (IGSEC), pp. 1–6 (2016) Pandey, A., Jereminov, M., Li, X., Hug, G., Pileggi, L.: Aggregated load and generation equivalent circuit models with semi-empirical data fitting. In: 2016 IEEE Green Energy and Systems Conference (IGSEC), pp. 1–6 (2016)
29.
go back to reference Papadimitriou, S., Brockwell, A., Faloutsos, C.: Adaptive, hands-off stream mining. In: VLDB, pp. 560–571 (2003) Papadimitriou, S., Brockwell, A., Faloutsos, C.: Adaptive, hands-off stream mining. In: VLDB, pp. 560–571 (2003)
30.
go back to reference Park, J., Park, Y., Lee, K.: Composite modeling for adaptive short-term load forecasting. IEEE Trans. Power Syst. 6(2), 450–457 (1991)CrossRef Park, J., Park, Y., Lee, K.: Composite modeling for adaptive short-term load forecasting. IEEE Trans. Power Syst. 6(2), 450–457 (1991)CrossRef
31.
go back to reference Rogers, M., Li, L., Russell, S.J.: Multilinear dynamical systems for tensor time series. In: NIPS, pp. 2634–2642 (2013) Rogers, M., Li, L., Russell, S.J.: Multilinear dynamical systems for tensor time series. In: NIPS, pp. 2634–2642 (2013)
32.
go back to reference Smith, M.: Modeling and short-term forecasting of new south wales electricity system load. J. Bus. Econ. Stat. 18(4), 465–478 (2000) Smith, M.: Modeling and short-term forecasting of new south wales electricity system load. J. Bus. Econ. Stat. 18(4), 465–478 (2000)
33.
go back to reference Soliman, S., Persaud, S., El-Nagar, K., El-Hawary, M.: Application of least absolute value parameter estimation based on linear programming to short-term load forecasting. Int. J. Electr. Power Energy Syst. 19(3), 209–216 (1997)CrossRef Soliman, S., Persaud, S., El-Nagar, K., El-Hawary, M.: Application of least absolute value parameter estimation based on linear programming to short-term load forecasting. Int. J. Electr. Power Energy Syst. 19(3), 209–216 (1997)CrossRef
34.
go back to reference Stewart, E.M., Liao, A., Roberts, C.: Open \(\upmu \)PMU: a real world reference distribution micro-phasor measurement unit data set for research and application development, October 2016 Stewart, E.M., Liao, A., Roberts, C.: Open \(\upmu \)PMU: a real world reference distribution micro-phasor measurement unit data set for research and application development, October 2016
35.
go back to reference Takahashi, T., Hooi, B., Faloutsos, C.: Autocyclone: automatic mining of cyclic online activities with robust tensor factorization. In: WWW, pp. 213–221 (2017) Takahashi, T., Hooi, B., Faloutsos, C.: Autocyclone: automatic mining of cyclic online activities with robust tensor factorization. In: WWW, pp. 213–221 (2017)
36.
go back to reference Tao, D., Song, M., Li, X., Shen, J., Sun, J., Wu, X., Faloutsos, C., Maybank, S.J.: Bayesian tensor approach for 3-D face modeling. IEEE Trans. Circuits Syst. Video Technol. 18(10), 1397–1410 (2008)CrossRef Tao, D., Song, M., Li, X., Shen, J., Sun, J., Wu, X., Faloutsos, C., Maybank, S.J.: Bayesian tensor approach for 3-D face modeling. IEEE Trans. Circuits Syst. Video Technol. 18(10), 1397–1410 (2008)CrossRef
37.
go back to reference Wang, P., Wang, H., Wang, W.: Finding semantics in time series. In: ACM SIGMOD, pp. 385–396 (2011) Wang, P., Wang, H., Wang, W.: Finding semantics in time series. In: ACM SIGMOD, pp. 385–396 (2011)
38.
go back to reference Wang, Y., Chen, R., Ghosh, J., Denny, J.C., Kho, A., Chen, Y., Malin, B.A., Sun, J.: Rubik: knowledge guided tensor factorization and completion for health data analytics. In: ACM SIGKDD, pp. 1265–1274 (2015) Wang, Y., Chen, R., Ghosh, J., Denny, J.C., Kho, A., Chen, Y., Malin, B.A., Sun, J.: Rubik: knowledge guided tensor factorization and completion for health data analytics. In: ACM SIGKDD, pp. 1265–1274 (2015)
39.
go back to reference Yang, H.T., Huang, C.M.: A new short-term load forecasting approach using self-organizing fuzzy ARMAX models. IEEE Trans. Power Syst. 13(1), 217–225 (1998)CrossRef Yang, H.T., Huang, C.M.: A new short-term load forecasting approach using self-organizing fuzzy ARMAX models. IEEE Trans. Power Syst. 13(1), 217–225 (1998)CrossRef
Metadata
Title
PowerCast: Mining and Forecasting Power Grid Sequences
Authors
Hyun Ah Song
Bryan Hooi
Marko Jereminov
Amritanshu Pandey
Larry Pileggi
Christos Faloutsos
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-71246-8_37

Premium Partner