Skip to main content
Top
Published in: Data Mining and Knowledge Discovery 3/2023

13-03-2023

AA-forecast: anomaly-aware forecast for extreme events

Authors: Ashkan Farhangi, Jiang Bian, Arthur Huang, Haoyi Xiong, Jun Wang, Zhishan Guo

Published in: Data Mining and Knowledge Discovery | Issue 3/2023

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Time series models often are impacted by extreme events and anomalies, both prevalent in real-world datasets. Such models require careful probabilistic forecasts, which is vital in risk management for extreme events such as hurricanes and pandemics. However, it’s challenging to automatically detect and learn from extreme events and anomalies for large-scale datasets which often results in extra manual efforts. Here, we propose an anomaly-aware forecast framework that leverages the effects of anomalies to improve its prediction accuracy during the presence of extreme events. Our model has trained to extract anomalies automatically and incorporates them through an attention mechanism to increase the accuracy of forecasts during extreme events. Moreover, the framework employs a dynamic uncertainty optimization algorithm that reduces the uncertainty of forecasts in an online manner. The proposed framework demonstrated consistent superior accuracy with less uncertainty on three datasets with different varieties of anomalies over the current prediction models.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
We use the log transform of \({\textbf{x}}^{(k)}\) to handle the situation that specific values of original data are zero.
 
2
Adopted based on the choice of the p value (0.05) which is used as a standard level of statistical significance.
 
3
To reduce the ambiguity of the AA-Forecast layer, we are omitting the superscript (k) from this section
 
4
All datasets are publicly available at https://​github.​com/​ashfarhangi/​AA-Forecast
 
Literature
go back to reference Adilova L, Chen S, Kamp M (2021) Novelty detection in sequential data by informed clustering and modeling. arXiv preprint arXiv:2103.03943 Adilova L, Chen S, Kamp M (2021) Novelty detection in sequential data by informed clustering and modeling. arXiv preprint arXiv:​2103.​03943
go back to reference Bartik AW, Bertrand M, Lin F, Rothstein J, Unrath M (2020) Labor market impacts of covid-19 on hourly workers in small-and medium-sized businesses: four facts from homebase data. Institute for Research on Labor and Employment Bartik AW, Bertrand M, Lin F, Rothstein J, Unrath M (2020) Labor market impacts of covid-19 on hourly workers in small-and medium-sized businesses: four facts from homebase data. Institute for Research on Labor and Employment
go back to reference Box GE, Pierce DA (1970) Distribution of residual autocorrelations in autoregressive-integrated moving average time series models. J Am Stat Assoc 65(332):1509–1526MathSciNetCrossRefMATH Box GE, Pierce DA (1970) Distribution of residual autocorrelations in autoregressive-integrated moving average time series models. J Am Stat Assoc 65(332):1509–1526MathSciNetCrossRefMATH
go back to reference Broska LH, Poganietz WR, Vögele S (2020) Extreme events defined—a conceptual discussion applying a complex systems approach. Futures 115:102490CrossRef Broska LH, Poganietz WR, Vögele S (2020) Extreme events defined—a conceptual discussion applying a complex systems approach. Futures 115:102490CrossRef
go back to reference Cai L, Janowicz K, Mai G, Yan B, Zhu R (2020) Traffic transformer: capturing the continuity and periodicity of time series for traffic forecasting. Trans GIS 24(3):736–755CrossRef Cai L, Janowicz K, Mai G, Yan B, Zhu R (2020) Traffic transformer: capturing the continuity and periodicity of time series for traffic forecasting. Trans GIS 24(3):736–755CrossRef
go back to reference Cleveland RB, Cleveland WS, McRae JE, Terpenning I (1990) Stl: a seasonal-trend decomposition. J Off Stat 6(1):3–73 Cleveland RB, Cleveland WS, McRae JE, Terpenning I (1990) Stl: a seasonal-trend decomposition. J Off Stat 6(1):3–73
go back to reference Gal Y, Ghahramani Z (2016) Dropout as a bayesian approximation: representing model uncertainty in deep learning. In: international conference on machine learning, pp. 1050–1059 Gal Y, Ghahramani Z (2016) Dropout as a bayesian approximation: representing model uncertainty in deep learning. In: international conference on machine learning, pp. 1050–1059
go back to reference Grace D, Christiansen T (2013) Risk-based assessment of unplanned outage events and costs for combined-cycle plants. J Eng Gas Turbines Power 135(2) Grace D, Christiansen T (2013) Risk-based assessment of unplanned outage events and costs for combined-cycle plants. J Eng Gas Turbines Power 135(2)
go back to reference Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780CrossRef Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780CrossRef
go back to reference Jing M, Ng KY, Mac Namee B, Biglarbeigi P, Brisk R, Bond R, Finlay D, McLaughlin J (2021) Covid-19 modelling by time-varying transmission rate associated with mobility trend of driving via apple maps. J Biomedi Inform 122:103905CrossRef Jing M, Ng KY, Mac Namee B, Biglarbeigi P, Brisk R, Bond R, Finlay D, McLaughlin J (2021) Covid-19 modelling by time-varying transmission rate associated with mobility trend of driving via apple maps. J Biomedi Inform 122:103905CrossRef
go back to reference Khan A, Bibi S, Lyu J, Latif A, Lorenzo A (2021) Covid-19 and sectoral employment trends: assessing resilience in the us leisure and hospitality industry. Curr Issues Tour 24(7):952–969CrossRef Khan A, Bibi S, Lyu J, Latif A, Lorenzo A (2021) Covid-19 and sectoral employment trends: assessing resilience in the us leisure and hospitality industry. Curr Issues Tour 24(7):952–969CrossRef
go back to reference Khandelwal U, He H, Qi P, Jurafsky D (2018) Sharp nearby, fuzzy far away: How neural language models use context. arXiv preprint arXiv:1805.04623 Khandelwal U, He H, Qi P, Jurafsky D (2018) Sharp nearby, fuzzy far away: How neural language models use context. arXiv preprint arXiv:​1805.​04623
go back to reference Laptev N, Yosinski J, Li LE, Smyl S (2017) Time-series extreme event forecasting with neural networks at uber. In: International Conference on Machine Learning, vol. 34, pp. 1–5 Laptev N, Yosinski J, Li LE, Smyl S (2017) Time-series extreme event forecasting with neural networks at uber. In: International Conference on Machine Learning, vol. 34, pp. 1–5
go back to reference Li L, Yan J, Yang X, Jin Y (2019) Learning interpretable deep state space model for probabilistic time series forecasting. In: IJCAI, pp. 2901–2908 Li L, Yan J, Yang X, Jin Y (2019) Learning interpretable deep state space model for probabilistic time series forecasting. In: IJCAI, pp. 2901–2908
go back to reference Li S, Jin X, Xuan Y, Zhou X, Chen W, Wang YX, Yan X (2019) Enhancing the locality and breaking the memory bottleneck of transformer on time series forecasting. In: Advances in Neural Information Processing Systems, pp. 5243–5253 Li S, Jin X, Xuan Y, Zhou X, Chen W, Wang YX, Yan X (2019) Enhancing the locality and breaking the memory bottleneck of transformer on time series forecasting. In: Advances in Neural Information Processing Systems, pp. 5243–5253
go back to reference Lim B, Arik SO, Loeff N, Pfister T (2019) Temporal fusion transformers for interpretable multi-horizon time series forecasting. arXiv preprint arXiv:1912.09363 Lim B, Arik SO, Loeff N, Pfister T (2019) Temporal fusion transformers for interpretable multi-horizon time series forecasting. arXiv preprint arXiv:​1912.​09363
go back to reference Pang J, Liu D, Peng Y, Peng X (2017) Anomaly detection based on uncertainty fusion for univariate monitoring series. Measurement 95:280–292CrossRef Pang J, Liu D, Peng Y, Peng X (2017) Anomaly detection based on uncertainty fusion for univariate monitoring series. Measurement 95:280–292CrossRef
go back to reference Rolnick D, Donti PL, Kaack LH, Kochanski K, Lacoste A, Sankaran K, Ross AS, Milojevic-Dupont N, Jaques N, Waldman-Brown A, et al (2019) Tackling climate change with machine learning. arXiv preprint arXiv:1906.05433 Rolnick D, Donti PL, Kaack LH, Kochanski K, Lacoste A, Sankaran K, Ross AS, Milojevic-Dupont N, Jaques N, Waldman-Brown A, et al (2019) Tackling climate change with machine learning. arXiv preprint arXiv:​1906.​05433
go back to reference Sagheer A, Kotb M (2019) Unsupervised pre-training of a deep lstm-based stacked autoencoder for multivariate time series forecasting problems. Sci Rep 9(1):1–16CrossRef Sagheer A, Kotb M (2019) Unsupervised pre-training of a deep lstm-based stacked autoencoder for multivariate time series forecasting problems. Sci Rep 9(1):1–16CrossRef
go back to reference Salinas D, Flunkert V, Gasthaus J, Januschowski T (2020) Deepar: probabilistic forecasting with autoregressive recurrent networks. Int J Forecast 36(3):1181–1191CrossRef Salinas D, Flunkert V, Gasthaus J, Januschowski T (2020) Deepar: probabilistic forecasting with autoregressive recurrent networks. Int J Forecast 36(3):1181–1191CrossRef
go back to reference Santos-Burgoa C, Sandberg J, Suárez E, Goldman-Hawes A, Zeger S, Garcia-Meza A, Pérez CM, Estrada-Merly N, Colón-Ramos U, Nazario CM et al (2018) Differential and persistent risk of excess mortality from hurricane maria in puerto rico: a time-series analysis. Lancet Planet Health 2(11):e478–e488CrossRef Santos-Burgoa C, Sandberg J, Suárez E, Goldman-Hawes A, Zeger S, Garcia-Meza A, Pérez CM, Estrada-Merly N, Colón-Ramos U, Nazario CM et al (2018) Differential and persistent risk of excess mortality from hurricane maria in puerto rico: a time-series analysis. Lancet Planet Health 2(11):e478–e488CrossRef
go back to reference Selerio E, Maglasang R (2021) Minimizing production loss consequent to disasters using a subsidy optimization model: a pandemic case. Struct Chang Econ Dyn 58:112–124CrossRef Selerio E, Maglasang R (2021) Minimizing production loss consequent to disasters using a subsidy optimization model: a pandemic case. Struct Chang Econ Dyn 58:112–124CrossRef
go back to reference Smith AB (2022) 2021 us billion dollar weather and climate disasters in historical context including new county-level exposure, vulnerability and projected damage mapping. In: 102nd American Meteorological Society Annual Meeting. AMS Smith AB (2022) 2021 us billion dollar weather and climate disasters in historical context including new county-level exposure, vulnerability and projected damage mapping. In: 102nd American Meteorological Society Annual Meeting. AMS
go back to reference Tarsitano A, Amerise IL (2017) Short-term load forecasting using a two-stage sarimax model. Energy 133:108–114CrossRef Tarsitano A, Amerise IL (2017) Short-term load forecasting using a two-stage sarimax model. Energy 133:108–114CrossRef
go back to reference Tolstikhin IO, Houlsby N, Kolesnikov A, Beyer L, Zhai X, Unterthiner T, Yung J, Steiner A, Keysers D, Uszkoreit J et al (2021) Mlp-mixer: an all-mlp architecture for vision. Adv Neural Inform Process Syst 34:24261–24272 Tolstikhin IO, Houlsby N, Kolesnikov A, Beyer L, Zhai X, Unterthiner T, Yung J, Steiner A, Keysers D, Uszkoreit J et al (2021) Mlp-mixer: an all-mlp architecture for vision. Adv Neural Inform Process Syst 34:24261–24272
go back to reference Wahab H, Jain V, Tyrrell AS, Seas MA, Kotthoff L, Johnson PA (2020) Machine-learning-assisted fabrication: Bayesian optimization of laser-induced graphene patterning using in-situ raman analysis. Carbon 167:609–619CrossRef Wahab H, Jain V, Tyrrell AS, Seas MA, Kotthoff L, Johnson PA (2020) Machine-learning-assisted fabrication: Bayesian optimization of laser-induced graphene patterning using in-situ raman analysis. Carbon 167:609–619CrossRef
go back to reference Wen Q, Gao J, Song X, Sun L, Xu H, Zhu S (2019) Robuststl: A robust seasonal-trend decomposition algorithm for long time series. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, pp. 5409–5416 Wen Q, Gao J, Song X, Sun L, Xu H, Zhu S (2019) Robuststl: A robust seasonal-trend decomposition algorithm for long time series. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, pp. 5409–5416
go back to reference Zaheer M, Guruganesh G, Dubey A, Ainslie J, Alberti C, Ontanon S, Pham P, Ravula A, Wang Q, Yang L, et al (2020) Big bird: transformers for longer sequences. arXiv preprint arXiv:2007.14062 Zaheer M, Guruganesh G, Dubey A, Ainslie J, Alberti C, Ontanon S, Pham P, Ravula A, Wang Q, Yang L, et al (2020) Big bird: transformers for longer sequences. arXiv preprint arXiv:​2007.​14062
go back to reference Zhu L, Laptev N (2017) Deep and confident prediction for time series at uber. In: 2017 IEEE International Conference on Data Mining Workshops (ICDMW), pp. 103–110. IEEE Zhu L, Laptev N (2017) Deep and confident prediction for time series at uber. In: 2017 IEEE International Conference on Data Mining Workshops (ICDMW), pp. 103–110. IEEE
Metadata
Title
AA-forecast: anomaly-aware forecast for extreme events
Authors
Ashkan Farhangi
Jiang Bian
Arthur Huang
Haoyi Xiong
Jun Wang
Zhishan Guo
Publication date
13-03-2023
Publisher
Springer US
Published in
Data Mining and Knowledge Discovery / Issue 3/2023
Print ISSN: 1384-5810
Electronic ISSN: 1573-756X
DOI
https://doi.org/10.1007/s10618-023-00919-7

Premium Partner