Skip to main content

2017 | OriginalPaper | Buchkapitel

Detection and Prediction of Natural Hazards Using Large-Scale Environmental Data

verfasst von : Nina Hubig, Philip Fengler, Andreas Züfle, Ruixin Yang, Stephan Günnemann

Erschienen in: Advances in Spatial and Temporal Databases

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Recent developments in remote sensing have made it possible to instrument and sense the physical world with high resolution and fidelity. Consequently, very large spatio-temporal environmental data sets, have become available to the research community. Such data consists of time-series, starting as early as 1973, monitoring up to thousands of environmental parameters, for each spatial region of a resolution as low as \(0.5'\times 0.5'\). To make this flood of data actionable, in this work, we employ a data driven approach to detect and predict natural hazards. Our supervised learning approach learns from labeled historic events. We describe each event by a three-mode tensor, covering space, time and environmental parameters. Due to the very large number of environmental parameters, and the possibility of latent features hidden within these parameters, we employ a tensor factorization approach to learn latent factors. As the corresponding tensors can grow very large, we propose to employ an outlier-score for sparsification, thus explicitly modeling interesting (location, time, parameter) triples only. In our experimental evaluation, we apply our data-driven learning approach to the use-case of predicting the rapid-intensification of tropical storms. Learning from past tropical storms, we show that our approach is able to predict the future rapid-intesification of tropical storms with high accuracy, matching the accuracy of domain specific solutions, yet without using any domain knowledge.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Acar, E., Kolda, T.G., Dunlavy, D.M.: All-at-once optimization for coupled matrix and tensor factorizations. arXiv preprint arXiv:1105.3422 (2011) Acar, E., Kolda, T.G., Dunlavy, D.M.: All-at-once optimization for coupled matrix and tensor factorizations. arXiv preprint arXiv:​1105.​3422 (2011)
2.
Zurück zum Zitat Berndt, D., Clifford, J.: Using dynamic time warping to find patterns in time series. In: KDD Workshop, pp. 359–370 (1994) Berndt, D., Clifford, J.: Using dynamic time warping to find patterns in time series. In: KDD Workshop, pp. 359–370 (1994)
3.
Zurück zum Zitat Das, M., Parthasarathy, S.: Anomaly detection and Spatio-temporal analysis of global climate system. In: SensorKDD 2009 (2009) Das, M., Parthasarathy, S.: Anomaly detection and Spatio-temporal analysis of global climate system. In: SensorKDD 2009 (2009)
4.
Zurück zum Zitat de Lima, G.R.T., Stephany, S.: A new classification approach for detecting severe weather patterns. Comput. Geosci. 57, 158–165 (2013)CrossRef de Lima, G.R.T., Stephany, S.: A new classification approach for detecting severe weather patterns. Comput. Geosci. 57, 158–165 (2013)CrossRef
5.
Zurück zum Zitat DeMaria, M., Kaplan, J.: A statistical hurricane intensity prediction scheme (ships) for the atlantic basin. Weather Forecast. 9(2), 209–220 (1994)CrossRef DeMaria, M., Kaplan, J.: A statistical hurricane intensity prediction scheme (ships) for the atlantic basin. Weather Forecast. 9(2), 209–220 (1994)CrossRef
6.
Zurück zum Zitat Ester, M., Kriegel, H.-P., Sander, J., Xu, X.: A density-based algorithm for discovering clusters in large spatial databases with noise, pp. 226–231 (1996) Ester, M., Kriegel, H.-P., Sander, J., Xu, X.: A density-based algorithm for discovering clusters in large spatial databases with noise, pp. 226–231 (1996)
7.
Zurück zum Zitat Faghmous, J.H., Kumar, V.: Spatio-temporal data mining for climate data: advances, challenges, and opportunities. In: Chu, W. (ed.) Data Mining and Knowledge Discovery for Big Data. Studies in Big Data, vol. 1, pp. 83–116. Springer, Heidelberg (2014). doi:10.1007/978-3-642-40837-3_3 CrossRef Faghmous, J.H., Kumar, V.: Spatio-temporal data mining for climate data: advances, challenges, and opportunities. In: Chu, W. (ed.) Data Mining and Knowledge Discovery for Big Data. Studies in Big Data, vol. 1, pp. 83–116. Springer, Heidelberg (2014). doi:10.​1007/​978-3-642-40837-3_​3 CrossRef
8.
Zurück zum Zitat Ganguly, A.R., Steinhaeuser, K.: Data mining for climate change and impacts. In: ICDMW, pp. 385–394 (2008) Ganguly, A.R., Steinhaeuser, K.: Data mining for climate change and impacts. In: ICDMW, pp. 385–394 (2008)
9.
Zurück zum Zitat Hey, T., Tansley, S., Tolle, K.M., et al.: The Fourth Paradigm: Data-Intensive Scientific Discovery, vol. 1. Microsoft research Redmond, WA (2009) Hey, T., Tansley, S., Tolle, K.M., et al.: The Fourth Paradigm: Data-Intensive Scientific Discovery, vol. 1. Microsoft research Redmond, WA (2009)
10.
Zurück zum Zitat Jeon, I., Papalexakis, E.E., Kang, U., Faloutsos, C.: Haten2: billion-scale tensor decompositions. In: ICDE (2015) Jeon, I., Papalexakis, E.E., Kang, U., Faloutsos, C.: Haten2: billion-scale tensor decompositions. In: ICDE (2015)
11.
Zurück zum Zitat Kaplan, J., DeMaria, M.: Large-scale characteristics of rapidly intensifying tropical cyclones in the North Atlantic Basin. Weather Forecast. 18(6), 1093–1108 (2003)CrossRef Kaplan, J., DeMaria, M.: Large-scale characteristics of rapidly intensifying tropical cyclones in the North Atlantic Basin. Weather Forecast. 18(6), 1093–1108 (2003)CrossRef
12.
Zurück zum Zitat Kaplan, J., et al.: Evaluating environmental impacts on tropical cyclone rapid intensification predictability utilizing statistical models. Weather Forecast. 30(5), 1374–1396 (2015)CrossRef Kaplan, J., et al.: Evaluating environmental impacts on tropical cyclone rapid intensification predictability utilizing statistical models. Weather Forecast. 30(5), 1374–1396 (2015)CrossRef
13.
Zurück zum Zitat Karvonen, J., Kaarna, A.: Sea ice SAR feature extraction by non-negative matrix and tensor factorization. In: 2008 IEEE International Geoscience and Remote Sensing Symposium (IGARSS 2008). vol. 4, pp. IV–1093 (2008) Karvonen, J., Kaarna, A.: Sea ice SAR feature extraction by non-negative matrix and tensor factorization. In: 2008 IEEE International Geoscience and Remote Sensing Symposium (IGARSS 2008). vol. 4, pp. IV–1093 (2008)
14.
Zurück zum Zitat Knorr, E.M., Ng, R.T.: Algorithms for mining distance-based outliers in large datasets, pp. 392–403 (1998) Knorr, E.M., Ng, R.T.: Algorithms for mining distance-based outliers in large datasets, pp. 392–403 (1998)
15.
Zurück zum Zitat Kolda, T.G., Bader, B.W.: Tensor decompositions and applications. In: SIAM, pp. 455–500 (2009) Kolda, T.G., Bader, B.W.: Tensor decompositions and applications. In: SIAM, pp. 455–500 (2009)
16.
Zurück zum Zitat Papalexakis, E.E., Faloutsos, C., Sidiropoulos, N.D.: ParCube: sparse parallelizable tensor decompositions. In: Flach, P.A., Bie, T., Cristianini, N. (eds.) ECML PKDD 2012. LNCS, vol. 7523, pp. 521–536. Springer, Heidelberg (2012). doi:10.1007/978-3-642-33460-3_39 CrossRef Papalexakis, E.E., Faloutsos, C., Sidiropoulos, N.D.: ParCube: sparse parallelizable tensor decompositions. In: Flach, P.A., Bie, T., Cristianini, N. (eds.) ECML PKDD 2012. LNCS, vol. 7523, pp. 521–536. Springer, Heidelberg (2012). doi:10.​1007/​978-3-642-33460-3_​39 CrossRef
17.
Zurück zum Zitat Rienecker, M., Suarez, M., Todling, R., Bacmeister, J., Takacs, L., Liu, H., Gu, W., Sienkiewicz, M., Koster, R., Gelaro, R., et al.: The GEOs-5 data assimilation system-documentation of versions 5.0.1, 5.1.0, and 5.2.0. NASA Technical Memorandum 104606(27):2008 (2008) Rienecker, M., Suarez, M., Todling, R., Bacmeister, J., Takacs, L., Liu, H., Gu, W., Sienkiewicz, M., Koster, R., Gelaro, R., et al.: The GEOs-5 data assimilation system-documentation of versions 5.0.1, 5.1.0, and 5.2.0. NASA Technical Memorandum 104606(27):2008 (2008)
18.
Zurück zum Zitat Rienecker, M.M., Suarez, M.J., Gelaro, R., Todling, R., Bacmeister, J., Liu, E., Bosilovich, M.G., Schubert, S.D., Takacs, L., Kim, G.-K., et al.: Merra: Nasa’s modern-era retrospective analysis for research and applications. J. Clim. 24(14), 3624–3648 (2011)CrossRef Rienecker, M.M., Suarez, M.J., Gelaro, R., Todling, R., Bacmeister, J., Liu, E., Bosilovich, M.G., Schubert, S.D., Takacs, L., Kim, G.-K., et al.: Merra: Nasa’s modern-era retrospective analysis for research and applications. J. Clim. 24(14), 3624–3648 (2011)CrossRef
19.
Zurück zum Zitat Réjichi, S., Chaabane, F.: Feature extraction using PCA for VHR satellite image time series Spatio-temporal classification. In: IGARSS, pp. 485–488 (2015) Réjichi, S., Chaabane, F.: Feature extraction using PCA for VHR satellite image time series Spatio-temporal classification. In: IGARSS, pp. 485–488 (2015)
20.
Zurück zum Zitat Réjichi, S., Chaâbane, F.: SVM Spatio-temporal vegetation classification using HR satellite images, vol. 8176 (2011) Réjichi, S., Chaâbane, F.: SVM Spatio-temporal vegetation classification using HR satellite images, vol. 8176 (2011)
21.
Zurück zum Zitat Shin, K., Kang, U.: Distributed methods for high-dimensional and large-scale tensor factorization. In: 2014 IEEE International Conference on Data Mining, pp. 989–994, December 2014 Shin, K., Kang, U.: Distributed methods for high-dimensional and large-scale tensor factorization. In: 2014 IEEE International Conference on Data Mining, pp. 989–994, December 2014
22.
Zurück zum Zitat Steinbach, M., Tan, P.-N., Kumar, V., Klooster, S., Potter, C.: Discovery of climate indices using clustering. In: KDD, pp. 446–455 (2003) Steinbach, M., Tan, P.-N., Kumar, V., Klooster, S., Potter, C.: Discovery of climate indices using clustering. In: KDD, pp. 446–455 (2003)
23.
Zurück zum Zitat Takeuchi, K., Tomioka, R., Ishiguro, K., Kimura, A., Sawada, H.: Non-negative multiple tensor factorization. In: 2013 IEEE 13th International Conference on Data Mining, pp. 1199–1204, December 2013 Takeuchi, K., Tomioka, R., Ishiguro, K., Kimura, A., Sawada, H.: Non-negative multiple tensor factorization. In: 2013 IEEE 13th International Conference on Data Mining, pp. 1199–1204, December 2013
24.
Zurück zum Zitat Tobler, W.R.: A computer movie simulating urban growth in the detroit region. Econ. Geogr. 46, 234–240 (1970)CrossRef Tobler, W.R.: A computer movie simulating urban growth in the detroit region. Econ. Geogr. 46, 234–240 (1970)CrossRef
25.
Zurück zum Zitat Wang, D., Ding, W.: A hierarchical pattern learning framework for forecasting extreme weather events. In: ICDM (2015) Wang, D., Ding, W.: A hierarchical pattern learning framework for forecasting extreme weather events. In: ICDM (2015)
26.
Zurück zum Zitat Yang, R.: A systematic classification investigation of rapid intensification of atlantic tropical cyclones with the ships database. Weather Forecast. 31(2), 495–513 (2016)CrossRef Yang, R.: A systematic classification investigation of rapid intensification of atlantic tropical cyclones with the ships database. Weather Forecast. 31(2), 495–513 (2016)CrossRef
27.
Zurück zum Zitat Yang, R., Tang, J., Kafatos, M.: Mining “optimal” conditions for rapid intensifications of tropical cyclones. In: Program of the 19th Conference on Probability and Statistics. American Meteorological Society (2008) Yang, R., Tang, J., Kafatos, M.: Mining “optimal” conditions for rapid intensifications of tropical cyclones. In: Program of the 19th Conference on Probability and Statistics. American Meteorological Society (2008)
28.
Zurück zum Zitat Yang, R., Tang, J., Sun, D.: Association rule data mining applications for atlantic tropical cyclone intensity changes. Weather Forecast. 26(3), 337–353 (2011)CrossRef Yang, R., Tang, J., Sun, D.: Association rule data mining applications for atlantic tropical cyclone intensity changes. Weather Forecast. 26(3), 337–353 (2011)CrossRef
29.
Zurück zum Zitat Yang, W., Cui, Y.: Tensor factorization-based classification of Alzheimer’s disease vs healthy controls. In: 2012 5th International Conference on Biomedical Engineering and Informatics (BMEI), pp. 371–374. IEEE (2012) Yang, W., Cui, Y.: Tensor factorization-based classification of Alzheimer’s disease vs healthy controls. In: 2012 5th International Conference on Biomedical Engineering and Informatics (BMEI), pp. 371–374. IEEE (2012)
Metadaten
Titel
Detection and Prediction of Natural Hazards Using Large-Scale Environmental Data
verfasst von
Nina Hubig
Philip Fengler
Andreas Züfle
Ruixin Yang
Stephan Günnemann
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-64367-0_16