Skip to main content

2020 | OriginalPaper | Buchkapitel

Historical Weather Data Recovery and Estimation

verfasst von : Fadoua Rafii, Tahar Kechadi

Erschienen in: Innovations in Smart Cities Applications Edition 3

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In order to make efficient decisions in agriculture, it is imperative to analyse the weather data collected from various sources. These data are generated by automated weather stations. Unfortunately, weather observations may be missing or altered since weather stations may be stopped for maintenance or became out of order. Thus, it would affect significantly the process of data analysis. The purpose of this study is to estimate those missing values by using interpolation methods and others. We study the effectiveness of each method and compare them on different weather attributes. The methods were applied on different patterns of missing values and outliers. The experimental results prove that the two methods based on geographical proximity are performing better.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Menne, M.J., Williams, C.N., Gleason, B.E., Rennie, J.J., Lawrimore, J.H.: The global historical climatology network monthly temperature dataset, version 4. J. Clim. 31, 9835–9854 (2018)CrossRef Menne, M.J., Williams, C.N., Gleason, B.E., Rennie, J.J., Lawrimore, J.H.: The global historical climatology network monthly temperature dataset, version 4. J. Clim. 31, 9835–9854 (2018)CrossRef
2.
Zurück zum Zitat Paltasingh, K.R., Goyari, P., Mishra, R.K.: Measuring weather impact on crop yield using aridity index: evidence from Odisha. Agric. Econ. Res. Rev. 25, 205–216 (2012) Paltasingh, K.R., Goyari, P., Mishra, R.K.: Measuring weather impact on crop yield using aridity index: evidence from Odisha. Agric. Econ. Res. Rev. 25, 205–216 (2012)
3.
Zurück zum Zitat Iizumi, T., Ramankutty, N.: How do weather and climate influence cropping area and intensity? Glob. Food Secur. 4, 46–50 (2015)CrossRef Iizumi, T., Ramankutty, N.: How do weather and climate influence cropping area and intensity? Glob. Food Secur. 4, 46–50 (2015)CrossRef
4.
Zurück zum Zitat Ceglar, A., Turco, M., Toreti, A., Doblas-Reyes, F.J.: Linking crop yield anomalies to large-scale atmospheric circulation in Europe. Agric. For. Meteorol. 240–241, 35–45 (2017)CrossRef Ceglar, A., Turco, M., Toreti, A., Doblas-Reyes, F.J.: Linking crop yield anomalies to large-scale atmospheric circulation in Europe. Agric. For. Meteorol. 240–241, 35–45 (2017)CrossRef
5.
Zurück zum Zitat Ray, D.K., Gerber, J.S., MacDonald, G.K., West, P.C.: Climate variation explains a third of global crop yield variability. Nat. Commun. 6, 1–9 (2015) Ray, D.K., Gerber, J.S., MacDonald, G.K., West, P.C.: Climate variation explains a third of global crop yield variability. Nat. Commun. 6, 1–9 (2015)
6.
Zurück zum Zitat Haworth, J., Cheng, T.: Non-parametric regression for space–time forecasting under missing data. Comput. Environ. Urban Syst. 36(6), 538–550 (2012)CrossRef Haworth, J., Cheng, T.: Non-parametric regression for space–time forecasting under missing data. Comput. Environ. Urban Syst. 36(6), 538–550 (2012)CrossRef
7.
Zurück zum Zitat Houari, R., Bounceur, A., Kechadi, M.-T., Tari, A.-K., Euler, R.: Dimensionality reduction in data mining: a copula approach. Expert Syst. Appl. 64(12), 247–280 (2016)CrossRef Houari, R., Bounceur, A., Kechadi, M.-T., Tari, A.-K., Euler, R.: Dimensionality reduction in data mining: a copula approach. Expert Syst. Appl. 64(12), 247–280 (2016)CrossRef
8.
Zurück zum Zitat Kotsiantis, S., Kostoulas, A., Lykoudis, S., Argiriou, A., Menagias, K.: Filling missing temperature values in weather data banks. In: 2nd IET International Conference on Intelligent Environments (IE 2006), vol. 1, p. 327. IEE, Athens (2006) Kotsiantis, S., Kostoulas, A., Lykoudis, S., Argiriou, A., Menagias, K.: Filling missing temperature values in weather data banks. In: 2nd IET International Conference on Intelligent Environments (IE 2006), vol. 1, p. 327. IEE, Athens (2006)
9.
Zurück zum Zitat Grzymala-Busse, J.W., Hu, M.: A comparison of several approaches to missing attribute values in data mining. In: LNAJ, vol. 2005, pp. 378–385 (2001) Grzymala-Busse, J.W., Hu, M.: A comparison of several approaches to missing attribute values in data mining. In: LNAJ, vol. 2005, pp. 378–385 (2001)
10.
Zurück zum Zitat Cong, R.-G., Brady, M.: The interdependence between rainfall and temperature: copula analyses. Sci. World J. 2012, 1–11 (2012)CrossRef Cong, R.-G., Brady, M.: The interdependence between rainfall and temperature: copula analyses. Sci. World J. 2012, 1–11 (2012)CrossRef
11.
Zurück zum Zitat Medori, M., Michelini, L., Nogues, I., Loreto, F., Calfapietra, C.: The impact of root temperature on photosynthesis and isoprene emission in three different plant species. Sci. World J. 2012, 10 (2012). Article ID 525827CrossRef Medori, M., Michelini, L., Nogues, I., Loreto, F., Calfapietra, C.: The impact of root temperature on photosynthesis and isoprene emission in three different plant species. Sci. World J. 2012, 10 (2012). Article ID 525827CrossRef
12.
Zurück zum Zitat Palomares-Salas, J.C., Agüera-Pérez, A., de la Rosa, J.J.G., Moreno-Muñoz, A.: A novel neural network method for wind speed forecasting using exogenous measurements from agriculture stations. Measurement 55, 295–304 (2014)CrossRef Palomares-Salas, J.C., Agüera-Pérez, A., de la Rosa, J.J.G., Moreno-Muñoz, A.: A novel neural network method for wind speed forecasting using exogenous measurements from agriculture stations. Measurement 55, 295–304 (2014)CrossRef
13.
Zurück zum Zitat Hatfield, J.L., Prueger, J.H.: Temperature extremes: effect on plant growth and development. Weather Clim. Extrem. 10, 4–10 (2015)CrossRef Hatfield, J.L., Prueger, J.H.: Temperature extremes: effect on plant growth and development. Weather Clim. Extrem. 10, 4–10 (2015)CrossRef
14.
Zurück zum Zitat Fiala, K., Tůma, I., Holub, P.: Effect of manipulated rainfall on root production and plant belowground dry mass of different grassland ecosystems. Ecosystems 12, 906–914 (2009)CrossRef Fiala, K., Tůma, I., Holub, P.: Effect of manipulated rainfall on root production and plant belowground dry mass of different grassland ecosystems. Ecosystems 12, 906–914 (2009)CrossRef
15.
Zurück zum Zitat Kant, S., Meshram, S., Sahu, K.C.: Analysis of rainfall data for drought investigation at Agra UP. Recent Res. Sci. Technol. 6(1), 62–64 (2014) Kant, S., Meshram, S., Sahu, K.C.: Analysis of rainfall data for drought investigation at Agra UP. Recent Res. Sci. Technol. 6(1), 62–64 (2014)
16.
Zurück zum Zitat Ben Alaya, M.A., Chebana, F., Ouarda, T.B.M.J.: Probabilistic multisite statistical downscaling for daily precipitation using a bernoulli–generalized pareto multivariate autoregressive model. J. Clim. 28, 2349–2364 (2015)CrossRef Ben Alaya, M.A., Chebana, F., Ouarda, T.B.M.J.: Probabilistic multisite statistical downscaling for daily precipitation using a bernoulli–generalized pareto multivariate autoregressive model. J. Clim. 28, 2349–2364 (2015)CrossRef
17.
Zurück zum Zitat Huang, B.Q., Rashid, T., Kechadi, M.T.: Multi-context recurrent neural network for time series applications. Int. J. Comput. Intell. 3(1), 45–55 (2006) Huang, B.Q., Rashid, T., Kechadi, M.T.: Multi-context recurrent neural network for time series applications. Int. J. Comput. Intell. 3(1), 45–55 (2006)
18.
Zurück zum Zitat Sophia, K., Kanchi, R.R.: Wind speed and direction measurement system using Atmel 89S51 microcontroller. In: International Conference on Inventive Computation Technologies, pp. 1–6 (2016) Sophia, K., Kanchi, R.R.: Wind speed and direction measurement system using Atmel 89S51 microcontroller. In: International Conference on Inventive Computation Technologies, pp. 1–6 (2016)
19.
Zurück zum Zitat De Silva, R.P., Dayawansa, N.D.K., Ratnasiri, M.D.: A comparison of methods used in estimating missing rainfall data. J. Agric. Sci. 3(May), 101–108 (2007) De Silva, R.P., Dayawansa, N.D.K., Ratnasiri, M.D.: A comparison of methods used in estimating missing rainfall data. J. Agric. Sci. 3(May), 101–108 (2007)
20.
Zurück zum Zitat Jahan, F., Sinha, N.C., Rahman, Md.M., Rahman, Md.M., Mondal, Md.S.H., Islam, M.A.: Comparison of missing value estimation techniques in rainfall data of Bangladesh. Theor. Appl. Climatol. 136, 1115–1131 (2019)CrossRef Jahan, F., Sinha, N.C., Rahman, Md.M., Rahman, Md.M., Mondal, Md.S.H., Islam, M.A.: Comparison of missing value estimation techniques in rainfall data of Bangladesh. Theor. Appl. Climatol. 136, 1115–1131 (2019)CrossRef
21.
Zurück zum Zitat Suhalia, J., Sayang, M.D., Jemain, A.A.: Revised spatial weighting methods for estimation of missing rainfall data. Asia-Pac. J. Atmos. Sci. 44(2), 93–104 (2008) Suhalia, J., Sayang, M.D., Jemain, A.A.: Revised spatial weighting methods for estimation of missing rainfall data. Asia-Pac. J. Atmos. Sci. 44(2), 93–104 (2008)
22.
Zurück zum Zitat Sattari, M.-T., Rezazadeh-Joudi, A., Kusiak, A.: Assessment of different methods for estimation of missing data in precipitation studies. Hydrol. Res. 48, 1032–1044 (2017)CrossRef Sattari, M.-T., Rezazadeh-Joudi, A., Kusiak, A.: Assessment of different methods for estimation of missing data in precipitation studies. Hydrol. Res. 48, 1032–1044 (2017)CrossRef
23.
Zurück zum Zitat Bonan, G.B., Doney, S.C.: Climate, ecosystems, and planetary futures: the challenge to predict life in Earth system models. Science 359, eaam8328 (2018)CrossRef Bonan, G.B., Doney, S.C.: Climate, ecosystems, and planetary futures: the challenge to predict life in Earth system models. Science 359, eaam8328 (2018)CrossRef
24.
Zurück zum Zitat Liu, S., Su, H., Tian, J., Zhang, R., Wang, W., Wu, Y.: Evaluating four remote sensing methods for estimating surface air temperature on a regional scale. J. Appl. Meteorol. Climatol. 56, 803–814 (2017)CrossRef Liu, S., Su, H., Tian, J., Zhang, R., Wang, W., Wu, Y.: Evaluating four remote sensing methods for estimating surface air temperature on a regional scale. J. Appl. Meteorol. Climatol. 56, 803–814 (2017)CrossRef
25.
Zurück zum Zitat Stahl, K., Moore, R., Floyer, J., Asplin, M., McKendry, I.: Comparison of approaches for spatial interpolation of daily air temperature in a large region with complex topography and highly variable station density. Agric. For. Meteorol. 139, 224–236 (2006)CrossRef Stahl, K., Moore, R., Floyer, J., Asplin, M., McKendry, I.: Comparison of approaches for spatial interpolation of daily air temperature in a large region with complex topography and highly variable station density. Agric. For. Meteorol. 139, 224–236 (2006)CrossRef
26.
Zurück zum Zitat Rahman, M.G., Islam, M.Z.: A decision tree based missing value imputation technique for data preprocessing. In: Proceedings of the Ninth Australasian Data Mining Conference, Ballarat, pp. 41–50 (2011) Rahman, M.G., Islam, M.Z.: A decision tree based missing value imputation technique for data preprocessing. In: Proceedings of the Ninth Australasian Data Mining Conference, Ballarat, pp. 41–50 (2011)
27.
Zurück zum Zitat Yozgatligil, C., Aslan, S., Iyigun, C., Batmaz, I.: Comparison of missing value imputation methods in time series: the case of turkish meteorological data. Theor. Appl. Climatol. 112(1–2), 143–167 (2013)CrossRef Yozgatligil, C., Aslan, S., Iyigun, C., Batmaz, I.: Comparison of missing value imputation methods in time series: the case of turkish meteorological data. Theor. Appl. Climatol. 112(1–2), 143–167 (2013)CrossRef
28.
Zurück zum Zitat Zahrah, S.N., Burhanuddin, A., Mohad Deni, S., Mohamed Ramli, N.: Revised normal ratio methods for imputation of missing rainfall data. Sci. Res. J. 13(1), 83 (2016)CrossRef Zahrah, S.N., Burhanuddin, A., Mohad Deni, S., Mohamed Ramli, N.: Revised normal ratio methods for imputation of missing rainfall data. Sci. Res. J. 13(1), 83 (2016)CrossRef
29.
Zurück zum Zitat Burhanuddin, S.N.Z.A.: Normal ratio in multiple imputation based on bootstrapped sample for rainfall data with missingness. Int. J. GEOMATE 13, 131–137 (2017) Burhanuddin, S.N.Z.A.: Normal ratio in multiple imputation based on bootstrapped sample for rainfall data with missingness. Int. J. GEOMATE 13, 131–137 (2017)
30.
Zurück zum Zitat Eskelson, B.N.I., Temesgen, H., Lemay, V., Barrett, T.M., Crookston, N.L., Hudak, A.T.: The roles of nearest neighbor methods in imputing missing data in forest inventory and monitoring databases. Scand. J. For. Res. 24, 235–246 (2009)CrossRef Eskelson, B.N.I., Temesgen, H., Lemay, V., Barrett, T.M., Crookston, N.L., Hudak, A.T.: The roles of nearest neighbor methods in imputing missing data in forest inventory and monitoring databases. Scand. J. For. Res. 24, 235–246 (2009)CrossRef
31.
Zurück zum Zitat Bárdossy, A., Pegram, G.: Infilling missing precipitation records – a comparison of a new copula-based method with other techniques. J. Hydrol. 519(November 2014), 1162–1170 (2014)CrossRef Bárdossy, A., Pegram, G.: Infilling missing precipitation records – a comparison of a new copula-based method with other techniques. J. Hydrol. 519(November 2014), 1162–1170 (2014)CrossRef
32.
Zurück zum Zitat Kanda, N., Negi, H.S., Rishi, M.S., Shekhar, M.S.: Performance of various techniques in estimating missing climatological data over snowbound mountainous areas of Karakoram Himalaya: estimation of missing climate data over mountainous areas. Meteorol. Appl. 25, 337–349 (2018)CrossRef Kanda, N., Negi, H.S., Rishi, M.S., Shekhar, M.S.: Performance of various techniques in estimating missing climatological data over snowbound mountainous areas of Karakoram Himalaya: estimation of missing climate data over mountainous areas. Meteorol. Appl. 25, 337–349 (2018)CrossRef
Metadaten
Titel
Historical Weather Data Recovery and Estimation
verfasst von
Fadoua Rafii
Tahar Kechadi
Copyright-Jahr
2020
DOI
https://doi.org/10.1007/978-3-030-37629-1_85

    Premium Partner