Skip to main content
Top

2020 | OriginalPaper | Chapter

Historical Weather Data Recovery and Estimation

Authors : Fadoua Rafii, Tahar Kechadi

Published in: Innovations in Smart Cities Applications Edition 3

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In order to make efficient decisions in agriculture, it is imperative to analyse the weather data collected from various sources. These data are generated by automated weather stations. Unfortunately, weather observations may be missing or altered since weather stations may be stopped for maintenance or became out of order. Thus, it would affect significantly the process of data analysis. The purpose of this study is to estimate those missing values by using interpolation methods and others. We study the effectiveness of each method and compare them on different weather attributes. The methods were applied on different patterns of missing values and outliers. The experimental results prove that the two methods based on geographical proximity are performing better.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Menne, M.J., Williams, C.N., Gleason, B.E., Rennie, J.J., Lawrimore, J.H.: The global historical climatology network monthly temperature dataset, version 4. J. Clim. 31, 9835–9854 (2018)CrossRef Menne, M.J., Williams, C.N., Gleason, B.E., Rennie, J.J., Lawrimore, J.H.: The global historical climatology network monthly temperature dataset, version 4. J. Clim. 31, 9835–9854 (2018)CrossRef
2.
go back to reference Paltasingh, K.R., Goyari, P., Mishra, R.K.: Measuring weather impact on crop yield using aridity index: evidence from Odisha. Agric. Econ. Res. Rev. 25, 205–216 (2012) Paltasingh, K.R., Goyari, P., Mishra, R.K.: Measuring weather impact on crop yield using aridity index: evidence from Odisha. Agric. Econ. Res. Rev. 25, 205–216 (2012)
3.
go back to reference Iizumi, T., Ramankutty, N.: How do weather and climate influence cropping area and intensity? Glob. Food Secur. 4, 46–50 (2015)CrossRef Iizumi, T., Ramankutty, N.: How do weather and climate influence cropping area and intensity? Glob. Food Secur. 4, 46–50 (2015)CrossRef
4.
go back to reference Ceglar, A., Turco, M., Toreti, A., Doblas-Reyes, F.J.: Linking crop yield anomalies to large-scale atmospheric circulation in Europe. Agric. For. Meteorol. 240–241, 35–45 (2017)CrossRef Ceglar, A., Turco, M., Toreti, A., Doblas-Reyes, F.J.: Linking crop yield anomalies to large-scale atmospheric circulation in Europe. Agric. For. Meteorol. 240–241, 35–45 (2017)CrossRef
5.
go back to reference Ray, D.K., Gerber, J.S., MacDonald, G.K., West, P.C.: Climate variation explains a third of global crop yield variability. Nat. Commun. 6, 1–9 (2015) Ray, D.K., Gerber, J.S., MacDonald, G.K., West, P.C.: Climate variation explains a third of global crop yield variability. Nat. Commun. 6, 1–9 (2015)
6.
go back to reference Haworth, J., Cheng, T.: Non-parametric regression for space–time forecasting under missing data. Comput. Environ. Urban Syst. 36(6), 538–550 (2012)CrossRef Haworth, J., Cheng, T.: Non-parametric regression for space–time forecasting under missing data. Comput. Environ. Urban Syst. 36(6), 538–550 (2012)CrossRef
7.
go back to reference Houari, R., Bounceur, A., Kechadi, M.-T., Tari, A.-K., Euler, R.: Dimensionality reduction in data mining: a copula approach. Expert Syst. Appl. 64(12), 247–280 (2016)CrossRef Houari, R., Bounceur, A., Kechadi, M.-T., Tari, A.-K., Euler, R.: Dimensionality reduction in data mining: a copula approach. Expert Syst. Appl. 64(12), 247–280 (2016)CrossRef
8.
go back to reference Kotsiantis, S., Kostoulas, A., Lykoudis, S., Argiriou, A., Menagias, K.: Filling missing temperature values in weather data banks. In: 2nd IET International Conference on Intelligent Environments (IE 2006), vol. 1, p. 327. IEE, Athens (2006) Kotsiantis, S., Kostoulas, A., Lykoudis, S., Argiriou, A., Menagias, K.: Filling missing temperature values in weather data banks. In: 2nd IET International Conference on Intelligent Environments (IE 2006), vol. 1, p. 327. IEE, Athens (2006)
9.
go back to reference Grzymala-Busse, J.W., Hu, M.: A comparison of several approaches to missing attribute values in data mining. In: LNAJ, vol. 2005, pp. 378–385 (2001) Grzymala-Busse, J.W., Hu, M.: A comparison of several approaches to missing attribute values in data mining. In: LNAJ, vol. 2005, pp. 378–385 (2001)
10.
go back to reference Cong, R.-G., Brady, M.: The interdependence between rainfall and temperature: copula analyses. Sci. World J. 2012, 1–11 (2012)CrossRef Cong, R.-G., Brady, M.: The interdependence between rainfall and temperature: copula analyses. Sci. World J. 2012, 1–11 (2012)CrossRef
11.
go back to reference Medori, M., Michelini, L., Nogues, I., Loreto, F., Calfapietra, C.: The impact of root temperature on photosynthesis and isoprene emission in three different plant species. Sci. World J. 2012, 10 (2012). Article ID 525827CrossRef Medori, M., Michelini, L., Nogues, I., Loreto, F., Calfapietra, C.: The impact of root temperature on photosynthesis and isoprene emission in three different plant species. Sci. World J. 2012, 10 (2012). Article ID 525827CrossRef
12.
go back to reference Palomares-Salas, J.C., Agüera-Pérez, A., de la Rosa, J.J.G., Moreno-Muñoz, A.: A novel neural network method for wind speed forecasting using exogenous measurements from agriculture stations. Measurement 55, 295–304 (2014)CrossRef Palomares-Salas, J.C., Agüera-Pérez, A., de la Rosa, J.J.G., Moreno-Muñoz, A.: A novel neural network method for wind speed forecasting using exogenous measurements from agriculture stations. Measurement 55, 295–304 (2014)CrossRef
13.
go back to reference Hatfield, J.L., Prueger, J.H.: Temperature extremes: effect on plant growth and development. Weather Clim. Extrem. 10, 4–10 (2015)CrossRef Hatfield, J.L., Prueger, J.H.: Temperature extremes: effect on plant growth and development. Weather Clim. Extrem. 10, 4–10 (2015)CrossRef
14.
go back to reference Fiala, K., Tůma, I., Holub, P.: Effect of manipulated rainfall on root production and plant belowground dry mass of different grassland ecosystems. Ecosystems 12, 906–914 (2009)CrossRef Fiala, K., Tůma, I., Holub, P.: Effect of manipulated rainfall on root production and plant belowground dry mass of different grassland ecosystems. Ecosystems 12, 906–914 (2009)CrossRef
15.
go back to reference Kant, S., Meshram, S., Sahu, K.C.: Analysis of rainfall data for drought investigation at Agra UP. Recent Res. Sci. Technol. 6(1), 62–64 (2014) Kant, S., Meshram, S., Sahu, K.C.: Analysis of rainfall data for drought investigation at Agra UP. Recent Res. Sci. Technol. 6(1), 62–64 (2014)
16.
go back to reference Ben Alaya, M.A., Chebana, F., Ouarda, T.B.M.J.: Probabilistic multisite statistical downscaling for daily precipitation using a bernoulli–generalized pareto multivariate autoregressive model. J. Clim. 28, 2349–2364 (2015)CrossRef Ben Alaya, M.A., Chebana, F., Ouarda, T.B.M.J.: Probabilistic multisite statistical downscaling for daily precipitation using a bernoulli–generalized pareto multivariate autoregressive model. J. Clim. 28, 2349–2364 (2015)CrossRef
17.
go back to reference Huang, B.Q., Rashid, T., Kechadi, M.T.: Multi-context recurrent neural network for time series applications. Int. J. Comput. Intell. 3(1), 45–55 (2006) Huang, B.Q., Rashid, T., Kechadi, M.T.: Multi-context recurrent neural network for time series applications. Int. J. Comput. Intell. 3(1), 45–55 (2006)
18.
go back to reference Sophia, K., Kanchi, R.R.: Wind speed and direction measurement system using Atmel 89S51 microcontroller. In: International Conference on Inventive Computation Technologies, pp. 1–6 (2016) Sophia, K., Kanchi, R.R.: Wind speed and direction measurement system using Atmel 89S51 microcontroller. In: International Conference on Inventive Computation Technologies, pp. 1–6 (2016)
19.
go back to reference De Silva, R.P., Dayawansa, N.D.K., Ratnasiri, M.D.: A comparison of methods used in estimating missing rainfall data. J. Agric. Sci. 3(May), 101–108 (2007) De Silva, R.P., Dayawansa, N.D.K., Ratnasiri, M.D.: A comparison of methods used in estimating missing rainfall data. J. Agric. Sci. 3(May), 101–108 (2007)
20.
go back to reference Jahan, F., Sinha, N.C., Rahman, Md.M., Rahman, Md.M., Mondal, Md.S.H., Islam, M.A.: Comparison of missing value estimation techniques in rainfall data of Bangladesh. Theor. Appl. Climatol. 136, 1115–1131 (2019)CrossRef Jahan, F., Sinha, N.C., Rahman, Md.M., Rahman, Md.M., Mondal, Md.S.H., Islam, M.A.: Comparison of missing value estimation techniques in rainfall data of Bangladesh. Theor. Appl. Climatol. 136, 1115–1131 (2019)CrossRef
21.
go back to reference Suhalia, J., Sayang, M.D., Jemain, A.A.: Revised spatial weighting methods for estimation of missing rainfall data. Asia-Pac. J. Atmos. Sci. 44(2), 93–104 (2008) Suhalia, J., Sayang, M.D., Jemain, A.A.: Revised spatial weighting methods for estimation of missing rainfall data. Asia-Pac. J. Atmos. Sci. 44(2), 93–104 (2008)
22.
go back to reference Sattari, M.-T., Rezazadeh-Joudi, A., Kusiak, A.: Assessment of different methods for estimation of missing data in precipitation studies. Hydrol. Res. 48, 1032–1044 (2017)CrossRef Sattari, M.-T., Rezazadeh-Joudi, A., Kusiak, A.: Assessment of different methods for estimation of missing data in precipitation studies. Hydrol. Res. 48, 1032–1044 (2017)CrossRef
23.
go back to reference Bonan, G.B., Doney, S.C.: Climate, ecosystems, and planetary futures: the challenge to predict life in Earth system models. Science 359, eaam8328 (2018)CrossRef Bonan, G.B., Doney, S.C.: Climate, ecosystems, and planetary futures: the challenge to predict life in Earth system models. Science 359, eaam8328 (2018)CrossRef
24.
go back to reference Liu, S., Su, H., Tian, J., Zhang, R., Wang, W., Wu, Y.: Evaluating four remote sensing methods for estimating surface air temperature on a regional scale. J. Appl. Meteorol. Climatol. 56, 803–814 (2017)CrossRef Liu, S., Su, H., Tian, J., Zhang, R., Wang, W., Wu, Y.: Evaluating four remote sensing methods for estimating surface air temperature on a regional scale. J. Appl. Meteorol. Climatol. 56, 803–814 (2017)CrossRef
25.
go back to reference Stahl, K., Moore, R., Floyer, J., Asplin, M., McKendry, I.: Comparison of approaches for spatial interpolation of daily air temperature in a large region with complex topography and highly variable station density. Agric. For. Meteorol. 139, 224–236 (2006)CrossRef Stahl, K., Moore, R., Floyer, J., Asplin, M., McKendry, I.: Comparison of approaches for spatial interpolation of daily air temperature in a large region with complex topography and highly variable station density. Agric. For. Meteorol. 139, 224–236 (2006)CrossRef
26.
go back to reference Rahman, M.G., Islam, M.Z.: A decision tree based missing value imputation technique for data preprocessing. In: Proceedings of the Ninth Australasian Data Mining Conference, Ballarat, pp. 41–50 (2011) Rahman, M.G., Islam, M.Z.: A decision tree based missing value imputation technique for data preprocessing. In: Proceedings of the Ninth Australasian Data Mining Conference, Ballarat, pp. 41–50 (2011)
27.
go back to reference Yozgatligil, C., Aslan, S., Iyigun, C., Batmaz, I.: Comparison of missing value imputation methods in time series: the case of turkish meteorological data. Theor. Appl. Climatol. 112(1–2), 143–167 (2013)CrossRef Yozgatligil, C., Aslan, S., Iyigun, C., Batmaz, I.: Comparison of missing value imputation methods in time series: the case of turkish meteorological data. Theor. Appl. Climatol. 112(1–2), 143–167 (2013)CrossRef
28.
go back to reference Zahrah, S.N., Burhanuddin, A., Mohad Deni, S., Mohamed Ramli, N.: Revised normal ratio methods for imputation of missing rainfall data. Sci. Res. J. 13(1), 83 (2016)CrossRef Zahrah, S.N., Burhanuddin, A., Mohad Deni, S., Mohamed Ramli, N.: Revised normal ratio methods for imputation of missing rainfall data. Sci. Res. J. 13(1), 83 (2016)CrossRef
29.
go back to reference Burhanuddin, S.N.Z.A.: Normal ratio in multiple imputation based on bootstrapped sample for rainfall data with missingness. Int. J. GEOMATE 13, 131–137 (2017) Burhanuddin, S.N.Z.A.: Normal ratio in multiple imputation based on bootstrapped sample for rainfall data with missingness. Int. J. GEOMATE 13, 131–137 (2017)
30.
go back to reference Eskelson, B.N.I., Temesgen, H., Lemay, V., Barrett, T.M., Crookston, N.L., Hudak, A.T.: The roles of nearest neighbor methods in imputing missing data in forest inventory and monitoring databases. Scand. J. For. Res. 24, 235–246 (2009)CrossRef Eskelson, B.N.I., Temesgen, H., Lemay, V., Barrett, T.M., Crookston, N.L., Hudak, A.T.: The roles of nearest neighbor methods in imputing missing data in forest inventory and monitoring databases. Scand. J. For. Res. 24, 235–246 (2009)CrossRef
31.
go back to reference Bárdossy, A., Pegram, G.: Infilling missing precipitation records – a comparison of a new copula-based method with other techniques. J. Hydrol. 519(November 2014), 1162–1170 (2014)CrossRef Bárdossy, A., Pegram, G.: Infilling missing precipitation records – a comparison of a new copula-based method with other techniques. J. Hydrol. 519(November 2014), 1162–1170 (2014)CrossRef
32.
go back to reference Kanda, N., Negi, H.S., Rishi, M.S., Shekhar, M.S.: Performance of various techniques in estimating missing climatological data over snowbound mountainous areas of Karakoram Himalaya: estimation of missing climate data over mountainous areas. Meteorol. Appl. 25, 337–349 (2018)CrossRef Kanda, N., Negi, H.S., Rishi, M.S., Shekhar, M.S.: Performance of various techniques in estimating missing climatological data over snowbound mountainous areas of Karakoram Himalaya: estimation of missing climate data over mountainous areas. Meteorol. Appl. 25, 337–349 (2018)CrossRef
Metadata
Title
Historical Weather Data Recovery and Estimation
Authors
Fadoua Rafii
Tahar Kechadi
Copyright Year
2020
DOI
https://doi.org/10.1007/978-3-030-37629-1_85

Premium Partner