Skip to main content
Erschienen in: The Journal of Supercomputing 6/2021

09.11.2020

Air quality monitoring and analysis with dynamic training using deep learning

verfasst von: Endah Kristiani, Ching-Fang Lee, Chao-Tung Yang, Chin-Yin Huang, Yu-Tse Tsan, Wei-Cheng Chan

Erschienen in: The Journal of Supercomputing | Ausgabe 6/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Time series prediction is a challenging predictive modeling case. It is essential to have a prediction model that can adapt to dynamic data. Air quality data show a significant changing degree of spatial and temporal data. Therefore, the updated deep learning model is suitable for this case. In this paper, monitoring and analysis of air quality with dynamic training using recurrent neural network (RNN) are proposed to provide the model remains up-to-date as new data comes. In the experiments, by adjusting the model, the accuracy is enhanced. The scheduling retrained model is provided based on the expected mean absolute percentage error (MAPE) value. First, the machine learning architecture environment is being prepared. Secondly, the RNN parameters were optimized for excellent level predictive precision. Third, set and test the scheduling and MAPE value based on the MAPE’s expected value for the automatic retraining model. Finally, on the interactive map, the output is presented using R and Shiny to visualize the RNN training results.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Aravinth MS, Shanmugapriyaa M, Sowmya M, Arun M (2015) An efficient HADOOP frameworks SQOOP and Ambari for big data processing. Int J Innov Res Sci Technol 1(10):252–255 Aravinth MS, Shanmugapriyaa M, Sowmya M, Arun M (2015) An efficient HADOOP frameworks SQOOP and Ambari for big data processing. Int J Innov Res Sci Technol 1(10):252–255
2.
Zurück zum Zitat Bai Y, Sun Z, Deng J, Li L, Long J, Li C (2017) Manufacturing quality prediction using intelligent learning approaches: a comparative study. Sustainability 10(1):85CrossRef Bai Y, Sun Z, Deng J, Li L, Long J, Li C (2017) Manufacturing quality prediction using intelligent learning approaches: a comparative study. Sustainability 10(1):85CrossRef
3.
Zurück zum Zitat Bivand RS, Pebesma EJ, Gómez-Rubio V, Pebesma EJ (2008) Applied spatial data analysis with R, vol 747248717. Springer, BerlinMATH Bivand RS, Pebesma EJ, Gómez-Rubio V, Pebesma EJ (2008) Applied spatial data analysis with R, vol 747248717. Springer, BerlinMATH
5.
Zurück zum Zitat Brocklebank JC, Dickey DA, Choi B (2018) SAS for forecasting time series. SAS Institute, North CarolinaMATH Brocklebank JC, Dickey DA, Choi B (2018) SAS for forecasting time series. SAS Institute, North CarolinaMATH
6.
Zurück zum Zitat Chang F, Dean J, Ghemawat S, Hsieh WC, Wallach DA, Burrows M, Chandra T, Fikes A, Gruber RE (2008) Bigtable: a distributed storage system for structured data. ACM Trans Comput Syst (TOCS) 26(2):4CrossRef Chang F, Dean J, Ghemawat S, Hsieh WC, Wallach DA, Burrows M, Chandra T, Fikes A, Gruber RE (2008) Bigtable: a distributed storage system for structured data. ACM Trans Comput Syst (TOCS) 26(2):4CrossRef
7.
Zurück zum Zitat Connor JT, Martin RD, Atlas LE (1994) Recurrent neural networks and robust time series prediction. IEEE Trans Neural Netw 5(2):240–254CrossRef Connor JT, Martin RD, Atlas LE (1994) Recurrent neural networks and robust time series prediction. IEEE Trans Neural Netw 5(2):240–254CrossRef
8.
Zurück zum Zitat Dean J, Ghemawat S (2008) Mapreduce: simplified data processing on large clusters. Commun ACM 51(1):107–113CrossRef Dean J, Ghemawat S (2008) Mapreduce: simplified data processing on large clusters. Commun ACM 51(1):107–113CrossRef
10.
Zurück zum Zitat do Nascimento Camelo H, Lucio PS, Junior JBVL, de Carvalho PCM, dos Santos DVG (2018) Innovative hybrid models for forecasting time series applied in wind generation based on the combination of time series models with artificial neural networks. Energy 151:347–357. https://doi.org/10.1016/j.energy.2018.03.077CrossRef do Nascimento Camelo H, Lucio PS, Junior JBVL, de Carvalho PCM, dos Santos DVG (2018) Innovative hybrid models for forecasting time series applied in wind generation based on the combination of time series models with artificial neural networks. Energy 151:347–357. https://​doi.​org/​10.​1016/​j.​energy.​2018.​03.​077CrossRef
11.
Zurück zum Zitat Ghemawat S, Gobioff H, Leung ST (2003) The Google file system. ACM, New York Ghemawat S, Gobioff H, Leung ST (2003) The Google file system. ACM, New York
13.
Zurück zum Zitat Kristiani E, Yang CT, Huang CY, Ko PC, Fathoni H (2020) On construction of sensors, edge, and cloud (ISEC) framework for smart system integration and applications. In: IEEE Internet of Things Journal Kristiani E, Yang CT, Huang CY, Ko PC, Fathoni H (2020) On construction of sensors, edge, and cloud (ISEC) framework for smart system integration and applications. In: IEEE Internet of Things Journal
14.
Zurück zum Zitat Ku JH (2018) A study on prediction model of equipment failure through analysis of big data based on RHADOOP. Wirel Pers Commun 98(4):3163–3176CrossRef Ku JH (2018) A study on prediction model of equipment failure through analysis of big data based on RHADOOP. Wirel Pers Commun 98(4):3163–3176CrossRef
15.
Zurück zum Zitat Lee CF, Yang CT, Kristiani E, Tsan YT, Chan WC, Huang CY (2018) Recurrent neural networks for analysis and automated air pollution forecasting. In: International Conference on Frontier Computing, pp 50–59. Springer Lee CF, Yang CT, Kristiani E, Tsan YT, Chan WC, Huang CY (2018) Recurrent neural networks for analysis and automated air pollution forecasting. In: International Conference on Frontier Computing, pp 50–59. Springer
16.
Zurück zum Zitat Lee CH, Zheng YL (2015) Automatic SQL-to-NoSQL schema transformation over the MySQL and HBase databases. In: Consumer Electronics-Taiwan (ICCE-TW), 2015 IEEE International Conference on, pp 426–427. IEEE Lee CH, Zheng YL (2015) Automatic SQL-to-NoSQL schema transformation over the MySQL and HBase databases. In: Consumer Electronics-Taiwan (ICCE-TW), 2015 IEEE International Conference on, pp 426–427. IEEE
17.
Zurück zum Zitat Li X, Peng L, Hu Y, Shao J, Chi T (2016) Deep learning architecture for air quality predictions. Environ Sci Pollut Res 23(22):22408–22417CrossRef Li X, Peng L, Hu Y, Shao J, Chi T (2016) Deep learning architecture for air quality predictions. Environ Sci Pollut Res 23(22):22408–22417CrossRef
18.
Zurück zum Zitat Liu L, Yang X, Liu H, Wang M, Welles S, Márquez S, Frank A, Haas CN (2016) spatial-temporal analysis of air pollution, climate change, and total mortality in 120 cities of China, 2012–2013. Front Public Health 4:143CrossRef Liu L, Yang X, Liu H, Wang M, Welles S, Márquez S, Frank A, Haas CN (2016) spatial-temporal analysis of air pollution, climate change, and total mortality in 120 cities of China, 2012–2013. Front Public Health 4:143CrossRef
19.
Zurück zum Zitat Medsker LRR, Jain LC (2001) Recurrent neural networks. Des Appl vol 5 Medsker LRR, Jain LC (2001) Recurrent neural networks. Des Appl vol 5
21.
Zurück zum Zitat Vapnik V, Izmailov R (2017) Knowledge transfer in SVM and neural networks. Anna Math Artif Intell 81(1–2):3–19MathSciNetCrossRef Vapnik V, Izmailov R (2017) Knowledge transfer in SVM and neural networks. Anna Math Artif Intell 81(1–2):3–19MathSciNetCrossRef
22.
Zurück zum Zitat Xie Y, Zhao B, Zhang L, Luo R (2015) Spatiotemporal variations of PM2.5 and PM10 concentrations between 31 Chinese cities and their relationships with SO2, NO2, CO and O3. Particuology 20:141–149CrossRef Xie Y, Zhao B, Zhang L, Luo R (2015) Spatiotemporal variations of PM2.5 and PM10 concentrations between 31 Chinese cities and their relationships with SO2, NO2, CO and O3. Particuology 20:141–149CrossRef
26.
Zurück zum Zitat Zaytar MA, El Amrani C (2016) Sequence to sequence weather forecasting with long short term memory recurrent neural networks. Int J Comput Appl 143(11):7–11 Zaytar MA, El Amrani C (2016) Sequence to sequence weather forecasting with long short term memory recurrent neural networks. Int J Comput Appl 143(11):7–11
27.
Zurück zum Zitat Zhang W, Eftychiou A, Vrusias B, Antonopoulos N, Zhang D, Ma M, Oikonomou A, Bessis N, Norrington P, Yue Y, et al. (2014) International journal of grid and high performance computing. International Standard Serial Number Zhang W, Eftychiou A, Vrusias B, Antonopoulos N, Zhang D, Ma M, Oikonomou A, Bessis N, Norrington P, Yue Y, et al. (2014) International journal of grid and high performance computing. International Standard Serial Number
Metadaten
Titel
Air quality monitoring and analysis with dynamic training using deep learning
verfasst von
Endah Kristiani
Ching-Fang Lee
Chao-Tung Yang
Chin-Yin Huang
Yu-Tse Tsan
Wei-Cheng Chan
Publikationsdatum
09.11.2020
Verlag
Springer US
Erschienen in
The Journal of Supercomputing / Ausgabe 6/2021
Print ISSN: 0920-8542
Elektronische ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-020-03492-8

Weitere Artikel der Ausgabe 6/2021

The Journal of Supercomputing 6/2021 Zur Ausgabe