Top

Annals of Data Science

18-11-2024 | Original Article

Statistical Data-Driven Modelling and Forecasting: An Application to COVID-19 Pandemic

Authors: Shalabh, Subhra Sankar Dhar, Sabara Parshad Rajeshbhai

Published in: Annals of Data Science

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

One of the key objectives of statistics is to provide a model compatible with the data generated by an unknown random process. Often, it happens that the unknown process is intractable, and no prior data or information associated with the unknown process is available. Under such circumstances, well-known techniques like regression modelling techniques may not work. As a result, an alternative approach may be to observe the general features of the process from the available data. Afterward, a suitable statistical distribution, like a mixture of certain distributions, can be fitted to the existing available data, and future observations can be predicted using this fitting. For example, one may consider the prediction related to the COVID-19 pandemic. As it occurred for the first time, no prior data was available to apprehend the behaviour and progression of the COVID-19 pandemic. For such cases, a data-based statistical modelling procedure can be adopted to predict future occurrences based on a small data set. This article presents such an application-oriented, data-based statistical modelling procedure with an implementation on the COVID-19 data. The proposed procedure can be used for a wide range of modelling and forecasting of future events.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Available only for authorised users

Dhar SS, Shalabh, (2022) GIVE statistic for goodness of fit in instrumental variables models with application to COVID data. Nat Sci Rep 12:9472. https://doi.org/10.1038/s41598-022-13240-yCrossRef

Shalabh, Dhar SS, Chakroborty C, Jha, P (Appearing) Goodness of fit based and variable selection in non-parametric measurement error model. In: Shekhar C, Sinha RR (eds) Statistical Modeling and applications on real-time problems, Taylor's & Francis, CRC Press

Shalabh, Dhar SS, Garg G (Appearing) Robust measures of goodness of fit and outlier detection in linear regression models. In: Ali MM, Ali I, Yousof HM (eds) Statistical outliers and related topics, Taylor's & Francis, CRC Press

Xu C, Chang W, Liu W (2023) Data-driven decision model based on local two-stage weighted ensemble learning. Ann Oper Res 325:995–1028CrossRef

Prume E, Reese S, Ortiz M (2023) Model-free data-driven inference in computational mechanics. Comput Methods Appl Mech Eng 403:115704. https://doi.org/10.1016/j.cma.2022.115704CrossRef

Ahmadi A, Foster JM, Protas B (2022) Data-driven optimal closures for mean-cluster models: beyond the classical pair approximation. Phys Rev E 106:025313. https://doi.org/10.1103/PhysRevE.106.025313CrossRef

Beyaztas BH, Bandyopadhyay S (2022) Data driven robust estimation methods for fixed effects panel data models. J Stat Comput Simul 7(92):1401–1425CrossRef

Wang C, Qiang X, Fan H, Wu T, Chen Y (2022) Novel data-driven method for non-probabilistic uncertainty analysis of engineering structures based on ellipsoid model. Comput Methods Appl Mech Eng 394:114889. https://doi.org/10.1016/j.cma.2022.114889CrossRef

Sun W, Feng J, Su J, Liang Y (2022) Data driven adaptive Gaussian mixture model for solving Fokker-Planck equation. Chaos 32:033131. https://doi.org/10.1063/5.0083822CrossRef

10.

Zhao J, Zhang Y, Wu S, Shen L (2022) Data-driven and distribution-free estimation of tailed-related risks for GARCH models using composite asymmetric least squares regression. J Comput Appl Math 403:113862. https://doi.org/10.1016/j.cam.2021.113862CrossRef

11.

Huang H, Gao W, Ye C (2021) An intelligent data-driven model for disease diagnosis based on machine learning theory. J Comb Optim 42:884–895CrossRef

12.

Sang J, Pan X, Lin T, Liang W, Liu GR (2021) A data-driven artificial neural network model for predicting wind load of buildings using GSM-CFD solver. Eur J Mech B Fluids 87:24–36CrossRef

13.

Wang M, Liu C, Xie T, Sun Z (2020) Data-driven model checking for errors-in-variables varying-coefficient models with replicate measurements. Comput Stat Data Anal 141:12–27CrossRef

14.

Boruvka A, Takahara G, Tu D (2016) Data-driven ridge regression for Aalen’s additive risk model. Stat Probab Lett 109:189–193CrossRef

15.

Guay A, Guerre E (2006) A data-driven nonparametric specification test for dynamic regression models. Economet Theor 22:543–586CrossRef

16.

Vieu P (2002) Data-driven model choice in multivariate nonparametric regression. Statistics 36:231–246CrossRef

17.

Spokoiny V (2001) Data-driven testing the fit of linear models. Math Methods Stat 10:465–497

18.

Shi Y (2022) Advances in big data analytics: theory, algorithm and practice. Springer, SingaporeCrossRef

19.

Shi Y, Tian YJ, Kou G, Peng Y, Li JP (2011) Optimization based data mining: theory and applications. Springer, BerlinCrossRef

20.

Kelleher JD, Tierney B (2018) Data science. MIT Press, United KingdomCrossRef

21.

Provost F, Fawcett T (2013) Data science and its relationship to big data and data-driven decision making. Big Data 1:51–59. https://doi.org/10.1089/big.2013.1508CrossRef

22.

Efron B, Hastie T (2021) Computer age statistical inference: algorithms, evidence, and data science. Cambridge University Press, India

23.

Kordon AK (2020). The AI-Based Data Science Workflow. Applying Data Science. Springer, Cham. https://doi.org/10.1007/978-3-030-36375-8_6

24.

Tien JM (2017) Internet of things, real-time decision making, and artificial intelligence. Ann Data Sci 4(2):149–178CrossRef

25.

Nazarathy Y, Klok H (2021) Statistics with Julia—fundamentals for data science, machine learning and artificial intelligence. Springer, ChamCrossRef

26.

Olson DL, Shi Y (2007) Introduction to business data mining. McGraw-Hill/Irwin, New York

27.

Yanqing D, John SE, Dwivedi YK (2019) Artificial intelligence for decision making in the era of Big Data – evolution, challenges and research agenda. Int J Inf Manage 48:63–71. https://doi.org/10.1016/j.ijinfomgt.2019.01.021CrossRef

28.

Alloghani M, Al-Jumeily D, Mustafina J, Hussain A, Aljaaf AJ (2020) A systematic review on supervised and unsupervised machine learning algorithms for data science. In: Berry M, Mohamed A, Yap B (eds) Supervised and unsupervised learning for data science. Unsupervised and Semi-Supervised Learning. Springer, Cham. https://doi.org/10.1007/978-3-030-22475-2_1

29.

Kanter JM, Veeramachaneni K (2015) Deep feature synthesis: Towards automating data science endeavors. IEEE International Conference on Data Science and Advanced Analytics (DSAA) Paris, France, 1–10. https://doi.org/10.1109/DSAA.2015.7344858

30.

Xue L, Jing S, Miller JC, Sun W, Li H, Estrada-Franco JG, Hyman JM, Zhu H (2020) A data-driven network model for the emerging COVID-19 epidemics in Wuhan, Toronto and Italy. Math Biosci 326:10. https://doi.org/10.1016/j.mbs.2020.108391CrossRef

31.

Zanella M, Bardelli C, Dimarco G, Deandrea S, Perotti P, Azzi M, Figini S, Toscani G (2021) A data-driven epidemic model with social structure for understanding the COVID-19 infection on a heavily affected Italian province. Math Models Methods Appl Sci 31:2533–2570CrossRef

32.

Adhikari K, Gautam R, Pokharel A, Uprety KN, Vaidya NK (2023) Data-driven models for the risk of infection and hospitalization during a pandemic: case study on COVID-19 in Nepal. J Theoret Biol 574:11. https://doi.org/10.1016/j.jtbi.2023.111622CrossRef

33.

Ganesh M, Hawkins SC (2022) A surrogate Bayesian framework for a SARS-CoV-2 data driven stochastic model. Comput Math Biophys 10:34–67CrossRef

34.

Cai M, Karniadakis GE, Li C (2022) Fractional SEIR model and data-driven predictions of COVID-19 dynamics of Omicron variant. Chaos 32:7. https://doi.org/10.1063/5.0099450CrossRef

35.

Eshkiti A, Sabouhi F, Bozorgi-Amiri A (2023) A data-driven optimization model to response to COVID-19 pandemic: a case study. Ann Oper Res 328:337–386CrossRef

36.

Latif et al. (2020) Leveraging data science to combat COVID-19: a comprehensive review. IEEE Trans Artif Intell, 1(1): 85–103. https://doi.org/10.1109/TAI.2020.3020521

37.

Dasari VN, Prabaharan SRS (2020) Data science and the role of artificial intelligence in achieving the fast diagnosis of Covid-19. Chaos Solitons Fract 140(110182):7

38.

Matthew AW, Stanley EF (2013) Data science, predictive analytics, and big data: a revolution that will transform supply chain design and management. J Bus Logist 2(34):77–84. https://doi.org/10.1111/jbl.12010CrossRef

39.

Schoenherr T, Speier-Pero C (2015) Data Science, Predictive Analytics, and Big Data in Supply Chain Management: Current State and Future Potential. J Bus Logist 1(36):120–132. https://doi.org/10.1111/jbl.12082CrossRef

40.

Rego Rodríguez FA, Germán FL, Vitón-Castillo AA (2022) Artificial intelligence and machine learning: present and future applications in health sciences. Semin Med Writ Educ 1:9. https://doi.org/10.56294/mw20229CrossRef

41.

Yuequan B, Zhicheng C, Shiyin W, Yang X, Zhiyi T, Hui L (2019) The state of the art of data science and engineering in structural health monitoring. Engineering 2(5):234–242. https://doi.org/10.1016/j.eng.2018.11.027CrossRef

42.

Gerard G, Osinga EC, Lavie D, Scott BA (2016) Big data and data science methods for management research. Acad Manag J 5(59):1493–1507. https://doi.org/10.5465/amj.2016.4005CrossRef

43.

Ben KD (2019) Big Data and data science: a critical review of issues for educational research. Br J Edu Technol 1(50):101–113. https://doi.org/10.1111/bjet.12595CrossRef

44.

Sabara PR, Dhar SS, Shalabh (2021) Statistical Forecasting: Third Wave of COVID-19-With an Application to India. medRxiv. https://doi.org/10.1101/2021.12.20.21268150

45.

Sabara PR, Dhar SS, Shalabh (2022) Fourth Wave of COVID-19 in India: Statistical Forecasting. medRxiv https://doi.org/10.1101/2022.02.23.22271382

46.

Mathieu E, Ritchie H, Rodés-Guirao L, Appel C, Gavrilov D, Giattino C, Hasell J, Macdonald B, Dattani S, Beltekian D, Ortiz-Ospina E, Roser M (2020) Coronavirus pandemic (covid-19). Our World in Data. https://ourworldindata.org/coronavirus

47.

Deshpande M (2020) Clustering with Gaussian mixture models. https://pythonmachinelearning.pro/clustering-with-gaussian-mixture-models

48.

DiFrancesco V (2021) Gaussian mixture models for clustering. https://towardsdatascience.com/gaussian-mixture-models-for-clustering-3f62d0da675

49.

Dempster AP, Laird NM, Rubin DB (1977) Maximum likelihood from incomplete data via the EM algorithm. J R Stat Soc B 39:1–38CrossRef

50.

Pedregosa FG et al (2011) Scikit-learn Machine learning in Python. J Mach Learn Res 12:2825–2830

51.

Efron B, Tibshirani R (1993) An introduction to the bootstrap. Chapman and Hall/CRCCrossRef

52.

van der Vaart AW (1998) Asymptotic Statistics. Cambridge University PressCrossRef

53.

Heumann C, Schomaker M, Shalabh M (2022) Introduction to statistics and data analysis—with exercises, solutions and applications in R. Springer, Switzerland

Title: Statistical Data-Driven Modelling and Forecasting: An Application to COVID-19 Pandemic
Authors: Shalabh
Subhra Sankar Dhar
Sabara Parshad Rajeshbhai
Publication date: 18-11-2024
Publisher: Springer Berlin Heidelberg
Published in: Annals of Data Science
Print ISSN: 2198-5804
Electronic ISSN: 2198-5812
DOI: https://doi.org/10.1007/s40745-024-00583-8

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Technik"

Springer Professional "Wirtschaft+Technik"

Springer Professional "Wirtschaft"