Skip to main content
Top

2021 | OriginalPaper | Chapter

Forecasting Air Flight Delays and Enabling Smart Airport Services in Apache Spark

Authors : Gerasimos Vonitsanos, Theodor Panagiotakopoulos, Andreas Kanavos, Athanasios Tsakalidis

Published in: Artificial Intelligence Applications and Innovations. AIAI 2021 IFIP WG 12.5 International Workshops

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In light of the rapidly growing passenger and flight volumes, airports seek for sustainable solutions to improve passengers’ experience and comfort, while maximizing their profits. A major technological solution towards improving service quality and management processes in airports comprises Internet of Things (IoT) systems that realize the concept of smart airports and offer interconnection potential with other public infrastructures and utilities of smart cities. In order to deliver smart airport services, real-time flight delay data and forecasts are a critical source of information. This paper introduces an essential methodology using machine learning techniques on Apache Spark, a cloud computing framework, with Apache MLlib, a machine learning library to develop and implement prediction models for air flight delays that could be integrated with information systems in order to provide up-to-date analytics. The experimental results have been implemented with various algorithms in terms of classification as well as regression, thus manifesting the potential of the proposed framework.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference AhmadBeygi, S., Cohn, A., Guan, Y., Belobaba, P.: Analysis of the potential for delay propagation in passenger airline networks. J. Air Transp. Manage. 14(5), 221–236 (2008)CrossRef AhmadBeygi, S., Cohn, A., Guan, Y., Belobaba, P.: Analysis of the potential for delay propagation in passenger airline networks. J. Air Transp. Manage. 14(5), 221–236 (2008)CrossRef
2.
go back to reference Alexopoulos, A., Drakopoulos, G., Kanavos, A., Sioutas, S., Vonitsanos, G.: Parametric evaluation of collaborative filtering over apache spark. In: 5th South-East Europe Design Automation, Computer Engineering, Computer Networks and Social Media Conference (SEEDA-CECNSM), pp. 1–8 (2020) Alexopoulos, A., Drakopoulos, G., Kanavos, A., Sioutas, S., Vonitsanos, G.: Parametric evaluation of collaborative filtering over apache spark. In: 5th South-East Europe Design Automation, Computer Engineering, Computer Networks and Social Media Conference (SEEDA-CECNSM), pp. 1–8 (2020)
3.
go back to reference Alghadeir, A., Al-Sakran, H.: Smart airport architecture using Internet of Things. Int. J. Innov. Res. Comput. Sci. Technol. 4, 148–155 (2016) Alghadeir, A., Al-Sakran, H.: Smart airport architecture using Internet of Things. Int. J. Innov. Res. Comput. Sci. Technol. 4, 148–155 (2016)
4.
go back to reference Aljubairy, A., Zhang, W.E., Shemshadi, A., Mahmood, A., Sheng, Q.Z.: A system for effectively predicting flight delays based on IoT data. Computing 102(9), 2025–2048 (2020)MathSciNetCrossRef Aljubairy, A., Zhang, W.E., Shemshadi, A., Mahmood, A., Sheng, Q.Z.: A system for effectively predicting flight delays based on IoT data. Computing 102(9), 2025–2048 (2020)MathSciNetCrossRef
5.
go back to reference Allan, S.S., Beesley, J.A., Evans, J.E., Gaddy, S.G.: Analysis of delay causality at Newark international airport. In: 4th USA/Europe Air Traffic Management R&D Seminar, pp. 1–11 (2001) Allan, S.S., Beesley, J.A., Evans, J.E., Gaddy, S.G.: Analysis of delay causality at Newark international airport. In: 4th USA/Europe Air Traffic Management R&D Seminar, pp. 1–11 (2001)
7.
go back to reference Barnhart, C., Smith, B.: Quantitative Problem Solving Methods in the Airline Industry, vol. 169, (2012) Barnhart, C., Smith, B.: Quantitative Problem Solving Methods in the Airline Industry, vol. 169, (2012)
8.
go back to reference Belcastro, L., Marozzo, F., Talia, D., Trunfio, P.: Using scalable data mining for predicting flight delays. ACM Trans. Intell. Syst. Technol. 8(1), 5:1–5:20 (2016) Belcastro, L., Marozzo, F., Talia, D., Trunfio, P.: Using scalable data mining for predicting flight delays. ACM Trans. Intell. Syst. Technol. 8(1), 5:1–5:20 (2016)
9.
go back to reference Bezerra, G.C.L., Gomes, C.F.: Performance measurement in airport settings: a systematic literature review. benchmarking: An Int. J. 23(4), 1027–1050 (2016) Bezerra, G.C.L., Gomes, C.F.: Performance measurement in airport settings: a systematic literature review. benchmarking: An Int. J. 23(4), 1027–1050 (2016)
10.
go back to reference Bolaños, M.E., Murphy, D.: How much delay does New York inject into the national airspace system? a graph theory analysis. In: Aviation Technology, Integration and Operations Conference, p. 4221 (2013) Bolaños, M.E., Murphy, D.: How much delay does New York inject into the national airspace system? a graph theory analysis. In: Aviation Technology, Integration and Operations Conference, p. 4221 (2013)
11.
go back to reference Boswell, S.B., Evans, J.E.: Analysis of Downstream Impacts of Air Traffic Delay. Lincoln Laboratory, Massachusetts Institute of Technology (1997) Boswell, S.B., Evans, J.E.: Analysis of Downstream Impacts of Air Traffic Delay. Lincoln Laboratory, Massachusetts Institute of Technology (1997)
12.
go back to reference Chakrabarty, N.: A data mining approach to flight arrival delay prediction for American airlines. In: 9th Annual Information Technology, Electromechanical Engineering and Microelectronics Conference (IEMECON), pp. 102–107 (2019) Chakrabarty, N.: A data mining approach to flight arrival delay prediction for American airlines. In: 9th Annual Information Technology, Electromechanical Engineering and Microelectronics Conference (IEMECON), pp. 102–107 (2019)
13.
go back to reference Chen, H., Wang, J., Yan, X.: A fuzzy support vector machine with weighted margin for flight delay early warning. In: 15th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD), pp. 331–335 (2008) Chen, H., Wang, J., Yan, X.: A fuzzy support vector machine with weighted margin for flight delay early warning. In: 15th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD), pp. 331–335 (2008)
14.
go back to reference Chen, J., Li, M.: Chained predictions of flight delay using machine learning. In: AIAA Scitech 2019 forum, p. 1661 (2019) Chen, J., Li, M.: Chained predictions of flight delay using machine learning. In: AIAA Scitech 2019 forum, p. 1661 (2019)
15.
go back to reference García, S., Luengo, J., Herrera, F.: Data Preprocessing in Data Mining, Intelligent Systems Reference Library, vol. 72. Springer, Heidelberg (2015) García, S., Luengo, J., Herrera, F.: Data Preprocessing in Data Mining, Intelligent Systems Reference Library, vol. 72. Springer, Heidelberg (2015)
16.
go back to reference Hong, S.J., Choi, D., Chae, J.: Exploring different airport users’ service quality satisfaction between service providers and air travelers. J. Retail. Consum. Serv. 52 (2020) Hong, S.J., Choi, D., Chae, J.: Exploring different airport users’ service quality satisfaction between service providers and air travelers. J. Retail. Consum. Serv. 52 (2020)
17.
go back to reference Hsiao, C.Y., Hansen, M.: Econometric analysis of U.S. airline flight delays with time-of-day effects. transportation research record: J. Transp. Res. Board 1951(1), 104–112 (2006) Hsiao, C.Y., Hansen, M.: Econometric analysis of U.S. airline flight delays with time-of-day effects. transportation research record: J. Transp. Res. Board 1951(1), 104–112 (2006)
18.
go back to reference Jimenez, E., Claro, J., de Sousa, J.P.: The airport business in a competitive environment. Procedia - Soc. Behav. Sci. 111, 947–954 (2014)CrossRef Jimenez, E., Claro, J., de Sousa, J.P.: The airport business in a competitive environment. Procedia - Soc. Behav. Sci. 111, 947–954 (2014)CrossRef
19.
go back to reference Kanavos, A., Nodarakis, N., Sioutas, S., Tsakalidis, A., Tsolis, D., Tzimas, G.: Large scale implementations for twitter sentiment classification. Algorithms 10(1), 33 (2017)MathSciNetCrossRef Kanavos, A., Nodarakis, N., Sioutas, S., Tsakalidis, A., Tsolis, D., Tzimas, G.: Large scale implementations for twitter sentiment classification. Algorithms 10(1), 33 (2017)MathSciNetCrossRef
20.
go back to reference Kanavos, A., Perikos, I., Hatzilygeroudis, I., Tsakalidis, A.: Emotional community detection in social networks. Comput. Electr. Eng. 65, 449–460 (2018)CrossRef Kanavos, A., Perikos, I., Hatzilygeroudis, I., Tsakalidis, A.: Emotional community detection in social networks. Comput. Electr. Eng. 65, 449–460 (2018)CrossRef
21.
go back to reference Khaksar, H., Sheikholeslami, A.: Airline delay prediction by machine learning algorithms. Sci. Iranica 26(5), 2689–2702 (2019) Khaksar, H., Sheikholeslami, A.: Airline delay prediction by machine learning algorithms. Sci. Iranica 26(5), 2689–2702 (2019)
22.
go back to reference Knoch, S., Staudt, P., Puzzolante, B., Maggi, A.: A smart digital platform for airport services improving passenger satisfaction. In: 22nd IEEE Conference on Business Informatics (CBI), pp. 250–259 (2020) Knoch, S., Staudt, P., Puzzolante, B., Maggi, A.: A smart digital platform for airport services improving passenger satisfaction. In: 22nd IEEE Conference on Business Informatics (CBI), pp. 250–259 (2020)
23.
go back to reference Kotsiantis, S.B., Kanellopoulos, D.N., Pintelas, P.E.: Data preprocessing for supervised leaning. Int. J. Comput. Sci. 1(2), 111–117 (2006) Kotsiantis, S.B., Kanellopoulos, D.N., Pintelas, P.E.: Data preprocessing for supervised leaning. Int. J. Comput. Sci. 1(2), 111–117 (2006)
24.
go back to reference Lu, Z.: Alarming large scale of flight delays: an application of machine learning. Mach. Learn. 239–250 (2010) Lu, Z.: Alarming large scale of flight delays: an application of machine learning. Mach. Learn. 239–250 (2010)
25.
go back to reference Lu, Z., Wang, J., Zheng, G.: A new method to alarm large scale of flights delay based on machine learning. In: International Symposium on Knowledge Acquisition and Modeling (KAM), pp. 589–592 (2008) Lu, Z., Wang, J., Zheng, G.: A new method to alarm large scale of flights delay based on machine learning. In: International Symposium on Knowledge Acquisition and Modeling (KAM), pp. 589–592 (2008)
26.
go back to reference Meng, X., et al.: Mllib: machine learning in apache spark. J. Mach. Learn. Res. 17, 34:1–34:7 (2016) Meng, X., et al.: Mllib: machine learning in apache spark. J. Mach. Learn. Res. 17, 34:1–34:7 (2016)
27.
go back to reference Ntaliakouras, N., Vonitsanos, G., Kanavos, A., Dritsas, E.: An apache spark methodology for forecasting tourism demand in Greece. In: 10th International Conference on Information, Intelligence, Systems and Applications (IISA), pp. 1–5 (2019) Ntaliakouras, N., Vonitsanos, G., Kanavos, A., Dritsas, E.: An apache spark methodology for forecasting tourism demand in Greece. In: 10th International Conference on Information, Intelligence, Systems and Applications (IISA), pp. 1–5 (2019)
28.
go back to reference Oza, S., Sharma, S., Sangoi, H., Raut, R., Kotak, V.C.: Flight delay prediction system using weighted multiple linear regression. Int. J. Eng. Comput. Sci. 4(4), 11668–11677 (2015) Oza, S., Sharma, S., Sangoi, H., Raut, R., Kotak, V.C.: Flight delay prediction system using weighted multiple linear regression. Int. J. Eng. Comput. Sci. 4(4), 11668–11677 (2015)
29.
go back to reference Prabakaran, N., Kannadasan, R.: Airline delay predictions using supervised machine learning. Int. J. Pure Appl. Math. 119(7), 329–337 (2018) Prabakaran, N., Kannadasan, R.: Airline delay predictions using supervised machine learning. Int. J. Pure Appl. Math. 119(7), 329–337 (2018)
30.
go back to reference Pyrgiotis, N., Malone, K.M., Odoni, A.: Modelling delay propagation within an airport network. Transp. Res. Part C: Emerg. Technol. 27, 60–75 (2013)CrossRef Pyrgiotis, N., Malone, K.M., Odoni, A.: Modelling delay propagation within an airport network. Transp. Res. Part C: Emerg. Technol. 27, 60–75 (2013)CrossRef
31.
go back to reference Rajapaksha, A., Jayasuriya, N.: Smart airport: a review on future of the airport operation. Glob. J. Manage. Bus. Res. 20(3) (2020) Rajapaksha, A., Jayasuriya, N.: Smart airport: a review on future of the airport operation. Glob. J. Manage. Bus. Res. 20(3) (2020)
32.
go back to reference Rebollo, J.J., Balakrishnan, H.: Characterization and prediction of air traffic delays. Transp. Res. Part C: Emerg. Technol. 44, 231–241 (2014)CrossRef Rebollo, J.J., Balakrishnan, H.: Characterization and prediction of air traffic delays. Transp. Res. Part C: Emerg. Technol. 44, 231–241 (2014)CrossRef
33.
go back to reference Rupp, N.G.: Investigating the causes of flight delays. Tech. rep (2007) Rupp, N.G.: Investigating the causes of flight delays. Tech. rep (2007)
35.
go back to reference Vonitsanos, G., Kanavos, A., Mylonas, P., Sioutas, S.: A nosql database approach for modeling heterogeneous and semi-structured information. In: 9th International Conference on Information, Intelligence, Systems and Applications (IISA), pp. 1–8 (2018) Vonitsanos, G., Kanavos, A., Mylonas, P., Sioutas, S.: A nosql database approach for modeling heterogeneous and semi-structured information. In: 9th International Conference on Information, Intelligence, Systems and Applications (IISA), pp. 1–8 (2018)
Metadata
Title
Forecasting Air Flight Delays and Enabling Smart Airport Services in Apache Spark
Authors
Gerasimos Vonitsanos
Theodor Panagiotakopoulos
Andreas Kanavos
Athanasios Tsakalidis
Copyright Year
2021
DOI
https://doi.org/10.1007/978-3-030-79157-5_33

Premium Partner