Top

Published in:

2022 | OriginalPaper | Chapter

Review of Markov Chain and Its Applications in Telecommunication Systems

Authors : Amel Salem Omer, Dereje Hailemariam Woldegebreal

Published in: e-Infrastructure and e-Services for Developing Countries

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Markov chain is a powerful mathematical tool that is used to predict future state of a random process based on its present state, for classical or first-order Markov chain, and past states for higher-order Markov chain. Markov chain has a wide range of applications in various fields of science and technology. To mention some in the area of telecommunication systems: Internet page ranking; Internet traffic modeling; language source modeling in natural language processing for text compression and text generation applications; speech recognition; wireless channel modeling; spectrum occupancy prediction for cognitive radio; user mobility modeling, handover management, and operation status monitoring in cellular mobile networks; network service and maintenance optimization; and in Markov chain Monte Carlo simulation methods. The main objective of this paper is to review fundamental concepts in Markov chain for discrete sources with emphasis on its application in telecommunication systems. It introduces terminologies, method to compute transition probabilities from real data, computing different states of the chain, and possible applications areas. The focus is given for both classical and higher-order Markov chain as well as Hidden Markov models. While acknowledging a related lecture note published in 2010, which we came to know lately, this review includes additional topics, such as higher-order Markov chain and Hidden Markov models, and tries to present core ideas in less mathematically rigorous but more practicable way. We hope that interested researchers who wish to apply Markov chain for various applications will benefit from this review.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

previous chapter CMFR-CMQ: Congestion Management and Control Message Quenching Based on Flow Setup Requests in SDN-WISE

next chapter Determining SDN Stability by the Analysis of Variance Technique

Tolver A.: An Introduction to Markov Chain, Lecture Notes for Stochastic Process. Department of Mathematical Sciences, University of Copenhagen (2016)

Seneta, E.: Markov and the creation of Markov Chains. School of Mathematics and Statistics, University of Sydney (2006)

Baum, L., Petrie, T.: Statistical inference for probabilistic functions of finite state Markov chains. Ann. Math. Stat. 37(6), 1554–1563 (1966)MathSciNetCrossRef

A brief Introduction to Markov Chains with Examples (2021). https://www.edureka.co/blog/introduction-to-markov-chains/#What%20Is%20A%20Markov%20Chain. Accessed 13 Mar 13

Markov Chain (2021). https://en.wikipedia.org/wiki/Markov_chain. Accessed 13 Mar 2021

Powell, V.: Markov Chains Explained Visually (2021). https://setosa.io/ev/markov-chains/. Accessed 9 May 2021

Privault, N.: Understanding Markov Chains. Springer, Singapore (2013). https://doi.org/10.1007/978-981-13-0659-4CrossRefMATH

Bickenbach, F., Bode, E.: Markov or Not Markov – This Should Be a Question. Kiel Working Paper No. 1086, December 2001. https://www.files.ethz.ch/isn/124233/kap1086.pdf. Accessed 26 Aug 2021

Stamp, M.: A Revealing Introduction to Hidden Markov Models. Department of Computer Science, San Jose State University (2021)

10.

Hassan, R., Nath, B.: Stock market forecasting using hidden Markov model: a new approach (2005)

11.

Mo, J.: Performance modeling of communication networks with Markov chains. Synth. Lect. Commun. Netw. 3, 1–90 (2010)CrossRef

12.

Fazio, P., Marano, S: Mobility prediction and resource reservation in cellular networks with distributed Markov chains. In: 8th International Wireless Communications and Mobile Computing Conference (IWCMC), Limassol, Cyprus (2012)

13.

Amirrudin, N., Ariffin, S., Malik, N., Ghazali, E.: Mobility prediction via Markov model in LTE Femtocell. Int. J. Comput. Appl. (0975–8887), 65(18), (2013)

14.

Zaidi, S., Manalastas, M., Farooq, H., Imran, A.: Mobility management in emerging ultra-dense cellular networks: a survey, outlook, and future research directions. IEEE Access 8, 183505–183533 (2020)CrossRef

15.

Bellahsene, S., Kloul, L.: A new Markov-based mobility prediction algorithm for mobile networks. In: Aldini, A., Bernardo, M., Bononi, L., Cortellessa, V. (eds.) Computer Performance Engineering, vol. 6342, pp. 37–50. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-15784-4_3CrossRef

16.

Hadachi, A., Batrashev, O., Lind, A., Singer, G., Vainikko, E.: Cell phone subscribers mobility prediction using enhanced Markov chain algorithm. In: IEEE Intelligent Vehicles Symposium (IV), 8–11 June 2014, Dearborn, Michigan, USA (2014)

17.

Lahby, M., Essouiri, A., Sekkaki, A.: A novel modeling approach for vertical handover based on dynamic k-partite graph in heterogeneous networks. Digit. Commun. Netw. 5(4), 297–307 (2019)CrossRef

18.

Wu, J., Li, Y.: A survey of spectrum prediction methods in cognitive radio networks. In: AIP Conference Proceedings, vol. 1834, p. 020018 (2017)

19.

Song, C., Chen, D., Zhang, Q.: Understand the predictability of wireless spectrum: a large-scale empirical study. In: 2010 IEEE International Conference on Communications (2010). https://doi.org/10.1109/ICC.2010.5502054

20.

Oluwaranti, A., Okegbile, S.: Two state Markov chain based predictive model for cognitive radio spectrum availability: a conceptual approach. In: 2016 Future Technologies Conference (FTC), pp. 179–186 (2016)

21.

Eltom, H., Kandeepan, S., Moran B., Evans, R.: Spectrum occupancy prediction using a hidden Markov model. In: 9th International Conference on Signal Processing and Communication Systems (ICSPCS) (2015)

22.

Hong, Z., Zhao1, Y. Luo, Y., Wang G., Pu, L: Advanced high-order hidden bivariate Markov model based spectrum prediction. EAI Endorsed Trans. Wirel. Spectr. 3(10) (2017)

23.

Liu, X., Liu, C. Liu, W., Zeng, X.: Wireless channel modeling and performance analysis based on Markov chain. In: 29th Chinese Control and Decision Conference (CCDC), pp. 2256–2260 (2017)

24.

Castanet, L.: Channel modelling based on N-state Markov chains for SatCom systems simulation. In: 12th International Conference on Antennas and Propagation (ICAP 2003) (2003). https://doi.org/10.1049/cp:20030030

25.

Sánchez-Salas, D., Cuevas-Ruíz, J., González-Mendoza, M.: Wireless channel model with Markov Chains using MATLAB (2012). https://doi.org/10.5772/46475

26.

Sanchez-Salas, D., Cuevas-Ruiz, J.: N-states channel model using Markov chains. In: Electronics, Robotics and Automotive Mechanics Conference (CERMA 2007), pp. 342–347 (2007). https://doi.org/10.1109/CERMA.2007.4367710

27.

Zhang, S., Wang, H., Zhang, X.: Estimation of Channel State Transition Probabilities Based on Markov Chains in Cognitive Radio

28.

Terefe, T., Hailemariam, D.: Entropy estimation and entropy-based encoding of written Amharic language for efficient transmission in telecom networks. In: Proceeding of IEEE AFRICON, Cape Town, South Africa, pp. 238–244 (2017)

29.

Jurafsky, D., Martin, J.: Hidden Markov Models. Speech and Language Processing, 30 December 2020

30.

Rabiner, R. Hidden Markov Models and Selected Applications in Speech Recognition (1989)

31.

How Google autocomplete works in Search. https://www.blog.google/products/search/how-google-autocomplete-works-search/. Accessed 29 Aug 2021

32.

Text Generation With Markov Chains. https://algotech.netlify.app/blog/text-generating-with-markov-chains/. Accessed 29 Aug 2021

33.

Hands-On Guide To Markov Chain For Text Generation. https://analyticsindiamag.com/hands-on-guide-to-markov-chain-for-text-generation/. Accessed 29 Aug 2021

34.

Hendrawan: RRC success rate accessibility prediction on SAE/LTE network using Markov chain model. In: 2017 11th International Conference on Telecommunication Systems Services and Applications (TSSA), pp. 1–5 (2017)

35.

Hendrawan: Accessibility degradation prediction on LTE/SAE Network using discrete time Markov chain (DTMC) model. ITB J. 13(1), 18 (2019)

36.

Kim, J., Hwang, J. Kim, K.: High-performance internet traffic classification using a Markov Model and Kullback-Leibler divergence. Mobile Inf. Syst. 2016 (2016)

37.

Frankel, E.: Testing for Markov properties. In: Systems Reliability and Risk Analysis. Engineering Applications of Systems Reliability and Risk Analysis, vol. 1. Springer, Dordrecht (1984). https://doi.org/10.1007/978-94-009-6920-9_8

38.

Markov, A.A.: Extension of the law of large numbers to dependent quantities. IzvestiiaFiz.-Matem. Obsch. Kazan Univ. (2nd Ser.) 15, 135–156 (1906). (in Russian)

Title: Review of Markov Chain and Its Applications in Telecommunication Systems
Authors: Amel Salem Omer
Dereje Hailemariam Woldegebreal
Publisher: Springer International Publishing
Book: e-Infrastructure and e-Services for Developing Countries
Print ISBN: 978-3-031-06373-2

Electronic ISBN: 978-3-031-06374-9

Copyright Year: 2022
DOI: https://doi.org/10.1007/978-3-031-06374-9_24

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner