Skip to main content
Erschienen in: Queueing Systems 3-4/2020

08.01.2020

Stationary distributions and convergence for M/M/1 queues in interactive random environment

verfasst von: Guodong Pang, Andrey Sarantsev, Yana Belopolskaya, Yuri Suhov

Erschienen in: Queueing Systems | Ausgabe 3-4/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

A Markovian single-server queue is studied in an interactive random environment. The arrival and service rates of the queue depend on the environment, while the transition dynamics of the random environment depend on the queue length. We consider in detail two types of Markov random environments: a pure jump process and a reflected jump diffusion. In both cases, the joint dynamics are constructed so that the stationary distribution can be explicitly found in a simple form (weighted geometric). We also derive an explicit estimate for the exponential rate of convergence to the stationary distribution via coupling.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Arapostathis, A., Pang, G., Sandrić, N.: Ergodicity of Lévy-driven SDEs arising from multiclass many-server queues. Ann. Appl. Probab. 29(2), 1070–1126 (2019) Arapostathis, A., Pang, G., Sandrić, N.: Ergodicity of Lévy-driven SDEs arising from multiclass many-server queues. Ann. Appl. Probab. 29(2), 1070–1126 (2019)
2.
Zurück zum Zitat Arapostathis, A., Hmedi, H., Pang, G., Sandrić, N.: Uniform polynomial rates of convergence for a class of Lévy-driven controlled SDEs arising in multiclass many-server queues. In: Yin, G., Zhang, Q. (eds.) Modeling, Stochastic Control, Optimization, and Applications. The IMA Volumes in Mathematics and its Applications, vol. 164, pp. 1–20. Springer, New York (2019) Arapostathis, A., Hmedi, H., Pang, G., Sandrić, N.: Uniform polynomial rates of convergence for a class of Lévy-driven controlled SDEs arising in multiclass many-server queues. In: Yin, G., Zhang, Q. (eds.) Modeling, Stochastic Control, Optimization, and Applications. The IMA Volumes in Mathematics and its Applications, vol. 164, pp. 1–20. Springer, New York (2019)
3.
Zurück zum Zitat Ata, B., Peng, X.: An optimal callback policy for general arrival processes: a pathwise analysis. Working paper (2018) Ata, B., Peng, X.: An optimal callback policy for general arrival processes: a pathwise analysis. Working paper (2018)
4.
Zurück zum Zitat Bassamboo, A., Harrison, J.M., Zeevi, A.: Dynamic routing and admission control in high-volume service systems: asymptotic analysis via multi-scale fluid limits. Queueing Syst. 51(3–4), 249–285 (2005) Bassamboo, A., Harrison, J.M., Zeevi, A.: Dynamic routing and admission control in high-volume service systems: asymptotic analysis via multi-scale fluid limits. Queueing Syst. 51(3–4), 249–285 (2005)
5.
Zurück zum Zitat Bassamboo, A., Harrison, J.M., Zeevi, A.: Design and control of a large call center: asymptotic analysis of an LP-based method. Oper. Res. 54(3), 419–435 (2006) Bassamboo, A., Harrison, J.M., Zeevi, A.: Design and control of a large call center: asymptotic analysis of an LP-based method. Oper. Res. 54(3), 419–435 (2006)
8.
Zurück zum Zitat Borodin, A., Salminen, P.: Handbook of Brownian Motion. Facts and Formulae, 2nd edn. Birkhauser, Basel (2002) Borodin, A., Salminen, P.: Handbook of Brownian Motion. Facts and Formulae, 2nd edn. Birkhauser, Basel (2002)
9.
Zurück zum Zitat Burdzy, K., Kendall, W.S.: Efficient Markovian couplings: examples and counterexamples. Ann. Appl. Probab. 10(2), 362–409 (2000) Burdzy, K., Kendall, W.S.: Efficient Markovian couplings: examples and counterexamples. Ann. Appl. Probab. 10(2), 362–409 (2000)
10.
Zurück zum Zitat Chen, H., Yao, D.D.: Fundamentals of Queueing Networks. Stochastic Modeling and Applied Probability, vol. 46. Springer, Berlin (2001) Chen, H., Yao, D.D.: Fundamentals of Queueing Networks. Stochastic Modeling and Applied Probability, vol. 46. Springer, Berlin (2001)
11.
Zurück zum Zitat Chen, M.-F., Li, S.-F.: Coupling methods for multidimensional diffusion processes. Ann. Probab. 17(1), 151–177 (1989) Chen, M.-F., Li, S.-F.: Coupling methods for multidimensional diffusion processes. Ann. Probab. 17(1), 151–177 (1989)
12.
Zurück zum Zitat Cogburn, R.: Markov chains in random environments: the case of Markovian environments. Ann. Appl. Probab. 8(5), 908–916 (1980) Cogburn, R.: Markov chains in random environments: the case of Markovian environments. Ann. Appl. Probab. 8(5), 908–916 (1980)
13.
Zurück zum Zitat Cogburn, R., Torrez, W.C.: Birth and death processes with random environments in continuous time. J. Appl. Probab. 18(1), 19–30 (1981) Cogburn, R., Torrez, W.C.: Birth and death processes with random environments in continuous time. J. Appl. Probab. 18(1), 19–30 (1981)
14.
Zurück zum Zitat Cornez, R.: Birth and death processes in random environments with feedback. J. Appl. Probab. 24(1), 25–34 (1987) Cornez, R.: Birth and death processes in random environments with feedback. J. Appl. Probab. 24(1), 25–34 (1987)
15.
Zurück zum Zitat Douc, R., Fort, G., Guillin, A.: Subgeometric rates of convergence of \(f\)-ergodic strong Markov processes. Stoch. Proc. Appl. 119(3), 897–923 (2009) Douc, R., Fort, G., Guillin, A.: Subgeometric rates of convergence of \(f\)-ergodic strong Markov processes. Stoch. Proc. Appl. 119(3), 897–923 (2009)
16.
Zurück zum Zitat Economou, A.: Generalized product-form stationary distributions for Markov chains in random environments with queueing applications. Adv. Appl. Probab. 37(1), 185–211 (2005) Economou, A.: Generalized product-form stationary distributions for Markov chains in random environments with queueing applications. Adv. Appl. Probab. 37(1), 185–211 (2005)
17.
Zurück zum Zitat Falin, G.: A heterogeneous blocking system in a random environment. J. Appl. Probab. 33(1), 211–216 (1996) Falin, G.: A heterogeneous blocking system in a random environment. J. Appl. Probab. 33(1), 211–216 (1996)
18.
Zurück zum Zitat Gannon, M., Pechersky, E., Suhov, Y., Yambartsev, A.: A random walk in a queueing network environment. J. Appl. Probab. 53(2), 448–462 (2016) Gannon, M., Pechersky, E., Suhov, Y., Yambartsev, A.: A random walk in a queueing network environment. J. Appl. Probab. 53(2), 448–462 (2016)
19.
Zurück zum Zitat Hunter, J.J.: Coupling and mixing times in a Markov chain. Lin. Algebra Appl. 430(10), 2607–2621 (2009) Hunter, J.J.: Coupling and mixing times in a Markov chain. Lin. Algebra Appl. 430(10), 2607–2621 (2009)
20.
Zurück zum Zitat Ichiba, T., Sarantsev, A.: Stationary distributions and convergence for Walsh diffusions. Bernoulli 25(4A), 2439–2478 (2019) Ichiba, T., Sarantsev, A.: Stationary distributions and convergence for Walsh diffusions. Bernoulli 25(4A), 2439–2478 (2019)
21.
Zurück zum Zitat Karatzas, I., Shreve, S.E.: Brownian Motion and Stochastic Calculus. Graduate Texts in Mathematics, vol. 113. Springer, Berlin (1991) Karatzas, I., Shreve, S.E.: Brownian Motion and Stochastic Calculus. Graduate Texts in Mathematics, vol. 113. Springer, Berlin (1991)
22.
Zurück zum Zitat Kelly, F.: Reversibility and Stochastic Networks. Wiley, Chichester (1979) Kelly, F.: Reversibility and Stochastic Networks. Wiley, Chichester (1979)
23.
Zurück zum Zitat Kelly, F., Yudovina, E.: Stochastic Networks. Cambridge University Press, Cambridge (2014) Kelly, F., Yudovina, E.: Stochastic Networks. Cambridge University Press, Cambridge (2014)
24.
Zurück zum Zitat Krenzler, R., Daduna, H., Otton, S.: Jackson networks in nonautonomous random environments. Adv. Appl. Probab. 48(2), 315–331 (2016) Krenzler, R., Daduna, H., Otton, S.: Jackson networks in nonautonomous random environments. Adv. Appl. Probab. 48(2), 315–331 (2016)
25.
Zurück zum Zitat Krishnamoorthy, A., Pramod, P.K., Chakravarthy, S.R.: Queues with interruptions: a survey. TOP 22(1), 290–320 (2014) Krishnamoorthy, A., Pramod, P.K., Chakravarthy, S.R.: Queues with interruptions: a survey. TOP 22(1), 290–320 (2014)
26.
Zurück zum Zitat Kumar, R., Lewis, M.E., Topaloglu, H.: Dynamic service rate control for a single-server queue with Markov-modulated arrivals. Naval Res. Logist. 60(8), 661–677 (2013) Kumar, R., Lewis, M.E., Topaloglu, H.: Dynamic service rate control for a single-server queue with Markov-modulated arrivals. Naval Res. Logist. 60(8), 661–677 (2013)
27.
Zurück zum Zitat Kurtz, T.G., Stockbridge, R.H.: Stationary solutions and forward equations for controlled and singular martingale problems. Electron. J. Probab. 6(17), 1–52 (2001) Kurtz, T.G., Stockbridge, R.H.: Stationary solutions and forward equations for controlled and singular martingale problems. Electron. J. Probab. 6(17), 1–52 (2001)
28.
Zurück zum Zitat Lions, P.-L., Sznitman, A.-S.: Stochastic differential equations with reflecting boundary conditions. Commun. Pure Appl. Math. 37(4), 511–537 (1984) Lions, P.-L., Sznitman, A.-S.: Stochastic differential equations with reflecting boundary conditions. Commun. Pure Appl. Math. 37(4), 511–537 (1984)
29.
Zurück zum Zitat Liu, Y., Zhang, H., Zhao, Y.: Subgeometric ergodicity for continuous-time Markov chains. J. Math. Anal. Appl. 368(1), 178–189 (2010) Liu, Y., Zhang, H., Zhao, Y.: Subgeometric ergodicity for continuous-time Markov chains. J. Math. Anal. Appl. 368(1), 178–189 (2010)
30.
Zurück zum Zitat Levin, D.A., Perez, Y., Wilmer, E.L.: Markov Chains and Mixing Times, 2nd edn. American Mathematical Society, Providence (2017) Levin, D.A., Perez, Y., Wilmer, E.L.: Markov Chains and Mixing Times, 2nd edn. American Mathematical Society, Providence (2017)
31.
Zurück zum Zitat Lund, R., Meyn, S.P., Tweedie, R.L.: Computable exponential convergence rates for stochastically ordered Markov processes. Ann. Appl. Probab. 6(1), 218–237 (1996) Lund, R., Meyn, S.P., Tweedie, R.L.: Computable exponential convergence rates for stochastically ordered Markov processes. Ann. Appl. Probab. 6(1), 218–237 (1996)
32.
Zurück zum Zitat Meyn, S.P., Tweedie, R.L.: Stability of Markovian processes II. Continuous-time processes and sampled chains. Adv. Appl. Probab. 25(3), 487–517 (1993) Meyn, S.P., Tweedie, R.L.: Stability of Markovian processes II. Continuous-time processes and sampled chains. Adv. Appl. Probab. 25(3), 487–517 (1993)
33.
Zurück zum Zitat Neuts, R.F.: Matrix-Geometric Solutions in Stochastic Models: An Algorithmic Approach. Dover, Mineola (1995) Neuts, R.F.: Matrix-Geometric Solutions in Stochastic Models: An Algorithmic Approach. Dover, Mineola (1995)
34.
Zurück zum Zitat Norris, J.R.: Markov chains. Cambridge Series in Statistical and Probabilistic Mathematics. Cambridge University Press, Cambridge (1997) Norris, J.R.: Markov chains. Cambridge Series in Statistical and Probabilistic Mathematics. Cambridge University Press, Cambridge (1997)
35.
Zurück zum Zitat Regterschot, G.J.K., de Smit, J.H.A.: The queue \(M/G/1\) with Markov modulated arrivals and services. Math. Oper. Res. 11(3), 465–483 (1986) Regterschot, G.J.K., de Smit, J.H.A.: The queue \(M/G/1\) with Markov modulated arrivals and services. Math. Oper. Res. 11(3), 465–483 (1986)
36.
Zurück zum Zitat Robert, P.: Stochastic Networks and Queues. Stochastic Modeling and Applied Probability, vol. 52. Springer, Berlin (2003) Robert, P.: Stochastic Networks and Queues. Stochastic Modeling and Applied Probability, vol. 52. Springer, Berlin (2003)
37.
Zurück zum Zitat Sarantsev, A.: Explicit rates of exponential convergence for reflected jump-diffusions on the positive half-line. ALEA Lat. Am. J. Probab. Math. Stat. 13(2), 1069–1093 (2016) Sarantsev, A.: Explicit rates of exponential convergence for reflected jump-diffusions on the positive half-line. ALEA Lat. Am. J. Probab. Math. Stat. 13(2), 1069–1093 (2016)
38.
Zurück zum Zitat Sarantsev, A.: Reflected Brownian motion in a convex polyhedral cone: tail estimates for the stationary distribution. J. Theor. Probab. 32(3), 545–585 (2019) Sarantsev, A.: Reflected Brownian motion in a convex polyhedral cone: tail estimates for the stationary distribution. J. Theor. Probab. 32(3), 545–585 (2019)
39.
Zurück zum Zitat Sawyer, S.A.: A formula for semigroups, with an application to branching diffusion processes. Trans. Am. Math. Soc. 152(1), 1–38 (1970) Sawyer, S.A.: A formula for semigroups, with an application to branching diffusion processes. Trans. Am. Math. Soc. 152(1), 1–38 (1970)
40.
Zurück zum Zitat Suhov, Y., Kelbert, M.: Probability and statistics by example. Markov chains: a primer in random processes and their applications. Cambridge University Press, Cambridge (2008) Suhov, Y., Kelbert, M.: Probability and statistics by example. Markov chains: a primer in random processes and their applications. Cambridge University Press, Cambridge (2008)
41.
Zurück zum Zitat Takine, T.: Single-server queues with Markov-modulated arrival and service speed. Queueing Syst. 49(1), 7–22 (2005) Takine, T.: Single-server queues with Markov-modulated arrival and service speed. Queueing Syst. 49(1), 7–22 (2005)
42.
Zurück zum Zitat Williams, R.J.: Reflected Brownian motion with skew symmetric data in a polyhedral domain. Probab. Theor. Relat. Fields 75, 459–485 (1987) Williams, R.J.: Reflected Brownian motion with skew symmetric data in a polyhedral domain. Probab. Theor. Relat. Fields 75, 459–485 (1987)
43.
Zurück zum Zitat Williams, R.J.: Semimartingale reflecting Brownian motions in the orthant: a survey. IMA Vol. Math. Appl. 71, 125–137 (1995) Williams, R.J.: Semimartingale reflecting Brownian motions in the orthant: a survey. IMA Vol. Math. Appl. 71, 125–137 (1995)
44.
Zurück zum Zitat Yechiali, U.: A queueing-type birth-and-death process defined in a continuous-time Markov chain. Oper. Res. 21(2), 604–609 (1973) Yechiali, U.: A queueing-type birth-and-death process defined in a continuous-time Markov chain. Oper. Res. 21(2), 604–609 (1973)
Metadaten
Titel
Stationary distributions and convergence for M/M/1 queues in interactive random environment
verfasst von
Guodong Pang
Andrey Sarantsev
Yana Belopolskaya
Yuri Suhov
Publikationsdatum
08.01.2020
Verlag
Springer US
Erschienen in
Queueing Systems / Ausgabe 3-4/2020
Print ISSN: 0257-0130
Elektronische ISSN: 1572-9443
DOI
https://doi.org/10.1007/s11134-019-09644-9

Weitere Artikel der Ausgabe 3-4/2020

Queueing Systems 3-4/2020 Zur Ausgabe

Premium Partner