Skip to main content

2017 | OriginalPaper | Buchkapitel

17. Near-Optimal Switching Strategies for a Tandem Queue

verfasst von : Daphne van Leeuwen, Rudesindo Núñez-Queija

Erschienen in: Markov Decision Processes in Practice

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Motivated by various applications in logistics, road traffic and production management, we investigate two versions of a tandem queueing model in which the service rate of the first queue can be controlled. The objective is to keep the mean number of jobs in the second queue as low as possible, without compromising the total system delay (i.e. avoiding starvation of the second queue). The balance between these objectives is governed by a linear cost function of the queue lengths. In the first model, the server in the first queue can be either switched on or off, depending on the queue lengths of both queues. This model has been studied extensively in the literature. Obtaining the optimal control is known to be computationally intensive and time consuming. We are particularly interested in the scenario that the first queue can operate at larger service speed than the second queue. This scenario has received less attention in literature. We propose an approximation using an efficient mathematical analysis of a near-optimal threshold policy based on a matrix-geometric solution of the stationary probabilities that enables us to compute the relevant stationary measures more efficiently and determine an optimal choice for the threshold value.
In some of our target applications, it is more realistic to see the first queue as a (controllable) batch-server system. We follow a similar approach as for the first model and obtain the structure of the optimal policy as well as an efficiently computable near-optimal threshold policy.
We illustrate the appropriateness of our approximations using simulations of both models.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat F. Avram, Optimal Control of Fluid Limits of Queueing Networks and Stochasticity Corrections. Lectures in Applied Mathematics, vol. 33 (Springer, New York, 1997), pp. 1–36 F. Avram, Optimal Control of Fluid Limits of Queueing Networks and Stochasticity Corrections. Lectures in Applied Mathematics, vol. 33 (Springer, New York, 1997), pp. 1–36
2.
Zurück zum Zitat R.E. Bellman, Dynamic Programming. (Princeton University Press, Princeton, NJ, 2003) Republished 2003: Dover R.E. Bellman, Dynamic Programming. (Princeton University Press, Princeton, NJ, 2003) Republished 2003: Dover
3.
Zurück zum Zitat G.L. Curry, R.M. Feldman, An M/M/1 queue with a general bulk service rule. Nav. Res. Logist. Q. 32 (4), 595–603 (1985)CrossRef G.L. Curry, R.M. Feldman, An M/M/1 queue with a general bulk service rule. Nav. Res. Logist. Q. 32 (4), 595–603 (1985)CrossRef
4.
Zurück zum Zitat A. El-Rayes, M. Kwiatkowska, G. Norman, Solving infinite stochastic process algebra models through matrix-geometric methods. School of Computer Science Research Reports, University of Birmingham (1999) A. El-Rayes, M. Kwiatkowska, G. Norman, Solving infinite stochastic process algebra models through matrix-geometric methods. School of Computer Science Research Reports, University of Birmingham (1999)
5.
Zurück zum Zitat A. Gajrat, A. Hordijk, A. Ridder, Large-deviations analysis of the fluid approximation for a controllable tandem queue. Ann. Appl. Probab. 13, 1423–1448 (2003)CrossRef A. Gajrat, A. Hordijk, A. Ridder, Large-deviations analysis of the fluid approximation for a controllable tandem queue. Ann. Appl. Probab. 13, 1423–1448 (2003)CrossRef
6.
Zurück zum Zitat G. Koole, Convexity in tandem queues. Probab. Eng. Inf. Sci. 18 (1), 13–31 (2004)CrossRef G. Koole, Convexity in tandem queues. Probab. Eng. Inf. Sci. 18 (1), 13–31 (2004)CrossRef
7.
Zurück zum Zitat G. Latouche, M. Neuts, Efficient algorithmic solutions to exponential tandem queues with blocking. SIAM J. Algebr. Discr. Meth. 1, 93–106 (1980)CrossRef G. Latouche, M. Neuts, Efficient algorithmic solutions to exponential tandem queues with blocking. SIAM J. Algebr. Discr. Meth. 1, 93–106 (1980)CrossRef
8.
Zurück zum Zitat G. Latouche, V. Ramaswami, A logarithmic reduction algorithm for quasi-birth-and-death processes. J. Appl. Probab. 30, 650–674 (1993)CrossRef G. Latouche, V. Ramaswami, A logarithmic reduction algorithm for quasi-birth-and-death processes. J. Appl. Probab. 30, 650–674 (1993)CrossRef
9.
Zurück zum Zitat S.A. Lippman, Applying a new device in the optimisation of exponential queueing systems. Oper. Res. 23 (4), 687–710 (1975)CrossRef S.A. Lippman, Applying a new device in the optimisation of exponential queueing systems. Oper. Res. 23 (4), 687–710 (1975)CrossRef
10.
Zurück zum Zitat S.P. Meyn, Control Techniques for Complex Networks (Cambridge University Press, Cambridge, 2008). ISBN 978-0-521-88441-9 hardback S.P. Meyn, Control Techniques for Complex Networks (Cambridge University Press, Cambridge, 2008). ISBN 978-0-521-88441-9 hardback
11.
Zurück zum Zitat M. Neuts, A general class of bulk queues with Poisson input. Ann. Math. Stat. 38 (3), 759–770 (1967)CrossRef M. Neuts, A general class of bulk queues with Poisson input. Ann. Math. Stat. 38 (3), 759–770 (1967)CrossRef
12.
Zurück zum Zitat M. Neuts, Matrix-Geometric Solutions in Stochastic Models: An Algorithmic Approach. (Courier Dover Publications, Mineola, 1981) M. Neuts, Matrix-Geometric Solutions in Stochastic Models: An Algorithmic Approach. (Courier Dover Publications, Mineola, 1981)
13.
Zurück zum Zitat M.L. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming (Wiley, New York, 1994)CrossRef M.L. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming (Wiley, New York, 1994)CrossRef
14.
Zurück zum Zitat Z. Rosberg, P.P. Varaiya, J. Walrand, Optimal control of service in tandem queues. IEEE Trans. Autom. Control 27 (3), 600-610 (1982)CrossRef Z. Rosberg, P.P. Varaiya, J. Walrand, Optimal control of service in tandem queues. IEEE Trans. Autom. Control 27 (3), 600-610 (1982)CrossRef
15.
Zurück zum Zitat R.R. Weber, S. Stidham, Optimal control of service rates in networks of queues. Adv. Appl. Probab. 19, 202–218 (1987)CrossRef R.R. Weber, S. Stidham, Optimal control of service rates in networks of queues. Adv. Appl. Probab. 19, 202–218 (1987)CrossRef
16.
Zurück zum Zitat J. Weiss, The computation of optimal control limits for a queue with batch services. Manag. Sci. 25 (4), 320–328 (1979)CrossRef J. Weiss, The computation of optimal control limits for a queue with batch services. Manag. Sci. 25 (4), 320–328 (1979)CrossRef
Metadaten
Titel
Near-Optimal Switching Strategies for a Tandem Queue
verfasst von
Daphne van Leeuwen
Rudesindo Núñez-Queija
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-47766-4_17