We consider a cyclic polling system with general service times, general switch-over times, and simultaneous batch arrivals. This means that at an arrival epoch, a batch of customers may arrive simultaneously at the different queues of the system. For the exhaustive service discipline, we study the batch sojourn-time, which is defined as the time from an arrival epoch until service completion of the last customer in the batch. We obtain exact expressions for the Laplace–Stieltjes transform of the steady-state batch sojourn-time distribution, which can be used to determine the moments of the batch sojourn-time and, in particular, its mean. However, we also provide an alternative, more efficient way to determine the mean batch sojourn-time, using mean value analysis. We briefly show how our framework can be applied to other service disciplines: locally gated and globally gated. Finally, we compare the batch sojourn-times for different service disciplines in several numerical examples. Our results show that the best performing service discipline, in terms of minimizing the batch sojourn-time, depends on system characteristics.
The online version of this article (doi:10.1007/s11134-016-9513-y) contains supplementary material, which is available to authorized users.
1 Introduction
Polling models are multi-queue systems in which a single server cyclically visits queues in order to serve waiting customers, typically incurring a switch-over time when moving to the next queue. Polling systems have been extensively used for decades to model a wide variety of applications in areas such as computer and communication systems, production systems, and traffic and transportation systems [1, 19]. In the majority of the literature on polling systems, it is assumed that in each queue, new customers arrive via independent Poisson processes. However, in many applications, these arrival processes are not necessarily independent; customers arrive in batches, and batches of customers may arrive at different queues simultaneously [21]. It is important to consider the correlation structure in the arrival processes for these applications, because neglecting it may lead to strongly erroneous performance predictions and, consequently, to improper decisions about system performance. In this paper, we study the batch sojourn-time in polling systems with simultaneous arrivals, that is, the time until all the customers in a single batch are served after an arrival epoch.
Batch sojourn-times are of great interest in many applications of polling systems with simultaneous arrivals. Below we describe two examples in manufacturing and communication. The first example is the stochastic economic lot scheduling problem, which is used to study the production of multiple products on a single machine with limited capacity, under uncertain demands, production times, and setup times [9, 24]. In the case of a cyclic policy, there is a fixed production sequence such that the order in which products are manufactured is always known to the manufacturer. Whenever a customer has placed an order for one or multiple products, the machine starts production. After the requested number of products has been produced, including possible demand for the same product from orders that just came in, the machine starts to process the next product in the sequence. In this way, the machine polls the buffers of the different product categories to check whether production is required. In this example, the server represents the machine, a customer represents a unit of demand for a given product, and a batch arrival corresponds to the order itself. The batch sojourn-time is defined as the total time required for manufacturing an entire order.
Anzeige
The second example from the area of computer communication systems is an I/O subsystem of a web server. Web servers are required to perform millions of transaction requests per day at an acceptable quality of service (QoS) level in terms of client response time and server throughput [22]. When a request for a web page from the server is made, several file-retrieval requests are made simultaneously (for example, text, images, and multimedia). In many implementations, these incoming file-retrieval requests are placed in separate I/O buffers. The I/O controller continuously polls, using a scheduling mechanism, the different buffers to check for pending file-retrieval requests to be executed. The web page will be fully loaded when all its file-retrieval requests are executed. In this application, the server represents the I/O controller, a customer represents an individual file-retrieval request, a batch of customers who arrive simultaneously corresponds to each web page request, and the batch sojourn-time is the time required to fully load a web page.
The objective of this paper is to analyze the batch sojourn-time in a cyclic polling system with simultaneous batch arrivals. The contribution of this paper is that we obtain exact expressions for the Laplace–Stieltjes transform of the steady-state batch sojourn-time distribution for exhaustive service, which can be used to determine the moments of the batch sojourn-time and, in particular, its mean. However, we provide an alternative, more efficient way to determine the mean batch sojourn-time by extending the mean value analysis (MVA) approach of Winands et al. [23]. We briefly show how our framework can be applied to other service disciplines that satisfy the branching property [16], i.e., locally gated and globally gated. We compare the batch sojourn-times for the different service disciplines in several numerical examples and show that the best performing service discipline, minimizing the batch sojourn-time, depends on system characteristics. From the results, we conclude that there is no unique best service discipline that minimizes the expected batch sojourn-time. As such, our results provide a starting point for a framework to minimize batch sojourn-times for a given polling system.
The organization of this paper is as follows. In Sect. 2, the literature review is given. In Sect. 3, a detailed description of the model and the corresponding notation used in this paper is given. Section 4 analyzes the batch sojourn-time for exhaustive service, the analysis for locally gated service and globally gated service is shown in the appendix. We extensively analyze the results of our model in Sect. 5 via computational experiments for a range of parameters. Finally, in Sect. 6, we conclude and suggest some further research topics.
2 Literature review
In the literature, polling systems with simultaneous arrivals have not been studied intensively. Shiozawa et al. [17] studies a two-queue polling system where customers arrive at each station according to an independent Poisson process and, in addition, customers can arrive in pairs at the system and each join a different queue. The authors derive the Laplace–Stieltjes transform of the waiting time distribution of an individual customer and the response time distribution of a pair of customers who arrive simultaneously. Levy and Sidi [14] studies polling models with simultaneous batch arrivals. For models with gated or exhaustive service, they derive a set of linear equations for the expected waiting time at each of the queues. They also provide a pseudo-conservation law for the system, i.e., an exact expression for a specific weighted sum of the expected waiting times at the different queues. Chiarawongse and Srinivasan [5] also derives pseudo-conservation laws, but in their model all customers in a batch join the same queue. Finally, Van der Mei [20] considers an asymmetric cyclic polling model with mixtures of gated and exhaustive service and general service time and switch-over time distributions and studies the heavy traffic behavior. The results were further generalized in [21].
Anzeige
3 Model description
Consider a polling system consisting of \(N\ge 2\) infinite buffer queues \(Q_{1},\dots ,Q_{N}\) served by a single server that visits the queues in a fixed cyclic order. For ease of presentation, all references to queue indices greater than N or less than 1 are implicitly assumed to be modulo N, for example, \(Q_{N+1}\) is understood as \(Q_{1}\). Assume that a new batch of customers arrives according to a Poisson process with rate \(\lambda \). Each batch of customers is of size \(\varvec{K}=\left( K_{1},\dots ,K_{N}\right) \), where \(K_{i}\) represents the number of customers entering the system at \(Q_{i}\), \(i=1,\dots ,N\). The random vector \(\varvec{K}\) is assumed to be independent of past and future arrival epochs and at least one element of vector \(\varvec{K}\) is larger than 0 and the other elements are larger than or equal to 0, i.e., each batch contains at least one customer. The set of all possible realizations of \(\varvec{K}\) is denoted by \(\mathcal {K}\), and let \(\varvec{k}=\left( k_{1},\dots ,k_{N}\right) \) be a realization of \(\varvec{K}\). The joint probability distribution of \(\varvec{K}\), \(\pi \left( \varvec{k}\right) =\mathbb {P}\left( K_{1}=k_{1},\dots ,K_{N}=k_{N}\right) \) is arbitrary, and its corresponding probability generating function (PGF) is given by \(\widetilde{K}\left( \varvec{z}\right) =E\left( z_{1}^{K_{1}}z_{2}^{K_{2}}\dots z_{N}^{K_{N}}\right) \). The PGF of the marginal batch size distribution at \(Q_{i}\) is denoted by \(\widetilde{K}_{i}\left( z\right) =\widetilde{K}\left( 1,\dots ,1,z,1,\dots ,1\right) \), \(\left| z\right| \le 1\), where the z occurs at the ith entry. The arrival rate of customers to \(Q_{i}\) is \(\lambda _{i}=\lambda E\left( K_{i}\right) \), and let \(E\left( K_{ij}\right) =E\left( K_{i}K_{j}\right) \) for \(i\ne j\) and \(E\left( K_{ii}\right) =E\left( K_{i}^{2}\right) -E\left( K_{i}\right) \). The total arrival rate of customers arriving in the system is given by \(\varLambda =\sum _{i=1}^{N}\lambda _{i}\).
The service time of a customer in \(Q_{i}\) is a generally distributed random variable \(B_{i}\) with Laplace–Stieltjes transform (LST) \(\widetilde{B}_{i}\left( .\right) \), and with first and second moment \(E\left( B_{i}\right) \) and \(E(B_{i}^{2})\), respectively. The workload at queue \(Q_{i}\), \(i=1,\dots ,N\), is defined by \(\rho _{i}=\lambda _{i}E\left( B_{i}\right) \); the overall system load by \(\rho =\sum _{i=1}^{N}\rho _{i}\). In order for the system to be stable, a necessary and sufficient condition is that \(\rho <1\) [18]. In the remainder of this paper, it is assumed that the condition for stability holds. When the server switches from \(Q_{i}\) to \(Q_{i+1}\), it incurs a generally distributed switch-over time \(S_{i}\) with LST \(\tilde{S_{i}}\left( .\right) \), and first and second moment \(E\left( S_{i}\right) \) and \(E(S_{i}^{2})\). Let \(E\left( S\right) =\sum _{i=1}^{N}E\left( S_{i}\right) \) be the mean total switch-over time in a cycle and \(E(S^{2})=\sum _{i=1}^{N}E(S_{i}^{2})+\sum _{i\ne j}E\left( S_{i}\right) E\left( S_{j}\right) \) its second moment.
Fig. 1
Description of a cycle, visit periods, and switch-over times
×
The cycle time \(C_{i}\) of \(Q_{i}\) is defined as the time between two successive visits of the server at this queue. A cycle consists of N visit periods each followed by a switch-over time; \(V_{i},S_{i},V_{i+1},\dots ,V_{i+N-1},S_{i+N-1}\) (see Fig. 1). A visit period, \(V_{i}\), starts whenever there are customers waiting at \(Q_{i}\) with a service beginning and ends with a service completion. Its duration equals the sum of service times of the customers served during the current visit to \(Q_{i}\). By definition, a visit beginning always corresponds to a switch-over completion, whereas a visit completion corresponds to a switch-over beginning. In the case where there are no customers waiting at \(Q_{i}\), these two epochs coincide. It is well-known that the mean cycle length is independent of the queue involved (and the service discipline considered in this paper) and is given by (see, for example, [18]) \(E\left( C\right) =E\left( S\right) /\left( 1-\rho \right) \).
In this paper, three different service policies are considered that satisfy the branching property [16]. Under the exhaustive policy, when a visit beginning starts at \(Q_{i}\), the server continues to work until the queue becomes empty. Any customer who arrives during the server’s visit to \(Q_{i}\) is also served within the current visit. However, under the locally gated policy, the server only serves the customers who were present at \(Q_{i}\) at its visit beginning; all customers who arrive during the course of the visit are served in the next visit to \(Q_{i}\). The final policy is the globally gated policy; according to this policy, the server will only serve the customers who were present at all queues at the visit beginning of a reference queue, which is normally assumed to be \(Q_{1}\). Customers arriving after this visit beginning will only be served after the server has finished its current cycle. This policy strongly resembles the locally gated policy, except that all queues are gated at the same time instead of one per visit beginning.
Fig. 2
Description of the batch sojourn-time
×
The batch sojourn-time of a specific customer batch \(\varvec{k}\), denoted by \(T_{\varvec{k}}\) and its LST by \(\widetilde{T}_{\varvec{k}}\left( .\right) \), is defined as the time between its arrival epoch until the service completion of the last customer in the arrived batch; see Fig. 2. In this example, assume that when the server is in a visit period of \(Q_{j}\), a batch of three customers arrives in \(Q_{1}\) and \(Q_{i}\). Then the batch sojourn-time of this batch equals the residual time in \(V_{j}\), switch-over times \(S_{j},\dots ,S_{i-1}\), visit periods \(V_{j+1},\dots ,V_{i-1}\), and the time until service completion of the last customer of the batch in \(V_{i}\). By definition, the batch sojourn-time corresponds to the sojourn-time of the last customer who is served within the batch. It is important to realize that the queue where the batch finishes service depends on the location of the server on the arrival of the batch, and there is no fixed order in which the customers need to be served. The order in which the customers are served in this example is the same for the three service policies, but varies between disciplines depending on the location of the server. Finally, the batch sojourn-time of an arbitrary customer batch is denoted by T and its corresponding LST by \(\widetilde{T}\left( .\right) \).
Throughout this paper, we make references to the server path from \(Q_{i}\) to \(Q_{j}\), which should be understood in a cyclic sense, for example, \(Q_{i},Q_{i+1},\dots ,Q_{j}\) if \(i\le j\), and otherwise \(Q_{i},Q_{i+1},\dots ,Q_{N},Q_{1},\dots ,Q_{j}\) if \(i>j\). For ease of notation, we define a cyclic sum and, analogously, a cyclic product as [3]
and alternatively,
Finally, let \(\mathcal {K}_{i,j}\) be a subset of \(\mathcal {K}\) where the last customer of an arbitrary arriving customer batch is served in \(Q_{j}\) and all its other customers are served in \(Q_{i},\dots ,Q_{j}\). By definition, a batch will complete its service in one of the queues, such that \(\bigcup _{j=1}^{N}\mathcal {K}_{i,j}=\mathcal {K}\), \(i=1,\dots ,N\). The corresponding probability of subset \(\mathcal {K}_{i,j}\) is given by
In addition, let \(E\left( K_{l}|\mathcal {K}_{i,j}\right) \) be the conditional expected number of customers who have arrived in \(Q_{l}\), \(l=1,\dots ,N\), given subset \(\mathcal {K}_{i,j}\). We define \(\widetilde{K}\left( \varvec{z}|\mathcal {K}_{i,j}\right) \) as the conditional PGF of the distribution of the number of customers who arrive in \(Q_{i},\dots ,Q_{j}\) given \(\mathcal {K}_{i,j}\),
(1)
such that \(\widetilde{K}\left( \varvec{z}\right) =\sum _{j=1}^{N}\pi \left( \mathcal {K}_{i,j}\right) \widetilde{K}\left( \varvec{z}|\mathcal {K}_{i,j}\right) \), \(i=1,\dots ,N\).
4 Exhaustive service
In this section, we start by deriving the LST of the batch sojourn-time distribution of a specific batch of customers in the case of exhaustive service. The batch sojourn-time distribution is found by conditioning on the numbers of customers present in each queue at an arrival epoch and then studying the evolution of the system until all customers within the batch have been served. For this analysis, we first study the joint queue-length distribution at several embedded epochs in Sect. 4.1. We use these results to determine the LST of the batch sojourn-time distribution for both a specific and an arbitrary batch of arriving customers in Sect. 4.2, and present a MVA to calculate the mean batch sojourn-time in Sect. 4.3.
4.1 The joint queue-length distribution
In the polling literature, the probability generating function (PGF) of the joint queue-length distribution at various epochs is extensively studied (for example., [11, 13, 18]). Let \(\widetilde{LB}^{\left( V_{i}\right) }\left( \varvec{z}\right) \) and \(\widetilde{LC}^{\left( V_{i}\right) }\left( \varvec{z}\right) \) be the joint queue-length PGF at visit beginnings and completions at \(Q_{i}\), where \(\varvec{z}=\left( z_{1},\dots ,z_{N}\right) \) is an N-dimensional vector with \(\left| z_{i}\right| \le 1\). Similarly, let \(\widetilde{LB}^{\left( S_{i}\right) }\left( \varvec{z}\right) \) and \(\widetilde{LC}^{\left( S_{i}\right) }\left( \varvec{z}\right) \) be the joint queue-length PGFs at switch-over beginnings and completions at \(Q_{i}\), respectively. Because of the branching property [16], these PGFs can be related to each other as follows:
where \(i=1,\dots ,N\) and \(\widetilde{BP}_{i}\left( .\right) \) is the LST of a busy period in \(Q_{i}\), equals that of an \(M^{X}/G/1\) queue initiated by the service of a customer and is given by
Equations (2)–(5) are referred to in the polling literature as the laws of motion. The interpretation of (2) is that the queue-length in \(Q_{j}\), \(j\ne i\), at the end of visit period \(V_{i}\) is given by the number of customers already at \(Q_{j}\) at the visit beginning plus all the customers who arrive in the system during visit period \(V_{i}\). For \(Q_{i}\), all customers who are already in \(Q_{i}\) or arrive during \(V_{i}\) will be served before the end of the visit completion, and therefore, \(Q_{i}\) will contain no customers at the end of the visit period. Equation (3) simply states that the PGF of a visit completion corresponds to the PGF of the next switch-over beginning (see also Fig. 1). Finally, the queue-length vector at a switch-over completion corresponds to the sum of customers already present at the switch-over beginning plus all the customers who arrive during this switch-over period (4), and by definition the queue-length vector at a switch-over completion is the same for the next visit beginning (5). Note that Eqs. (2)–(5) can be differentiated with respect to \(z_{1},\dots ,z_{N}\) to compute moments of the queue-length distributions on embedded points [14] or numerically inverted for the queue-length probability distributions (for example, [6] for the case for non-simultaneous arrivals).
Let \(\widetilde{LB}^{\left( B_{i}\right) }\left( \varvec{z}\right) \) and \(\widetilde{LC}^{\left( B_{i}\right) }\left( \varvec{z}\right) \) be the joint queue-length PGFs at service beginnings and completions at \(Q_{i}\). Eisenberg [8] proved that besides the laws of motion, there exists a simple relation between the joint queue-length distributions at visit- and service beginnings and completions. He observed that each visit beginning either starts with a service beginning, or with a visit completion in the case where there are no customers at the queue. Similarly, each visit completion coincides with either a visit beginning or a service completion. Eisenberg [8] only considered polling systems either with exhaustive or gated service at all queues and individual arriving customers, but [4] has proven that the relation is not restricted to a particular service discipline and also holds for general branching-type service disciplines. In this section, we generalize this result for the case of simultaneous batch arrivals. Similarly to [8], the four PGFs are related as follows:
where the term \(1/\left( \lambda _{i}E\left( C\right) \right) \) is the long-run ratio between the number of service beginnings/completions and visit beginnings/completions in \(Q_{i}\), for every \(i=1,\dots ,N\).
Furthermore, the joint queue-length distribution at service beginnings and completions are related via
Next, we can find the PGFs of the joint queue-length distributions at an arbitrary moment during \(V_{i}\) and \(S_{i}\), denoted by \(\tilde{L}^{\left( V_{i}\right) }\left( \varvec{z}\right) \) and \(\tilde{L}^{\left( S_{i}\right) }\left( \varvec{z}\right) \), by noticing that the queue-length at an arbitrary moment in \(V_{i}\) or \(S_{i}\) is equal to the queue-length at service/switch-over beginning plus the number of customers who arrived in the past service/switch-over time,
Using these results, \(\tilde{L}\left( \varvec{z}\right) \), which is the PGF of the joint queue-length distribution at an arbitrary moment, can be obtained. By conditioning on periods \(V_{1},S_{1},\dots ,V_{N},S_{N}\) and using (10) and (11) \(\tilde{L}\left( \varvec{z}\right) \) can be written as
with \(E\left( V_{i}\right) =\rho _{i}E\left( C\right) \) as the expected visit time to \(Q_{i}\).
4.2 Batch sojourn-time distribution
In order to determine the LST of the steady-state batch sojourn-time distribution, we follow the method of Boon et al. [2] by conditioning on the location of the server and determining the time it takes until the last customer in a specific batch is served. These results are then used to determine the batch sojourn-time distribution of an arbitrary batch. Boon et al. [2] developed this method to study the steady-state waiting time distribution for polling systems with rerouting. For these kinds of models, the distributional form of Little’s Law [10] cannot be applied, since the combined processes of internal and external arrivals do not necessarily form a Poisson process. However, by studying the evolution of the system after a customer arrival, this problem can be avoided and the waiting time distribution can be obtained. Important in their analysis is the concept of descendants from the theory of branching processes, which are defined as all the customers who arrive during the service of a tagged customer, plus the customers who arrive during the service of those customers, etc. (i.e., the total progeny of the tagged customer).
The approach of Boon et al. [2] is suitable to determine the steady-state batch sojourn-time distribution, since for a specific customer batch the location where the last customer in the batch will be served varies with the location of the server at the arrival of the batch (for example, in Fig. 2 depending of the location of the server the batch is either fully served in \(Q_{1}\) or \(Q_{i}\)). We explicitly condition on the location of the server; the LST of the batch sojourn-time distribution of a specific customer batch \(\varvec{k}\) can be written as
where \(\widetilde{T}_{\varvec{k}}^{\left( V_{j}\right) }\left( .\right) \) is the LST of the batch sojourn-time for customer batch \(\varvec{k}\)given that the batch arrived during \(V_{j}\), and where \(\widetilde{T}_{\varvec{k}}^{\left( S_{j}\right) }\left( .\right) \) is given that the customer batch arrived during \(S_{j}\). The remainder of this section will focus on how to determine \(\widetilde{T}_{\varvec{k}}^{\left( V_{j}\right) }\left( .\right) \), \(\widetilde{T}_{\varvec{k}}^{\left( S_{j}\right) }\left( .\right) \), and the LST of an arbitrary batch \(\widetilde{T}\left( .\right) \).
From the theory of branching processes, we denote \(B_{j,i,}\)\(i,j=1,\dots ,N\), as the service of a tagged customer in \(Q_{j}\) plus all its descendants that will be served before or during the next visit to \(Q_{i}\). Combining this gives the following recursive function:
(14)
where \(BP_{j}\) is the busy period initiated by the tagged customer in \(Q_{j}\), \(N_{l}\left( BP_{j}\right) \) denotes the number of customers who arrive in \(Q_{l}\) during this busy period in \(Q_{j}\), and \(B_{l_{m},i}\) is a sequence of (independent) \(B_{l,i}\)’s. Let \(\widetilde{B}_{j,i}\left( .\right) \) be the LST of \(B_{j,i}\), which is given by
A similar LST can also be formulated for a switch-over time \(S_{j}\) and the service of all its descendants that will be served before the end of the visit to \(S_{i}\),
The key difference with (16) is that (18) excludes any new customer arrivals in \(Q_{i}\). This is needed to omit customers who arrive in \(Q_{i}\) after the batch arrival; these customers do not influence the batch sojourn-time of the arriving customer batch since they will be served afterwards.
We first focus on the batch sojourn-time of a customer batch that arrives during a visit period. Assume than an arriving customer batch \(\varvec{k}\) enters the system while the server is currently within visit period \(V_{j}\) and the last customer in the batch will be served in \(Q_{i}\). Formally, this means \(k_{i}>0\) and all the other customer arriving in the same batch should be served before the next visit to \(Q_{i}\); \(k_{l}\ge 0\), \(l=j,\dots ,i-1\), and \(k_{l}=0\) elsewhere. Whenever all the customers arrive in the same queue that is currently visited, then \(k_{i}=k_{j}>0\), and \(k_{l}=0\) elsewhere.
The batch sojourn-time of customer batch \(\varvec{k}\) consists of (i) the residual service time in \(Q_{j}\), (ii) the service of all the customers already in the system in \(Q_{j},\dots ,Q_{i}\), (iii) the service of all new customer arrivals that arrive after customer batch \(\varvec{k}\) in \(Q_{j},\dots ,Q_{i-1}\) before the server reaches \(Q_{i}\), (iv) the switch-over times \(S_{j},\dots ,S_{i-1}\), and (v) the service of the customers in the customer batch \(\varvec{k}\). From (10), we know that at the arrival of the customer batch, the PGF of the joint queue-length distribution is the equal to the queue-lengths at a service beginning, \(\widetilde{LB}^{\left( B_{j}\right) }\left( .\right) \), plus the number of customers who arrived in the elapsed part of the service time, \(\widetilde{B}_{j}^{P}\left( .\right) \). On the other hand, we also need to consider the residual part of the service time, \(\widetilde{B}_{j}^{R}\left( .\right) \), and if \(i\ne j\) the arrivals that occur in \(Q_{j},\dots ,Q_{i-1}\) during this period as well. Therefore, similarly to [2], we need to consider the PGF-LST of the joint queue-length distribution at an arrival epoch and the residual service time; \(\widetilde{L}^{\left( V_{i}\right) }\left( \varvec{z},\omega \right) \). First, since the number of customers who arrive in the elapsed and residual part of the service time are independent of each other and from the queue-lengths at a service beginning, we can write the LST of the joint distribution of \(\widetilde{B}_{j}^{P}\left( .\right) \) and \(\widetilde{B}_{j}^{R}\left( .\right) \) as [7]
Then, because of independence between \(\widetilde{B}_{j}^{PR}\left( \omega _{P},\omega _{R}\right) \) and \(\widetilde{LB}^{\left( B_{j}\right) }\left( \varvec{z}\right) \), we have
The LST of the batch sojourn-time distribution of batch \(\varvec{k}\) conditional on the server being in visit period \(V_{j}\) and the last customer in the batch being served in \(Q_{i}\) is given by
(20)
Proof
Consider the system just before the arrival of the customer batch and assume that the batch does not finish service in the current visit period, i.e., \(i\ne j\). Then, let \(n_{1},n_{2},\dots ,n_{N}\) be the number of customers present in the system at the arrival epoch of the customer batch and \(k_{1},\dots ,k_{N}\) be the number of customers per queue that arrived in batch \(\varvec{k}\). Since the batch arrives in \(V_{j}\), it first has to wait for the residual service time of the customer currently in service. During this period, new customers can arrive before the next visit to \(Q_{i}\) which bring in additional work with \(\lambda (1-\widetilde{K}(\varvec{B_{j,i-1}}))\). Afterwards, each customer already in the system at the arrival of the customer batch in \(Q_{j},\dots ,Q_{i}\) and each customer in batch \(\varvec{k}\) will make a contribution of \((\varvec{B_{j,i}^{*}})_{l}\), \(l=j,\dots ,i\), to the batch sojourn-time. Finally, in the switch-over periods between \(Q_{j}\) and \(Q_{i}\), new customers can arrive who will be served before the service of the last customer in the batch. Combining this gives the LST of the batch sojourn-time distribution of batch \(\varvec{k}\) conditional on \(n_{1},n_{2},\dots ,n_{N}\) customers being already present in the system, the server being in visit period \(V_{j}\), and the last customer in the batch being served in \(Q_{i}\):
(21)
Unconditioning this equation gives (20). \(\square \)
Now, consider a customer batch that arrives during a switch-over period. Assume an arriving customer batch \(\varvec{k}\) enters the system while the server is currently within switch-over period \(S_{j-1}\) and the last customer in the batch will be served in \(Q_{i}\). The reason that we consider \(S_{j-1}\) is that batch \(\varvec{k}\) will finish service in the same queue had it arrived in \(V_{j}\) because of the exhaustive service discipline.
In this case, the batch sojourn-time consists of the same components (ii), (iii), (iv), and (v). Component (i) is however different and is now defined as the residual switch-over time between \(Q_{j-1}\) and \(Q_{j}\). Similarly, we define \(\widetilde{L}^{\left( S_{j-1}\right) }\left( \varvec{z},\omega \right) \) as the PGF-LST of the joint queue-length distribution of customers present in the system at an arbitrary moment during \(S_{j-1}\)and the residual switch-over time \(\widetilde{S}_{j-1}^{R}\left( .\right) \). From (11), we have the joint queue-length distribution at a switch-over beginning, \(\widetilde{LB}^{\left( S_{j-1}\right) }\left( .\right) \), and the number of customers who arrived in the elapsed part of the switch-over time, \(\widetilde{S}_{j-1}^{P}\left( .\right) \). Similarly to \(\widetilde{B}_{j}^{PR}\left( .\right) \), we define \(\widetilde{S}_{j-1}^{PR}\left( \omega _{R},\omega _{P}\right) \) as the LST of the joint distribution of the elapsed and residual switch-over time \(S_{j-1}\) as
Then, due to independence, the PGF-LST of the joint queue-length distribution present at an arbitrary moment during \(S_{j-1}\) and the residual switch-over time is given by
The LST of the batch sojourn-time distribution of batch \(\varvec{k}\) conditional on the server being in switch-over period \(S_{j-1}\) and the last customer in the batch being served in \(Q_{i}\) is given by
(23)
Proof
Similarly to Proposition 1, we condition on the number of customers present in the system before the arrival of batch \(\varvec{k}\) and the number of customer who enter the system per queue that arrived in batch \(\varvec{k}\). Then, studying the contribution of each customer to the batch sojourn-time, we obtain (23). \(\square \)
From Propositions 1 and 2, it can be seen that the LST of the batch sojourn-time distribution of batch \(\varvec{k}\) conditioned on a visit/switch-over period is comprised of two terms: a term independent of batch \(\varvec{k}\)and a term that corresponds to the additional contribution batch \(\varvec{k}\) makes to the batch sojourn-time:
(24)
(25)
where \(1_{\left( \varvec{k}\in \mathcal {K}_{j,i}\right) }\) is an indicator function that is equal to one if all customers in batch \(\varvec{k}\) are served in \(Q_{j},\dots ,Q_{i}\) and the last customer will be served in \(Q_{i}\), and zero otherwise. The terms \(\widetilde{W}_{i}^{\left( V_{j}\right) }\left( \omega \right) \) and \(\widetilde{W}_{i}^{\left( S_{j-1}\right) }\left( \omega \right) \) can be considered as the time between the batch arrival epoch and the service completion of the last customer in \(Q_{i}\) that was already in the system at the arrival of the customer batch, excluding batch \(\varvec{k}\) and any arrivals to \(Q_{i}\) after the arrival epoch, conditioned on the location of the server. In the case where there are only individually arriving customers, this would correspond to the LST of the waiting time distribution of a customer arriving in \(Q_{i}\) conditional on the server being in a visit or switch-over period. The LST of the batch sojourn-time distribution of a specific customer batch \(\varvec{k}\) can now be calculated using (13).
Finally, we focus on the LST of the batch sojourn-time of an arbitrary batch \(\widetilde{T}\left( .\right) \).
Theorem 1
The LST of the batch sojourn-time distribution of an arbitrary batch \(\widetilde{T}\left( \varvec{.}\right) \) in the case of exhaustive service is given by
From (24) and (25), it can be seen that when the server is either in \(S_{j-1}\) or \(V_{j}\), then for two different customer batches that both finish service in the same queue, their LST of the batch sojourn-time distribution only varies in the contribution the batch makes to the batch sojourn-time.
Substituting the last equation in (28) gives (27). \(\square \)
Differentiating (27) will give the mean batch sojourn-time; however, in the next section, an alternative, more efficient way to determine the mean batch sojourn-time is presented.
4.3 Mean batch sojourn-time
In this section, we derive the mean batch sojourn-time of a specific batch and an arbitrary batch using MVA. MVA for polling systems was developed by Winands et al. [23] to study mean waiting times in systems with exhaustive, gated service, or mixed service. The main advantage of MVA is that it has a pure probabilistic interpretation and is based on standard queueing results, i.e., the Poisson arrivals see time averages (PASTA) property [25] and Little’s Law [15]. Furthermore, MVA evaluates the polling system at arbitrary time periods and not on embedded points such as visit beginnings, like in the buffer occupancy method [18] and the descendant set approach [12].
Central in MVA [23] is the derivation of \(E\left( \bar{L}_{i}^{\left( S_{j-1},V_{j}\right) }\right) \), the mean queue-length at \(Q_{i}\) (excluding the potential customer currently in service) at an arbitrary epoch within switch-over period \(S_{j-1}\) and visit period \(V_{j}:\)
where \(E\left( \bar{L}_{i}^{\left( S_{j-1}\right) }\right) \) and \(E\left( \bar{L}_{i}^{\left( V_{j}\right) }\right) \) are the expected queue-length in \(Q_{i}\) during, respectively, a switch-over/visit period and \(E\left( V_{j}\right) =\rho _{j}E\left( C\right) \). Subsequently, with \(E\left( \bar{L}_{i}^{\left( S_{j-1};V_{j}\right) }\right) \) the mean queue-length \(E\left( \bar{L}_{i}\right) \) in \(Q_{i}\) can be determined:
and by Little’s law, also the mean waiting time \(E\left( W_{i}\right) \) of a random customer in \(Q_{i}\), which is defined as the time in steady state from the customer’s arrival until the start of his/her service.
For notational purposes, we introduce \(\theta _{j}\) as short-hand for the intervisit period \(\left( S_{j-1},V_{j}\right) \); the expected duration of this period \(E\left( \theta _{j}\right) \) is given by
Notice that \(\sum _{j=1}^{N}E\left( \theta _{j}\right) =E\left( C\right) \). In addition, we define \(\theta _{j,i}\) as the duration of an intervisit period starting in \(\theta _{j}\) and ending in \(\theta _{i}\), the expected duration of this period \(E\left( \theta _{j,i}\right) \) is equal to
(32)
and where \(E\left( \theta _{j,i}^{R}\right) =E\left( \theta _{j,i}^{2}\right) /2E\left( \theta _{j,i}\right) \) is the mean residual duration of this period. However, \(E\left( \theta _{j,i}^{2}\right) \) is unknown and not straightforward to derive directly. In the MVA, based on probabilistic arguments, \(E\left( \theta _{j,i}^{2}\right) \) will be expressed in terms of \(E\left( \bar{L}_{i}^{\left( \theta _{j}\right) }\right) \).
We denote \(E\left( B_{j,i}\right) \) as the mean service of a customer in \(Q_{j}\) and all its descendants before the server starts serving \(Q_{i}\). Let \(E\left( B_{j,j}\right) =E\left( B_{j}\right) \) and \(E\left( B_{j,j+1}\right) =E\left( B_{j}\right) /\left( 1-\rho _{j}\right) \) be the expected busy period initiated by a customer in \(Q_{j}\). Then, \(E\left( B_{j,j+2}\right) \) equals the busy period in \(Q_{j}\) plus all the customers who arrive during this busy period in \(Q_{j+1}\) and the busy periods that they trigger:
In general, we can write \(E\left( B_{j,i}\right) \) for \(i\ne j\) as
(33)
Also, let \(E\left( S_{j,i}\right) \) denote the switch-over in \(Q_{j}\) and the service of all the customers who arrive during \(E\left( S_{j}\right) \) and their descendants before the server starts serving \(Q_{i}\). Then \(E\left( S_{j,j+1}\right) =E\left( S_{j}\right) \) and, in general, for \(i\ne j+1\),
(34)
Finally, \(E\left( B_{j,i}^{R}\right) \) is the mean residual service of a customer in \(Q_{j}\) and all its descendants before the server starts serving \(Q_{i}\) and is given by replacing \(E\left( B_{j}\right) \) by \(E\left( B_{j}^{R}\right) =E\left( B_{j}^{2}\right) /2E\left( B_{j}\right) \) in \(E\left( B_{j,i}\right) \). In addition, \(E\left( S_{j,i}^{R}\right) \) is defined as \(E\left( S_{j,i}\right) \) and by replacing \(E\left( S_{j}\right) \) by \(E\left( S_{j}^{R}\right) =E\left( S_{j}^{2}\right) /2E\left( S_{j}\right) \).
In MVA, a set of \(N^{2}\) linear equations is derived for \(E\left( \bar{L}_{i}\right) \) in terms of unknowns \(E\left( \bar{L}_{i}^{\left( \theta _{j}\right) }\right) \). For this, we have to consider the waiting time of an arbitrary customer and make use of the arrival relation and the PASTA property. Assume that an arbitrary customer enters the system in \(Q_{i}\). The waiting time of the customer consists of (i) the service of \(E\left( \bar{L}_{i}\right) \) customers already at \(Q_{i}\) upon its arrival to the system, (ii) the service of \(E\left( K_{ii}\right) /2E\left( K_{i}\right) \) customers who arrived in the same customer batch, but are placed before the arbitrary customer in \(Q_{i}\), (iii) if the server is currently in intervisit period \(\theta _{i}\), then the arbitrary customer has to wait with probability \(\rho _{i}\) for the residual service time \(E\left( B_{i}^{R}\right) \) and with probability \(E\left( S_{i-1}\right) /E\left( C\right) \) for the residual switch-over time \(E\left( S_{i-1}^{R}\right) \). Finally, (iv) whenever the server is not in intervisit period \(\theta _{i}\), the arbitrary customer has to wait for the expected residual duration before the server returns at \(Q_{i}\). Based on these components, the mean waiting time \(E\left( W_{i}\right) \) of a customer in \(Q_{i}\), \(i=1,\dots ,N\), is given by
The next step to derive the equations is to relate the unknowns \(E\left( \theta _{i+1,i-1}^{R}\right) \) to \(E\left( \bar{L}_{i}^{\left( \theta _{j}\right) }\right) \). Consider \(E\left( \theta _{j,i}^{R}\right) \), the expected residual duration of an intervisit period starting in \(\theta _{j}\) and ending in \(\theta _{i}\) given that an arbitrary customer batch just entered the system. Then with probability \(E\left( \theta _{l}\right) /E\left( \theta _{j,i}\right) \), the server is during this period in intervisit period \(\theta _{l}\), \(l=j,\dots ,i\), and the expected residual duration until the intervisit ending of \(\theta _{i}\), conditional on the server being in intervisit period \(\theta _{l}\), is defined as follows. First, with probability \(E\left( V_{l}\right) /E\left( \theta _{l}\right) \), the server is busy serving a customer in \(Q_{l}\) and with probability \(E\left( S_{l-1}\right) /E\left( \theta _{l}\right) \), the server is in switch-over period \(S_{l-1}\). During the residual service/switch-over time, new customers can arrive who will be served before the intervisit ending in \(\theta _{i}\), which equals \(E\left( B_{l,i+1}^{R}\right) \) and \(E\left( S_{l-1,i+1}^{R}\right) \), respectively. In addition, the expected number of customers in \(Q_{n}\) given the server is in \(\theta _{l}\), \(E\left( \bar{L}_{n}^{\left( \theta _{l}\right) }\right) \), and the expected number of customers \(E\left( K_{nl}\right) /E\left( K_{n}\right) \) who arrived in \(Q_{n}\) in the arbitrary customer batch will increase the duration of \(E\left( \theta _{j,i}^{R}\right) \) by \(E\left( B_{n,i+1}\right) \). Finally, the customer also has to wait for all the switch-over times \(E\left( S_{n,i+1}\right) \), \(n=j,\dots ,i\), between \(Q_{n}\) to \(Q_{n+1}\) plus the customers who arrive during the switch-over times and their descendants that will be served before the end of \(E\left( \theta _{j,i}^{R}\right) \). Combining this gives the following expression for \(i\ne j-1\):
(36)
It is now possible to set up a set of \(N^{2}\) linear equations. First, after the server has visited \(Q_{i}\), there will be no customers present in the queue. Therefore, the number of customers in \(Q_{i}\) given an arbitrary moment in an intervisit period starting in \(\theta _{i+1}\) and ending in \(\theta _{j}\) equals the number of Poisson arrivals during the age of this period [23]. Because the age is equal to the residual time in distribution, we have, for \(i=1,\dots ,N,\,j=1,\dots ,N\), and \(i\ne j\),
(37)
Second, by (35) and using Little’s Law, \(\lambda _{i}E\left( W_{i}\right) =E\left( \bar{L}_{i}\right) \). Substituting this into (30) gives, for \(i=1,2\dots ,N\),
With (37) and (38), a set of \(N^{2}\) linear equations for unknowns \(E\left( \bar{L}_{i}^{\left( \theta _{j}\right) }\right) \) are now defined. Solving the set of linear equations and by (30) and (35) will give the expected queue-lengths and waiting times.
In order to derive the mean batch sojourn-time \(E\left( T_{\varvec{k}}\right) \) of customer batch \(\varvec{k}\), \(E\left( \bar{L}_{i}^{\left( \theta _{j}\right) }\right) \) also plays an integral role. Similarly to (13), in order to calculate the expected batch sojourn-time distribution of a specific customer batch \(\varvec{k}\), we explicitly condition on the location on the server:
where \(E\left( T_{\varvec{k}}^{\left( \theta _{j}\right) }\right) \) is the expected batch sojourn-time distribution of a specific customer batch \(\varvec{k}\) given that the server is in intervisit period \(\theta _{j}\). \(E\left( T_{\varvec{k}}^{\left( \theta _{j}\right) }\right) \) can be derived in a similar way to (36). This gives the following expression:
(40)
Note that the same decomposition as (24) and (25) also holds for the expected batch sojourn-time:
where \(E\left( W_{i}^{\left( \theta _{j}\right) }\right) \) is the expected time between the batch arrival epoch and the service completion of the last customer in \(Q_{i}\) that is already in the system, excluding any arrivals to \(Q_{i}\) after the arrival epoch. The term can be interpreted as the total contribution batch \(\varvec{k}\) makes to the batch sojourn-time.
Finally, the expected batch sojourn-time of an arbitrary customer batch is obtained by multiplying \(E\left( T_{\varvec{k}}\right) \) with the probability that a particular batch \(\varvec{k}\) enters the system:
However, if there are many different realizations of customer batches possible, (41) might not be computationally feasible, since for every \(\varvec{k}\) we have to determine the mean batch sojourn-time given that the server starts in intervisit period \(\theta _{j}\) and ends in \(\theta _{i}\); in total, there are \(\left| \mathcal {K}\right| \times N\times N\) combinations to consider, where \(\left| \mathcal {K}\right| \) denotes the size of set \(\mathcal {K}\). Instead, by using \(E\left( K_{l}|\mathcal {K}_{j,i}\right) \), we can rewrite (41) as follows:
The advantage is that the number of combinations reduces to \(N\times N\), and \(\pi \left( \mathcal {K}_{j,i}\right) \) can be determined in \(\left| \mathcal {K}\right| \) steps.
5 Numerical results
In this section we investigate the batch sojourn-times for the three server disciplines. In Sect. 5.1 we study a symmetrical polling system with two queues and derive a closed-form solution for the expected batch sojourn-times and show under which parameters settings, which service discipline has the smallest expected batch sojourn-time. In Sect. 5.2 we study asymmetrical systems and show that the service discipline that achieves the shortest expected batch sojourn-time depends on the system parameters.
5.1 A symmetrical polling system with two exponential queues
Consider a symmetrical polling system with two queues where all customers arrive in pairs and each of them joins another queue as shown in Fig. 3. Assume that the arrival rate is \(\lambda \), the expected service time of a customer in \(Q_{1}\) or \(Q_{2}\) is \(E\left( B_{1}\right) =E\left( B_{2}\right) =b\), and the expected switch-over time from \(Q_{1}\) to \(Q_{2}\) and vice versa is \(E\left( S_{1}\right) =E\left( S_{2}\right) =s\). In addition, we make the assumption that both service times and switch-over times are exponentially distributed, i.e., \(E\left( B_{1}^{R}\right) =E\left( B_{2}^{R}\right) =b\) and \(E\left( S_{1}^{R}\right) =E\left( S_{2}^{R}\right) =s\). Since customers arrive in pairs, \(E\left( K_{1}\right) =E\left( K_{2}\right) =1\), and \(E\left( K_{12}\right) =E\left( K_{21}\right) =1\) and \(E\left( K_{11}\right) =E\left( K_{22}\right) =0\). Finally, the overall system load is \(\rho =\rho _{1}+\rho _{2}=2b\lambda \).
Fig. 3
A symmetrical polling system with two exponential queues
×
In Fig. 4, a comparison is made between the mean batch sojourn-time and its variance for exhaustive and locally gated service. We excluded the results for globally gated since in this case it is always dominated by locally gated. The mean batch sojourn-times are obtained from MVA, and using (41), the mean batch sojourn-time in the case of exhaustive service is given by
In order to obtain the variance of the batch sojourn-time, we numerically invert (26) using the algorithm from Choudhury and Whitt [6], adapted for the case of batch arrivals.
Now, we can compare the batch sojourn-times for the symmetrical polling system and investigate under which parameter settings which service discipline achieves the smallest expected batch sojourn-time. Figure 4 shows the combinations of service and switch-over times where a specific service discipline achieves the smallest batch sojourn-time. It can be seen that when the switch-over times are longer compared to the service times, the exhaustive service discipline achieves the smallest expected batch sojourn-time, since it is more beneficial to serve all customers at the current queue first before moving to the other queue. However, if the service times are longer than the switch-over times, it is better to switch to the other queue more often, because otherwise the server will spend too much time serving customers in one queue and it will take a long time before a customer batch is completely served. In this case, locally gated performs better than exhaustive service. The same pattern can also be observed for the variance.
Fig. 4
Batch sojourn-time for the symmetrical polling system with two queues. \(\circ \) means locally gated is better, \(\otimes \) means exhaustive is better. a Mean batch sojourn-time, b variance batch sojourn-time
×
Table 1
Parameters for three polling models
\(Q_{i}\)
Model a
Model b
Model c
1
2
3
1
2
3
1
2
3
\(E\left( B_{i}\right) \)
1.00
1.00
1.00
1.00
1.00
1.00
0.10
0.40
0.90
\(E\left( B_{i}^{\left( 2\right) }\right) \)
2.00
2.00
2.00
2.00
2.00
2.00
1.00
1.00
1.00
\(E\left( S_{i}\right) \)
0.10
0.10
0.10
1.00
1.00
1.00
1.00
1.00
1.00
\(E\left( S_{i}^{\left( 2\right) }\right) \)
0.02
0.02
0.02
2.00
2.00
2.00
1.00
1.00
1.00
\(\varvec{k}\in \mathcal {K}\)
\(\pi \left( 1,1,0\right) =1/4\)
\(\pi \left( 1,0,0\right) =1/3\)
\(\pi \left( 1,1,0\right) =4/5\)
\(\pi \left( 3,0,1\right) =3/4\)
\(\pi \left( 0,1,0\right) =1/3\)
\(\pi \left( 1,0,3\right) =1/5\)
\(\pi \left( 0,0,1\right) =1/3\)
Fig. 5
Expected batch sojourn-time for various utilizations for three different systems. a Locally gated minimizes the expected batch sojourn-time, b exhaustive minimizes the expected batch sojourn-time, c globally gated minimizes the expected batch sojourn-time
×
5.2 Asymmetrical polling systems with multiple queues
In the previous section we have shown that depending on the system parameters, exhaustive service or locally gated service minimizes the expected batch sojourn-time. However, it can be shown that any of the three service disciplines studied in this paper can minimize the expected batch sojourn-time. In Table 1, the parameters of three systems with \(N=3\) are given. Model a has short switch-over times, Model b is a system with individual arriving customers and equal switch-over times and service times, and in Model c the last queue is the slowest and receives most of the work. Using the results of Sect. 4.3, and the online appendix the expected batch sojourn-times for the three different models can be calculated. The batch sojourn-times are shown in Fig. 5 for \(0\le \rho <1\). The results of Model a in Fig. 5a show that locally gated achieves the lowest expected batch sojourn-times, which is similar to Sect. 5.1 when the switch-over times were short. From the results of Model b shown in Fig. 5b, it can be seen that exhaustive service has the lowest expected batch sojourn-times. Here it is beneficial to serve a customer arriving to the same queue that is currently being served, since otherwise this customer has to wait a full cycle which increases the mean batch sojourn-time. Finally, Model c in Fig. 5c shows that globally gated service achieves the lowest expected batch sojourn-times, since for this policy the server will switch more often between the queues and finish service for all customers in a batch during one cycle, compared to the other disciplines.
6 Conclusion and further research
In this paper we analyzed the batch sojourn-time in a cyclic polling system with simultaneous batch arrivals and obtained exact expressions for the Laplace–Stieltjes transform of the steady-state batch sojourn-time distribution for the locally gated, globally gated, and exhaustive service disciplines. Also, we provided a more efficient way to determine the mean batch sojourn-time using MVA. We compared the batch sojourn-times for the different service disciplines in several numerical examples and showed that the best performing service discipline, minimizing the batch sojourn-time, depends on system characteristics.
A further research topic would be to determine, for each of the three policies, under what conditions on the system parameters its mean batch sojourn-time is smaller than that of the other two, and whether alternative service disciplines can achieve even lower batch sojourn-times. Another interesting further research topic would be to study how the customers of an arriving customer batch should be allocated over the various queues in order to minimize the batch sojourn-times.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
and alternatively,
Finally, let \(\mathcal {K}_{i,j}\) be a subset of \(\mathcal {K}\) where the last customer of an arbitrary arriving customer batch is served in \(Q_{j}\) and all its other customers are served in \(Q_{i},\dots ,Q_{j}\). By definition, a batch will complete its service in one of the queues, such that \(\bigcup _{j=1}^{N}\mathcal {K}_{i,j}=\mathcal {K}\), \(i=1,\dots ,N\). The corresponding probability of subset \(\mathcal {K}_{i,j}\) is given byIn addition, let \(E\left( K_{l}|\mathcal {K}_{i,j}\right) \) be the conditional expected number of customers who have arrived in \(Q_{l}\), \(l=1,\dots ,N\), given subset \(\mathcal {K}_{i,j}\). We define \(\widetilde{K}\left( \varvec{z}|\mathcal {K}_{i,j}\right) \) as the conditional PGF of the distribution of the number of customers who arrive in \(Q_{i},\dots ,Q_{j}\) given \(\mathcal {K}_{i,j}\),
such that \(\widetilde{K}\left( \varvec{z}\right) =\sum _{j=1}^{N}\pi \left( \mathcal {K}_{i,j}\right) \widetilde{K}\left( \varvec{z}|\mathcal {K}_{i,j}\right) \), \(i=1,\dots ,N\).
where \(BP_{j}\) is the busy period initiated by the tagged customer in \(Q_{j}\), \(N_{l}\left( BP_{j}\right) \) denotes the number of customers who arrive in \(Q_{l}\) during this busy period in \(Q_{j}\), and \(B_{l_{m},i}\) is a sequence of (independent) \(B_{l,i}\)’s. Let \(\widetilde{B}_{j,i}\left( .\right) \) be the LST of \(B_{j,i}\), which is given bywhere \(\varvec{B_{j+1,i}}\) is an N-dimensional vector defined as follows:A similar LST can also be formulated for a switch-over time \(S_{j}\) and the service of all its descendants that will be served before the end of the visit to \(S_{i}\),Finally, let \(\varvec{B_{j,i}^{*}}\) be an N-dimensional vector defined asThe key difference with (16) is that (18) excludes any new customer arrivals in \(Q_{i}\). This is needed to omit customers who arrive in \(Q_{i}\) after the batch arrival; these customers do not influence the batch sojourn-time of the arriving customer batch since they will be served afterwards.
Unconditioning this equation gives (20). \(\square \)
where \(1_{\left( \varvec{k}\in \mathcal {K}_{j,i}\right) }\) is an indicator function that is equal to one if all customers in batch \(\varvec{k}\) are served in \(Q_{j},\dots ,Q_{i}\) and the last customer will be served in \(Q_{i}\), and zero otherwise. The terms \(\widetilde{W}_{i}^{\left( V_{j}\right) }\left( \omega \right) \) and \(\widetilde{W}_{i}^{\left( S_{j-1}\right) }\left( \omega \right) \) can be considered as the time between the batch arrival epoch and the service completion of the last customer in \(Q_{i}\) that was already in the system at the arrival of the customer batch, excluding batch \(\varvec{k}\) and any arrivals to \(Q_{i}\) after the arrival epoch, conditioned on the location of the server. In the case where there are only individually arriving customers, this would correspond to the LST of the waiting time distribution of a customer arriving in \(Q_{i}\) conditional on the server being in a visit or switch-over period. The LST of the batch sojourn-time distribution of a specific customer batch \(\varvec{k}\) can now be calculated using (13).
and where \(E\left( \theta _{j,i}^{R}\right) =E\left( \theta _{j,i}^{2}\right) /2E\left( \theta _{j,i}\right) \) is the mean residual duration of this period. However, \(E\left( \theta _{j,i}^{2}\right) \) is unknown and not straightforward to derive directly. In the MVA, based on probabilistic arguments, \(E\left( \theta _{j,i}^{2}\right) \) will be expressed in terms of \(E\left( \bar{L}_{i}^{\left( \theta _{j}\right) }\right) \).
Also, let \(E\left( S_{j,i}\right) \) denote the switch-over in \(Q_{j}\) and the service of all the customers who arrive during \(E\left( S_{j}\right) \) and their descendants before the server starts serving \(Q_{i}\). Then \(E\left( S_{j,j+1}\right) =E\left( S_{j}\right) \) and, in general, for \(i\ne j+1\),
Finally, \(E\left( B_{j,i}^{R}\right) \) is the mean residual service of a customer in \(Q_{j}\) and all its descendants before the server starts serving \(Q_{i}\) and is given by replacing \(E\left( B_{j}\right) \) by \(E\left( B_{j}^{R}\right) =E\left( B_{j}^{2}\right) /2E\left( B_{j}\right) \) in \(E\left( B_{j,i}\right) \). In addition, \(E\left( S_{j,i}^{R}\right) \) is defined as \(E\left( S_{j,i}\right) \) and by replacing \(E\left( S_{j}\right) \) by \(E\left( S_{j}^{R}\right) =E\left( S_{j}^{2}\right) /2E\left( S_{j}\right) \).
It is now possible to set up a set of \(N^{2}\) linear equations. First, after the server has visited \(Q_{i}\), there will be no customers present in the queue. Therefore, the number of customers in \(Q_{i}\) given an arbitrary moment in an intervisit period starting in \(\theta _{i+1}\) and ending in \(\theta _{j}\) equals the number of Poisson arrivals during the age of this period [23]. Because the age is equal to the residual time in distribution, we have, for \(i=1,\dots ,N,\,j=1,\dots ,N\), and \(i\ne j\),
Second, by (35) and using Little’s Law, \(\lambda _{i}E\left( W_{i}\right) =E\left( \bar{L}_{i}\right) \). Substituting this into (30) gives, for \(i=1,2\dots ,N\),With (37) and (38), a set of \(N^{2}\) linear equations for unknowns \(E\left( \bar{L}_{i}^{\left( \theta _{j}\right) }\right) \) are now defined. Solving the set of linear equations and by (30) and (35) will give the expected queue-lengths and waiting times.
Note that the same decomposition as (24) and (25) also holds for the expected batch sojourn-time:
where \(E\left( W_{i}^{\left( \theta _{j}\right) }\right) \) is the expected time between the batch arrival epoch and the service completion of the last customer in \(Q_{i}\) that is already in the system, excluding any arrivals to \(Q_{i}\) after the arrival epoch. The term
can be interpreted as the total contribution batch \(\varvec{k}\) makes to the batch sojourn-time.
The advantage is that the number of combinations reduces to \(N\times N\), and \(\pi \left( \mathcal {K}_{j,i}\right) \) can be determined in \(\left| \mathcal {K}\right| \) steps.