Abstract
We consider the \(M_t/M_t/1\) queue, the multi-server queue (\(M_t/M_t/c_t\)), and queues with jumps of size one and two. Results are extensible to more general ergodic quasi-birth-death processes (QBDs) with time-varying periodic transition rates of period one. The estimates are asymptotic in the level of the process (the length of the queue). These asymptotic estimates highlight the connections between the asymptotic periodic distribution of a stable queue with time-varying rates and the same type of queue with constant rates. The estimates can also be used to approximate other performance measures such as the waiting time distribution. We illustrate the method with several examples.
Access provided by Autonomous University of Puebla. Download chapter PDF
Similar content being viewed by others
Keywords
- \(M_t/M_t/1\) queues
- Multi-server queues
- Queues with jumps
- Waiting time distribution
- Generating function
2010 Mathematics Subject Classification
1 Introduction
Systems with time-varying periodic rates are pervasive. They include telephone call centers, hospital emergency rooms, airports, any system which exhibits seasonal behavior whether natural or man-made, ambulances, police and fire service and many, many others. The recent paper by Schwarz, Selinka and Stolletz [7] provides both a useful survey of applications and a survey of methods for analyzing queueing systems with time-varying parameters.
In this paper, we consider the \(M_t/M_t/1\) queue, the multi-server queue (\(M_t/M_t/c_t\)), and queues with jumps of size one and two. Results are extensible to more general ergodic quasi-birth-death processes (QBDs) with time-varying periodic transition rates of period one. The estimates are asymptotic in the level of the process (the length of the queue). These asymptotic estimates highlight the connections between the asymptotic periodic distribution of a stable queue with time-varying rates and the same type of queue with constant rates. The estimates can also be used to approximate other performance measures such as the waiting time distribution. We illustrate the method with several examples.
The basic approach is to solve for the generating function of the queueing system using the assumption that if the process is in its asymptotic periodic distribution at some time t, then the generating function at time t will equal the generating function at time \(t+1\). That is, we assume the system is in the periodic analog of steady state. For more detail on when the asymptotic periodic distribution exists, see [5]. This will yield a function for the generating function in terms of an integral equation. We find the poles of this function to create our asymptotic estimates. The poles of the generating function depend only on the evolution of the system over the course of a single period.
For the single-server queue, these estimates take a particularly simple form. Let \(\bar{\lambda }\) be the average arrival rate in a time period and \(\bar{\mu }\) be the average departure rate. Then an asymptotic estimate for the probability that there are n in the queue at time t is given by \(\pi _n(t)\approx f(t)\left( \frac{\bar{\lambda }}{\bar{\mu }}\right) ^n\). For constant rates, the formula is exact and \(f(t)=\pi _0=1-\frac{\bar{\lambda }}{\bar{\mu }}\). In general, f(t) depends on \(\pi _0(t)\). Given \(\pi _0(t),\) f(t) can be easily computed for any stable periodic \(M_t/M_t/1\) queue. Similar formulas can be developed using this approach for more complex quasi-birth-and-death processes.
In Sect. 2, we find the transient solution of the \(M_t/M_t/1\) queue up to an integral equation. In Sect. 2.1, we find the generating function for the single-server queue with periodic rates and use that to find the asymptotic periodic distribution of the number in the system in terms of an integral equation. In Sect. 2.2, we obtain asymptotic estimates for the distribution of the number in the queue at time t within the period. Section 2.3 provides numerical examples for the single-server queue with time-varying transition rates. In Sect. 3 we find similar quantities for the multi-server queue with time-varying transition rates. In Sect. 4, we illustrate the method for another type of queue.
2 \(M_t/M_t/1\) Queue Example
Consider a single-server queue with time-varying arrival and departure rates. Let \(X_t\) represent the number in the queue at time t, and let \(X_s=i\) give the length of the queue at some given initial time s. Define \(p_{i,n}(t)=P\{X_t=n|X_s=i\}\).
We have the Chapman–Kolmogorov equations:
with \(p_{i,n}(s)=\delta _{i=n}\) for some initial time s. We define the generating function \(P(z,s,t)=\sum _{n=0}^\infty z^n p_{i,n}(t)\), then P(z, s, t) satisfies the ordinary differential equation:
This has solution
where \(\varPhi (z,u,t)\) is defined below. Note that since \(p_{i,n}(s)=\delta _{i=n}\), \(P(z,s,s)=z^i.\)
We define the randomized random walk, \(Y_t\) with jumps to the left occurring at rate \(\mu (t)\) and to the right at rate \(\lambda (t)\). Let
and
then
where \(I_n(\cdot )\) is the modified Bessel function of the first kind. We denote the generating function for \(Y_t\) as \(\varPhi _Y(z,s,t)\) with
Furthermore, we define
Note that \(\phi _n(s,t)\) does not depend on i, the location of the random walk at time s.
\(\varPhi _Y(z,s,t)\) is the solution of the evolution equation:
and
We will use the notation \([z^n](A(z))\) to represent the coefficient \(a_n\) of \(z^n\) in the series \(A(z)=\sum _n a_n z^n\) (see Flajolet and Sedgewick [1]). The transient solution for the single-server queue with time-varying transition rates is then given by
To find \(p_{i,0}(u)\), we solve the Volterra equation
2.1 Periodic
Now suppose transition rates are periodic with period one. In this case, we use \(\pi _n(t)\) to designate the asymptotic periodic probability of n in the queue at time t rather than \(p_{i,n}(t)\) for the transient probability. We wish to solve directly for the asymptotic periodic solution. In that case, \(P(z,t-1,t)=P(z,t-1,t-1)\), so
Now,
and
so
Although we have an explicit formula for \(\phi _n(u,t+k)=P\{Y(u,t+k)=n\}\), computation of these quantities is very cumbersome and in general convergence is slow.
In the next section, we describe asymptotic methods for approximating these infinite sums.
2.2 Asymptotic Methods
Define \(\bar{\lambda }=\varLambda (0,1)=\int _{t-1}^t\lambda (u)du\) and \(\bar{\mu }=M(0,1)=\int _{t-1}^t\mu (u)du\). These represent the expected number of steps to the right (\(\bar{\lambda }\)) or to the left (\(\bar{\mu }\)) during one period for the random walk \(Y_t\). We have zeros in the denominator of equation (14.1), where
This expression has two zeros: \(z=1\), and \(z=\bar{\mu }/\bar{\lambda }\). \(z=1\) is a root of both the numerator and the denominator, so we factor it out:
We can rewrite this as
This is suggestive of the relation between the asymptotic periodic solution for the queue with time-varying parameters and the steady-state solution for the constant rate queue which is given by
To obtain the asymptotic estimate, we use the following result (see [1, p. 228, IV.2]):
So
Hence an asymptotic estimate is given by
We have shown that
where
Note that, if \(\mu (t)=\bar{\mu }\) and \(\lambda (t)=\bar{\lambda }\), the expression simplifies to
If we let \(\alpha (z)=\bar{\lambda }(z-1)+\bar{\mu }(z^{-1}-1)\), then we obtain
This has Maclaurin series in \(\alpha \) of
where the \(B_n\)’s are the Bernoulli numbers. See, for example, [6, p. 289]. Additional terms of an asymptotic expansion for the number in queue may be obtained using this expansion, since as \(z\rightarrow \bar{\mu }/\bar{\lambda }\), \(\alpha \rightarrow 0\). In what follows, we will use the asymptotic estimate given in Eq. (14.3).
2.3 Numerical Examples for the \(M_t/M_t/1\) Queue
We consider several numerical examples:
Examples | 1 | 2 | 3 |
---|---|---|---|
Arrival rate \(\lambda (t)\) | \(3-2\cos (2\pi t)\) | \(0.3-0.2\cos (2\pi t)\) | \(3-2\cos (2\pi t)\) |
Departure rate \(\mu (t)\) | \(4+2\cos (2\pi t)\) | \(0.4+0.2\cos (2\pi t)\) | \(4 - 2\cos (2\pi t)\) |
\(\bar{\lambda }\) | 3 | 0.3 | 3 |
\(\bar{\mu }\) | 4 | 0.4 | 4 |
\(\rho =\frac{\bar{\lambda }}{\bar{\mu }}\) | 0.75 | 0.75 | 0.75 |
Examples | 4 | 5 | 6 |
---|---|---|---|
Arrival rate \(\lambda (t)\) | \(3.6-2.8\cos (2\pi t)\) | \(0.36-0.28\cos (2\pi t)\) | \(0.4-0.3\cos (2\pi t)\) |
Departure rate \(\mu (t)\) | \(4+2\cos (2\pi t)\) | \(0.4+0.2\cos (2\pi t)\) | \(4 - 2\cos (2\pi t)\) |
\(\bar{\lambda }\) | 3.6 | 0.36 | 0.4 |
\(\bar{\mu }\) | 4 | 0.4 | 4 |
\(\rho =\frac{\bar{\lambda }}{\bar{\mu }}\) | 0.9 | 0.9 | 0.1 |
These examples collectively illustrate the convergence behavior toward theasymptotic estimates for the probabilities of the number in queue for three different traffic intensities: \(\rho =0.75\) (examples 1–3), \(\rho =0.9\) (examples 4–5), and \(\rho =0.1\) (example 6); for different rates and for arrival and service intensities that move together or do not. For each of the examples, the convergence to the asymptotic estimate is fairly rapid. The behavior of periodic probabilities for some sets of parameters is close to the constant rate steady state probabilities, but for other examples (those with greater rates), the probabilities show greater variability within the period (Fig. 1).
For each of these six examples, we provide two graphs. One shows the asymptotic periodic probabilities of having j in the queue for \(j=\) 0–5 (solid lines) compared to the asymptotic estimate of the probability shown as dashed lines. The second graph shows the estimate for the function f(t) used in the asymptotic estimates for each of probabilities zero to five compared to the exact f(t), where f(t) is given in Eq. (14.4). As the number in the queue increases, it can be seen that the quality of the asymptotic estimate improves (Fig. 2).
3 Example: Multi-server Queue
Next, we consider the multi-server queue with time-varying periodic rates and c servers. The analysis parallels the analysis for the single-server queue (Fig. 3).
We have the Chapman–Kolmogorov equations
We define the generating function \(P(z,s,t)=\sum _{n=0}^\infty z^n p_{i,n}(t)\). The function P(z, s, t) satisfies the ordinary differential equation
In line 1 on the right-hand side of the preceding equation, we replace the infinite sum with the generating function for the number in queue. In lines 2 and 3, we add and subtract like quantities so that we can rewrite the expressions in terms of the generating function for the number in queue:
We replace the series in lines 2 and 3 of the right-hand side of the previous equation with the generating function for the number in queue:
This differential equation has solution
where we denote the generating function for \(Y_t\) as \(\varPhi _Y(z,s,t)\) and
\(\varPhi _Y(z,s,t)\) is the solution of the evolution equation
and
The transient distribution for number in queue is given by
Let
and
Define the matrix function \(\mathbf{K}(s,t)\)
where \(\mathbf{k}_j(u,t)\) is the column vector
Then
and
To compute these transient probabilities, we discretize each component of the matrix function \(\mathbf{K}(s,t)\) so that we have a matrix of matrices. Let m be the mesh size, then we weight each component matrix by \(\frac{1}{m}\).
In the case where transition rates are periodic only the first m rows of each component matrix need be computed. Subsequent blocks of m rows are equal to preceding blocks shifted m columns to the right. We also weight the diagonal and the top row of each component matrix by \(\frac{1}{2}\). These weights allow us to use matrix multiplication to apply the trapezoidal rule of numerical integration to solve for the transient probabilities (Fig. 4).
3.1 Periodic
Now suppose transition rates are periodic with period one. In this case, we use \(\pi _n(t)\) to designate the asymptotic periodic probability of n in the queue at time t rather than \(p_{i,n}(t)\) for the transient probability. We wish to solve directly for the asymptotic periodic solution. In that case, \(P(z,t-1,t)=P(z,t-1,t-1)\), so
The coefficient on \(z^j\) gives us the following integral formula for the periodic probability, \(\pi _j(t)\), of j in the queue at time t within the period:
We have zeros in the denominator of equation (14.5), where
This expression has two zeros: \(z=1\), and \(z=c\bar{\mu }/\bar{\lambda }\). The value \(z=1\) is a root of both the numerator and the denominator, so we factor it out:
We can rewrite this as
An asymptotic estimate is then given by
We may estimate \(\pi _j(t)\) as
where
The resulting expression for f(t) in the multi-server case is analogous to that in the single-server case in Eq. (14.4). For a c server queue, the expression depends on the first c periodic probabilities for number in queue. The expression reduces to the single-server expression when \(c=1\). The queue length probabilities are asymptotically geometric with rate \(\frac{\bar{\lambda }}{c\bar{\mu }}\).
4 Example: The Queue with Transitions of Size One and Two
For this queueing system, the classical single-server queueing system, M / M / 1 is generalized to allow transition rates of size two in addition to the standard transition rates of size one (Fig. 5).
In terms of the queueing models, these systems each allow customers to arrive or be served instantly in pairs as well as individually (Fig. 6).
Krinik and Shun [2] have derived the steady-state distributions explicitly and determined a condition for the existence of a steady-state distribution. Assuming that a steady-state condition prevails, they determined the canonical performance measures, including expressions for the average number of customers in either system or queue. They also derived formulae for the average waiting time that a customer spends in the system or queue.
In this example, we generalize their model to allow transition rates to vary periodically with period of length one.
We have the Chapman–Kolmogorov equations with \(\beta (t)\) and \(\gamma (t)\) giving the rates at which transitions of size two occur:
We define the generating function \(P(z,t)=\sum _{n=0}^\infty z^n p_{i,n}(t)\). Then we have
This has solution
where
and \(X_t\) and \(Y_t\) are the randomized random walks. For the walk \(X_t\) steps to the right occur at rate \(\beta (t)\) and to the left at rate \(\gamma (t)\). For the walk \(Y_t\) steps to the right occur at rate \(\lambda (t)\) and to the left at rate \(\mu (t)\). \(\varPhi _X(z,s,t)\) and \(\varPhi _Y(z,s,t)\) are the generating functions for the randomized random walks \(X_t\) and \(Y_t\), respectively. Expanding the generating function in terms of coefficients on \(z^n\), we have
Assume that \(p_{i,j}(s)=\delta _{j=i}\). Matching coefficients on \(z_n\), we see that
and more generally
Now suppose that transition rates are time-varying and periodic. Further suppose that our generating function is for the asymptotic periodic distribution of the number in the system. Then we have the generating function
and
and more generally
These expressions are difficult to evaluate numerically. So as in the \(M_t/M_t/1\) example, we apply an asymptotic estimate of the transition probabilities.
The first step is to factor out \(z-1\) since one is a root of both the numerator and the denominator. Second, we follow Krinik and Shun and find the roots of the denominator. Then following the approach outlined by Sedgewick and Flajolet [1], we approximate the integrand as a sum of geometric series. We will need to do a partial fractions decomposition.
Factorization of the numerator of Eq. (14.9) by \(z-1\) yields
The denominator is zero when \(\varPhi (z,t-1,t)=1\), that is, when
One root occurs at \(z=1\):
Factorization of the denominator of equation (14.9) by \(z-1\) yields
There are three other real roots of the denominator. These were computed by Krinik and Shun [2, Lemma 1.1]. Their reciprocals are given by
where \(U=\frac{a^2-3b}{9}\), \(V=\frac{2a^3-9ab+27c}{54}\), \(\theta =\cos ^{-1}\left( \frac{V}{\sqrt{U^3}}\right) \), \(a=\frac{\bar{\mu }+\bar{\gamma }}{\bar{\gamma }}\), \(b=-\frac{\bar{\beta }+\bar{\gamma }}{\bar{\gamma }}\), \(c=-\frac{\bar{\beta }}{\bar{\gamma }}\) and \(\frac{1}{r_1}<-1<\frac{1}{r_2}<0<\frac{1}{r_3}\).
We are considering stable queues, so \(r_1\) is also a root of the numerator. We apply a partial fractions decomposition to
Define
So we may write our asymptotic estimate as
This solution is analogous to that obtained by Krinik and Shun for the steady-state distribution. They had
for constants \(c_2\) and \(c_3\) which they give explicitly in their paper [2].
5 Asymptotic Estimates for Level Independent Quasi-Birth-Death Processes
The same method can be used to obtain estimates for the level distribution for QBDs with level independent transitions. Such QBDs will have infinitesimal generator with block tri-diagonal structure:
where \(\mathbf{A}_{-1}(t)\), \(\mathbf{A}_0(t)\), \(\mathbf{A}_1(t)\) and \(\mathbf{B}(t)\) are square matrices of order m, and m represents the number of phases.
We partition \(\varvec{\pi }(t)\) by levels into subvectors \(\varvec{\pi }_n(t),\) \(n\ge 0\), where \(\varvec{\pi }_n(t)\) has m components. The QBD system satisfies the Chapman–Kolmogorov forward equations
with the additional requirement that
For periodic rates with period of length one, if stability conditions are met, there will be a solution of the Chapman–Kolmogorov equations such that
\(k\in \mathbb {Z}\).
The generating function for the random walk corresponding to this QBD satisfies
where \(\phi _n(s,t)\) is an \(m\times m\) matrix of transition probabilities. The (i, j) component represents the probability of traveling to phase j by time t and remaining there until at least time t and traveling to a level n units to the right of the level occupied at time s given that the random walk process was in phase i at time s. For more details on the set up and analysis of such systems with time-varying periodic transitions, see [4] or [5]. For more background on quasi-birth-death processes in general see [3].
The generating function for the levels of the QBD solves the differential equation
so
and for the periodic case with period 1,
There will be poles in the determinant of the matrix \(\left( \mathbf{I}-\varPhi (z,t-1,t)\right) \). These poles will reveal the geometric behavior of the level distribution.
6 Conclusion
This approach to the analysis of time-varying queues with periodic transition rates offers considerable promise for improving the understanding of the behavior of such systems. In particular, it shows that such queues are asymptotically geometric in the queue length distribution. Future work will involve extending these results and further analyzing quasi-birth-and-death problems that fit this framework. For scalar queueing models, computation of the roots is straightforward. For quasi-birth-and-death processes, computation of the roots is feasible in special cases, but is challenging for general QBDs.
References
Flajolet, P., Sedgewick, R.: Analytic Combinatorics. Cambridge University Press, Cambridge (2009)
Krinik, A.C., Shun, K.: Markov processes with constant transition rates of size one and two. J. Stat. Theory Pract. 5(3), 475–495 (2011)
Latouche, G., Ramaswami, V.: Introduction to Matrix Analytic Methods in Stochastic Modeling. ASA-SIAM Series on Statistics and Applied Probability, vol. 5. Society for Industrial and Applied Mathematics (1999)
Margolius, B.H.: Transient and periodic solution to the time-inhomogeneous quasi-birth process. Queueing Syst. 56(3–4), 183–194 (2007)
Margolius, B.H.: The matrices \(R\) and \(G\) of matrix analytic methods and the time-inhomogeneous periodic quasi-birth-and-death process. Queueing Syst. 60(1–2), 131–151 (2008)
Paulsen, W.: Asymptotic Analysis and Perturbation Theory. A Chapman and Hall book, Taylor and Francis (2014)
Schwarz, J.A., Selinka, G., Stolletz, R.: Performance analysis of time-dependent queueing systems: Survey and classification. Omega 63, 170–189 (2016)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Margolius, B. (2019). Asymptotic Estimates for Queueing Systems with Time-Varying Periodic Transition Rates. In: Andrews, G., Krattenthaler, C., Krinik, A. (eds) Lattice Path Combinatorics and Applications. Developments in Mathematics, vol 58. Springer, Cham. https://doi.org/10.1007/978-3-030-11102-1_14
Download citation
DOI: https://doi.org/10.1007/978-3-030-11102-1_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-11101-4
Online ISBN: 978-3-030-11102-1
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)