Abstract
In this paper we consider an \(M/GI/\infty \) queueing system operating in a semi-Markovian random environment. That is, the arrival rate and service-time distribution change according to the external semi-Markov process state transitions. The service policy subject to environment transitions is as follows: the service-time distribution of the present customers does not change until their service is finished. The purpose of our study is to obtain the probability distribution of the number of customers in the system under asymptotic condition of high arrival rate and frequent environment transitions. To do this, we first apply the method of supplementary variable and the original method of dynamic screening to our system. We then conduct the asymptotic analysis of the system to obtain the discrete probability distribution.
Access provided by Autonomous University of Puebla. Download conference paper PDF
Similar content being viewed by others
Keywords
- Queueing theory
- Random environment
- Semi-Markov process
- Method of dynamic screening
- Method of asymptotic analysis
1 Introduction
Queueing systems subject to external stochastic influences such as Markov modulation and random environment are of considerate interest in scientific literature. Such influences are often represented as system breakdowns or arrivals of priority customers (including batch arrivals) that force the system to behave at a different mode. Namely, several cases of Markov-modulated single-server queues are studied in [1]. Represented as a road subject to traffic incidents, the \(M/M/\infty \) system operating under batch partial failures is considered in [2]. The random environment is assumed to have only two states: when there is an incident and when there are no incidents on the road. In [4], authors consider a more general case of \(M/M/\infty \) queue in Markovian random environment with arbitrary finite number of states. The expression for steady-state factorial moments is obtained. In [5], the analysis of \(M/G/\infty \) system in Markovian random environment is given. As a result, transient mean and stationary variance of the number of customers present in the system are obtained; a deeper analysis of exponential service case is conducted; the asymptotic normality of the number of customers probability distribution is shown under conditions of high arrival rate and frequent environment transitions due to the central limit theorem. In turn, the steady-state mean number of customers in \(M/M/\infty \) in semi-Markovian random environment is obtained in [7] as well as the steady-state distribution of the number of customers for the environment with 2 states.
Depending on the model application, different service policies of present customers with respect to environment transition may be considered. For instance, in one of the earliest papers [3] a single-server queue with general service-time is considered subject to interruptions with generally distributed durations. Two different cases of customer behavior after interruption clearance are studied: first, the resume policy, when the service is continued as it was left before the interruption; second, the repeat policy, when the service starts over. In [10, 11], the \(M/G/\infty \) system in semi-Markovian random environment is studied. These papers cover three cases of the present customers’ reaction to environment state transitions. The first one is considered in the present paper — service-time distribution stays the same while the customer is in the system. This policy is also assumed in [5]. In the second case all customers are immediately cleared from the queue as environment state transition happens. The last case considers customers in service moving to a secondary queue which is an infinite-server system with bulk arrivals. This case is specifically analyzed in [10], and as a result the steady-state mean number of customers in the secondary queue is obtained.
Infinite-server queues are often used to approximate the behavior of systems with sufficiently large number of servers, such as banks, call-centers, supermarkets or digital distribution platforms. Such objects in reality are often affected by extraneous factors of stochastic nature which affect their performance. For instance, the change of bank rate set by the Central bank affects the conditions under which commercial banks give loans to their clients. These, in turn, significantly influence the intensity of clients’ arrival. In this article we consider a mathematical model of such situation as an \(M/GI/\infty \) queue operating in a random environment, for which the underlying process is a semi-Markov process with finite number of states. The arrival rate and service-time distribution change according to the environment state. Note that distribution of service-time customers which are currently being served does not change until the service-time is finished. Say the bank provided a credit to the client on certain conditions and during the repayment period there was a change of bank rate. The client will continue to repay his debt on those initial conditions — as mentioned in a loan agreement.
2 Problem Statement
We consider an \(M/GI/\infty \) queueing system operating in semi-Markovian random environment. The system under discussion is an infinite-server queue with one stationary Poisson arrival process with parameter \(\lambda _sN\) and the unlimited number of servers each having service-time distribution function \(B_s(x)\), \(s = \overline{1,K}\). We use a large parameter N that represents the condition of high arrival rate. Here \(s=\overline{1,K}\) is the current state of a semi-Markov stochastic process s(t) defined by the matrix product \(\mathbf {P\cdot A}(x)\). The matrix \(\mathbf {P}\) here is a probability matrix of s(t) state transitions and \(\mathbf {A}(x)\) is a diagonal matrix with conditional sojourn time cdfs for every state \(s = \overline{1,K}\) of s(t) on its main diagonal. As there is always a free server in the system, there is no queue or loss option and each arriving customer is immediately placed at any free server and stays there for random time with distribution function \(B_s(x)\). Note that we study the case when service-time distribution of a customer which is currently being served does not change until its service is finished.
That being said, for considered model we define a two-component process \(\left\{ i(t), s(t)\right\} \), where i(t) with values \(i\ge 0\) is the number of customers in the system at time t. Apparently, this process is non-Markovian. To deal with it, we first apply the original method of dynamic screening and the method of supplementary variable.
3 Method of Dynamic Screening
The method of dynamic screening can be used for the analysis of both queueing systems and networks. Further applications may be found in [14–16]. We apply this method to our system in the following way.
Given that at a certain time \(t_0\) the system is empty, we pick a moment T and track the customer arrivals during the time interval \((t_0, T)\). The customer will be referred to as “screened” at time t with probability
if it arrived at the system at time \(t < T\) and was not fully serviced until the time T. Thus, the screened customers will be in the system taking up its servers at time T.
Let us denote by n(t) the number of customers that were screened until time t. Stochastic process n(t) is a screened point process with its points being the screened customers. The following identity always takes place:
We need to choose time \(t_{0}\) so that at all times \(t < t_0\) there are no screened customers, i.e.
Since \(B_s(x)\) is a cumulative distribution function, it is obvious enough to put \(t_0 = -\infty \).
We write the possible state transitions of n(t) and their probabilities assuming \(n(t) = n, n \ge 0\) as follows:
Equality (1) allows us to analyze a point process n(t) instead of i(t). Characteristics of the process n(t) at time T coincide with the characteristics of value i(T).
4 Kolmogorov Differential Equations
In order to deal with semi-Markovian process s(t), we first need to apply the method of supplementary variable. We define z(t) as residual sojourn time of s(t) process in the current state, i.e. the interval from t until the next environment transition. It follows that the three-dimensional process \(\left\{ s(t), n(t), z(t)\right\} \) is a Markovian one. Therefore, we define the probabilities of system and environment state at time t as follows:
Here the big parameter N justifies the condition of frequent environment transitions that compensates high arrival rate. The matrices that define the process s(t) are determined as follows:
Let \(\tau _s\) be the sojourn time of s(t) in state \(s = \overline{1, K}\). Then functions \(A_s(x)\) are defined in the following way:
which means that \(A_s(x)\) are the distribution functions of N-fold sojourn time of s(t) in state \(s = \overline{1, K}\).
The system of Kolmogorov differential equations that defines the probabilities (2) is written as follows:
Here we use the denotation
Provided \(z \rightarrow \infty \), the initial condition to such system’s solution is defined as follows:
Here r(s) are the stationary probabilities of embedded Markov chain states of s(t), \(s = \overline{1, K}\). The partial characteristic functions of the process \(\left\{ s(t), n(t), z(t)\right\} \) are defined as follows:
Here \(j = \sqrt{-1}\) is the imaginary unit. We rewrite the system (4) using partial characteristic functions in the following way:
We then use the following vector and matrix denotations:
to rewrite the system (4) as follows:
Here \(\mathbf {I}\) is the identity matrix. Our goal is to obtain the solution to system (6) as \(z \rightarrow \infty \) that satisfies the initial condition derived from (4):
The row vector \(\mathbf {r}\) here is the stationary probability distribution of the embedded Markov chain of the process s(t) and solves the following system of matrix-vector equations:
5 Method of Asymptotic Analysis
Method of asymptotic analysis for queueing systems is the analysis of equations that define any of the system’s characteristics or parameters [13]. It allows us to obtain the explicit distribution, parameters and moments under certain asymptotic conditions.
We obtain the solution to system (6) under asymptotic conditions of high arrival rate and frequent environment transitions, that is, as \(N\rightarrow \infty \).
5.1 First-Order Asymptotic Analysis
Let us define substitutions for system (6) as follows:
Then (6) can be rewritten as
As \(\varepsilon \rightarrow 0\), the following equality holds:
We then represent the function \(\mathbf {F}_1(w, z, t)\) as a product
Substitution (11) applied to (10) gives the following equation that defines row-vector \(\mathbf {r}(z)\):
To determine the value \(\mathbf {r}'(0)\), we make the following substitution
Note that according to (8)
Apparently, the matrix \(\mathbf {A}\) here is the diagonal matrix containing means \(A_s, s = \overline{1, K}\) of distribution functions from \(\mathbf {A}(x)\) on its main diagonal. According to (8), the constant C is derived as follows:
Finally, we write the expression for \(\mathbf {r}(z)\):
Note that
Now we set \(z = \infty \) in (5.1) and make substitution (11):
Post-multiplication by \(\mathbf {e}\) of both parts of the latter equation gives us the following first-order ordinary differential equation:
As \(\varepsilon \rightarrow 0\), the function \(\varPhi _1(w, t)\) that solves the equation above and satisfies the initial condition derived from (7) is as follows:
Finally, we can write
where \(w = Nu\). It follows that
Since (1) takes place, we can finally conclude:
Let us calculate the value \(\kappa _{1}(T)\):
where \(b_s\) are the service-time means, \(s=\overline{1, K}\). Thus
where \(\mathbf {B}\) is a diagonal matrix containing service-time means \(b_s\).
5.2 Second-Order Asymptotic Analysis
In the equation (6) we make a substitution
The function \(\mathbf {H}_2(u, z, t)\) here is the centered characteristic function as the following relation takes place:
The substitution (15) yields an equation which defines \(\mathbf {H}_2(u, z, t)\):
We rewrite the latter system using substitutions
in the following way:
As \(\varepsilon \rightarrow 0\), the following relation takes place:
It follows that the function \(\mathbf {F}_2(w, z, t)\) may be represented as follows:
In turn, the function \(\mathbf {F}_2(w, z, t, \varepsilon )\) may be approximated with the following expression:
The row-vector function \(\mathbf {f}_2(z, t)\) is to be defined. To do this, first we make a substitution (19) in the system (17). We also make the following approximation in (17):
and then set \(\varepsilon \rightarrow 0\). These manipulations yield us the following equation that defines \(\mathbf {f}_2(z, t)\):
Here \(\mathbf {0}\) is the row-vector filled with zeros. It follows that as \(z\rightarrow \infty \), we have the relation
The right part of the latter relation is the improper integral. In order for it to converge, it is necessary that the integrand function converges to 0 as the variable of integration approaches \(\infty \). That is, the following relation stands for \(\mathbf {f}_2(0, t)\):
The equation above is the non-homogeneous underdetermined system of linear equations. We represent its solution as a sum of general solution to homogeneous system and a partial solution to non-homogeneous system:
where c(t) is an arbitrary scalar function of t. We write the additional condition for the function \(\mathbf {g}(t)\) as follows:
Let us now define the explicit expression for (21):
Note that \(\mathbf {A}^{-1}\int \limits _{0}^{z}\left[ \mathbf {I - A}(x)\right] dx\) is a diagonal matrix that contains distribution functions of both elapsed and residual sojourn time of s(t) at each of its states. Then denoted by \(\mathbf {\overline{A}}\) is the diagonal matrix that contains means of such cdfs respectively. Finally, we rewrite the expression for \(\mathbf {f}_2(t)\) as follows:
Now we show that the row-vector function \(\mathbf {f}_2(t)\) does not actually depend on the arbitrary scalar function c(t) that is present in (23). To do that, we consider the following term that is present in (25):
With (8) and \(a = \mathbf {rAe}\) in mind, we conclude that the two latter terms cancel each other. Thus, the function c(t) is not present in (25).
Now let us determine the function \(\varPhi _2(w, t)\). For this purpose, we again make substitution (19) in (17) and also the following approximation:
As \(\varepsilon \rightarrow 0\) and \(z\rightarrow \infty \), this yields us the first-order ODE that defines \(\varPhi _2(w, t)\):
Its solution that satisfies the initial condition derived from (7) is of the following form:
where
Thus, the expression for the centered characteristic function \(\mathbf {H}_2(u, t)\) is obtained and is written as follows:
It follows that
Considering (1), the following identities are true:
where \(\kappa _{2}(T)\) is of the following form:
According to the definition of functions \(S_s(t) = 1 - B_s(T - t)\) it is clear that \(\lim \limits _{t\rightarrow \infty }S_s(t) = 0, s = \overline{1, K}\). Therefore, it is clear that the improper integral (32) is converging and thus can be calculated numerically given specific system and environment parameters.
Obviously, the asymptotic steady-state probability distribution of the number of customers in the system defined by (31) is normal with first and second cumulants \(\kappa _{1}(t)N\) and \(\kappa _{2}(t)N\) respectively. It is known that
Inverse Fourier transform of (31) gives the probability density function of the normally distributed random variable:
It is necessary to switch from this continuous distribution to discrete as follows:
where the constant value C is defined considering the normalizing condition:
Due to (36), C is given as follows:
6 Conclusion
Thus, the Gaussian approximation of the probability distribution of the number of customers in the system \(M(\lambda _s)/G(B_s(x))/\infty \) is obtained during the asymptotic analysis under conditions of high arrival rate and frequent environment transitions. Using the method of dynamic screening, we considered a non-stationary Markov point process n(t) instead of non-Markovian i(t) which is the number of customers in the system. Then, according to the method of supplementary variable we defined the residual sojourn time z(t) in the present state of the environment process s(t) to be able to analyze it with theory of Markov processes tools. After deriving the system of differential equations in terms of vector characteristic functions of the number of customers in the system, we conducted the asymptotic analysis of the system in question.
Earlier we considered a problem of \(M/G/\infty \) queue operating in Markovian random environment with the same service policy when service-time distribution does not change while the customer is in the system. Similarly, we obtained the steady-state probability distribution of the number of customers in the system. However, the Markov case narrows down the application area significantly. Thus, in this paper we considered a more general case with random environment being semi-Markovian.
References
Prabhu, N.U., Zhu, Y.: Markov-modulated queueing systems. Queueing Syst. 5, 215–245 (1989)
Baykal-Gursoy, M., Xiao, W.: Stochastic decomposition in \(M/M/\infty \) queues with Markov modulated service rates. Queueing Syst. 48, 75–88 (2004)
Keilson, J.: Queues subject to service interruption. Ann. Math. Statist. 33, 1314–1322 (1962)
O’Cinneide, C.A., Purdue, P.: The \(M/M/\infty \) queue in a random environment. J. Appl. Prob. 23, 175–184 (1986)
Blom, J., Kella, O., Mandjes, M., Thorsdottir, H.: Markov-modulated infinite-server queues with general service times. Queueing Syst. 76, 403–424 (2014)
D’Auria, B.: \(M/M/\infty \) queues in semi-Markovian random environment. Queueing Syst. 58, 221–237 (2008)
Falin, G.: The \(M/M/\infty \) queue in random environment. Queueing Syst. 58, 65–76 (2008)
Fralix, B.H., Adan, I.J.B.F.: An infinite-server queue influenced by a semi-Markovian environment. Queueing Syst. 61, 65–84 (2009)
D’Auria, B.: Stochastic decomposition of the \(M/G/\infty \) queue in a random environment. Oper. Res. Lett. 35, 805–812 (2007)
Purdue, P., Linton, D.: An infinite-server queue subject to an extraneous phase process and related models. J. Appl. Prob. 18, 236–244 (1981)
Linton, D., Purdue, P.: An \(M/G/\infty \) queue with \(m\) customer types subject to periodic clearing. Opsearch 16, 80–88 (1979)
Nazarov, A.A., Baymeeva, G.V.: The study of \(M/G/\infty \) in random environment
Nazarov, A.A., Moiseeva, S.P.: Method of Asymptotic Analysis in Queueing Theory. NTL, Tomsk (2006) (in Russian)
Nazarov, A.A., Moiseev, A.N.: Analysis of an open non-Markovian \(GI-(GI|\infty )^{K}\) queueing network with high-rate renewal arrival process. Prob. Inf. Transm. 49, 167–178 (2013)
Moiseev, A.N., Nazarov, A.A.: Asymptotic analysis of a multistage queuing system with a high-rate renewal arrival process Optoelectronics. Instrum. Data Process. 50(2), 163–171 (2014)
Moiseev, A., Nazarov, A.: Asymptotic analysis of the infinite-server queueing system with high-rate semi-Markov arrivals. In: IEEE International Congress on Ultra Modern Telecommunications and Control Systems (ICUMT 2014), pp. 507–513. IEEE Press (2014)
Acknowledgments
The work is supported by Tomsk State University Competitiveness Improvement Program.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Nazarov, A., Baymeeva, G. (2015). The \(M/GI/\infty \) System Subject to Semi-Markovian Random Environment. In: Dudin, A., Nazarov, A., Yakupov, R. (eds) Information Technologies and Mathematical Modelling - Queueing Theory and Applications. ITMM 2015. Communications in Computer and Information Science, vol 564. Springer, Cham. https://doi.org/10.1007/978-3-319-25861-4_11
Download citation
DOI: https://doi.org/10.1007/978-3-319-25861-4_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-25860-7
Online ISBN: 978-3-319-25861-4
eBook Packages: Computer ScienceComputer Science (R0)