On the sojourn of an arbitrary customer in an $M/M/1$ Processor Sharing Queue
Fabrice Guillemin, Veronica Quintuna Rodriguez

TL;DR
This paper analyzes the distribution of arrivals and departures seen by a tagged customer in an M/M/1 processor sharing queue, revealing their equality in distribution and asymptotic behavior, with implications for queue approximation methods.
Contribution
It derives the distributions of arrivals and departures seen by a tagged customer and proves their equality, providing insights into queue behavior and approximation validity.
Findings
Distributions of arrivals and departures are equal in the queue.
Asymptotic behavior of the common distribution is characterized.
The approximation assuming random service among residual busy period is validated.
Abstract
In this paper, we consider the number of both arrivals and departures seen by a tagged customer while in service in a classical processor sharing queue. By exploiting the underlying orthogonal structure of this queuing system revealed in an earlier study, we compute the distributions of these two quantities and prove that they are equal in distribution. We moreover derive the asymptotic behavior of this common distribution. The knowledge of the number of departures seen by a tagged customer allows us to test the validity of an approximation, which consists of assuming that the tagged customer is randomly served among those customers in the residual busy period of the queue following the arrival of the tagged customer. A numerical evidence shows that this approximation is reasonable for moderate values of the number of departures, given that the asymptotic behaviors of the…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
On the sojourn of an arbitrary customer in an Processor Sharing Queue
Fabrice Guillemin and Veronica Quintuna
Orange Labs2, CNC/NCA, Avenue Pierre Marzin, 22300 Lannion, France
Abstract.
In this paper, we consider the number of both arrivals and departures seen by a tagged customer while in service in a classical processor sharing queue. By exploiting the underlying orthogonal structure of this queuing system revealed in an earlier study, we compute the distributions of these two quantities and prove that they are equal in distribution. We moreover derive the asymptotic behavior of this common distribution. The knowledge of the number of departures seen by a tagged customer allows us to test the validity of an approximation, which consists of assuming that the tagged customer is randomly served among those customers in the residual busy period of the queue following the arrival of the tagged customer. A numerical evidence shows that this approximation is reasonable for moderate values of the number of departures, given that the asymptotic behaviors of the distributions are very different even if the exponential decay rates are equal.
Key words and phrases:
Sojourn time; Processor Sharing, etc.
Key words and phrases:
Processor Sharing, queue, sojourn time, asymptotic analysis
1. Introduction
The processor sharing (PS) policy is a well known service discipline, which was introduced in the 1960’s by Kleinrock [9] in the performance evaluation of computer networks (see also [10]). With this service discipline, jobs in the queue are served in an egalitarian way. Thus, if there are jobs in the queue, each job receives the fraction of the server capacity. The -PS queue has been studied in the queuing literature by several authors, see for instance [13, 15, 16], who computed the Laplace transform of the sojourn time of a tagged customer conditioned on the service time. For the specific case of the queue, it is possible to obtain an explicit expression of the sojourn time distribution of an arbitrary customer [3, 12]. In [6], an orthogonal structure involving Pollaczek polynomials was introduced to solve the infinite differential system satisfied by the vector composed of the distributions of the sojourn time of a customer conditioned on the number of customers in the system upon arrival. The -PS system has then been further extended to account of permanent customers [2, 8, 17].
From a practical point view, the processor sharing discipline has gained renewed interest in the study of resource sharing in the Internet. As a matter of fact, the PS discipline can be used to model how TCP connections share the bandwidth of a bottleneck in a packet network [11]. More recently, in the context of cloud platforms, the processor sharing can reflect how the capacity of a multi-core platform is shared among several tenants [14].
In this paper, instead of directly computing the distribution of the sojourn time of a customer, we study the number of both arrivals and departures seen by a tagged customer while it is in service, denoted by and , respectively. We explicitly compute the distributions of these two quantities in the stationary regime. We notably establish that (equality in distribution). As a byproduct, we can recover the distribution of the sojourn time of the tagged customer in the queue. To compute the distribution of , we use the orthogonal structure underlying the -PS queue, namely Pollaczek polynomials and their associated orthogonality measure [6].
The knowledge of the distribution of allows us to easily test the accuracy of the following approximation: Since at each departure, all customers have equal chance of leaving the system, because of the memory-less property of the exponential distribution, we can suppose that when a tagged customer enters the queue, this customer is randomly served among those customers served in the residual busy period (i.e., the busy period starting at the arrival epoch of the tagged customer and ending when the queue empties). Under this assumption, we compute the distribution of the number of customers leaving the system before the tagged customer is randomly picked. Even if this approximation seems to be rough at first glance, numerical results show that is a reasonable upper bound for . The motivation for this approximation is to develop a method of approximating the sojourn time of a batch in an -PS queue. While the Laplace transform of the sojourn time of a job has been computed in [7] when batches are geometrically distributed, results for the sojourn time of an entire batch is much more challenging.
The organization of this paper is as follows: In Section 2, we introduce the model and the various random variables. In particular, these random variables are related to an absorbed Markov discrete time, whose transition matrix introduces a selfadjoint operator in an ad-hoc Hilbert space. The spectral properties of this operator are studied in Section 3 and the distributions of the random variables are computed in Section 4. Numerical results are presented in Section 5. Further research directions are discussed in Section 6.
2. Model description
We consider a classical Processor sharing queue with arrival rate and unit service rate. We assume that a tagged customer arrives at the queue at time and that there are customers in the queue upon arrival of this tagged customer. We introduce the discrete-time process describing the number of customers in the queue other than the tagged one at the departures or arrivals of customers. When the tagged customer completes its service, the process is absorbed in some state, denoted by . The index is thus the number of departures from the queue or arrivals at this queue before the process gets absorbed. We set since we assume that there are customers in the queue upon arrival of the tagged customer.
The state space of the process is and is a discrete-time Markov chain with transition matrix given by
[TABLE]
The non-null coefficients of the matrix are given by and for
[TABLE]
Let us now consider the sub-matrix of obtained by deleting the first row and the first column of matrix . The non-null coefficients of matrix are given for for by
[TABLE]
with the convention . This matrix is tridiagonal and sub-stochastic, and gives the transition probabilities of the Markov chain before absorption.
Let be the column vector with all entries equal to 0 except the -th one equal to 1. Then, for ,
[TABLE]
where is the row vector equal to the transpose of the column vector . The probability that the tagged customer leaves the system at stage and leaves customers in the queue is equal to
[TABLE]
Let denote the number of customers left in the system by the tagged customer upon service completion. We have
[TABLE]
Similarly, if we denote by the time at which the tagged customer leaves the system, we have for
[TABLE]
Finally, for and
[TABLE]
Let and respectively denote the number of arrivals (excluding the tagged customer) and departures, while the tagged customer is in the system. Assume that there are customers in the system at the arrival time of the tagged customer and customers in the system upon service completion of the tagged customer. We have
[TABLE]
so that
[TABLE]
In view of Equation (1), we see that for characterizing the distribution of the various random variables introduced above, we have to compute the resolvent of the infinite matrix , namely as well as the powers of matrix . For this purpose, we prove in the next section that this matrix induces a selfadjoint operator in some ad-hoc Hilbert space.
3. Spectral properties of matrix
3.1. Selfadjointness properties
We introduce the same real Hilbert space as in [6]. Let
[TABLE]
where . The Hilbert space is equipped with the scalar product
[TABLE]
and the norm
[TABLE]
The infinite matrix induces in an operator that we also denote by . By using the same arguments as in [6], we can easily prove the following lemma, where we use the norm of the operator defined by
[TABLE]
by definition, the operator is bounded if .
Lemma 1**.**
The operator is symmetric and bounded in and hence self-adjoint.
Proof.
The symmetry of is straightforward since it is easily checked for every , owing to the reversibility property for all .
For , we have by Schwarz inequality
[TABLE]
This implies that . ∎
3.2. Spectrum
The spectrum of the operator is defined by
[TABLE]
Since , we know that .
Let us consider some such that for some real number . By setting without loss of generality and , we have for
[TABLE]
which can be rewritten as
[TABLE]
Let us introduce the Pollaczek polynomials defined for real and by the recursion: , and for
[TABLE]
It is then easily checked that
[TABLE]
In the following, we introduce the vectors such that the -th component is
[TABLE]
For , let be such that and define
[TABLE]
The Pollaczek polynomials have the generating function defined for by
[TABLE]
these polynomials are orthogonal with respect to the weight function supported by the interval and given by
[TABLE]
such that
[TABLE]
where is the Kronecker symbol.
It follows that the polynomials are orthogonal with respect to the measure given by
[TABLE]
or equivalently for with
[TABLE]
and satisfy
[TABLE]
The polynomials have the generating function
[TABLE]
for with . The generating function satisfies the first order differential equation
[TABLE]
It is worth noting that for real
[TABLE]
In particular,
[TABLE]
With the above observations, we state the following lemma.
Lemma 2**.**
The operator has the continuous spectrum and spectral measure defined by Equation (4).
4. Computation of distributions
Let us first consider the random variables and .
Proposition 1**.**
The distribution of the random variable (i.e., the number of jobs in the system upon completion of the tagged job) conditionally on the number of jobs in the system upon arrival of the tagged job is given for by
[TABLE]
Moreover,
[TABLE]
and
[TABLE]
Proof.
By using Equation (1), we have
[TABLE]
By using the spectral identity, we have
[TABLE]
where is the projection of the vector on the vector space spanned by the vector . By using the orthogonality relation (5), we have
[TABLE]
Hence,
[TABLE]
and Equation (8) easily follows.
Similarly, we have
[TABLE]
and Equation (9) follows. Finally,
[TABLE]
and Equation (10) easily follows. ∎
It is worth noting that
[TABLE]
Let defined by
[TABLE]
so that
[TABLE]
We then have
[TABLE]
By introducing the Laplace transform of the random variable , which is the sojourn time of a tagged job entering the PS queue while there are jobs in service, we have from [6]
[TABLE]
as expected. This shows in particular that for all
[TABLE]
By using the above computations, we have the following corollary.
Corollary 1**.**
When the tagged job enters an -PS queue in the stationary regime, the number of jobs left in the system upon service completion of the tagged customer has distribution
[TABLE]
The generating function of the random variable (i.e., the time at which the tagged customer leaves the system) is given by
[TABLE]
Proof.
Since , we have
[TABLE]
where we have used Equation (11) in the last step.
Using again , we immediately obtain Equation (13). We verify that by using Equation (11). ∎
Equation (12) is consistent with the fact that in the stationary regime, the distribution of the occupancy of the queue seen by departing customers is the same as the distribution seen by arriving customers (equal to the stationary distribution owing to the PASTA property); this is a classical result in queuing theory. Moreover, the sojourn time of the tagged customer finding customers in the queue is
[TABLE]
where is a sequence of independent and identically distributed exponential random variables with mean . It follows that the Laplace transform of is
[TABLE]
By inverting the Laplace transform we eventually obtain
[TABLE]
which corresponds to Equation (15) in [6].
Corollary 2**.**
The number of arrivals at the queue while the tagged job is in service is given by
[TABLE]
and the number of departures under the same condition is such that (equality in distribution).
Proof.
Let be an integer. We have
[TABLE]
We note that is a polynomial with degree and hence owing to the orthogonality property of polynomials
[TABLE]
for that is . It follows that
[TABLE]
and Equation (14) follows by deconditioning on .
By using similar arguments, we have
[TABLE]
By using Equation (15), we deduce that
[TABLE]
for and hence
[TABLE]
so that we have . ∎
To conclude this section, let us study the asymptotic behavior of the common distribution of the random variables and . In the following, we set .
Proposition 2**.**
When tends to infinity, we have
[TABLE]
where
[TABLE]
Proof.
The idea of the proof is to show that when tends to infinity
[TABLE]
and to use the same technique as in [5] to obtain Equation (16).
By definition, we have
[TABLE]
where
[TABLE]
We clearly have
[TABLE]
Let . We can write
[TABLE]
where
[TABLE]
We first note that
[TABLE]
where we have used the normalizing condition (3). It follows that if we choose sufficiently small so that
[TABLE]
It is then easily checked that
[TABLE]
where is defined by Equation (17).
Now, we can decompose as with
[TABLE]
and
[TABLE]
By using the same arguments as above, we can show that the quantity is less than or equal to
[TABLE]
and then
[TABLE]
Because , we clearly have
[TABLE]
Finally, we have
[TABLE]
For small
[TABLE]
and
[TABLE]
By mimicking the proof in [5, Section 6], we have for large
[TABLE]
where we have set and
[TABLE]
.
Let us introduce . We have
[TABLE]
and for . In addition, . By using Laplace’s method, we obtain
[TABLE]
It follows that for large
[TABLE]
By using Equation (7), we obtain
[TABLE]
and Equation (16) follows. ∎
In the following section, we numerically compute the distribution of and we illustrate the asymptotic behavior of the tail of the distribution.
5. Numerical Experiments
5.1. Number of departures
To compute for , we use the following procedure. Since the polynomials satisfy the recursion defined by Equation (2) with and , we can represent the polynomial by a list so that
[TABLE]
where the coefficients can be recursively computed by using the fact that for and
[TABLE]
with , and .
By using the above definitions, the quantity can be expressed as
[TABLE]
where is the -th moment of the measure defined by
[TABLE]
By using the orthogonality relation (5), we have for
[TABLE]
and the moments for can be recursively computed by
[TABLE]
with .
The moment is analytically defined by
[TABLE]
It is easily checked that for odd and for even
[TABLE]
We can estimate the value of for large by using the same arguments as above and we obtain
[TABLE]
when tends to infinity.
To numerically compute the value of , we truncate the sum for ranging from 0 to infinity. We fix some and we increase the value of so as to obtain for some
Figure 1 illustrates the probability distribution function of the number departures while the tagged job is in service for various system loads. In this figure, we have indicated the value of used to truncate the infinite sum in the expression of .
Figure 2 presents the asymptotic behavior given by Equation (16) (dashed line) of the distribution of the number of departures while the tagged customer is in service. The asymptotic formula is rapidly accurate for light load and the convergence is much slower for high loads. This phenomenon also occurs for the sojourn time distribution of a tagged customer by using the approximation established by Flatto [5] for the Random Order Service queue and which is applicable to the PS queue modulo a factor (see [1] for details).
5.2. Approximation
As discussed in the Introduction, we now consider the following approximation. Since the tagged customer has at each instant a probability of completing service equal to that of any other customer present in the queue, we may assume that the tagged customer is randomly served together with those customers in the residual busy period of the queue i.e., the period of activity of the queue following the entrance of the tagged customer in the queue up to exhaustion. See Figure 3 for an illustration of the residual busy periof and the associated random variables.
Let be the number of customers served in the residual busy period and let denote the number of customers served in a regular busy period. It is clear that
[TABLE]
since each present customer in the queue at the arrival of the tagged customer generates an independent busy period and then
[TABLE]
From [10, p. 218],
[TABLE]
and then
[TABLE]
The point is obviously a removable singularity for the function and this function has an algebraic singularity at point .
By using the expansion
[TABLE]
we obtain
[TABLE]
Since the term in parenthesis is null for , we have
[TABLE]
and then
[TABLE]
where we have used the fact that . It follows that the distribution of the number of customers served in the residual busy period of the tagged customer is defined by: for
[TABLE]
As shown in Figure 3, if we pick up a random customer among those customers served in the residual busy period, then the number of customers served before this customer has distribution given by
[TABLE]
and generating function
[TABLE]
For in the neighborhood of , we have
[TABLE]
and by Darboux method [4], we obtain
[TABLE]
It follows that
[TABLE]
The probability distribution function of the number of customers served before the one that is randomly picked up in the residual busy period of the tagged customer is shown in Figure 4. The asymptotic behavior given by Equation (19) is illustrated in dashed lines.
Figure 5 represents the distributions of (the number of departures before service completion of the tagged job) and (the number of departures before a customer randomly picked up in the residual busy period). We can observe that both distribution are reasonably close, especially for light loads. The approximation is less accurate for high loads.
It is worth noting that and have the same decay rate in the sense that
[TABLE]
When the tagged customer stays for a very long time in the queue, then the residual busy period is also very long and on the same exponential scale as the regular busy period. However, the prefactors are very different and
[TABLE]
The tagged customers stays much less time in the queue than the time provided by the approximation. In spite of this, we can conclude that the approximation is reasonable for moderate values of as shown in Figure 5.
6. Conclusion
We have computed in this paper the number of departures seen by a tagged customer when entering an -PS queue in the stationary regime. By using the underlying orthogonal structure of this queue, it is possible to obtain an explicit expression for the distribution of this random variable. We have also derived the asymptotic behavior of this distribution. Subsequently, we have developed an approximation for this quantity, which involves random variables with simpler distributions. Numerical experiments show that this approximation is reasonably accurate for moderate values and asymptotically yields an upper bound for the number of departures seen by the tagged customer in the -PS queue. The same kind of approximation may be used in more complex systems, such as the -PS queue.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] Sem Borst, Rudesindo Núñez-Queija, and Bert Zwart. Sojourn time asymptotics in processor-sharing queues. Queueing Systems , 53(1):31–51, Jun 2006.
- 2[2] O.J. Boxma and J.W. Cohen. The M / G / 1 𝑀 𝐺 1 M/G/1 queue with permanent customers. IEEE J. Sel. Areas Commun. , 9(2):179 – 184, 1991.
- 3[3] Coffman, Muntz, and Trotter. Waiting time distributions for processor-sharing systems. JACM: Journal of the ACM , 17, 1970.
- 4[4] Philippe Flajolet and Robert Sedgewick. Analytic Combinatorics . Cambridge University Press, 2009.
- 5[5] L. Flatto. The waiting time distribution for the random order service M/M/1 queue. The Annals of Apllied Probability , 7(2):382 –409, 1997.
- 6[6] F. Guillemin and J. Boyer. Analysis of the M/M/1 queue with processor sharing via spectral analysis. Queueing Systems , 39:377 – 397, 2001.
- 7[7] Fabrice Guillemin, Veronica Karina Quintuna Rodriguez, and Alain Simonian. Sojourn time in an M / M / 1 𝑀 𝑀 1 M/M/1 processor sharing queue with permanent customers. Stochastic Models , 34:322 – 361, 2018.
- 8[8] Fabrice Guillemin and Farah Slim. Sojourn time in an M / M / 1 𝑀 𝑀 1 M/M/1 processor sharing queue with permanent customers. Stochastic Models , 34:115 – 137, 2018.
