Abstract
We introduce a transient reflected Brownian motion in a multidimensional orthant, which is either absorbed at the apex of the cone or escapes to infinity. We address the question of computing the absorption probability, as a function of the starting point of the process. We provide a necessary and sufficient condition for the absorption probability to admit an exponential product form, namely that the determinant of the reflection matrix is zero. We call this condition a dual skew symmetry. It recalls the famous skew symmetry introduced by Harrison (Adv Appl Probab 10:886–905, 1978), which characterizes the exponential stationary distributions in the recurrent case. The duality comes from that the partial differential equation satisfied by the absorption probability is dual to the one associated with the stationary distribution in the recurrent case.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
1 Introduction and main results
1.1 Reflected Brownian motion in orthants
Reflected Brownian motion (RBM) in orthants \({\mathbb {R}}_+^d\) is a fundamental stochastic process. Starting from the eighties, it has been studied in depth, with focuses on its definition and semimartingale properties [41, 43, 45], its recurrence or transience [6, 7, 10, 29, 30, 42], the possible particular (e.g., product) form of its stationary distribution [14, 26], the asymptotics of its stationary distribution [12, 24], its Lyapunov functions [16, 37], its links with other stochastic processes [15, 32, 33], its use to approximate large queuing networks [4, 19, 23], numerical methods to compute the stationary distribution [11], links with complex analysis [4, 8, 19, 22], PDEs [25], etc. The RBM is characterized by a covariance matrix \(\Sigma \), a drift vector \(\mu \) and a reflection matrix R. We will provide in Sect. 2 a precise definition. While \(\Sigma \) and \(\mu \) correspond to the Brownian behaviour of the process in the interior of the cone, the matrix R describes how the process is reflected on the boundary faces of the orthant. In the semimartingale case, RBM admits a simple description using local times on orthant faces, see (9).
1.2 Dimensions 1 and 2
The techniques to study RBM in an orthant very heavily depend on the dimension. In dimension 1, RBM with zero drift in the positive half-line \({\mathbb {R}}_+\) is equal, in distribution, to the absolute value of a standard Brownian motion, via the classical Tanaka formula; if the drift is nonzero, the RBM in \({\mathbb {R}}_+\) is connected to the so-called bang-bang process [38]. Most of the computations can be performed explicitly, using closed-form expressions for the transition kernel.
The case of dimension 2 is historically the one which attracted the most of attention, and is now well understood. Thanks to a simple linear transform, RBM in a quadrant with covariance matrix is equivalent to RBM in a wedge with covariance identity, see [22, Appendix]. The very first question is to characterize the parameters of the RBM (opening of the cone \(\beta \) and reflection angles \(\delta ,\varepsilon \), see Fig. 1) leading to a semimartingale RBM, as then tools from stochastic calculus become available. The condition takes the form \(\alpha <1\), see [42], with
As a second step, conditions for transience and recurrence were derived, see [29, 42]. Complex analysis techniques prove to be quite efficient in dimension 2, see [4, 8]. In particular, this method leads to explicit expressions for the Laplace transforms of quantities of interest (stationary distribution in the recurrent case [8, 22], Green functions in the transient case [21], escape and absorption probabilities [18, 20]).
1.3 Higher dimension
As opposed to the previous cases, the case of \(d>2\) is much most mysterious. However, necessary and sufficient conditions for the process to be a semimartingale are known, and read as follows: denote the reflection matrix by
The column vector
represents the reflection vector on the orthant face \(x_i=0\). Then, the RBM is a semimartingale if and only if the matrix R is completely-\({\mathcal {S}}\), in the following sense, see [36, 40].
By definition, a principal sub-matrix of R is any matrix of the form \((r_{ij})_{(i,j)\in I^2}\), where I is a non-empty subset of \(\{1,\ldots ,d\}\), possibly equal to \(\{1,\ldots ,d\}\). If x is a vector in \({\mathbb {R}}^d\), we will write \(x> 0\) (resp. \(x\geqslant 0\)) to mean that all its coordinates are positive (resp. non-negative). We define \(x<0\) and \(x\leqslant 0\) in the same way. The definition extends to matrices.
Definition
(\({\mathcal {S}}\)-matrix). A square matrix R is an \(\mathcal {S}\)-matrix if there exists \(x \geqslant 0\) such that \(Rx > 0\). Moreover, R is completely-\(\mathcal {S}\) if all its principal sub-matrices are \(\mathcal {S}\)-matrices.
Apart from the semimartingale property, very few is known about multidimensional RBM. In particular, necessary and sufficient conditions for transience or recurrence are not yet fully known in the general case, even though, under some additional hypothesis on R, some conditions are known [10, 27], or in dimension 3 [6, 17]. For example, if R is assumed to be a non-singular \(\mathcal {M}\)-matrix (which means that R is an \(\mathcal {S}\)-matrix whose off-diagonal entries are all non-positive), then \(R^{-1}\mu <0\) is a necessary and sufficient condition for positive recurrence. Moreover, contrary to the two-dimensional case, no explicit expressions are available for quantities of interest such as the stationary distribution, in general.
1.4 The historical skew symmetry condition
The only notable and exceptional case, in which everything is known and behaves smoothly, is the so-called skew symmetric case, as discovered by Harrison [23] in dimension 2, and Harrison and Williams [26] in arbitrary dimension. They prove that the RBM stationary distribution has a remarkable product form
if and only if the following relation between the covariance and reflection matrices holds:
In the latter case, the stationary distribution admits the exponential product form given by (4), with parameters equal to
with \(\mu \) denoting the drift vector. In dimension 2, if we translate this model from the quadrant to a wedge, condition (5) is equivalent to \(\alpha =0\), see [22, Sec. 5.2] and our Fig. 2. Models having this skew symmetry are very popular, as they offer the possibility of computing the stationary distribution in closed-form. No generalization of the skew symmetry is known, except in dimension 2, where according to [14], the stationary distribution is a sum of \(n\geqslant 1\) exponential terms as in (4) (with suitable normalization) if and only if \(\alpha =-n\), where the parameter \(\alpha \) is as in (1). The recent article [8] goes much further, generalizing again this result and finding new conditions on \(\alpha \) to have simplified expressions of the density distribution.
The concept of skew symmetry has been explored in other cases than orthants, see for example [35, 44].
1.5 Our approach and contributions
In this paper, we will not work under the completely-\({\mathcal {S}}\) hypothesis. More precisely, we will assume that:
Assumption 1
The reflection matrix R is not \({\mathcal {S}}\).
Assumption 2
All principal, strict sub-matrices of R are completely-\({\mathcal {S}}\).
Before going further, observe that the appearance of \({\mathcal {S}}\)-matrices is very natural in the present context. Indeed, for instance, R is an \({\mathcal {S}}\)-matrix if and only if there exists a convex combination of reflection vectors which belongs to the interior of the orthant. Such a condition would allow us to define the process as a semimartingale after the time of hitting the origin. Similarly, the fact that a given principal sub-matrix of R is \({\mathcal {S}}\) translates into the property that it is possible to define the process as a semimartingale after its visits on the corresponding face.
Therefore, as we shall prove, the probabilistic counterpart of Assumptions 1 and 2 is that we can define the process \((Z_t)_{t\geqslant 0}\) as a semimartingale before time
but not for \(t\geqslant T\). For this reason, we will call T in (6) the absorption time: if the process hits the apex of the cone, then \(T<\infty \) and we will say that the process is absorbed at the origin. Indeed, because of Assumption 1, there is no convex combination of reflection vectors belonging to the orthant, and consequently, we cannot define the process as a semimartingale after time T. However, our process is a semimartingale in the random time interval [0, T]; this will be proved in Proposition 2.
We will also assume that:
Assumption 3
The drift of the RBM is positive, that is, all coordinates of \(\mu \) are positive.
Under Assumptions 1, 2 and 3, our process exhibits the following dichotomy: either it hits the origin of the cone in finite time, i.e., \(T<\infty \), or it goes to infinity (in the direction of the drift) before hitting the apex, i.e., \(T=\infty \) and \(\vert Z_t\vert \rightarrow \infty \) as \(t\rightarrow \infty \). See Fig. 3. We will prove this dichotomy in Proposition 5.
This leads us to ask the following questions: what is the absorption probability
Equivalently, what is the escape probability
These questions are not only of theoretical nature: they also admit natural interpretations in population biology problems, in terms of extinction times of multitype populations [31], or in risk theory, in terms of ruin of companies that collaborate to cover their mutual deficits [1, 5, 30].
Because of its somehow dual nature, the problem of computing the absorption (or escape) probability is a priori as difficult as the problem of computing the stationary distribution in the semimartingale, recurrent case. Therefore, a natural question is to find an analogue of the skew symmetry [23, 26] in this context, which we recalled here in (4) and (5). The main result of the article is given in Theorem 1. It is stated under four assumptions; while the first three have already been introduced, the final one, Assumption 4, is of more technical nature and will be presented in Sect. 3. We conjecture that Assumption 4 is always true. For \(x=(x_1, \ldots , x_n)\in \mathbb {R}_+^d\), \(f(x)={\mathbb {P}}_x[T<\infty ]\) denotes the absorption probability (7).
Theorem 1
(Dual skew symmetry in an orthant). Under Assumptions 1, 2, 3 and 4, the following statements are equivalent:
-
(i)
The absorption probability has a product form, i.e., there exist functions \(f_1,\ldots ,f_d\) such that
$$\begin{aligned} f(x)=f_1(x_1)f_2(x_2) \cdots f_d(x_d). \end{aligned}$$ -
(ii)
The absorption probability is exponential, i.e., there exists \(a\in \mathbb {R}^d\setminus \{0\}\) such that
$$\begin{aligned} f(x)= \exp (a\cdot x). \end{aligned}$$ -
(iii)
The reflection vectors \(R_1,\ldots ,R_d\) defined in (2) and (3) are coplanar, that is,
$$\begin{aligned} \det R =0. \end{aligned}$$
When these properties are satisfied, the vector \(a=(a_1,\ldots ,a_n)\) in (ii) has negative coordinates and is the unique nonzero vector such that
We refer to Figs. 2 and 4 for a geometric illustration of the condition \(\det R =0\) appearing in (iii). See Fig. 5 for a geometric illustration of the exponential decay rate a in (8). When the parameters satisfy the assumptions (and conclusions) of Theorem 1, we will say that the model satisfies the dual skew symmetry condition. This terminology will be explained in more detail in Remark 2. In the case of dimension 2, Theorem 1 is proved in [18]. Assumption 4 will be discussed in Remark 1. Note that the proof of (iii)\(\Rightarrow \)(ii)\(\Rightarrow \)(i) does not use Assumption 4.
1.6 Structure of the paper
-
Section 2: We define properly the process and show some of its pathwise properties. In particular, Proposition 5 shows the dichotomy behaviour (absorption vs. escape at infinity).
-
Section 3: We state and prove a PDE for the density of the absorption probability (Proposition 6). This PDE is dual to the one satisfied by the stationary distribution in the recurrent case.
-
Section 5: We propose a generalization of Theorem 1 with absorption on facets, not necessarily the origin.
2 Definition and first properties of the absorbed reflected Brownian motion
2.1 Existence and definition
Let \((W_t)_{t\geqslant 0}\) be a d-dimensional Brownian motion of covariance matrix \(\Sigma \). Let \(\mu \in \mathbb {R}^d\) be a drift, and let R be a d-dimensional square matrix (2) with coefficients 1 on the diagonal.
Proposition 2
(Existence of an absorbed SRBM). Under Assumption 2, there exists an absorbed SRBM in the orthant, i.e., a semimartingale defined up to the absorption time \(T\leqslant \infty \) as in (6) and such that for all \(t \leqslant T\),
where \(L_t\) is a vector whose ith coordinate \(L_t^i\) is a continuous, non-decreasing process starting from 0, which increases only when the ith coordinate of the process \(Z_t^i = 0\), and which is called the local time on the corresponding orthant face.
Under the additional hypothesis that R is completely-\({\mathcal {S}}\), Proposition 2 is most classical: in this case, the RBM is well defined as the semimartingale (9), actually for any \(t\in [0,\infty )\). Our contribution here is to prove that if R is not an \({\mathcal {S}}\)-matrix (our Assumption 1) and is therefore not completely-\({\mathcal {S}}\), then it is still possible to define the RBM as a semimartingale on the time interval [0, T].
Proof
Although Proposition 2 is not formally proved in Taylor’s PhD thesis [39], all necessary tools may be found there. More precisely, Taylor proves that when R is completely-\({\mathcal {S}}\) (i.e., our Assumption 2 plus the fact that R is \({\mathcal {S}}\)), then the RBM is an orthant \({\mathbb {R}}_+^d\) exists as a semimartingale globally on \([0,\infty )\). The proof in [39] is then split into two parts:
-
First, [39, Chap. 4] shows that the SRBM exists on [0, T], with T defined in (6). The fact that R is an \({\mathcal {S}}\)-matrix is nowhere used in the proof: the only needed hypotheses are that all principal, strict sub-matrices are completely-\({\mathcal {S}}\) (our Assumption 2).
-
As a second step, in [39, Chap. 5] (see in particular her Lemma 5.3), Taylor proves that if R is an \({\mathcal {S}}\)-matrix, then it is possible for the process started at the origin to escape the origin and to be well defined as a semimartingale.
Using only the first part of her arguments readily entails our Proposition 2. \(\square \)
2.2 Absorption and escape in asymptotic regimes
We first prove two results which are intuitively clear, namely that the absorption probability tends to one (resp. zero) when the starting point approaches the origin (resp. infinity), see Proposition 3 (resp. Proposition 4). Then, we will prove in Proposition 5 the dichotomy already mentioned: either the process is absorbed in finite time, or it escapes to infinity as time goes to infinity. By convention, we will write \(x\rightarrow 0\) (resp. \(x\rightarrow \infty \)) to mean that \(\vert x\vert \rightarrow 0\) (resp. \(\vert x\vert \rightarrow \infty \)) in the cone.
Proposition 3
(Absorption starting near the origin). One has
Proposition 4
(Absorption starting near infinity). One has
Proposition 5
(Complementarity of escape and absorption). When \(T=\infty \), then almost surely \(\lim _{t\rightarrow \infty } \vert Z_t\vert = \infty \), i.e.,
This implies that \(\mathbb {P}_x[T=\infty ]=\mathbb {P}_x[\vert Z_{t\wedge T}\vert \rightarrow \infty ]\).
Proof of Proposition 3
Let us define \(\tau _x = \inf \{t>0 : x+W_t+\mu t <0 \}\) (by convention \(\inf \emptyset =\infty \)), and consider the set
The proof consists in two steps. We first prove that \(\{ \tau _x<\infty \} \subset \{ T<\infty \}\) and then show that \(\lim _{x\rightarrow 0}\mathbb {P}[ \tau _x <\infty ] =1\).
-
Step 1.
Assume that \(\tau _x < \infty \) and fix a \(t<\infty \) such that \(x+W_t+\mu t<0\). We are going to show that \(T\leqslant t\). We proceed by contradiction and assume that \(t<T\). Then from (9), we get that
$$\begin{aligned} R L_t = Z_t - x-W_t-\mu t >0. \end{aligned}$$The last inequality comes from the fact that \(Z_t\geqslant 0\) and that \(x+W_t+\mu t <0\). Remembering that \(L_t\geqslant 0\), the fact that \( R L_t>0\) implies that R is an \(\mathcal {S}\)-matrix, which contradicts Assumption 1. We conclude that \(T\leqslant t<\infty \). We have thus shown that \(\{ \tau _x<\infty \} \subset \{ T<\infty \}\).
-
Step 2.
By Blumenthal’s zero–one law, we have
$$\begin{aligned} \mathbb {P}[ \tau _0=0 ] =1, \end{aligned}$$since
$$\begin{aligned} \{\tau _0 =0\}=\bigcap _{t>0} \left\{ \inf _{s \leqslant t} (W_s+\mu s) <0 \right\} \in \mathcal {F}_{0+}= \bigcap _{t>0} \mathcal {F}_t, \end{aligned}$$where \(\mathcal {F}_t =\sigma \{ W_s , s\leqslant t \}\). This implies that \(\mathbb {P}[\tau _0 <\infty ]=1\). We deduce that almost surely, there exists \(t_0\) such that \(W_{t_0}+\mu t_0<0\), and then for all \(x<-W_{t_0}-\mu t_0\) we have \(\tau _x <\infty \). Then, \(\mathbbm {1}_{\{\tau _x < \infty \}}\underset{x\rightarrow 0}{\longrightarrow } 1 \text { a.s.}\), and by dominated convergence we have
$$\begin{aligned} \mathbb {P}[ \tau _x<\infty ]=\mathbb {E}[\mathbbm {1}_{\{\tau _x < \infty \}}] \underset{x\rightarrow 0}{\longrightarrow } 1. \end{aligned}$$
Thanks to Step 1 and Step 2, we conclude that \(\mathbb {P}_x[T<\infty ]\geqslant \mathbb {P}[ \tau _x <\infty ]\) and therefore \(\underset{x\rightarrow 0}{\lim }\mathbb {P}_x [T<\infty ] = 1\), using the above estimate. \(\square \)
Proof of Proposition 4
Introduce the event
For any element belonging to \(B_x\), then \(Z_t=x+W_t+\mu t\) for all \(t\in \mathbb {R}\) (the process never touches the boundary of the orthant, meaning no reflection on the boundary). We deduce that \(Z_t>0\) for all \(t\in \mathbb {R}\) and then that \(B_x \subset \{ T=\infty \}\). Therefore,
To conclude, we are going to show that \(\lim _{x\rightarrow \infty } \mathbb {P}[B_x]=1\). It comes from the fact that a.s. \(\inf _{t>0} \{ W_t +\mu t \}> -\infty \), since \(\mu >0\) by Assumption 3. For all \(x> -\inf _{t>0} \{ W_t +\mu t \}\), we have \(x+W_t+\mu t >0\) for all t. We deduce that \( \mathbbm {1}_{\{\forall t\in \mathbb {R}, x+W_t+\mu t >0\}}\underset{x\rightarrow \infty }{\longrightarrow } 1 \text { a.s.} \), and by dominated convergence, we have
\(\square \)
Before proving Proposition 5, we first recall some useful definitions and properties related to recurrence and transience of Markov processes. All of them are most classical, but having them here stated clearly will facilitate our argument. These results and their proofs may be found in [3].
Consider a continuous, strong Feller Markov process \(X_t\) on a locally compact state space E with countable basis. For \(V\subset E\), let us define \(\tau _V = \inf \{t > 0 : X_t \in V \}\).
-
The point \(x\in E\) is said to be recurrent if for all neighbourhoods V of x,
$$\begin{aligned} \mathbb {P}[\limsup \mathbbm {1}_V (X_t)=1]=1. \end{aligned}$$ -
If a point is not recurrent, it is said to be transient. In this case, by [3, Thm. III 1], there exists a neighbourhood V of x such that \(\mathbb {P}[\limsup \mathbbm {1}_V (X_t)=1]=0\).
-
The point x is said to lead to y if for all neighbourhoods V of y, we have \(\mathbb {P}_x [\tau _V < \infty ] > 0\). The points x and y are said to communicate if x leads to y and y leads to x. This defines an equivalence relation.
-
If two states communicate, they are both transient or both recurrent [3, Prop. IV 2].
-
If all points are transient, then \(X_t\) tends to \(\infty \) as \(t\rightarrow \infty \) almost surely [3, Prop. III 1].
Proof of Proposition 5
Define the process \(({{\widetilde{Z}}}_t)_{t\geqslant 0}\) as the process \((Z_t)_{t\geqslant 0}\) conditioned never to hit 0 in a finite time. The transition semigroup of this new Markov process \(\widetilde{Z}_t\) is defined, for \(x\in \mathbb {R}_+^d \setminus \{ 0\}\) and \(V \subset \mathbb {R}_+^d \setminus \{ 0\}\), by
All points of \(\mathbb {R}_+^d \setminus \{0\}\) communicate, they thus constitute a unique equivalence class. We deduce that they all are transient or all recurrent. It is thus enough to show that one of them is transient, to show that they all are.
Let us take a point in the interior of \(\mathbb {R}_+^d \setminus \{0\}\), for example \(x=(1,\ldots , 1)\). Since \(\mu >0\), by standard properties of Brownian motion we have
In dimension one, this property directly derives from [9, Eq. 1.2.4(1)] (on p. 252); it easily generalizes to all dimensions. When this event of positive probability occurs, the process never touches the boundary and thus \(\widetilde{Z}_t= x+W_t+\mu t \rightarrow \infty \) and \(\limsup \mathbbm {1}_V (\widetilde{Z}_t)=0\), for any V relatively compact neighbourhood of x. We have shown that there exists a neighbourhood V of x such that \(\mathbb {P}_x [\limsup \mathbbm {1}_V (\widetilde{Z}_t)=1]<1\), which implies that x is not recurrent and is then transient.
Using [3, Prop. III 1] allows us to conclude, since as recalled above, if all points are transient, then the process tends to infinity almost surely. \(\square \)
3 Partial differential equation for the absorption probability
In a classical way, the generator of the Brownian motion in the interior of the orthant is defined by
where we assume that f is bounded in the first equality and that f is twice differentiable in the second equality. In the rest of the paper, the following assumption is made.
Assumption 4
For all continuous, bounded functions g, the transition semigroup
is differentiable, and satisfies the Neumann boundary condition \(R_i \cdot P_t g(x)=0\) on the ith face of the orthant \(x_i=0\).
Remark 1
(Plausibility of Assumption 4). Many evidences suggest that this hypothesis is true:
-
By [2, Cor. 3.3], Assumption 4 is true provided we replace T by the first hitting time of the intersection of two faces, or assuming that the process does not hit the intersection of two faces.
-
As a consequence of the above, Assumption 4 is true in dimension two.
-
By [13], Assumption 4 holds true in the particular case of orthogonal reflections.
-
Assumption 4 is stated as a conjecture in [25, (8.2b)]; however, the latter article does not attempt to prove rigorously these regularity questions.
-
The paper [34] shows in full generality the pathwise differentiability with respect to the starting point x. We believe that a way to attack the proof of Assumption 4 could be to combine the results of [34] with the computations made in the proof of [2, Cor. 3.3].
Proposition 6
(Partial differential equation). Under Assumptions 1, 2, 3 and 4, the absorption probability (7) is the unique function f which is
-
bounded and continuous in the interior of the orthant \({\mathbb {R}}_+^d\) and on its boundary,
-
continuously differentiable in the interior of the orthant and on its boundary (except perhaps at the corner),
and which further satisfies the PDE:
-
\(\mathcal {G} f =0\) on the orthant (harmonicity),
-
\(R_i \cdot \nabla f = 0\) on the ith face of the orthant \(x_i=0\) (Neumann boundary condition),
-
\(f(0)=1\) and \(\lim _{x\rightarrow \infty } f(x)=0\) (limit values).
Proof
The proof is similar to [18, Prop. 11]. We start with the sufficient condition. Dynkin’s formula leads to
There is a technical subtlety in applying Dynkin’s formula, as the latter requires functions having a \({\mathcal {C}}^2\)-regularity, which is a priori not satisfied at the origin in our setting. However, we may first apply this formula for \(T_n=\inf \{t>0 : \vert Z_t\vert<\frac{1}{n}\}<T\), then f has the desired regularity on \({\mathbb {R}}_+^d\setminus \{x:\vert x\vert <\frac{1}{n}\}\). One may conclude as \(T_n\) converges increasingly to T as \(n\rightarrow \infty \).
Since f is assumed to satisfy the PDE stated in Proposition 6, the latter sum of three terms is simply equal to f(x). We further compute
As \(t\rightarrow \infty \), the above quantity converges to
where the last equality comes from the limit values \(\lim _{x\rightarrow \infty } f(x)=0\), \(f(0)=1\) and from Proposition 5, which together imply that when \(T=\infty \) we have \(\lim _{t\rightarrow \infty }Z_{t}=\infty \). We immediately deduce that \(f(x)={\mathbb {P}}_x[T<\infty ]\).
We now move to the necessary condition. We denote the absorption probability (7) by f and show that it satisfies the PDE of Proposition 6. Consider the event \(\{ T<\infty \} \in \mathcal {F}_\infty \) and define
which is a \(\mathcal {F}_t\)-martingale. Observe that \(M_0=f(x)\) and, by the Markov property, \(M_t=f(Z_{t \wedge T})\). We deduce that \(\mathbb {E}_x[f(Z_{t \wedge T})]=\mathbb {E}[M_t \vert \mathcal {F}_0]=M_0=f(x)\). By definition of \(\mathcal {G}\), we obtain that for x in the interior of the orthant,
The Neumann boundary condition and the differentiability follow from the fact that \(f(x)=\mathbb {E}_x[f(Z_{t \wedge T})]\) and from Assumption 4. The limit values follow from our Propositions 3 and 4. \(\square \)
Remark 2
(Duality between absorption probability and stationary distribution). Let us define the dual generator \( \mathcal {G}^* f (x)= \frac{1}{2}(\nabla \cdot \Sigma \nabla f) (x) - (\mu \cdot \nabla f) (x) \) as well as the matrix \(R^* = 2 \Sigma -R \ \text {diag} (\Sigma )\), whose columns are denoted by \(R^*_i\). In the recurrent case, the stationary distribution satisfies the following PDE, see [25, Eq. (8.5)]:
-
\(\mathcal {G}^* f =0\) in the orthant,
-
\(R^*_i \cdot \nabla f -2 \mu _i f= 0\) on the ith face of the orthant defined by \(x_i=0\).
As a consequence, the absorption probability satisfies a PDE (Proposition 6), which is dual to the one which holds for the stationary distribution.
4 Dual skew symmetry: proof of the main result
This section is devoted to the proof of Theorem 1, which establishes the dual skew symmetry condition. We first prove two technical lemmas on the reflection matrix R in (2).
Lemma 7
If R satisfies Assumptions 1 and 2, then for all i, there exists \(j\ne i\) such that \(r_{ij} \ne 0\).
Proof
It is enough to prove Lemma 7 for \(i=1\), as we would show the other cases similarly. Consider \({\widetilde{R}}\) the principal submatrix of R obtained by removing the first line and the first column. This matrix is completely \(\mathcal {S}\) by Assumption 2, so that there exists \({\widetilde{X}}=(x_2,\ldots ,x_d)^\top \geqslant 0\) such that \({\widetilde{R}} {\widetilde{X}} >0\). Consider now \({\widetilde{C}}_1=(r_{21},\ldots ,r_{d1})^\top \), which is the first column of R without its first coordinate. Let us choose \(\lambda >0\) large enough such that \( {\widetilde{C}}_1 + \lambda {\widetilde{R}} {\widetilde{X}} >0\). If for all \(j\ne 1\) we have \(r_{1j}=0\), then for \( X=(1,\lambda x_2,\ldots ,\lambda x_d)^\top \) we would have
and then R would be an \(\mathcal {S}\)-matrix, contradicting our Assumption 1. \(\square \)
Lemma 8
If R satisfies Assumptions 1 and 2, and if in addition \(\det R=0\), then R has rank \(d-1\), and there exist a positive column vector \(U>0\) in \(\ker R\) and a positive row vector \(a>0\) such that \(aR=0\).
Proof
The rank of the matrix R is obviously \(\leqslant d-1\), since \(\det R=0\). We now show that the rank is \(\geqslant d-1\).
Let \({\widetilde{R}}_j\) be the submatrix of R obtained by removing the jth line and the jth column. These matrices are \(\mathcal {S}\)-matrices by Assumption 2, and we can choose
We now define the vertical vectors \(X_j^\varepsilon =({\widetilde{x}}_{ij})_{i=1,\ldots , d}\), setting \({\widetilde{x}}_{jj}=\varepsilon \) for some \(\varepsilon >0\). We have
where \(y_{ij}^\varepsilon = \varepsilon r_{ij}+ {\widetilde{y}}_{ij}>0\) for \(i \ne j\) and \(\varepsilon >0\) small enough, and \(y_{jj}^\varepsilon =\varepsilon + {\widetilde{L}}_j {\widetilde{X}}_j\), where we set
the jth line of R, with the jth coordinate \(r_{jj}=1\) excluded. Since R is not an \(\mathcal {S}\)-matrix by our Assumption 1, we must have \(y_{jj}^\varepsilon =\varepsilon + {\widetilde{L}}_j {\widetilde{X}}_j \leqslant 0\). We deduce that \(y_{jj}^0= {\widetilde{L}}_j {\widetilde{X}}_j \leqslant -\varepsilon <0\).
Then, introducing the vectors
we have
Denoting the matrix \(P=(X_1, \ldots , X_d ) \geqslant 0\), we have
All coefficients of T are positive. Consequently, using Perron–Frobenius theorem, T has a unique maximal eigenvalue r, its associated eigenspace is one-dimensional and there exists a positive eigenvector V associated to r. Let us remark that since \(\det R=0\), then \(\det (2 \text {Id} -T)=\det (-RP)=0\) and 2 is an eigenvalue of T. Then, \(r\geqslant 2\), and there are two cases to treat.
-
Assume first that the maximal eigenvalue is \(r>2\). Let \(V>0\) be a positive associated eigenvector such that \(TV=rV\). We deduce that \(-RPV=2V-TV=(2-r)V\) and then \(R(PV)=(r-2)V>0\), where \(PV \geqslant 0\) since \(P \geqslant 0\) and \( V > 0\). Then, we have shown that R is an \(\mathcal {S}\)-matrix, which contradicts Assumption 1. So we must be in the situation where \(r=2\).
-
If \(r=2\) is the maximal eigenvalue of T, and \(V>0\) the positive eigenvector such that \(TV=2V\), then we have \(RU=0\) for \(U=PV>0\). Furthermore \(\dim \ker (2\text {Id}-T)=1\) and then \(d-1=\text {rank} (2\text {Id}-T)=\text {rank} RP \leqslant \text {rank} R\) and then R has rank \(d-1\).
Left eigenspaces of T are (right) eigenspaces of \(T^\top \). If we take a such that \(aR=0\), then a belongs to the left eigenspace associated to the eigenvalue 2 of T. By Perron–Frobenius theorem, we deduce that we can choose \(a>0\). \(\square \)
We now prove a result showing that the hitting probability of the origin is never 0, for all starting points.
Lemma 9
For all \(x\in \mathbb {R}_+^d\), \(f(x) > 0\).
Proof
By Proposition 3, there exists a point \(y_0\) in the interior of the orthant such that \(f(y_0)> 0\). By continuity of f (Proposition 6), we can find an open neighbourhood U of \(y_0\) such that \(f(y) > 0\) for all \(y \in U\). Then we conclude that
(The first equality in the previous equation has already been proved in the proof of Proposition 6). \(\square \)
Let us now prove the main result.
Proof of Theorem 1
(i) \(\Rightarrow \) (ii): We assume that \(f(x)=f_1(x_1)\cdots f_d(x_d)\) and we denote \(\partial \ln f_i = f'_i /f_i\) (note that due to Proposition 6, the functions f and \(f_i\) are differentiable and by Lemma 9, \(f_i(x_i) \ne 0\) for all i and all \(x_i\)). On the boundary \(x_i=0\), the Neumann boundary condition of Proposition 6 implies that
In particular, for all \(j \ne i\), taking \(x_{i'}=0\) for all \(i'\ne j\), we obtain
We deduce that for all i and j such that \(i \ne j\), the function \(r_{ij} \partial \ln f_j (x_j) \) is a constant, which we can compute as \(- \sum _{j'\ne j} r_{ij'} \partial \ln f_{j'} (0)\). By Lemma 7, for all j there exists \(i \ne j\) such that \(r_{ij}\ne 0\). This implies that \(\partial \ln f_j (x_j) \) is constant and then that \(f_j\) is exponential: there exists \(a_j\) such that \(f_j(x_j)=e^{a_j x_j}\). The limit value \(\lim _{x\rightarrow \infty } f(x) =0\) implies that \(a \ne 0\).
(ii) \(\Rightarrow \) (i): This implication is trivial by taking \(f_i(x_i)=e^{a_i x_i}\).
(ii) \(\Rightarrow \) (iii): If \(f(x)=e^{ax}\) satisfies the PDE of Proposition 6, then \(R_i \cdot \nabla f(x)= a R_i e^{ax}=0 \) on the boundary face \(x_i=0\). We obtain that \( a R_i =0\) for all i and then that \(a R =0\). We deduce that \(\det R=0\) since \(a\ne 0\).
(iii) \(\Rightarrow \) (ii): If \(\det R =0\), then by Lemma 8 one has \(\dim \ker R=1\), and we can choose \(a' \in \mathbb {R}^d\) such that \(a'>0\) and \( a' R =0\). Then, \(a=- \frac{a'\mu }{a' \Sigma \cdot a'}\ a'<0\) is the unique vector which satisfies \(a\cdot R=0\) and \(a \Sigma \cdot a +a \mu =0 \). Then, it is easy to verify that \(e^{ax}\) satisfies the PDE of Proposition 6, while the boundary condition at infinity comes from the fact that \(a<0\). \(\square \)
5 A generalization of Theorem 1: absorption on a facet
Theorem 1 can be generalized to the case where the RBM is absorbed at a facet of the orthant, with equation
for some fixed \(k\in \{1,\ldots , n \}\). The situation where \(k=n\) is the case of an absorption at the apex of the cone, which is treated in detail in the present article. For the sake of brevity and to avoid too much technicality, we will not prove this generalization in this article, even though all intermediate steps in the proof may be extended.
In the general case of a facet, let us state three assumptions which generalize Assumptions 1, 2 and 3. Let us define \({\widetilde{R}}\) (resp. \({{\widetilde{\Sigma }}}\)) the principal sub-matrix of R (resp. \(\Sigma \)), where we keep only the \(i_1\)th up to \(i_k\)th lines and columns.
-
The new Assumption 1 is that the reflection matrix \({\widetilde{R}}\) is not \(\mathcal {S}\).
-
The new second assumption is that all principal sub-matrices of R which do not contain \({\widetilde{R}}\) are completely-\(\mathcal {S}\).
-
The third assumption about the positivity of the drift \(\mu >0\) remains unchanged (even though we could probably weaken this hypothesis).
Under these assumptions, we may define the reflected Brownian motion \((Z_t)_{t\geqslant 0}\) until time
where \(Z^i\) stands for the ith coordinate of Z. Let us denote the absorption probability
Then, Theorem 1 may be extended as follows. The following assertions are equivalent:
-
(i’)
f has a product form.
-
(ii’)
f is exponential, i.e., \(f(x)= \exp (a_{i_1}x_{i_1}+ \cdots +a_{i_k}x_{i_k} )\) with \(a_{i_j}\ne 0\).
-
(iii’)
\(\det {\widetilde{R}} =0\).
In this case, the vector \({\widetilde{a}}=(a_{i_1}, \ldots ,a_{i_k} )\) is negative and is the unique nonzero vector such that \({\widetilde{a}} {\widetilde{R}} =0\) and \({\widetilde{a}} {\widetilde{\Sigma }} \cdot {\widetilde{a}} + {\widetilde{a}} {\widetilde{\mu }}=0\), where we defined the vertical vector \({\widetilde{\mu }} =({\mu _{i_j}})_{j=1,\ldots , k}\).
References
Albrecher, H., Azcue, P., Muler, N.: Optimal dividend strategies for two collaborating insurance companies. Adv. Appl. Probab. 49, 515–548 (2017)
Andres, S.: Pathwise differentiability for SDEs in a convex polyhedron with oblique reflection. Ann. Inst. H. Poincaré Probab. Stat. 45, 104–116 (2009)
Azéma, J., Kaplan-Duflo, M., Revuz, D.: Récurrence fine des processus de Markov. Ann. Inst. H. Poincaré Probab. Stat. 2, 185–220 (1966)
Baccelli, F., Fayolle, G.: Analysis of models reducible to a class of diffusion processes in the positive quarter plane. SIAM J. Appl. Math. 47, 1367–1385 (1987)
Badila, E.S., Boxma, O.J., Resing, J.A.C., Winands, E.M.M.: Queues and risk models with simultaneous arrivals. Adv. Appl. Probab. 46(3), 812–831 (2014)
Bramson, M., Dai, J., Harrison, J.M.: Positive recurrence of reflecting Brownian motion in three dimensions. Ann. Appl. Probab. 20, 753–783 (2010)
Bramson, M.: Positive recurrence for reflecting Brownian motion in higher dimensions. Queueing Syst. 69, 203–215 (2011)
Bousquet-Mélou, M., Elvey Price, A., Franceschi, S., Hardouin, C., Raschel, K.: The stationary distribution of reflected Brownian motion in a wedge: differential properties. Preprint arXiv:2101.01562 (2021)
Borodin, A.N., Salminen, P.: Handbook of Brownian motion: Facts and formulae, 2nd edn. Probability and Its Applications, Birkhäuser (2012)
Chen, H.: A sufficient condition for the positive recurrence of a semimartingale reflecting Brownian motion in an orthant. Ann. Appl. Probab. 6, 758–765 (1996)
Dai, J., Harrison, J.M.: Reflected Brownian motion in an orthant: numerical methods for steady-state analysis. Ann. Appl. Probab. 2, 65–86 (1992)
Dai, J.G., Miyazawa, M.: Reflecting Brownian motion in two dimensions: exact asymptotics for the stationary distribution. Stoch. Syst. 1, 146–208 (2011)
Deuschel, J.-D., Zambotti, L.: Bismut-Elworthy’s formula and random walk representation for SDEs with reflection. Stoch. Process. Appl. 115, 907–925 (2005)
Dieker, A.B., Moriarty, J.: Reflected Brownian motion in a wedge: sum-of-exponential stationary densities. Electron. Commun. Probab. 14, 1–16 (2009)
Dubédat, J.: Reflected planar Brownian motions, intertwining relations and crossing probabilities. Ann. Inst. H. Poincaré Probab. Stat. 40, 539–552 (2004)
Dupuis, P., Williams, R.J.: Lyapunov functions for semimartingale reflecting Brownian motions. Ann. Probab. 22, 680–702 (1994)
El Kharroubi, A., Ben Tahar, A., Yaacoubi, A.: Sur la récurrence positive du mouvement brownien réfléchi dans l’orthant positif de \(\mathbb{R} ^n\). Stoch. Stoch. Rep. 68, 229–253 (2000)
Ernst, P.A., Franceschi, S., Huang, D.: Escape and absorption probabilities for obliquely reflected Brownian motion in a quadrant. Stoch. Process. Appl. 142, 634–670 (2021)
Foddy, M.E.: Analysis of Brownian motion with drift, confined to a quadrant by oblique reflection (diffusions, Riemann-Hilbert problem). ProQuest LLC, Ann Arbor, MI. Thesis (Ph.D.)–Stanford University (1984)
Fomichov, V., Franceschi, S., Ivanovs, J.: Probability of total domination for transient reflecting processes in a quadrant. Adv. Appl. Probab. 54, 1–45 (2022)
Franceschi, S.: Green’s functions with oblique Neumann boundary conditions in the quadrant. J. Theor. Probab. 34, 1775–1810 (2021)
Franceschi, S., Raschel, K.: Integral expression for the stationary distribution of reflected Brownian motion in a wedge. Bernoulli 25, 3673–3713 (2019)
Harrison, J.M.: The diffusion approximation for tandem queues in heavy traffic. Adv. Appl. Probab. 10, 886–905 (1978)
Harrison, J.M., Hasenbein, J.: Reflected Brownian motion in the quadrant: tail behavior of the stationary distribution. Queueing Syst. 61, 113–138 (2009)
Harrison, J.M., Reiman, M.I.: On the distribution of multidimensional reflected Brownian motion. SIAM J. Appl. Math. 41, 345–361 (1981)
Harrison, J.M., Williams, R.J.: Multidimensional reflected Brownian motions having exponential stationary distributions. Ann. Probab. 15, 115–137 (1987)
Harrison, J.M., Williams, R.J.: Brownian models of open queueing networks with homogeneous customer populations. Stochastics 22, 77–115 (1987)
Harrison, J.M.: Reflected Brownian motion in the quarter plane: an equivalence based on time reversal. Stoch. Process. Appl. 150, 1189–1203 (2022)
Hobson, D.G., Rogers, L.C.G.: Recurrence and transience of reflecting Brownian motion in the quadrant. Math. Proc. Camb. Philos. Soc. 113, 387–399 (1993)
Ivanovs, J., Boxma, O.: A bivariate risk model with mutual deficit coverage. Insurance Math. Econ. 64, 126–134 (2015)
Lafitte-Godillon, P., Raschel, K., Tran, V.C.: Extinction probabilities for a distylous plant population modeled by an inhomogeneous random walk on the positive quadrant. SIAM J. Appl. Math. 73, 700–722 (2013)
Le Gall, J.-F.: Mouvement brownien, cônes et processus stables. Probab. Theory Relat. Fields 76, 587–627 (1987)
Lépingle, D.: A two-dimensional oblique extension of Bessel processes. Markov Process. Relat. Fields 23, 233–266 (2017)
Lipshutz, D., Ramanan, K.: Pathwise differentiability of reflected diffusions in convex polyhedral domains. Ann. Inst. H. Poincaré Probab. Stat. 55, 1439–1476 (2019)
O’Connell, N., Ortmann, J.: Product-form invariant measures for Brownian motion with drift satisfying a skew-symmetry type condition. ALEA. Lat. Am. J. Probab. Math. Stat. 11, 307–329 (2014)
Reiman, M.I., Williams, R.J.: A boundary property of semimartingale reflecting Brownian motions. Probab. Theory Relat. Fields 77, 87–97 (1988)
Sarantsev, A.: Reflected Brownian motion in a convex polyhedral cone: tail estimates for the stationary distribution. J. Theoret. Probab. 30, 1200–1223 (2017)
Shreve, S.E.: Reflected Brownian motion in the “bang-bang’’ control of Brownian drift. SIAM J. Control. Optim. 19, 469–478 (1981)
Taylor, L.M.: Existence and uniqueness of semimartingale reflecting Brownian motions in an orthant. Thesis (Ph.D.)–University of California, San Diego (1990)
Taylor, L.M., Williams, R.J.: Existence and uniqueness of semimartingale reflecting Brownian motions in an orthant. Probab. Theory Relat. Fields 96, 283–317 (1993)
Varadhan, S.R.S., Williams, R.J.: Brownian motion in a wedge with oblique reflection. Commun. Pure Appl. Math. 38, 405–443 (1985)
Williams, R.J.: Recurrence classification and invariant measure for reflected Brownian motion in a wedge. Ann. Probab. 13, 758–778 (1985)
Williams, R.J.: Reflected Brownian motion in a wedge: semimartingale property. Z. Wahrsch. Verw. Gebiete 69, 161–176 (1985)
Williams, R.J.: Reflected Brownian motion with skew symmetric data in a polyhedral domain. Probab. Theory Relat. Fields 75, 459–485 (1987)
Williams, R.J.: Semimartingale reflecting Brownian motions in the orthant. Stochastic networks, 125–137, IMA Vol. Math. Appl., 71, Springer, New York (1995)
Acknowledgements
We are grateful to Philip Ernst and to John Michael Harrison for very interesting discussions about topics related to this article. We thank an anonymous referee for very useful remarks and suggestions.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This project has received funding from the ANR RESYST and from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme under the Grant Agreement No. 759702.
We are honored to dedicate this paper to Professor Masakiyo Miyazawa and to address him our warmest wishes for his 75th birthday. His beautiful contributions in the field of reflected Brownian motion (in particular [12]) are at the origin of our interest to this area and remain a great source of inspiration.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Franceschi, S., Raschel, K. A dual skew symmetry for transient reflected Brownian motion in an orthant. Queueing Syst 102, 123–141 (2022). https://doi.org/10.1007/s11134-022-09853-9
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11134-022-09853-9
Keywords
- Reflected Brownian motion in an orthant
- Absorption probability
- Escape probability
- Dual skew symmetry
- PDE with Neumann conditions