Abstract
In many areas, there arise linear systems of the form
where \(A \in {\mathbf {R}}^{n\times n}, D \in {\mathbf {R}}^{p\times p}\) are symmetric and positive semi-definite and \(B \in {\mathbf {R}}^{p \times n}.\) In this paper, some simple criteria for this special linear systems to have solutions and the unique solution are provided, and the solvability conditions are expressed by \(A, B, D, f\) and \(g\).
Similar content being viewed by others
Avoid common mistakes on your manuscript.
1 Introduction
Throughout this paper, we denote the real \(m \times n\) matrix space by \({{\mathbf {R}}}^{m \times n}\) and denote the transpose, the Moore–Penrose generalized inverse, the range space and the null space of a real matrix \(A \in {{\mathbf {R}}}^{m \times n}\) by \(A^\top \), \(A^+,\)\({\mathcal {R}}(A)\) and \({\mathcal {N}}(A)\), respectively. \(I_n\) represents the identity matrix of size \(n\). \(P_{{\mathcal {L}}}\) stands for the orthogonal projector on the subspace \({\mathcal {L}}\subset {\mathbf {R}}^n.\) We write \(A \ge 0\) (\(A > 0\)) if \(A\) is a symmetric positive semi-definite matrix (symmetric positive definite matrix). Furthermore, for a matrix \(A \in {{\mathbf {R}}}^{m \times n},\) let \(E_A\) and \(F_A\) stand for two orthogonal projectors: \(E_A=I_m-AA^+\), \(F_A=I_n-A^+A.\)
Recently, Bai and Bai [1] have established some necessary and sufficient conditions for the nonsingularity of the block two-by-two matrix by making use of the singular value decompositions and the Moore–Penrose generalized inverses of the matrix blocks. This paper is a special case of [1], which considers the solution of block \( 2\times 2\) linear systems of the form
where \(A \in {\mathbf {R}}^{n\times n}, D \in {\mathbf {R}}^{p\times p}\) are symmetric and positive semi-definite and \(B \in {\mathbf {R}}^{p \times n}.\) Linear systems of the form (1) arise in a number of applications including mixed finite element solution of the Navier–Stokes, the Maxwell equations and constraint optimization [2,3,4,5]. There have been many methods for solving the (generalized) saddle point problems (1) [6,7,8,9,10,11,12]. However, before to solve (1), a significant problem is under which conditions the equation of (1) is solvable ? In this paper, some simple criteria for the linear systems (1) to have solutions and the unique solution are provided, and the solvability conditions are expressed by \(A, B, D, f\) and \(g.\)
2 Main Results
To begin with, we introduce some lemmata.
Lemma 1
[13] If \(L \in \mathbf{R}^{m \times q}, \ b \in \mathbf{R}^{m},\) then \(Ly=b\) has a solution \(y \in \mathbf{R}^{q}\) if and only if one of the following conditions is satisfied:
-
(i)
\(LL^+b=b;\)
-
(ii)
\( b\in {\mathcal {R}}(L);\)
-
(iii)
\(N(L^\top )\subseteq N(b^\top ),\) that is, \( L^\top x=0\Rightarrow b^\top x=0\) for some \(x\in \mathbf{R}^{m}.\)
In this case, the general solution of the equation can be described as \( y=L^+ b+F_Lz\), where \(z \in \mathbf{R}^q\) is an arbitrary vector.
Lemma 2
[13] If \(A \in {{\mathbf {R}}}^{m \times n}, B \in {{\mathbf {R}}}^{n \times p},\) then
Lemma 3
[13] If \(A \in {{\mathbf {R}}}^{m \times n} \) and \(P_{{\mathcal {L}}}\) is an orthogonal projector on the subspace \({\mathcal {L}}\), then
Lemma 4
[13] Let \(P_{{\mathcal {L}}}\) and \(P_{{\mathcal {M}}}\) be the orthogonal projectors on the subspaces \({\mathcal {L}}\) and \({\mathcal {M}},\) respectively. Then \(P_{\mathcal {L}}P_{\mathcal {M}}\) is an orthogonal projector if and only if \(P_{\mathcal {L}}P_{\mathcal {M}}=P_{\mathcal {M}}P_{\mathcal {L}}.\) In this case, \(P_{\mathcal {L}}P_{\mathcal {M}}=P_{{\mathcal {L}}\cap {\mathcal {M}}}.\)
Lemma 5
[14] Assume that \(A \in {{\mathbf {R}}}^{m \times n}\) and \({\mathcal {T}}\) is a subspace of \({{\mathbf {R}}}^{n}\). Let \(\tilde{{\mathcal {T}}}={\mathcal {R}}(P_{\mathcal {T}}A^\top )=P_{\mathcal {T}} {\mathcal {R}}(A^\top ),\) then
Lemma 6
Suppose that a matrix \(M\) is partitioned as
where \(L_{11}\) and \(L_{22}\) are square. If \(M\) and \(L_{11}\) are nonsingular, then
where \(K=L_{22}- L_{21}L_{11}^{-1}L_{12}.\)
We first consider a special case: \(D=0.\) In this case, the equation of (1) can be equivalently written as
According to Lemma 1, the second equation of (2) has a solution if and only if \(BB^+g=g.\) In which case, the general solution of \(Bx=g\) is
where \(z\in {\mathbf {R}}^{n}\) is an arbitrary vector. Substituting (3) into the first equation of (2), we obtain
It follows from Lemma 1 that the equation of (4) with unknown vector \(y\) has a solution if and only if
and the general solution of (4) with respect to \(y\) is
where \(Q=F_BAF_B\) and \(v\in {\mathbf {R}}^{p}\) is an arbitrary vector. Using Lemma 1 again, we know that the equation of (5) with respect to \(z\) has a solution if and only if
In this case, the general solution of (5) is
where \(u \in {\mathbf {R}}^{n}\) is an arbitrary vector. Substituting (8) into (3) and (6), we obtain
Theorem 1
Assume that \(A \in {\mathbf {R}}^{n\times n}, B \in {\mathbf {R}}^{p \times n}\) and \(D=0.\) Let \(Q=F_BAF_B;\) then the equation of (1) has a solution if and only if
In which case, the general solution of (1) is
where \(u \in {\mathbf {R}}^{n}\) and \(v\in {\mathbf {R}}^{p}\) are arbitrary vectors.
Corollary 1
Assume that \(A \in {\mathbf {R}}^{n\times n}, B \in {\mathbf {R}}^{p \times n}\) and \(A\ge 0, \ D=0.\) Let \(Q=F_BAF_B;\) then the equation of (1) has a solution if and only if
or equivalently,
In which case, the general solution of (1) is
where \(u \in {\mathbf {R}}^{n}\) and \(v\in {\mathbf {R}}^{p}\) are arbitrary vectors.
Proof
If \(A\ge 0,\) it is easily seen that \({\mathcal {R}}(Q)= {\mathcal {R}}(F_BA),\) then we have
Thus, we can obtain (12) by (9). On the other hand, we notice that
which implies that \(F_BE_Q=E_QF_B.\) From Lemma 4, we know \(F_BE_Q\) is an orthogonal projector, that is,
By Lemma 2, we have
By Lemma 5,
Therefore,
Using Lemmas 2, 3 and (18), we have
which implies that (12) and (13) are equivalent. By (10), (11) and (16), we can get (14) and (15). \(\square \)
Corollary 2
Assume that \(A \in {\mathbf {R}}^{n\times n}, B \in {\mathbf {R}}^{p \times n}\) and \(A\ge 0, \ D=0.\) Let \(Q=F_BAF_B;\) then the solution of (1) is unique if and only if one of the following conditions is satisfied:
-
(a)
\(\left[ \begin{array}{cc} A &{}\quad B^\top \\ B &{}\quad 0 \\ \end{array} \right] \) is nonsingular;
-
(b)
\( E_B=0, \ E_QF_B=0 ;\)
-
(c)
\(\text{ rank }(B)=p\) (that is, \(B\) is of full row rank), \(A+B^\top B\) is nonsingular.
In which case, the unique solution of (1) is
Proof
Observe that the coefficient matrix of (1) is square, and therefore, the equation of (1) has a unique solution if and only if the condition (a) holds. From (14) and (15), the solution is unique if and only if \( E_B=0, E_QF_B=0.\) By (18), we have
It follows from \(A\ge 0\) that \({\mathcal {N}}(A+B^\top B)={\mathcal {N}}(A)\cap {\mathcal {N}}(B),\) which implies that (b) and (c) are equivalent. \(\square \)
Corollary 3
Assume that \(A \in {\mathbf {R}}^{n\times n}, B \in {\mathbf {R}}^{p \times n}\) and \(A > 0, \ D=0.\) Let \(Q=F_BAF_B;\) then the equation of (1) has a solution if and only if \(g\in {\mathcal {R}}(B).\) In which case, the general solution of (1) is
where \(v\in {\mathbf {R}}^{p}\) are arbitrary vectors.
Now, if \(A\ge 0 \) and \( D\ge 0,\) can we achieve the similar result as that of Corollary 1? The answer is affirmative.
Theorem 2
Assume that \(A \in {\mathbf {R}}^{n\times n}, D \in {\mathbf {R}}^{p\times p}, B \in {\mathbf {R}}^{p \times n}\) and \(A\ge 0, \ D \ge 0.\) Then the equation of (1) has a solution if and only if
Proof
The necessary part is clear. We now prove the sufficient part. When the conditions (21) hold, there exist vectors \(a,b, c\) and \(d\) such that
Let \([x_0^\top , y_0^\top ]^\top \) be a solution of the equation
That is,
It follows from (23) that
Thus, we have \(x_0^\top Ax_0+y_0^\top Dy_0=0.\) Notice that \(A\ge 0, \ D \ge 0,\) we can get
Substituting (25) into (23), we obtain
It follows from (22), (25) and (26) that
Therefore, according to the third condition of Lemma 1, we know the equation of (1) is solvable.
Theorem 3
Assume that \(A \in {\mathbf {R}}^{n\times n}, D \in {\mathbf {R}}^{p\times p}, B \in {\mathbf {R}}^{p \times n}\) and \(A\ge 0, \ D \ge 0.\) Then the solution of (1) is unique if and only if one of the following conditions is satisfied:
-
(c1)
\(\left[ \begin{array}{ll} A &{} B^\top \\ B &{} -D \\ \end{array} \right] \) is nonsingular;
-
(c2)
\(A+B^\top B \ \text{ and } \ D+BB^\top \) are nonsingular;
-
(c3)
\({\mathcal {N}}(A)\cap {\mathcal {N}}(B)=\{0\}, \ {\mathcal {N}}(D)\cap {\mathcal {N}}(B^\top )=\{0\}.\)
In which case, the unique solution of (1) is
where \(H=D+B(A+B^\top B)^{-1}(B^\top - B^\top D).\)
Proof
“\((c1) \Rightarrow (c2)\)” If \(A+B^\top B\) or \(D+BB^\top \) is singular, without loss of generality, we assume that \(A+B^\top B\) is singular, then there exists a nonzero vector \({\tilde{x}}\) such that \({\tilde{x}}\in {\mathcal {N}}(A+B^\top B).\) Notice that \({\mathcal {N}}(A+B^\top B)= {\mathcal {N}}(A)\cap {\mathcal {N}}(B),\) thus, \(A{\tilde{x}}=0, B{\tilde{x}}=0,\) that is,
which implies that \(\left[ \begin{array}{ll} A &{}\quad B^\top \\ B &{}\quad -\,D \\ \end{array} \right] \) is singular, this is in contradiction with the condition (c1). “\((c2) \Rightarrow (c1)\)” Let \([u^\top , v^\top ]^\top \) be a solution of the equation
That is,
From the proof of Theorem 2, we can get
Hence,
It follows from (29) and condition (c2) that \(u=0,v=0,\) which implies that \(\left[ \begin{array}{ll} A &{}\quad B^\top \\ B &{}\quad -\,D \\ \end{array} \right] \) is nonsingular. The equivalence of (c2) and (c3) is clear.
The equation of (1) can be equivalently written as
Applying Lemma 6 to (30), we can easily obtain the expressions of (27) and (28). \(\square \)
References
Bai, Z.-J., Bai, Z.-Z.: On nonsingularity of block two-by-two matrices. Linear Algebra Appl. 439, 2388–2404 (2013)
Girault, V., Raviart, P.-A.: Finite Element Approximation of the Navier–Stokes Equations. Springer, Berlin (1979)
Brenner, S.C., Scott, L.R.: The Mathematical Theory of Finite Element Methods. Springer, Berlin (2002)
Monk, P.: Finite Element Methods for Maxwell’s Equations. Oxford University Press, Oxford (2003)
Nocedal, J., Wright, S.: Numerical Optimization. Springer, Berlin (1999)
Benzi, M., Golub, G.H., Liesen, J.: Numerical solution of saddle point problems. Acta Numer. 14, 1–137 (2005)
Golub, G.H., Greif, C.: On solving block-structured indefinite linear systems. SIAM J. Sci. Comput. 24, 2076–2092 (2003)
Botchev, M.A., Golub, G.H.: A class of nonsymmetric preconditioners for saddle point problems. SIAM J. Matrix Anal. Appl. 27, 1125–1149 (2006)
Elman, H.C., Silvester, D.J., Wathen, A.J.: Performance and analysis of saddle point preconditioners for the discrete steady-state Navier–Stokes equations. Numer. Math. 90, 665–688 (2002)
Bramble, J.H., Pasciak, J.E., Vassilev, A.T.: Uzawa type algorithms for nonsymmetric saddle point problems. Math. Comp. 69, 667–689 (2000)
Chen, X., Hashimoto, K.: Numerical validation of solutions of saddle point matrix equations. Numer. Linear Algebra Appl. 10, 661–672 (2003)
Bai, Z.-Z., Golub, G.H., Ng, M.K.: Hermitian and skew-Hermitian splitting methods for non-Hermitian positive definite linear systems. SIAM J. Matrix Anal. Appl. 24, 603–626 (2003)
Ben-Israel, A., Greville, T.N.E.: Generalized Inverse: Theory and Applications. Wiley, New York (1974)
Chen, Y.L.: Representations and cramer rules for the solution of a restricted matrix equation. Linear Multilinear Algebra 35, 339–354 (1993)
Acknowledgements
The authors are thankful to the referees for very valuable comments and suggestions concerning an earlier version of this paper. The research of the third author is supported by the National Natural Science Foundation of China under Grant No. 11401305.
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by Miin Huey Ang.
Rights and permissions
About this article
Cite this article
Yuan, Y., Zuo, K., Liu, H. et al. Some Simple Criteria for the Solvability of Block \(2 \times 2\) Linear Systems. Bull. Malays. Math. Sci. Soc. 42, 2287–2294 (2019). https://doi.org/10.1007/s40840-018-0601-5
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40840-018-0601-5