Abstract
In this paper, some new relative perturbation bounds for the eigenvalues of diagonalizable matrices are derived. A relative perturbation bound for singular values is also obtained. The present results improve some existing results.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
Many problems in science and engineering deal with eigenvalues and singular values of matrices. Here our main concern is perturbation bounds for matrix eigenvalues and singular values. In general, eigenvalue perturbation problems comprise the method to estimate the error when the eigenvalues of a perturbed matrix are approximated by the eigenvalues of an unperturbed matrix. Earlier, the authors working on perturbation theory have concentrated mainly on the bounds on the absolute differences between the approximate eigenvalue and true eigenvalue. However, there are practical situations when small eigenvalues should be determined to high relative accuracy. In this case, bounds on relative error are required. The main theme of this work is to obtain some relative perturbation bounds for eigenvalues of diagonalizable matrices. A result on relative perturbation bounds for singular value is also derived. Some techniques used in this work can be found in [1,2,3,4].
The following notations are used in this paper. \(M_n\) denotes the set of all matrices of order \(n \times n \) with complex entries and \(S_n\) is the set of all n! permutations of \(\{1,2, \ldots , n\}.\) \(A^t\) indicates the transpose of the matrix A. For a matrix \(A = (a_{ij}) \in M_n\) we use the following notations (see [5, 6]),
and
For \(p=2,\) Eq. (1) gives the norm \(\Vert .\Vert _2\) which is known as Frobenius norm. The operator norm is denoted by \(\Vert .\Vert \).
One of the well-known theorem in the direction of absolute perturbation bound for matrix eigenvalues is the Hoffman–Weildant Theorem [7], which states that, if A and B are normal \(n \times n\) matrices and \(\{\lambda _1, \lambda _2, \ldots , \lambda _n\}\) and \(\{\mu _1, \mu _2, \ldots , \mu _n \}\) are their eigenvalues respectively then there exist a permutation \(\pi \in S_n\) such that,
In 1998, Eisenstat and Ipsen [8] proved that a Hoffman–Weildant type absolute perturbation bound implies a relative bound for diagonalizable matrices. They proved that, if A and B both are diagonalizable matrices of order n and if A is non-singular then there exists a permutation \(\pi \in S_n\) such that,
where X and \({\tilde{X}}\) are the invertible matrices which diagonalize the matrices A and B respectively and \(\kappa (X)= \Vert X\Vert \Vert X^{-1}\Vert \) is the condition number of the matrix X. Furthermore, Li and Sun [9] obtained bounds by taking the matrix A as normal and non-singular and the matrix B arbitrary. Later Li and Chen [10] generalized the result obtained by Li and Sun [9] for diagonalizable matrices. Recently Chen [11] has proved a relative perturbation bound for singular values of \(n \times n\) matrices. If \(s_1 \ge s_2 \ge \cdots \ge s_n\) and \( {\tilde{s}}_1 \ge {\tilde{s}}_2 \ge \cdots \ge {\tilde{s}}_n\) are singular values of \(n \times n\) complex matrices A and B respectively, where A is non-singular, then he proved that, there exists a permutation \(\tau \in S_n\) such that,
where \(E = B-A.\)
The results mentioned earlier involve only Frobenius norm. Ikramov [12] partially generalized the the Hoffman–Weildant theorem with the norm \(\Vert .\Vert _p\) and obtained the following result. If A and B are hermitian matrices, then for \(1 < p \le 2\)
where \(d_p(\lambda (A), \lambda (B))\) is the “Holder distance” between the eigenvalues of A and B and it is given by
Recently Zhou et al. [4] generalized the above result for diagonalizable matrices.
Similar as Holder distance \(d_p(\lambda (A), \lambda (B))\) we define \(\tilde{d_p}(\lambda (A), \lambda (B))\) for relative perturbation as,
where the matrix A is non-singular. A similar quantity \(\tilde{d_p}(s(A), s(B))\) can be defined for the singular values \(s(A) = \{s_1, \ldots , s_n\}\) of a non-singular matrix A and \(s(B) = \{{\tilde{s}}_1, \ldots , {\tilde{s}}_n\}\) of a matrix B. In this paper we investigated whether a bound similar as (6) holds for \(\tilde{d_p}(\lambda (A), \lambda (B))\) and \(\tilde{d_p}(s(A), s(B)).\) In “Relative Perturbation Bounds” section we will prove some upper and lower bounds for \(\tilde{d_p}(\lambda (A), \lambda (B))\) of diagonalizable matrices A and B. In “Relative Perturbation Bound for Singular Values” section we will derive an upper bound for \(\tilde{d_p}(s(A), s(B)).\)
Relative Perturbation Bounds
Before going to the main results we mention some basic relations which are useful. Let \(A=(a_{ij})\) and \(B=(b_{ij})\) are in \(M_n\) and let \(p \ge 1\) and q be such that \(\frac{1}{p}+\frac{1}{q}=1,\) then we have the following relations (see [6])
If B is non-singular, then
If A is non-singular, then
For \(0 < p \le 2\)
A square matrix of non-negative real numbers is called a doubly stochastic matrix if each row sum and each column sum is 1. A permutation matrix is a square matrix that has exactly one entry is 1 in each row and each column and 0 elsewhere. The Hadamard Product of two matrices with same dimension is defined by entrywise multiplication. If \(A=(a_{ij})\) and \(B=(b_{ij})\) are two matrices with same dimension then the Hadamard Product of A and B denoted by \(A \circ B\) and defined by
For any two \(n \times n\) real matrices A and B, \(A \le _{e} B\) means \((B-A)\) is entrywise non-negative. Also if \(A=(a_{ij})\) be a \(n \times n\) matrix then we denote \(A^{|\circ |p} = (|a_{ij}|^p) \) for a real \(p > 0.\) We denote the singular values of A as \(s_1(A) \ge s_2(A) \ge \cdots \ge s_n(A).\) The next lemma involves entry wise inequality between two matrices.
Lemma 1
[13, Theorem 3.36] Let \(A \in M_n\) and let p, q be real numbers with \(0 < p \le 2\) and \(q \ge 2\). Then there exist two doubly stochastic matrices B, \(C \in M_n\) such that,
and
We prove the following lemma which is useful in this section.
Lemma 2
Let \(Y=(y_{ij})\) be \(n \times n\) doubly stochastic matrix and \(M=(m_{ij}) \in M_n.\) Then there exist permutations \(\tau \) and \({\bar{\tau }}\) in \(S_n\) such that for \(p>0\),
Proof
Since Y is doubly stochastic, so by well-known Birkhoff’s Theorem it can be expressed as
where \(P_k\) are the permutation matrices and \(\sum \limits _{k=1}^{n!} \alpha _k = 1,\) \(\alpha _k \ge 0\). Let \(\tau _k\) are the corresponding permutations of the permutation matrices \(P_k\). For \(\mathrm{M=(m_{ij}) \in M_n}\)
Let e denotes the \(n \times 1\) column vector whose components are all 1. Then
Let
Also let \(\tau \) and \({\bar{\tau }}\) are the permutations corresponding P and \({\bar{P}}\) respectively. Therefore we have,
Since P is a permutation matrix and \(\tau \) be the corresponding permutation, so from above relation
Similarly for other part we have
\(\square \)
Let us consider the matrices A and B in \(M_n\) with eigenvalues \(\{\alpha _1, \alpha _2, \ldots , \alpha _n\}\) and \(\{\beta _1, \beta _2, \ldots , \beta _n\}\) respectively and \({E} = A-B\) . Then there are invertible matrices P, Q and diagonal matrices \(D_1\), \(D_2\) such that,
where \(D_1\), \(D_2\) are diagonal matrices containing the eigenvalues of A, B respectively.
Theorem 1
If A, B are diagonalizable matrices and follow the above mentioned decompositions then there exists permutation \(\pi \) in \(S_n\) such that
and
where \(1< p \le 2\).
Proof
From Eqs. (14) and (15) we have
Multiplying \(P^{-1}\) from left and Q from right in the above relation we get,
Let \(\mathrm P^{-1}{Q} = Z = (z_{ij}).\) Then
Taking the norm \(\Vert . \Vert _p\) on both sides of the above equation where \(1 \le p <2,\) we get
From Lemma 1 there exists a doubly stochastic matrix \(B=(b_{ij})\) such that for \(1< p \le 2\)
Therefore,
Again by Lemma 2 there exists a permutation \(\pi \in S_n\) such that,
Also from (17) using (13) we have
\(\square \)
Theorem 2
Under the same assumption of Theorem 1 there is permutation \(\sigma \) in \(S_n\) such that
where \(q \ge 2\).
Proof
For \(2 \le q,\) taking norm \(\Vert .\Vert _q\) on both sides of (16) we have,
From Lemma 1 there exists a doubly stochastic matrix \(C=(c_{ij})\) such that
where \(Z=P^{-1}Q.\) Therefore,
By Lemma 2 there exists a permutation \(\sigma \in S_n\) such that,
\(\square \)
Relative Perturbation Bound for Singular Values
Let \(A, B \in M_n\) where A is non-singular, the singular value decompositions (SVD)
respectively, where \(U, V^{*}, U_1, V^*_1\) are \(n \times n\) unitary matrices, and
and \(s_1 \ge s_2 \ge \cdots \ge s_n\) and \( {\tilde{s}}_1 \ge {\tilde{s}}_2 \ge \cdots \ge {\tilde{s}}_n\) are singular values of A and B respectively. In the next Theorem we use the following relation,
Theorem 3
Let \(A, B \in M_n\) with A is non-singular, follow the above mentioned singular value decomposition. Then there exists permutation \(\pi \) of \(S_n\) such that for \(p>1\),
where \(E= B-A.\)
Proof
Given \(A= U \varSigma V^*\) and \(B= U_1 {\tilde{\varSigma }} V^*_1,\) where \(U, V, U_1, V_1\) are \(n \times n\) unitary matrices. Since A is non-singular so,
where \(U^* U_1= P=(p_{ij})\) and \(V^*V_1 = Q = (q_{ij}).\) Therefore,
Also
In addition
Therefore
Adding the equations (18) and (19) we get,
From Lemma 1 there exists double stochastic matrix \(B=(b_{ij})\) such that,
Again from Lemma 2 there exists a permutation \(\pi \) of \(S_n\) such that,
which yields the desired result. \(\square \)
Remark 1
The results on relative perturbation bounds obtained in “Relative Perturbation Bounds” section generalize Corollary 5.2 of [8] and the result for singular values, proved in “Relative Perturbation Bound for Singular Values” section generalize Theorem 2.2 of [11].
As we have mentioned previously, relative error bounds are required when there are eigenvalues of small magnitude. There are practical situations where small eigenvalues have physical meaning and such situations include computing modes of vibration in a finite element context, and computing energy levels in quantum mechanical systems [14]. Also, relative perturbation bounds for eigenvalues and singular values have an applications in developing high accuracy numerical methods for eigenvalues and singular value problems [15, 16].
References
Sharma, K., Marin, M.: Effect of distinct conductive and thermodynamic temperatures on the reflection of plane waves in micropolar elastic half-space. Univ. Politec. Buchar. Sci. Bull. Ser. A Appl. Math. Phys. 75, 121–132 (2013)
Marin, M.: On weak solutions in elasticity of dipolar bodies with voids. J. Comput. Appl. Math. 82(1–2), 291–297 (1997)
Marin, M.: Harmonic vibrations in thermoelasticity of microstretch materials. J. Vib. Acoust. 132(4), 044501 (2010)
Zhou, D., Chen, G., Wu, G., Chen, X.: Perturbation bounds for eigenvalues of diagonalizable matrices and singular values. J. Inequalities Appl. 2016(1), 113 (2016)
Li, R.C.: Norms of certain matrices with applications to variations of the spectra of matrices and matrix pencils. Linear Algebra Appl. 182, 199–234 (1993)
Ostrowski, A.: über normen von matrizen. Mathematische Zeitschrift 63(1), 2–18 (1955)
Hoffman, A.J., Wielandt, H.W.: The variation of the spectrum of a normal matrix. Duke Math. J. 20(1), 37–39 (1953)
Eisenstat, S.C., Ipsen, I.C.: Three absolute perturbation bounds for matrix eigenvalues imply relative bounds. SIAM J. Matrix Anal. Appl. 20(1), 149–158 (1998)
Li, W., Sun, W.: The perturbation bounds for eigenvalues of normal matrices. Numer. Linear Algebra Appl. 12(2–3), 89–94 (2005)
Li, W., Chen, J.: The eigenvalue perturbation bound for arbitrary matrices. J. Comput. Math. 24, 141–148 (2006)
Chen, X.S.: Two perturbation bounds for singular values and eigenvalues. BIT Numer. Math. 48(3), 493–497 (2008)
Ikramov, K.D.: Some estimates for the eigenvalues of matrices. USSR Comput. Math. Math. Phys. 10(1), 226–233 (1970)
Zhan, X.: Matrix Inequalities. Springer, Berlin (2004)
Demmel, J., Gu, M., Eisenstat, S., Slapničar, I., Veselić, K., Drmač, Z.: Computing the singular value decomposition with high relative accuracy. Linear Algebra Appl. 299(1–3), 21–80 (1999)
Mathias, R.: Accurate eigensystem computations by Jacobi methods. SIAM J. Matrix Anal. Appl. 16(3), 977–1003 (1995)
Barlow, J., Demmel, J.: Computing accurate eigensystems of scaled diagonally dominant matrices. SIAM J. Numer. Anal. 27(3), 762–791 (1990)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Patra, A., Srivastava, P.D. Relative Perturbation Bounds for Matrix Eigenvalues and Singular Values. Int. J. Appl. Comput. Math 4, 138 (2018). https://doi.org/10.1007/s40819-018-0568-9
Published:
DOI: https://doi.org/10.1007/s40819-018-0568-9