Block diagonal form
Let be a linear operator over a complex vector space , with characteristic polynomial and minimal annihilating polynomial given by Eq. (4.13) and Eq. (4.14), respectively. The restriction to complex vector spaces ensures that all roots of the polynomials and are eigenvalues. A canonical form can also be derived for operators on real vector spaces, but it relies heavily on the complex version.
If is the th elementary divisor of , define the subspace
This subspace is invariant under , for
Our first task will be to show that is a direct sum of these invariant subspaces,
Lemma 4.4 · Annihilation order of generalized eigenvectors
If is an elementary divisor of the operator and for some , then
Proof
There is clearly no loss of generality in setting in the proof of this result. The proof proceeds by induction on .
Case : Let be any vector such that and set
Since , this vector satisfies the eigenvector equation, . If is the minimal annihilating polynomial of , then
As all for it follows that , which proves the case
Case : Suppose the lemma has been proved for . Then
which concludes the proof of the lemma.
If , let be a basis of and extend to a basis of using Theorem 3.7:
Of course if is the only elementary divisor of then , since as every vector is annihilated by . If, however, we will show that the vectors
form a basis of , where
Since the vectors listed in Eq. (4.17) are in number it is only necessary to show that they are linearly independent. Suppose that for some constants
Apply to this equation. The first sum on the left is annihilated since it belongs to , resulting in
and since we conclude from Lemma 4.4 that
Hence , and there exist constants such that
As the set is by definition a basis of , these constants must vanish: for all and . Substituting into Eq. (4.19), it fol lows from the linear independence of that all vanish as well. This proves the linear independence of the vectors in Eq. (4.17).
Let . By Eq. (4.18) every vector is of the form
since this is true of each of the vectors spanning . Conversely, suppose and let be the components of with respect to the original basis Eq. (4.16); then
Hence consists precisely of all vectors of the form where is an arbitrary vector of Furthermore is an invariant subspace of , for if then
Hence and are complementary invariant subspaces, , and the matrix of with respect to the basis Eq. (4.17) has block diagonal form
where is the matrix of and is the matrix of
Now on the subspace we have, by definition,
Hence is the only eigenvalue of , for if is an eigenvector of corresponding to an eigenvalue ,
then
from which it follows that since . The characteristic equation is therefore
Furthermore, the operator
is invertible. For, let be an arbitrary vector in and set where Let be the unique decomposition such that and ; then
and since any surjective (onto) linear operator on a finite dimensional vector space is bijective (one-to-one), the map must be invertible on . Hence
and cannot be an eigenvalue of .
The characteristic equation of is
and from Eq. (4.20) and Eq. (4.21) the only way the right-hand side can equal the expression in Eq. (4.13) is if
Hence, the dimension of each space is equal to the multiplicity of the eigenvalue and from the Cayley–Hamilton Theorem 4.3 it follows that
Repeating this process on , and proceeding inductively, it follows that
and setting
to be a basis adapted to this decomposition, the matrix of has block diagonal form
The restricted operators each have a minimal polynomial equation of the form
so that
Nilpotent operators
Any operator satisfying an equation of the form is called a nilpotent operator. The matrix of any nilpotent operator satisfies , and is called a nilpotent matrix. From Eq. (4.23), each matrix in the decomposition Eq. (4.22) is a multiple of the unit matrix plus a nilpotent matrix ,
We next find a basis that expresses the matrix of any nilpotent operator in a standard (canonical) form.
Let be a finite dimensional space, not necessarily complex, , and a nilpotent operator on . Set to be the smallest positive integer such that . Evidently if , while if then and . Define the subspaces of by
These subspaces form an increasing sequence,
and all are invariant under , for if then also belongs to since . The set inclusions are strict inclusion in every case, for suppose that for some . Then for any vector we have
Hence , and continuing inductively we find that This leads to the conclusion that for all , which contradicts the assumption that . Hence none of the subspaces can be equal to each other.
We call a set of vectors belonging to linearly independent with respect to if
Lemma 4.5 · Quotient dimensions and relative linear independence
Set so that . Then is the maximum number of vectors in that canform a set that is linearly independent with respect to
Proof
Let , and let be a basis of . Suppose is a maximal set of vectors l.i. with respect to ; that is, a set that cannot be extended to a larger such set. Such a maximal set must exist since any set of vectors that is l.i. with respect to is linearly independent and therefore cannot exceed in number. We show that is a basis of :
(a) is a l.i. set since
implies firstly that all vanish by the requirement that the vectors are l.i. with respect to , and secondly all the because the are l.i.
(b) spans else there would exist a vector that cannot be expressed as a linear combination of vectors of , and would be linearly independent. In that case, the set of vectors would be l.i. with respect to , for then from the linear independence of all and . This contradicts the maximality of , and must span the whole of
This proves the lemma.
Let be a maximal set of vectors in that is l.i. with respect to . From Lemma 4.5 we have . The vectors
all belong to and are l.i. with respect to , for if
then
from which it follows that
Since are l.i. with respect to we must have
Hence . Applying the same argument to all other gives
Now complete the set to a maximal system of vectors in that is l.i. with respect to
Similarly, define the vectors and extend to a maximal system in . Continuing in this way, form a series of vectors that are linearly independent and form a basis of and may be displayed in the following scheme:
Let be the subspace generated by the th column where . These subspaces are all invariant under , since , and the bottom elements are annihilated by ,
Since the vectors are linearly independent and form a basis for , the subspaces are non-intersecting, and
where the dimension of the th subspace is given by height of the th column. In particular, and
If a basis is chosen in by proceeding up the th column starting from the vector in the bottom row,
then the matrix of has all components zero except for 1’s in the superdiagonal,
Check this matrix representation by remembering that the components of the matrix of an operator with respect to a basis are given by
Now set and note that , etc.
Selecting a basis for that runs through the subspaces in order,
the matrix of appears in block diagonal form
where each submatrix has the form Eq. (4.25).
Jordan canonical form
Let be a complex vector space and a linear operator on . To summarize the above conclusions: there exists a basis of such that the operator has matrix in block diagonal form Eq. (4.22), and each has the form , where is a nilpotent matrix. The basis can then be further specialized such that each nilpotent matrix is in turn decomposed into a block diagonal form Eq. (4.26) such that the submatrices along the diagonal all have the form Eq. (4.25). This is called the Jordan canonical form of the matrix .
In other words, if is an arbitrary complex matrix, then there exists a non-singular complex matrix such that is in Jordan form. The essential features of the matrix can be summarized by the following Segré characteristics:
| Eigenvalues | … | ||
|---|---|---|---|
| Multiplicities | … | ||
| … |
where is the number of eigenvectors corresponding to the eigenvalue and
The Segré characteristics are determined entirely by properties of the operator such as its eigenvalues and its elementary divisors. It is important, however, to realize that the Jordan canonical form only applies in the context of a complex vector space since it depends critically on the fundamental theorem of algebra. For a real matrix there is no guarantee that a real similarity transformation will convert it to the Jordan form.
Let be a transformation on a four-dimensional vector space having matrix with respect to a basis whose components are
The characteristic equation can be written in the form
which has two roots , both of which are repeated roots. Each root corresponds to just a single eigenvector, written in column vector form as
satisfying
Let and be the vectors
and we find that
Expressing these column vectors in terms of the original basis
provides a new basis with respect to which the matrix of operator has block diagona Jordan form
The matrix needed to accomplish this form by the similarity transformation is found by solving for the in terms of the
which can be written
The matrix is summarized by the Segré characteristics:
2 2 (2) (2)
Verify that in Example 4.6.
Problems
On a vector space let and be two commuting operators,
(a) Show that if is an eigenvector of then so is
(b) Show that a basis for can be found such that the matrices of both and with respect to thi basis are in upper triangular form.
For the operator on a four-dimensional vector space given in Problem 3.10, show that no basis exists such that the matrix of is diagonal. Find a basis in which the matrix
of has the Jordan form
for some , and calculate the value of .
Let be the matrix
Find the minimal annihilating polynomial and the characteristic polynomial of this matrix, its eigenvalues and eigenvectors, and find a basis that reduces it to its Jordan canonical form