中文

Block diagonal form

Let be a linear operator over a complex vector space , with characteristic polynomial and minimal annihilating polynomial given by Eq. (4.13) and Eq. (4.14), respectively. The restriction to complex vector spaces ensures that all roots of the polynomials and are eigenvalues. A canonical form can also be derived for operators on real vector spaces, but it relies heavily on the complex version.

If is the th elementary divisor of , define the subspace

This subspace is invariant under , for

Our first task will be to show that is a direct sum of these invariant subspaces,

Lemma 4.4 · Annihilation order of generalized eigenvectors

If is an elementary divisor of the operator and for some , then

Proof

There is clearly no loss of generality in setting in the proof of this result. The proof proceeds by induction on .

Case : Let be any vector such that and set

Since , this vector satisfies the eigenvector equation, . If is the minimal annihilating polynomial of , then

As all for it follows that , which proves the case

Case : Suppose the lemma has been proved for . Then

which concludes the proof of the lemma.

If , let be a basis of and extend to a basis of using Theorem 3.7:

Of course if is the only elementary divisor of then , since as every vector is annihilated by . If, however, we will show that the vectors

form a basis of , where

Since the vectors listed in Eq. (4.17) are in number it is only necessary to show that they are linearly independent. Suppose that for some constants

Apply to this equation. The first sum on the left is annihilated since it belongs to , resulting in

and since we conclude from Lemma 4.4 that

Hence , and there exist constants such that

As the set is by definition a basis of , these constants must vanish: for all and . Substituting into Eq. (4.19), it fol lows from the linear independence of that all vanish as well. This proves the linear independence of the vectors in Eq. (4.17).

Let . By Eq. (4.18) every vector is of the form

since this is true of each of the vectors spanning . Conversely, suppose and let be the components of with respect to the original basis Eq. (4.16); then

Hence consists precisely of all vectors of the form where is an arbitrary vector of Furthermore is an invariant subspace of , for if then

Hence and are complementary invariant subspaces, , and the matrix of with respect to the basis Eq. (4.17) has block diagonal form

where is the matrix of and is the matrix of

Now on the subspace we have, by definition,

Hence is the only eigenvalue of , for if is an eigenvector of corresponding to an eigenvalue ,

then

from which it follows that since . The characteristic equation is therefore

Furthermore, the operator

is invertible. For, let be an arbitrary vector in and set where Let be the unique decomposition such that and ; then

and since any surjective (onto) linear operator on a finite dimensional vector space is bijective (one-to-one), the map must be invertible on . Hence

and cannot be an eigenvalue of .

The characteristic equation of is

and from Eq. (4.20) and Eq. (4.21) the only way the right-hand side can equal the expression in Eq. (4.13) is if

Hence, the dimension of each space is equal to the multiplicity of the eigenvalue and from the Cayley–Hamilton Theorem 4.3 it follows that

Repeating this process on , and proceeding inductively, it follows that

and setting

to be a basis adapted to this decomposition, the matrix of has block diagonal form

The restricted operators each have a minimal polynomial equation of the form

so that

Nilpotent operators

Any operator satisfying an equation of the form is called a nilpotent operator. The matrix of any nilpotent operator satisfies , and is called a nilpotent matrix. From Eq. (4.23), each matrix in the decomposition Eq. (4.22) is a multiple of the unit matrix plus a nilpotent matrix ,

We next find a basis that expresses the matrix of any nilpotent operator in a standard (canonical) form.

Let be a finite dimensional space, not necessarily complex, , and a nilpotent operator on . Set to be the smallest positive integer such that . Evidently if , while if then and . Define the subspaces of by

These subspaces form an increasing sequence,

and all are invariant under , for if then also belongs to since . The set inclusions are strict inclusion in every case, for suppose that for some . Then for any vector we have

Hence , and continuing inductively we find that This leads to the conclusion that for all , which contradicts the assumption that . Hence none of the subspaces can be equal to each other.

We call a set of vectors belonging to linearly independent with respect to if

Lemma 4.5 · Quotient dimensions and relative linear independence

Set so that . Then is the maximum number of vectors in that canform a set that is linearly independent with respect to

Proof

Let , and let be a basis of . Suppose is a maximal set of vectors l.i. with respect to ; that is, a set that cannot be extended to a larger such set. Such a maximal set must exist since any set of vectors that is l.i. with respect to is linearly independent and therefore cannot exceed in number. We show that is a basis of :

(a) is a l.i. set since

implies firstly that all vanish by the requirement that the vectors are l.i. with respect to , and secondly all the because the are l.i.

(b) spans else there would exist a vector that cannot be expressed as a linear combination of vectors of , and would be linearly independent. In that case, the set of vectors would be l.i. with respect to , for then from the linear independence of all and . This contradicts the maximality of , and must span the whole of

This proves the lemma.

Let be a maximal set of vectors in that is l.i. with respect to . From Lemma 4.5 we have . The vectors

all belong to and are l.i. with respect to , for if

then

from which it follows that

Since are l.i. with respect to we must have

Hence . Applying the same argument to all other gives

Now complete the set to a maximal system of vectors in that is l.i. with respect to

Similarly, define the vectors and extend to a maximal system in . Continuing in this way, form a series of vectors that are linearly independent and form a basis of and may be displayed in the following scheme:

Let be the subspace generated by the th column where . These subspaces are all invariant under , since , and the bottom elements are annihilated by ,

Since the vectors are linearly independent and form a basis for , the subspaces are non-intersecting, and

where the dimension of the th subspace is given by height of the th column. In particular, and

If a basis is chosen in by proceeding up the th column starting from the vector in the bottom row,

then the matrix of has all components zero except for 1’s in the superdiagonal,

Check this matrix representation by remembering that the components of the matrix of an operator with respect to a basis are given by

Now set and note that , etc.

Selecting a basis for that runs through the subspaces in order,

the matrix of appears in block diagonal form

where each submatrix has the form Eq. (4.25).

Jordan canonical form

Let be a complex vector space and a linear operator on . To summarize the above conclusions: there exists a basis of such that the operator has matrix in block diagonal form Eq. (4.22), and each has the form , where is a nilpotent matrix. The basis can then be further specialized such that each nilpotent matrix is in turn decomposed into a block diagonal form Eq. (4.26) such that the submatrices along the diagonal all have the form Eq. (4.25). This is called the Jordan canonical form of the matrix .

In other words, if is an arbitrary complex matrix, then there exists a non-singular complex matrix such that is in Jordan form. The essential features of the matrix can be summarized by the following Segré characteristics:

Eigenvalues…
Multiplicities…
…

where is the number of eigenvectors corresponding to the eigenvalue and

The Segré characteristics are determined entirely by properties of the operator such as its eigenvalues and its elementary divisors. It is important, however, to realize that the Jordan canonical form only applies in the context of a complex vector space since it depends critically on the fundamental theorem of algebra. For a real matrix there is no guarantee that a real similarity transformation will convert it to the Jordan form.

Let be a transformation on a four-dimensional vector space having matrix with respect to a basis whose components are

The characteristic equation can be written in the form

which has two roots , both of which are repeated roots. Each root corresponds to just a single eigenvector, written in column vector form as

satisfying

Let and be the vectors

and we find that

Expressing these column vectors in terms of the original basis

provides a new basis with respect to which the matrix of operator has block diagona Jordan form

The matrix needed to accomplish this form by the similarity transformation is found by solving for the in terms of the

which can be written

The matrix is summarized by the Segré characteristics:

22
(2)(2)

Verify that in Example 4.6.

Problems

On a vector space let and be two commuting operators,

(a) Show that if is an eigenvector of then so is

(b) Show that a basis for can be found such that the matrices of both and with respect to thi basis are in upper triangular form.

For the operator on a four-dimensional vector space given in Problem 3.10, show that no basis exists such that the matrix of is diagonal. Find a basis in which the matrix

of has the Jordan form

for some , and calculate the value of .

Let be the matrix

Find the minimal annihilating polynomial and the characteristic polynomial of this matrix, its eigenvalues and eigenvectors, and find a basis that reduces it to its Jordan canonical form