Orthogonal subspaces
Two vectors are said to be orthogonal if , written . If is a subspace of we denote its orthogonal complement by
Theorem 13.7 · The orthogonal complement is a closed subspace
If is a subspace of then is also a subspace.
Proof
is clearly a vector subspace, for since
for all . The space is closed, for if where , then
for all . Hence
Theorem 13.8 · Orthogonal decomposition and projection theorem
If is a subspace of a Hilbert space then every has a unique decomposition
Proof
The idea behind the proof of this theorem is to find the element of that is ‘nearest to . Just as in Euclidean space, this is the orthogonal projection of the vector onto the subspace . Let
and a sequence of vectors such that . The sequence is Cauchy, for if we set and in the parallelogram law Eq. (13.2), then
For any let be such that for all . Setting , both > in Eq. (13.8) we find . Hence is a Cauchy sequence.
Since is complete and is a closed subspace, there exists a vector such that . Setting , it follows from the exercise after Lemma 13.5 that
For any set , so that . Then
Hence , so that . Since is an arbitrary vector in , we have A subspace and its orthogonal complement can only have the zero vector in common, , for if then , which implies that . If , with and , then the vector is equal to . Hence and , the decomposition is unique.
Corollary 13.9 · Double orthogonal complement of a closed subspace
For any subspace
Proof
for if then for all . Conversely, let By Theorem 13.8 has a unique decomposition where and . Using Theorem 13.8 again but with replaced by , it follows that Hence
Riesz representation theorem
For every the map is a linear functional on . Linearity is obvious and continuity follows from Lemma 13.3. The following theorem shows that all (continuous) linear functionals on a Hilbert space are of this form, a result of considerable significance in quantum mechanics, as it motivates Dirac’s bra-ket notation.
Theorem 13.10 · Riesz representation theorem
(Riesz representation theorem) If is a linear functional on a Hilbert space , then there is a unique vector such that
Proof
Since a linear functional is required to be continuous, we always have
Let be the null space of ,
This is a closed subspace, for for all , then by continuity. If then vanishes on and one can set . Assume therefore that , and let be a non-zero vector such that . By Theorem 13.8, there is a unique decomposition
Then since . For any we may write
where the first term on the right-hand side belongs to since the linear functional gives the value 0 when applied to it, while the second term belongs to as it is proportional to . For any we have then
In particular, setting
gives
Hence this is the vector required for the theorem. It is the unique vector with this property, for if for all then , on setting -
Problems
If is any subset of , and the closed subspace generated by , show that for all
Which of the following is a vector subspace of , and which are closed? In each case find the space of vectors orthogonal to the set.
(a)
(b)
(c)
(d)
Show that the real Banach space with the norm does not have the closest point property of Theorem 13.8. Namely for a given point and one-dimensional subspace , there does not in general exist a unique point in that is closest to .
If is an operator such that for all , show that