Abstract
We introduce in this chapter the basic notions of functional analysis. Normed and Banach spaces are defined in Sect. 3.1. We study in Sect. 3.2 continuous linear mappings between normed spaces. Pre-Hilbert and Hilbert spaces are defined in Sect. 3.3. In Sect. 3.4, a proof of the spectral theorem for a compact symmetric operator is given.
On a le droit de faire la théorie générale des opérations sans définir l’opération que l’on considère, de même qu’on fait la théorie de l’addition sans définir la nature des termes à additionner.
Henri Poincaré
Access provided by Autonomous University of Puebla. Download chapter PDF
3.1 Banach Spaces
Since their creation by Banach in 1922, normed spaces have played a central role in functional analysis. Banach spaces are complete normed spaces. Completeness allows one to prove the convergence of a sequence or of a series without using the limit.
Definition 3.1.1
A norm on a real vector space X is a function
such that
- (\(\mathcal {N}_1\)):
-
for every u ∈ X ∖{0}, ||u|| > 0;
- (\(\mathcal {N}_2\)):
-
for every u ∈ X and for \(\alpha \in {\mathbb R}\), ||αu|| = |α| ||u||;
- (\(\mathcal {N}_3\)):
-
(Minkowski’s inequality) for every u, v ∈ X,
$$\displaystyle \begin{aligned} \vert\vert u+v\vert\vert\leq \vert\vert u\vert\vert +\vert\vert v\vert\vert . \end{aligned}$$
A (real) normed space is a (real) vector space together with a norm on that space.
Examples
-
1.
Let (X, ||.||) be a normed space and let Y be a subspace of X. The space Y together with ||.|| (restricted to Y ) is a normed space.
-
2.
Let (X 1, ||.||1), (X 2, ||.||2) be normed spaces. The space X 1 × X 2 together with
$$\displaystyle \begin{aligned} \vert\vert(u_1,u_2)\vert\vert =\max(\vert\vert u_1\vert\vert_1,\vert\vert u_2\vert\vert_2) \end{aligned}$$is a normed space.
-
3.
We define the norm on the space \({\mathbb R}^N\) to be
$$\displaystyle \begin{aligned} \vert x\vert_{\infty}=\max\Bigl\{|x_1|,\ldots,|x_{{\!{ {N}}}{}}|\Bigr\}. \end{aligned}$$
Every normed space is a metric space.
Proposition 3.1.2
Let X be a normed space. The function
is a distance on X. The following mappings are continuous:
Proof
By \(\mathcal {N}_1\) and \(\mathcal {N}_2\),
Finally, by Minkowski’s inequality,
Since by Minkowski’s inequality,
the norm is continuous on X. It is easy to verify the continuity of the sum and of the product by a scalar. □
Definition 3.1.3
Let X be a normed space and (u n) ⊂ X. The series \(\displaystyle {\sum _{n=0}^{\infty }}u_n\) converges, and its sum is u ∈ X if the sequence \( \displaystyle {\sum _{n=0}^{k}}u_n\) converges to u. We then write \(\displaystyle {\sum _{n=0}^{\infty }}u_n=u\).
The series \(\displaystyle {\sum _{n=0}^{\infty }}u_n\) converges normally if \(\displaystyle {\sum _{n=0}^{\infty }}\vert \vert u_n\vert \vert <\infty \).
Definition 3.1.4
A Banach space is a complete normed space.
Proposition 3.1.5
In a Banach space X, the following statements are equivalent:
-
(a)
\(\displaystyle {\sum ^{\infty }_{n=0} u_n}\) converges;
-
(b)
\(\displaystyle {\lim _{\text{{ {$j\to \infty $}}} \atop \text{{ {$j<k$}}}}\sum ^k_{n=j+1}u_n=0}\).
Proof
Define \(S_k=\displaystyle {\sum ^k_{n=0}}u_n\). Since X is complete, we have
□
Proposition 3.1.6
In a Banach space, every normally convergent series converges.
Proof
Let \(\displaystyle {\sum _{n=0}^{\infty }}u_n\) be a normally convergent series in the Banach space X. Minkowski’s inequality implies that for j < k,
Since the series is normally convergent,
It suffices then to use the preceding proposition. □
Examples
-
1.
The space of bounded continuous functions on the metric space X,
$$\displaystyle \begin{aligned} \mathcal{B}\mathcal{C}(X)=\left\{u\in\mathcal{C}(X):\sup_{x\in X}\vert u(x)\vert <\infty\right\}, \end{aligned}$$together with the norm
$$\displaystyle \begin{aligned} \vert\vert u\vert\vert_{\infty}=\sup_{x\in X}\vert u(x)\vert, \end{aligned}$$is a Banach space. Convergence with respect to ||.||∞ is uniform convergence.
-
2.
Let μ be a positive measure on Ω. We denote by L 1(Ω, μ) the quotient of \(\mathcal {L}^{1}\) (Ω, μ) by the equivalence relation “equality almost everywhere”. We define the norm
$$\displaystyle \begin{aligned} \vert\vert u\vert\vert_1=\int_{\varOmega}\vert u\vert \, d\mu. \end{aligned}$$Convergence with respect to ||.||1 is convergence in mean. We will prove in Sect. 4.2, on Lebesgue spaces, that L 1(Ω, μ) is a Banach space.
-
3.
Let Λ N be the Lebesgue measure on the open subset Ω of \({\mathbb R}^N\). We denote by L 1(Ω) the space L 1(Ω, Λ N). Convergence in mean is not implied by simple convergence, and almost everywhere convergence is not implied by convergence in mean.
If m(Ω) < ∞, the comparison theorem implies that for every \(u\in \mathcal {B}\mathcal {C}(\varOmega )\),
Hence \(\mathcal {B}\mathcal {C}(\varOmega )\subset L^1(\varOmega )\), and the canonical injection is continuous, since
In order to characterize the convergence in L 1(Ω, μ) we shall define the notions of convergence in measure and of equi-integrability.
We consider a positive measure μ on Ω. We identify two μ-measurable functions on Ω when they are μ-almost everywhere equal.
Definition 3.1.7
A sequence of measurable functions (u n) converges in measure to a measurable function u if for every t > 0,
Proposition 3.1.8
Assume that the sequence (u n) converges in measure to u.
Then there exists a subsequence \((u_{n_k})\) converging almost everywhere to u on Ω.
Proof
There exists a subsequence \((u_{n_k})\) such that, for every k,
Let us define
and
so that A = Ω∖B. For every x ∈ B, there exists j ≥ 1 such that
Hence, for every x ∈ B, \(\displaystyle \lim _{k\to \infty } u_{n_k}(x)=u(x)\).
Since, for every j,
we conclude that μ(A) = 0. □
Proposition 3.1.9
Let (u n) be a sequence of measurable functions such that
-
(a)
(u n) converges to u almost everywhere on Ω,
-
(b)
for every ε > 0, there exists a measurable subset B of Ω such that μ(B) < ∞ and supn∫Ω∖B|u n|dμ ≤ ε.
Then (u n) converges in measure to u.
Proof
Let t > 0 and let ε > 0. By assumption (b) there exists a measurable subset B of Ω such that μ(B) < ∞ and supn∫Ω∖B|u n|dμ ≤ εt∕3. It follows from Fatou’s lemma that ∫Ω∖B|u|dμ ≤ εt∕3. Lebesgue’s dominated convergence theorem implies the existence of m such that
We conclude using Markov’s inequality that, for n ≥ m,
□
Proposition 3.1.10
Let u ∈ L 1(Ω, μ) and let ε > 0. Then
-
(a)
there exists δ > 0 such that, for every measurable subset A of Ω
$$\displaystyle \begin{aligned}\mu(A) \leq \delta \Rightarrow \int_A |u| d\mu \leq \varepsilon \ ;\end{aligned}$$ -
(b)
there exists a measurable subset B of Ω such that μ(B) < ∞ and ∫Ω∖B|u|dμ ≤ ε.
Proof
(a) By Lebesgue’s dominated convergence theorem, there exists m such that
Let δ = ε∕(2m). For every measurable subset A of Ω such that μ(A) ≤ δ, we have that
(b) By Lebesgue’s dominated convergence theorem, there exists n such that
The set B = {|u| > 1∕n} is such that μ(B) < ∞ and ∫Ω∖B|u|dμ ≤ ε.
□
Definition 3.1.11
A subset S of L 1(Ω, μ) is equi-integrable if
-
(a)
for every ε > 0, there exists δ > 0 such that, for every measurable subset A of Ω satisfying μ(A) ≤ δ, supu ∈ S∫A|u|dμ ≤ ε,
-
(b)
for every ε > 0, there exists a measurable subset B of Ω such that μ(B) < ∞ and supu ∈ S∫Ω∖B|u|dμ ≤ ε.
Theorem 3.1.12 (Vitali)
Let (u n) ⊂ L 1(Ω, μ) and let u be a measurable function. Then the following properties are equivalent:
-
(a)
∥u n − u∥1 → 0, n →∞,
-
(b)
(u n) converges in measure to u and \(\{u_n: n \in \mathbb {N}\}\) is equi-integrable.
Proof
Assume that (a) is satisfied. Markov’s inequality implies that, for every t > 0,
Let ε > 0. There exists m such that
In particular, for every measurable subset A of Ω and for every n ≥ m,
Proposition 3.1.10 implies the existence of δ > 0 such that, for every measurable subset A of Ω,
We conclude that, for every measurable subset A of Ω,
Similarly, Proposition 3.1.10 implies the existence of a measurable subset B of Ω such that μ(B) < ∞ and
We conclude that supn∫Ω∖B|u n|dμ ≤ ε.
Assume now that (b) is satisfied. Let ε > 0. By assumption, there exists δ > 0 such that, for every measurable subset A of Ω,
and there exists a measurable subset B of Ω such that μ(B) < ∞ and
We assume that μ(B) > 0. The case μ(B) = 0 is simpler. Since (u n) converges in measure to u, Proposition 3.1.8 implies the existence of a subsequence \((u_{n_k})\) such that \(u_{n_k}\to u\) almost everywhere on Ω. It follows from Fatou’s lemma that, for every measurable subset A of Ω,
and that
There exists also m such that
Let us define A n = {|u n − u| > ε∕μ(B)}, so that, for n ≥ m, μ(A n) ≤ δ. For every n ≥ m, we obtain
Since ε > 0 is arbitrary, the proof is complete. □
The following characterization is due to de la Vallée Poussin.
Theorem 3.1.13
Let S ⊂ L 1(Ω, μ) be such that \(c = \underset {u\in S}{\sup } \|u\|{ }_1 < +\infty \) . The following properties are equivalent:
-
(a)
for every ε > 0 there exists δ > 0 such that, for every measurable subset A of Ω
$$\displaystyle \begin{aligned} \mu(A) \leq \delta \Rightarrow\underset{u\in S}{\sup} \int_A |u| d\mu \leq \varepsilon, \end{aligned}$$ -
(b)
there exists a strictly increasing convex function F : [0, +∞[→ [0, +∞[ such that
$$\displaystyle \begin{aligned} \lim_{t\to\infty} F(t)/t=+\infty , \quad M = \underset{u\in S}{\sup} \int_\varOmega F(|u|)d\mu < +\infty. \end{aligned}$$
Proof
Since, by Markov’s inequality
assumption (a) implies the existence of a sequence (n k) of integers such that, for every k,
Let us define \(F(t) = t + \displaystyle \sum ^\infty _{k=1} (t-n_k)^+\). It is clear that F is strictly increasing and convex. Moreover, for every j,
and, for every u ∈ S, by Levi’s theorem,
so that S satisfies (b).
Assume now that S satisfies (b). Let ε > 0. There exists s > 0 such that for every t ≥ s, F(t)∕t ≥ 2M∕ε. Hence for every u ∈ S we have that
We choose δ = ε∕(2s). For every measurable subset A of Ω such that μ(A) ≤ δ and for every u ∈ S, we obtain
□
3.2 Continuous Linear Mappings
In general, linear mappings between normed spaces are not continuous.
Proposition 3.2.1
Let X and Y be normed spaces and A : X → Y a linear mapping. The following properties are equivalent:
-
(a)
A is continuous;
-
(b)
\(c=\displaystyle {\sup _{\text{{ {$u\in X$}}} \atop \text{{ {$u\neq 0$}}}}\frac {\vert \vert Au\vert \vert }{\vert \vert u\vert \vert }}<\infty \).
Proof
If c < ∞, we obtain
Hence A is continuous.
If A is continuous, there exists δ > 0 such that for every u ∈ X,
Hence for every u ∈ X ∖{0},
□
Proposition 3.2.2
The function
defines a norm on the space \(\mathcal {L}(X,Y)=\{A:X\rightarrow Y:A\) is linear and continuous}.
Proof
By the preceding proposition, if \(A\in \mathcal {L}(X,Y)\), then 0 ≤||A|| < ∞. If A ≠ 0, it is clear that ||A|| > 0. It follows from axiom \(\mathcal {N}_2\) that
It follows from Minkowski’s inequality that
□
Proposition 3.2.3 (Extension by density)
Let Z be a dense subspace of a normed space X, Y a Banach space, and \(A\in \mathcal {L}(Z,Y)\) . Then there exists a unique mapping \(B\in \mathcal {L}(X,Y)\) such that B| Z = A. Moreover, ||B|| = ||A||.
Proof
Let u ∈ X. There exists a sequence (u n) ⊂ Z such that u n → u. The sequence (Au n) is a Cauchy sequence, since
by Proposition 1.2.3. We denote by f its limit. Let (v n) ⊂ Z be such that v n → u. We have
Hence Av n → f, and we define Bu = f. By Proposition 3.1.2, B is linear. Since for every n,
we obtain by Proposition 3.1.2 that
Hence B is continuous and ||B||≤||A||. It is clear that ||A||≤||B||. Hence ||A|| = ||B||.
If \(C\in \mathcal {L}(X,Y)\) is such that C|Z = A, we obtain
□
Proposition 3.2.4
Let X and Y be normed spaces, and let \((A_n)\subset \mathcal {L}(X,Y)\) and \(A\in \mathcal {L}(X,Y)\) be such that ||A n − A||→ 0. Then (A n) converges simply to A.
Proof
For every u ∈ X, we have
□
Proposition 3.2.5
Let Z be a dense subset of a normed space X, let Y be a Banach space, and let \((A_n)\subset \mathcal {L}(X,Y)\) be such that
-
(a)
c = supn||A n|| < ∞;
-
(b)
for every v ∈ Z, (A n v) converges.
Then A n converges simply to \(A\in \mathcal {L}(X,Y)\) , and
Proof
Let u ∈ X and ε > 0. By density, there exists v ∈ B(u, ε) ∩ Z. Since (A n v) converges, Proposition 1.2.3 implies the existence of n such that
Hence for j, k ≥ n, we have
The sequence (A n u) is a Cauchy sequence, since ε > 0 is arbitrary. Hence (A n u) converges to a limit Au in the complete space Y . It follows from Proposition 3.1.2 that A is linear and that
But then A is continuous and \(\vert \vert A\vert \vert \leq \renewcommand {\arraystretch }{0.5} \begin {array}[t]{c} \underline {\lim }\\ {\scriptstyle n\rightarrow \infty } \end {array} \renewcommand {\arraystretch }{1}\vert \vert A_n\vert \vert \). □
Theorem 3.2.6 (Banach–Steinhaus theorem)
Let X be a Banach space, let Y be a normed space, and let \((A_n)\subset \mathcal {L}(X,Y)\) be such that for every u ∈ X,
Then
First Proof
Theorem 1.3.13 applied to the sequence F n : u↦||A n u|| implies the existence of a ball B(v, r) such that
It is clear that for every y, z ∈ Y ,
Hence for every n and for every w ∈ B(0, r), ||A n w||≤ c, so that
Second Proof
Assume to obtain a contradiction that supn||A n|| = +∞. By considering a subsequence, we assume that n 3n ≤||A n||. Let us define inductively a sequence (u n). We choose u 0 = 0. There exists v n such that ||v n|| = 3−n and \(\frac {3}{4}3^{-n}\vert \vert A_n\vert \vert \leq \vert \vert A_nv_n\vert \vert \). By (∗), replacing if necessary v n by − v n, we obtain
We define u n = u n−1 + v n, so that ||u n − u n−1|| = 3−n. It follows that for every k ≥ n,
Hence (u n) is a Cauchy sequence that converges to u in the complete space X. Moreover,
We conclude that
Corollary 3.2.7
Let X be a Banach space, Y a normed space, and \((A_n)\subset \mathcal {L}(X,Y)\) a sequence converging simply to A. Then (A n) is bounded, \(A\in \mathcal {L}(X,Y)\) , and
Proof
For every u ∈ X, the sequence (A n u) is convergent, hence bounded, by Proposition 1.2.3. The Banach–Steinhaus theorem implies that supn||A n|| < ∞. It follows from Proposition 3.1.2 that A is linear and
so that A is continuous and \(\vert \vert A\vert \vert \leq \renewcommand {\arraystretch }{0.5} \begin {array}[t]{c} \underline {\lim }\\ {\scriptstyle n\rightarrow \infty } \end {array} \renewcommand {\arraystretch }{1}\vert \vert A_n\vert \vert \). □
The preceding corollary explains why every natural linear mapping defined on a Banach space is continuous.
Examples (Convergence of functionals)
We define the linear continuous functionals f n on L 1(]0, 1[) to be
Since for every u ∈ L 1(]0, 1[) such that ||u||1 = 1, we have
it is clear that
Choosing v k(x) = (k + 1)x k, we obtain
It follows that ||f n|| = 1, and for every u ∈ L 1(]0, 1[) such that ||u||1 = 1,
Lebesgue’s dominated convergence theorem implies that (f n) converges simply to f = 0. Observe that
Definition 3.2.8
A seminorm on a real vector space X is a function F : X → [0, +∞[ such that
-
(a)
for every u ∈ X and for every \(\alpha \in \mathbb {R}\), F(αu) = |α|F(u), (positive homogeneity);
-
(b)
for every u, v ∈ X, F(u + v) ≤ F(u) + F(v), (subadditivity).
Examples
-
(a)
Any norm is a seminorm.
-
(b)
Let X be a real vector space, Y a normed space, and A: X → Y a linear mapping. The function F defined on X by F(u) = ∥Au∥ is a seminorm.
-
(c)
Let X be a normed space, Y a real vector space, and A: X → Y a surjective linear mapping. The function F defined on Y by
$$\displaystyle \begin{aligned} F(v) = \inf \Bigl\{\|u\| \colon Au = v \Bigr\} \end{aligned}$$is a seminorm.
Proposition 3.2.9
Let F be a seminorm defined on a normed space X. The following properties are equivalent
-
(a)
F is continuous;
-
(b)
c =supu ∈ X ∥u∥=1 F(u) < ∞.
Proof
If F satisfies (b), then
so that F is continuous.
It is easy to prove that the continuity of F at 0 implies (b). □
Let F be a seminorm on the normed space X and consider a convergent series \(\displaystyle \sum ^\infty _{k=1}u_k\). For every n,
If, moreover, F is continuous, it follows that
Zabreiko’s theorem asserts that the converse is valid when X is a Banach space.
Theorem 3.2.10
Let X be a Banach space and let F : X → [0, +∞[ be a seminorm such that, for any convergent series \(\displaystyle \sum ^\infty _{k=1} u_k,\)
Then F is continuous.
Proof
Let us define, for any t > 0, G t = {u ∈ X : F(u) ≤ t}. Since \(\displaystyle X = \bigcup ^\infty _{n=1} \overline G_n\), Baire’s theorem implies the existence of m such that \(\overline G_m\) contains a closed ball B[a, r]. Using the propreties of F, we obtain
Let us define t = m∕r, so that B[0, 1] is contained in \( \overline G_t\), and, for every k, B[0, 1∕2k] is contained in \( \overline G_{t/2^k}\). Let u ∈ B[0, 1]. There exists u 1 ∈ G t such that ∥u − u 1∥≤ 1∕2. We construct by induction a sequence (u k) such that
By assumption
Since u ∈ B[0, 1] is arbitrary, we obtain
It suffices then to use Proposition 3.2.9. □
Let A be a linear mapping between two normed spaces X and Y . If A is continuous, then the graph of A is closed in X × Y :
The closed graph theorem, proven by S. Banach in 1932, asserts that the converse is valid when X and Y are Banach spaces.
Theorem 3.2.11
Let X and Y be Banach spaces and let A: X → Y be a linear mapping with a closed graph. Then A is continuous.
Proof
Let us define on X the seminorm F(u) = ∥Au∥. Assume that the series \(\displaystyle \sum ^\infty _{k=1} u_k\) converges to u in X and that \(\displaystyle \sum ^\infty _{k=1} F(u_k) < + \infty \). Since Y is a Banach space, \(\displaystyle \sum ^\infty _{k=1} Au_k\) converges to v in Y . But the graph of the linear mapping A is closed, so that v = Au and
We conclude using Zabreiko’s theorem:
□
The open mapping theorem was proved by J. Schauder in 1930.
Theorem 3.2.12
Let X and Y be Banach spaces and let \(A\in \mathcal {L} (X,Y)\) be surjective. Then {Au : u ∈ X, ∥u∥ < 1} is open in Y .
Proof
Let us define on Y the seminorm \(F(v)=\inf \{\|u\|:Au=v\}\). Assume that the series \(\displaystyle \sum ^\infty _{k=1} v_k\) converges to v in Y and that \(\displaystyle \sum ^\infty _{k=1} F(v_k) < + \infty \). Let ε > 0. For every k, there exists u k ∈ X such that
Since X is a Banach space, the series \(\displaystyle \sum ^\infty _{k=1} u_k\) converges to u in X. Hence we obtain
and
so that \(F(v) \leq \displaystyle \sum ^\infty _{k=1} F(v_k)+\varepsilon \). Since ε > 0 is arbitrary, we conclude that \(F(v) \leq \displaystyle \sum ^\infty _{k=1} F(v_k)\). Zabreiko’s theorem implies that
is open in Y . □
3.3 Hilbert Spaces
Hilbert spaces are Banach spaces with a norm derived from a scalar product.
Definition 3.3.1
A scalar product on the (real) vector space X is a function
such that
- \((\mathcal {S}_1)\) :
-
for every u ∈ X ∖{0}, (u|u) > 0;
- \((\mathcal {S}_2)\) :
-
for every u, v, w ∈ X and for every \(\alpha ,\beta \in {\mathbb R}\), (αu + βv|w) = α(u|w) + β(v|w);
- \((\mathcal {S}_3)\) :
-
for every u, v ∈ X, (u|v) = (v|u).
We define \(\vert \vert u\vert \vert =\sqrt {(u\vert u)}\). A (real) pre-Hilbert space is a (real) vector space together with a scalar product on that space.
Proposition 3.3.2
Let u, v, w ∈ X and let \(\alpha ,\beta \in {\mathbb R}\) . Then
-
(a)
(u|αv + βw) = α(u|v) + β(u|w);
-
(b)
||αu|| = |α| ||u||.
Proposition 3.3.3
Let X be a pre-Hilbert space and let u, v ∈ X. Then
-
(a)
(parallelogram identity) ||u + v||2 + ||u − v||2 = 2||u||2 + 2||v||2;
-
(b)
(polarization identity) \((u\vert v)=\frac {1}{4}\vert \vert u+v\vert \vert ^2- \frac {1}{4}\vert \vert u-v\vert \vert ^2\);
-
(c)
(Pythagorean identity) (u|v) = 0⇔||u + v||2 = ||u||2 + ||v||2.
Proof
Observe that
By adding and subtracting, we obtain parallelogram and polarization identities. The Pythagorean identity is clear. □
Proposition 3.3.4
Let X be a pre-Hilbert space and let u, v ∈ X. Then
-
(a)
(Cauchy–Schwarz inequality) |(u|v)|≤||u|| ||v||;
-
(b)
(Minkowski’s inequality) ||u + v||≤||u|| + ||v||.
Proof
It follows from (∗) and (∗∗) that for ||u|| = ||v|| = 1,
Hence for u ≠ 0 ≠ v, we obtain
By (∗) and the Cauchy–Schwarz inequality, we have
□
Corollary 3.3.5
-
(a)
The function \(\vert \vert u\vert \vert =\sqrt {(u\vert u)}\) defines a norm on the pre-Hilbert space X.
-
(b)
The function
$$\displaystyle \begin{aligned} X\times X\rightarrow{\mathbb R}: (u,v)\mapsto (u\vert v) \end{aligned}$$is continuous.
Definition 3.3.6
A family (e j)j ∈ J in a pre-Hilbert space X is orthonormal if
Proposition 3.3.7 (Bessel’s inequality)
Let (e n) be an orthonormal sequence in a pre-Hilbert space X and let u ∈ X. Then
Proof
It follows from the Pythagorean identity that
□
Proposition 3.3.8
Let (e 0, …, e k) be a finite orthonormal sequence in a pre-Hilbert space X, u ∈ X, and \(x_0,\ldots ,x_k\in {\mathbb R}\) . Then
Proof
It follows from the Pythagorean identity that
□
Definition 3.3.9
A Hilbert basis of a pre-Hilbert space X is an orthonormal sequence generating a dense subspace of X.
Proposition 3.3.10
Let (e n) be a Hilbert basis of a pre-Hilbert space X and let u ∈ X. Then
-
(a)
\(u=\displaystyle {\sum ^{\infty }_{n=0}}(u\mid e_n)e_n\);
-
(b)
(Parseval’s identity) \(\vert \vert u\vert \vert ^2=\displaystyle {\sum ^{\infty }_{n=0}}\vert (u\mid e_n)\vert ^2\).
Proof
Let ε > 0. By definition, there exists a sequence \(x _0,\ldots ,x_j\in {\mathbb R}\) such that
It follows from the preceding proposition that for k ≥ j,
Hence \(u=\displaystyle {\sum ^{\infty }_{n=0}}(u\mid e_n)e_n\), and by Proposition 3.1.2,
□
We characterize pre-Hilbert spaces having a Hilbert basis.
Proposition 3.3.11
Assume the existence of a sequence (f j) generating a dense subset of the normed space X. Then X is separable.
Proof
By assumption, the space of (finite) linear combinations of (f j) is dense in X. Hence the space of (finite) linear combinations with rational coefficients of (f j) is dense in X. Since this space is countable, X is separable. □
Proposition 3.3.12
Let X be an infinite-dimensional pre-Hilbert space. The following properties are equivalent:
-
(a)
X is separable;
-
(b)
X has a Hilbert basis.
Proof
By the preceding proposition, (b) implies (a).
If X is separable, it contains a sequence (f j) generating a dense subspace. We may assume that (f j) is free. Since the dimension of X is infinite, the sequence (f j) is infinite. We define by induction the sequences (g n) and (e n):
The sequence (e n) generated from (f n) by the Gram–Schmidt orthonormalization process is a Hilbert basis of X. □
Definition 3.3.13
A Hilbert space is a complete pre-Hilbert space.
Theorem 3.3.14 (Riesz–Fischer)
Let (e n) be an orthonormal sequence in the Hilbert space X. The series \(\displaystyle {\sum _{n=0}^{\infty }}c_ne_n\) converges if and only if \(\displaystyle {\sum _{n=0}^{\infty }}c_n^2<\infty \) . Then
Proof
Define \(S_k=\displaystyle {\sum _{n=0}^{k}}c_ne_n\). The Pythagorean identity implies that for j < k,
Hence
Since X is complete, (S k) converges if and only if \(\displaystyle {\sum _{n=0}^{\infty }}c_n^2<\infty \). Then \(\displaystyle {\sum _{n=0}^{\infty }}c_ne_n=\displaystyle {\lim _{k\rightarrow \infty }}S_k\), and by Proposition 3.1.2,
□
Examples
-
1.
Let μ be a positive measure on Ω. We denote by L 2(Ω, μ) the quotient of
$$\displaystyle \begin{aligned} \mathcal{L}^2(\varOmega,\mu)=\left\{u\in\mathcal{M}(\varOmega,\mu):\int_{\varOmega}\vert u\vert^2d\mu <\infty\right\} \end{aligned}$$by the equivalence relation “equality almost everywhere.” If u, v ∈ L 2(Ω, μ), then u + v ∈ L 2(Ω, μ). Indeed, almost everywhere on Ω, we have
$$\displaystyle \begin{aligned} \vert u(x)+v(x)\vert^2\leq 2(\vert u(x)\vert^2+\vert v(x)\vert^2). \end{aligned}$$We define the scalar product
$$\displaystyle \begin{aligned} (u\vert v)=\int_{\varOmega}uv\, d\mu \end{aligned}$$on the space L 2(Ω, μ).
The scalar product is well defined, since almost everywhere on Ω,
$$\displaystyle \begin{aligned} \vert u(x)\, v(x)\vert\leq\frac{1}{2}(\vert u(x)\vert^2+\vert v(x)\vert^2). \end{aligned}$$By definition,
$$\displaystyle \begin{aligned} \vert\vert u\vert\vert_2= \left(\int_{\varOmega}\vert u\vert^2d\mu\right)^{1/2}. \end{aligned}$$Convergence with respect to ||.||2 is convergence in quadratic mean. We will prove in Sect. 4.2, on Lebesgue spaces, that L 2(Ω, μ) is a Hilbert space. If μ(Ω) < ∞, it follows from the Cauchy–Schwarz inequality that for every u ∈ L 2(Ω, μ),
$$\displaystyle \begin{aligned} \vert\vert u\vert\vert_1=\int_{\varOmega}\vert u\vert \, d\mu\leq \mu(\varOmega)^{1/2}\vert\vert u\vert\vert_{2}. \end{aligned}$$Hence L 2(Ω, μ) ⊂ L 1(Ω, μ), and the canonical injection is continuous.
-
2.
Let Λ N be the Lebesgue measure on the open subset Ω of \({\mathbb R}^N\). We denote by L 2(Ω) the space L 2(Ω, Λ N). Observe that
$$\displaystyle \begin{aligned} \frac{1}{x}\in L^2(]1,\infty[)\setminus L^1(]1,\infty[)\mbox{ and }\frac{1}{\sqrt{x}}\in L^1(]0,1[)\setminus L^2(]0,1[). \end{aligned}$$If m(Ω) < ∞, the comparison theorem implies that for every \(u\in \mathcal {B}\mathcal {C}(\varOmega )\),
$$\displaystyle \begin{aligned} \vert\vert u\vert\vert^2_2=\int_{\varOmega} u^2dx\leq m(\varOmega)\vert\vert u\vert\vert^2_{\infty}. \end{aligned}$$Hence \(\mathcal {B}\mathcal {C}(\varOmega )\subset L^2(\varOmega )\), and the canonical injection is continuous.
Theorem 3.3.15 (Vitali 1921, Dalzell 1945)
Let (e n) be an orthonormal sequence in L 2(]a, b[). The following properties are equivalent:
-
(a)
(e n) is a Hilbert basis;
-
(b)
for every a ≤ t ≤ b, \(\displaystyle {\sum ^{\infty }_{n=1}\left (\int _a^te_n(x)dx\right )^2=t-a}\);
-
(c)
\(\displaystyle {\sum ^{\infty }_{n=1} \int _a^b\left (\int ^t_ae_n(x)dx\right )^2dt=\frac {(b-a)^2}{2}}\).
Proof
Property (b) follows from (a) and Parseval’s identity applied to χ [a,t]. Property (c) follows from (b) and Levi’s theorem. The converse is left to the reader. □
Example
The sequence \(e_n(x)=\displaystyle {\sqrt {\frac {2}{\pi }}}\sin n~x\) is orthonormal in L 2(]0, π[). Since
and since by a classical identity due to Euler,
the sequence (e n) is a Hilbert basis of L 2(]0, π[).
3.4 Spectral Theory
Spectral theory allows one to diagonalize symmetric compact operators.
Definition 3.4.1
Let X be a real vector space and let A : X → X be a linear mapping. The eigenvectors corresponding to the eigenvalue \(\lambda \in {\mathbb R}\) are the nonzero solutions of
The multiplicity of λ is the dimension of the space of solutions. The eigenvalue λ is simple if its multiplicity is equal to 1. The rank of A is the dimension of the range of A.
Definition 3.4.2
Let X be a pre-Hilbert space. A symmetric operator is a linear mapping A : X → X such that for every u, v ∈ X, (Au|v) = (u|Av).
Proposition 3.4.3
Let X be a pre-Hilbert space and A : X → X a symmetric continuous operator. Then
Proof
It is clear that
If ||u|| = ||v|| = 1, it follows from the parallelogram identity that
Hence b = a. □
Corollary 3.4.4
Under the assumptions of the preceding proposition, there exists a sequence (u n) ⊂ X such that
Proof
Consider a maximizing sequence (u n):
By passing if necessary to a subsequence, we can assume that (Au n|u n) → λ 1, |λ 1| = ||A||. Hence
□
Definition 3.4.5
Let X and Y be normed spaces. A mapping A: X → Y is compact if the set {Au: u ∈ X, ||u||≤ 1} is precompact in Y .
By Proposition 3.2.1, every linear compact mapping is continuous.
Theorem 3.4.6
Let X be a Hilbert space and let A: X → X be a symmetric compact operator. Then there exists an eigenvalue λ 1 of A such that |λ 1| = ||A||.
Proof
We can assume that A ≠ 0. The preceding corollary implies the existence of a sequence (u n) ⊂ X such that
Passing if necessary to a subsequence, we can assume that Au n → v. Hence \(u_n\rightarrow u=\lambda _1^{-1}v\), ||u|| = 1, and Au = λ 1 u. □
Theorem 3.4.7 (Poincaré’s principle)
Let X be a Hilbert space and A : X → X a symmetric compact operator with infinite rank. Let there be given the eigenvectors (e 1, …, e n−1) and the corresponding eigenvalues (λ 1, …, λ n−1). Then there exists an eigenvalue λ n of A such that
and λ n → 0, n →∞.
Proof
The closed subspace of X
is invariant by A. Indeed, if u ∈ X n and 1 ≤ j ≤ n − 1, then
Hence \(A_n=A\Big \vert _{X_n}\) is a nonzero symmetric compact operator, and there exist an eigenvalue λ n of A n such that |λ n| = ||A n|| and a corresponding eigenvector e n ∈ X n such that ||e n|| = 1. By construction, the sequence (e n) is orthonormal, and the sequence (|λ n|) is decreasing. Hence |λ n|→ d, n →∞, and for j ≠ k,
Since A is compact, d = 0. □
Theorem 3.4.8
Under the assumptions of the preceding theorem, for every u ∈ X, the series \(\displaystyle {\sum _{n=1}^{\infty }}(u\vert e_n)e_n\) converges and \(u-\displaystyle {\sum _{n=1}^{\infty }}(u\vert e_n)e_n\) belongs to the kernel of A:
Proof
For every k ≥ 1, \(u-\displaystyle {\sum _{n=1}^{k}}(u\vert e_n)e_n\in X_{k+1}\). It follows from Proposition 3.3.8. that
Bessel’s inequality implies that \(\displaystyle {\sum _{n=1}^{\infty }}\vert (u\vert e_n)\vert ^2\leq \vert \vert u\vert \vert ^2\). We deduce from the Riesz–Fischer theorem that \(\displaystyle {\sum _{n=1}^{\infty }}(u\vert e_n)e_n\) converges to v ∈ X. Since A is continuous,
and A(u − v) = 0. □
Formula (∗) is the diagonalization of symmetric compact operators.
3.5 Comments
The de la Vallée Poussin criterion was proved in the beautiful paper [17].
The first proof of the Banach–Steinhaus theorem in Sect. 3.2 is due to Favard [22], and the second proof to Royden [66].
Theorem 3.2.10 is due to P.P. Zabreiko, Funct. Anal. and Appl. 3 (1969) 70-72.
Let us recall the elegant notion of vector space over the reals used by S. Banach in [6] :
Suppose that a non-empty set E is given, and that to each ordered pair (x, y) of elements of E there corresponds an element x + y of E (called the sum of x and y) and that for each number t and x ∈ E an element tx of E (called the product of the number t with the element x) is defined in such a way that these operations, namely addition and scalar multiplication satisfy the following conditions (where x, y and z denote arbitrary elements of E and a, b are numbers):
- 1)
x + y = y + x,
- 2)
x + (y + z) = (x + y) + z,
- 3)
x + y = x + z implies y = z,
- 4)
a(x + y) = ax + ay,
- 5)
(a + b)x = ax + bx,
- 6)
a(bx) = (ab)x,
- 7)
1 ⋅ x = x.
Under these hypotheses, we say that the set E constitutes a vector or linear space. It is easy to see that there then exists exactly one element, which we denote by Θ, such that x + Θ = x for all x ∈ E and that the equality ax = bx where x ≠ Θ yields a = b; furthermore, that the equality ax = ay where a ≠ 0 implies x = y.
Put, further, by definition :
$$\displaystyle \begin{aligned} -x=(-1)x \quad \mbox{and} \quad x-y=x+(-y).\end{aligned} $$
The space \(\mathcal {L}^1 (\mathbb {R}^N)\) with the pointwise sum
and the scalar multiplication
is not a vector space. Indeed one has in general to allow −∞ and + ∞ as values of the elements of \(\mathcal {L}^1 (\mathbb {R}^N)\). Hence the pointwise sum and the scalar multiplication by 0 are not, in general, well defined. On the other hand the space L 1(Ω, μ), with the pointwise sum and the scalar multiplication, is a vector space since it consists of equivalence classes of μ-almost everywhere defined and finite function on Ω.
3.6 Exercises for Chap. 3
-
1.
Prove that \(\mathcal {B}\mathcal {C}(\varOmega )\cap L^1(\varOmega )\subset L^2(\varOmega )\).
-
2.
Define a sequence \((u_n)\subset \mathcal {B}\mathcal {C}(]0,1[)\) such that ||u n||1 → 0, ||u n||2 = 1, and ||u n||∞→∞.
-
3.
Define a sequence \((u_n)\subset \mathcal {B}\mathcal {C}({\mathbb R})\cap L^1({\mathbb R})\) such that ||u n||1 →∞, ||u n||2 = 1 and ||u n||∞→ 0.
-
4.
Define a sequence \((u_n)\subset \mathcal {B}\mathcal {C}(]0,1[)\) converging simply to u such that ||u n||∞ = ||u||∞ = ||u n − u||∞ = 1.
-
5.
Define a sequence (u n) ⊂ L 1(]0, 1[) such that ||u n||1 → 0 and for every 0 < x < 1, \(\displaystyle {\renewcommand {\arraystretch }{0.5} \begin {array}[t]{c} \overline {\lim }\\ {\scriptstyle n\rightarrow \infty } \end {array} \renewcommand {\arraystretch }{1}}u_n(x)=1\). Hint: Use characteristic functions of intervals.
-
6.
On the space \(\mathcal {C}([0,1])\) with the norm \(\vert \vert u\vert \vert _1=\displaystyle {\int ^1_0}|u(x)|dx\), is the linear functional
$$\displaystyle \begin{aligned} f:\mathcal{C}([0,1])\rightarrow{\mathbb R}:u\mapsto u(1/2) \end{aligned}$$continuous?
-
7.
Let X be a normed space such that every normally convergent series converges. Prove that X is a Banach space.
-
8.
A linear functional defined on a normed space is continuous if and only if its kernel is closed. If this is not the case, the kernel is dense.
-
9.
Is it possible to derive the norm on L 1(]0, 1[) (respectively \(\mathcal {B}\mathcal {C}(]0,1[)\)) from a scalar product?
-
10.
Prove Lagrange’s identity in pre-Hilbert spaces:
$$\displaystyle \begin{aligned} \big\vert\big\vert \vert\vert v\vert\vert u-\vert\vert u\vert\vert v\big\vert\big\vert^2=2\vert\vert u\vert\vert^2\vert\vert v\vert\vert^2-2\vert\vert u\vert\vert~\vert\vert v\vert\vert (u\vert v). \end{aligned}$$ -
11.
Let X be a pre-Hilbert space and u, v ∈ X ∖{0}. Then
$$\displaystyle \begin{aligned} \left|\left| \frac{u}{\vert\vert u\vert\vert^2}- \frac{v}{\vert\vert v\vert\vert ^2}\right|\right| =\frac{\vert\vert u-v\vert\vert}{\vert\vert u\vert\vert\, \vert\vert v\vert\vert}. \end{aligned}$$Let f, g, h ∈ X. Prove Ptolemy’s inequality:
$$\displaystyle \begin{aligned} \vert\vert f\vert\vert \, \vert\vert g-h\vert\vert \leq \vert\vert h\vert\vert \, \vert\vert f-g\vert\vert + \vert\vert g\vert\vert \, \vert\vert h-f\vert\vert. \end{aligned}$$ -
12.
(The Jordan–von Neumann theorem.) Assume that the parallelogram identity is valid in the normed space X. Then it is possible to derive the norm from a scalar product. Define
$$\displaystyle \begin{aligned} (u\vert v)=\frac{1}{4} \bigl(\vert\vert u+v\vert\vert^2-\vert\vert u-v\vert\vert ^2\bigr). \end{aligned}$$Verify that
$$\displaystyle \begin{aligned} \begin{array}{ll} &(f+g\vert h )+(f-g\vert h)=2(f\vert h),\\ \\ &\displaystyle{(u\vert h)+(v\vert h)=2\left(\frac{u+v}{2}\vert h\right)=(u+v\vert h).} \end{array} \end{aligned}$$ -
13.
Let f be a linear functional on L 2(]0, 1[) such that u ≥ 0 ⇒〈f, u〉≥ 0. Prove, by contradiction, that f is continuous with respect to the norm ||.||2. Prove that f is not necessarily continuous with respect to the norm ||.||1.
-
14.
Prove that every symmetric operator defined on a Hilbert space is continuous. Hint: If this were not the case, there would exist a sequence (u n) such that ||u n|| = 1 and ||Au n||→∞. Then use the Banach–Steinhaus theorem to obtain a contradiction.
-
15.
In a Banach space an algebraic basis is either finite or uncountable. Hint: Use Baire’s theorem.
-
16.
Assume that μ(Ω) < ∞. Let (u n) ⊂ L 1(Ω, μ) be such that
-
(a)
supn∫Ω|u n|ℓn(1 + |u n|)dμ < +∞;
-
(b)
(u n) converges almost everywhere to u.
Then u n → u in L 1(Ω, μ).
-
(a)
-
17.
Let us define, for n ≥ 1, \(u_n(x) = \displaystyle \frac {\cos 3^n x}{n}\).
-
(a)
The series \(\displaystyle \sum ^\infty _{n=1} u_n\) converges in L 2(]0, 2π[).
-
(b)
For every \(x\in A = \{2k\pi /3^j\colon j \in \mathbb {N}, k \in \mathbb {Z}\}\), \(\displaystyle \sum ^\infty _{n=1} u_n (x) = +\infty \).
-
(c)
For every \(x\in B = \{(2k+1)\pi /3^j\colon j\in \mathbb {N}, k \in \mathbb {Z}\}\), \(\displaystyle \sum ^\infty _{n=1} u_n (x) = -\infty \).
-
(d)
The sets A and B are dense in \(\mathbb {R}\).
-
(a)
References
de la Vallée Poussin, C.: Sur l’intégrale de Lebesgue. Trans. Am. Math. Soc. 16, 435–501 (1915)
Favard, J.: Cours d’analyse de l’Ecole Polytechnique, tome, vol. I. Gauthier-Villars, Paris (1960)
Royden, H.: Aspects of constructive analysis. Contemp. Math. 39, 57–64 (1983)
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Willem, M. (2022). Norms. In: Functional Analysis. Cornerstones. Birkhäuser, Cham. https://doi.org/10.1007/978-3-031-09149-0_3
Download citation
DOI: https://doi.org/10.1007/978-3-031-09149-0_3
Published:
Publisher Name: Birkhäuser, Cham
Print ISBN: 978-3-031-09148-3
Online ISBN: 978-3-031-09149-0
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)