$L^p(\mu)$: all $f$ with ${\|f\|}_p<\infty$, modulo $\mu$-null sets; a norm by Minkowski (Lecture 3), the $L^p$ norm; for $p=2$, that of ${\langle f,g\rangle}_2$ (Lecture 2).
For $p\to\infty$: ${\|f\|}_p\to{\|f\|}_\infty$ if some ${\|f\|}_q<\infty$; monotone from some $p^*$ on, from below or above.
If $\mu(\Omega)\leq1$: increasing in $p$ (Hölder, Lecture 8); on $[0,1]$, from the mean height ${\|f\|}_1$ to the maximum.
Example:$f=h\,\mathbf{1}_A$ (indicator function of $A$),$\mu(A)=w$:${\|f\|}_p=h\,w^{1/p}\to h$, increasing in $p$ if $w<1$, decreasing if $w>1$, so then from above.
$|f|$ on $[0,1]$,$\mu(\Omega)=1$; dashed: ${\|f\|}_1$ (mean height), ${\|f\|}_\infty$ (maximum)
1 · Norms for functions: the supremum norm and the $L^p$ norms
Sequence spaces
With the counting measure on $\{1,\dots,n\}$ we recover the $p$-norms on $\mathbb{R}^n$; on $\mathbb{N}$ we obtain the $p$-norms on the sequence spaces
One direction holds for all$f\in C([0,1])$:${\|f\|}_1\leq{\|f\|}_2\leq{\|f\|}_\infty$, since ${\|f\|}_p$ increases in $p$ when $\mu(\Omega)\leq1$ (Section 1).
The other fails: ${\|f_k\|}_\infty/{\|f_k\|}_1=k+1\to\infty$, so ${\|\cdot\|}_\infty$ is not equivalent to ${\|\cdot\|}_1$ or ${\|\cdot\|}_2$, unlike norms on $\mathbb{R}^n$ (Theorem 3.4 of Lecture 3).
$f_k\to0$ in $L^1$ and $L^2$, not uniformly: different open sets.
Completeness can depend on the norm too (Section 2).
$f_k(t)=t^k$ on $[0,1]$
the three norms as functions of $k$
Section 2 of 2
2
Completeness: Hilbert and Banach spaces
2.1 Incomplete spaces of infinite dimension2.2 Hilbert and Banach spaces2.3 Completion
2.1 · Incomplete spaces of infinite dimension
Example 2.1: finitely many non-zero entries
Unlike $\mathbb{R}^n$ (Lecture 3), infinite-dimensional spaces need not be complete. Three examples:
The subspace of $\ell^2$ of all sequences with finitely many non-zero entries, with the norm of $\ell^2$:
Cauchy:${\|f_k-f_m\|}_2=\frac{k-m}{k\sqrt{3m}}\leq\frac{1}{\sqrt{3m}}\to0$ for $k>m$.
Limit outside the space:${\|f_k-s\|}_2=\frac{1}{\sqrt{3k}}\to0$ for the step function $s$ (dashed), which is not continuous, even up to null sets.
Conclusion: $C([0,1])$ with ${\|\cdot\|}_2$ is not complete.
With ${\|\cdot\|}_\infty$, $C([0,1])$ is complete (uniform limits).
$f_k$ (orange), $f_{2k}$ (grey), the step function $s$ (dashed)
2.2 · Hilbert and Banach spaces
Complete spaces
Definition 2.2. A Banach space is a normed space $(V,{\|\cdot\|}_V)$ that is complete with respect to the metric $d(\mathbf{x},\mathbf{y})={\|\mathbf{y}-\mathbf{x}\|}_V$ of its norm. A Hilbert space is an inner product space $(V,{\langle\cdot,\cdot\rangle}_V)$ that is complete with respect to the norm ${\|\mathbf{x}\|}_V=\sqrt{{\langle\mathbf{x},\mathbf{x}\rangle}_V}$ of its inner product.
Every Hilbert space is a Banach space. The examples of Lectures 2, 3 and 4:
Hilbert spaces: $\mathbb{R}^n$ with the dot product; $\ell^2$;$L^2(\mu)$.
Banach, not Hilbert: $\mathbb{R}^n$ ($n\geq2$) with ${\|\cdot\|}_1$,${\|\cdot\|}_\infty$;$\ell^p$, $L^p(\mu)$ ($p\neq2$); $C([0,1])$ with ${\|\cdot\|}_\infty$.
Neither: $C([0,1])$ with ${\|\cdot\|}_2$; $\mathbb{R}[t]$ with ${\|\cdot\|}_\infty$; finitely many non-zero entries, ${\|\cdot\|}_2$.
The norms in the second item violate the parallelogram law (Theorem 1.2 of Lecture 3; Section 1). The completeness of $\ell^p$ and $L^p(\mu)$ is the Riesz–Fischer theorem (without proof).
2.2 · Hilbert and Banach spaces
Closed subspaces
A linear subspace $U$ of a normed space $X$ is closed if it contains the limits of its convergent sequences:
Theorem 2.3. Let $U\subseteq X$ be a linear subspace, with the norm (and inner product) of $X$.
If $X$ is a Banach space, then $U$ is a Banach space if and only if $U$ is closed.
If $X$ is a Hilbert space, then $U$ is a Hilbert space if and only if $U$ is closed.
Proof. 1. Closed $\Rightarrow$ complete: a Cauchy sequence in $U$ converges in $X$, with limit in $U$. Complete $\Rightarrow$ closed: $\mathbf{u}_k\to\mathbf{x}$ is Cauchy, so $\mathbf{u}_k\to\mathbf{u}\in U$, and $\mathbf{x}=\mathbf{u}$. 2. The restricted inner product induces the restricted norm; apply 1.□
Closed: every finite-dimensional subspace of a Banach space, since it is complete (as $\mathbb{R}^n$ is).
Not closed: the sequences in $\ell^2$ with finitely many non-zero entries; the continuous functions in $L^2([0,1])$.
The incomplete spaces of Section 2.1 have “holes”, as $\mathbb{Q}$ has a hole at $\sqrt2$. A completion fills them:
Definition 2.4 (Completion). A completion of a normed space $X$ is a Banach space $Y$ with a linear map $\iota:X\to Y$ that preserves norms and has dense image $\iota(X)$. For an inner product space $X$, $Y$ is a Hilbert space and $\iota$ preserves inner products.
Existence: every normed space has a completion, built from classes of Cauchy sequences (Theorem 2.5).
Uniqueness: two completions are identified by exactly one isometric isomorphism compatible with their maps (Proposition 2.6).
Closures: if $X$ lies in a Banach space $Z$, its closure in $Z$, with the inclusion, is a completion (Proposition 2.7).
2.3 · Completion
Filling the holes
Existence. $\mathbb{R}$ fills the hole of $\mathbb{Q}$ at $\sqrt2$ with Cauchy sequences, and the same works for every normed space $X$: a Cauchy sequence without a limit in $X$ defines a new element, its “ideal limit”, and two Cauchy sequences define the same element if they come arbitrarily close:
$a_k=\lfloor k\sqrt2\rfloor/k$ (orange) and $b_k=a_k+\frac1k$ (blue); dashed: $\sqrt2\notin\mathbb{Q}$
their distance $|a_k-b_k|=\frac1k$
2.3 · Completion
Construction by Cauchy sequences
Let $X$ be a normed space, possibly an inner product space. The equivalence class of a Cauchy sequence $(\mathbf{x}_k)$ is denoted by $[\mathbf{x}_k]$, the set of all classes by $\widehat{X}$. On $\widehat{X}$ we define
The definitions make sense: the sum of two Cauchy sequences is a Cauchy sequence, by the triangle inequality, and equivalent sequences have equivalent sums; similarly for multiples.
The norm exists:$\bigl|{\|\mathbf{x}_k\|}_X-{\|\mathbf{x}_m\|}_X\bigr|\leq{\|\mathbf{x}_k-\mathbf{x}_m\|}_X$, so $({\|\mathbf{x}_k\|}_X)$ is a Cauchy sequence of real numbers, which converges since $\mathbb{R}$ is complete; equivalent sequences have the same limit.
The inner product exists: by the Cauchy–Schwarz inequality, $({\langle\mathbf{x}_k,\mathbf{y}_k\rangle}_X)$ is a Cauchy sequence of real numbers, and its limit does not depend on the representatives (proof below).
$X$ sits inside: every $\mathbf{x}\in X$ defines the class $J(\mathbf{x}):=[\mathbf{x},\mathbf{x},\mathbf{x},\dots]$ of the constant sequence.
2.3 · Completion
Existence of a completion
Theorem 2.5 (Existence of a completion). Let $X$ be a normed space.
$\widehat{X}$, with these operations and this norm, is a Banach space; $J:X\to\widehat{X}$ is linear, preserves norms, and $J(X)$ is dense in $\widehat{X}$. So $(\widehat{X},J)$ is a completion of $X$.
If $X$ is an inner product space, then ${\langle\cdot,\cdot\rangle}_{\widehat{X}}$ is an inner product with norm ${\|\cdot\|}_{\widehat{X}}$: $\widehat{X}$ is a Hilbert space, and $(\widehat{X},J)$ is a completion of the inner product space $X$.
Proof. The vector space axioms and norm properties follow by taking limits; $\lim_k{\|\mathbf{x}_k\|}_X=0$ means $(\mathbf{x}_k)\sim(0,0,\dots)$.Density: for $\xi=[\mathbf{x}_k]$, ${\|\xi-J(\mathbf{x}_m)\|}_{\widehat{X}}=\lim_k{\|\mathbf{x}_k-\mathbf{x}_m\|}_X\to0$ for $m\to\infty$.Completeness: for a Cauchy sequence $(\xi_j)$ in $\widehat{X}$, choose $\mathbf{x}_j\in X$ with ${\|\xi_j-J(\mathbf{x}_j)\|}_{\widehat{X}}<1/j$. Then
so $(\mathbf{x}_j)$ is Cauchy and defines $\xi:=[\mathbf{x}_j]$, with $J(\mathbf{x}_j)\to\xi$ and hence ${\|\xi_j-\xi\|}_{\widehat{X}}\leq1/j+{\|J(\mathbf{x}_j)-\xi\|}_{\widehat{X}}\to0$.
2.3 · Completion
Inner products survive in $\widehat{X}$
Proof, continued. Cauchy sequences are bounded, say ${\|\mathbf{x}_k\|}_X,{\|\mathbf{y}_k\|}_X\leq C$, and by the Cauchy–Schwarz inequality
Hence $({\langle\mathbf{x}_k,\mathbf{y}_k\rangle}_X)$ is a Cauchy sequence of real numbers and converges, and the same estimate shows that the limit does not depend on the representatives. Bilinearity, symmetry and $\lim_k{\langle\mathbf{x}_k,\mathbf{x}_k\rangle}_X=\lim_k{\|\mathbf{x}_k\|}_X^2={\|[\mathbf{x}_k]\|}_{\widehat{X}}^2$ follow by taking limits.□
The constant sequences show that $J$ preserves inner products.
Density of $J(X)$: every element of $\widehat{X}$ is approximated by elements of $X$, as every real number by rational numbers.
2.3 · Completion
Uniqueness of completions
Proposition 2.6 (Uniqueness of completions). For any two completions $(Y_1,\iota_1)$ and $(Y_2,\iota_2)$ of $X$, there is exactly one isometric isomorphism $\Phi:Y_1\to Y_2$ with $\Phi\circ\iota_1=\iota_2$. If $Y_1$ and $Y_2$ are Hilbert spaces, $\Phi$ preserves inner products.
Proof. For $\mathbf{y}\in Y_1$, choose $\mathbf{x}_k\in X$ with $\iota_1(\mathbf{x}_k)\to\mathbf{y}$; $(\mathbf{x}_k)$ is Cauchy, so $\Phi(\mathbf{y}):=\lim_k\iota_2(\mathbf{x}_k)$ exists in $Y_2$. $\Phi$ is well defined, linear, preserves norms, and $\Phi\circ\iota_1=\iota_2$; its image is complete, hence closed (Theorem 2.3), and contains the dense set $\iota_2(X)$: $\Phi$ is onto. Two such maps agree on the dense set $\iota_1(X)$, hence everywhere. Inner products: polarization, ${\langle\mathbf{y},\mathbf{z}\rangle}_{Y_i}=\frac14({\|\mathbf{y}+\mathbf{z}\|}_{Y_i}^2-{\|\mathbf{y}-\mathbf{z}\|}_{Y_i}^2)$.□
The proposition does not say that two completions are equal; in general this makes no sense: $\widehat{X}$ consists of classes of Cauchy sequences, $\ell^2$ of sequences.
2.3 · Completion
Closures are completions
Proposition 2.7 (Closures are completions). Let $Z$ be a Banach space and $X\subseteq Z$ a linear subspace, with the norm of $Z$. Then the closure $\overline{X}$ of $X$ in $Z$, with the inclusion $X\hookrightarrow\overline{X}$, is a completion of $X$; if $Z$ is a Hilbert space, of the inner product space $X$.
Proof. $\overline{X}$ is a linear subspace, since limits of sums and multiples are sums and multiples of limits. It is closed, hence a Banach space, and a Hilbert space if $Z$ is one (Theorem 2.3). The inclusion preserves norms and inner products, and its image $X$ is dense in $\overline{X}$.□
Two natural completions of $X\subseteq Z$:$(\widehat{X},J)$, from classes of Cauchy sequences, and $\overline{X}$ with the inclusion, from the ambient space $Z$. Proposition 2.6 identifies them: $[\mathbf{x}_k]\mapsto\lim_k\mathbf{x}_k$ in $Z$.
Two completions by subspaces of the same $Z$ with the inclusions are equal: both are closed in $Z$ with $X$ dense, so both are $\overline{X}$.
2.3 · Completion
Example 2.8: completions as closures
Rational numbers$\mathbb{Q}$: dense in $\mathbb{R}$; the construction of $\widehat{\mathbb{Q}}$ is one of the standard ways of defining $\mathbb{R}$, due to Cantor.
Sequences with finitely many non-zero entries with ${\|\cdot\|}_2$: dense in $\ell^2$.
Polynomials on $[0,1]$ with ${\|\cdot\|}_\infty$: dense in $C([0,1])$. Every continuous function is a uniform limit of polynomials, the Weierstrass approximation theorem (without proof). Right: Bernstein polynomials.
$C([0,1])$ with ${\|\cdot\|}_2$: dense in $L^2([0,1])$; this needs measure theory (without proof).
a continuous $f$ (blue) and a polynomial of degree $n$ (orange)
Lecture 4
How the spaces are related
Affine spaces
e.g. the plane $x_1+x_2+x_3=1$ in $\mathbb{R}^3$
Vector spaces
e.g. all real sequences, all functions $[0,1]\to\mathbb{R}$
Normed spaces
e.g. polynomials on $[0,1]$ with ${\|\cdot\|}_\infty$
e.g. the sphere with the great-circle distance, $\mathbb{Z}$ with $|m-n|$
Topological spaces
A norm gives a metric, $d(\mathbf{x},\mathbf{y})={\|\mathbf{x}-\mathbf{y}\|}_V$, and a metric gives a topology. Completion: normed → Banach, inner product → Hilbert.
Lecture 4
Summary
Supremum norm on the bounded functions, $L^p$ norm on $L^p(\mu)$, $p$-norms on $\ell^p$.
By the parallelogram law, only the $L^2$ norm comes from an inner product, ${\langle f,g\rangle}_2=\int_\Omega fg\,d\mu$.
On $C([0,1])$, ${\|\cdot\|}_\infty$ is not equivalent to ${\|\cdot\|}_1$, ${\|\cdot\|}_2$ (unlike on $\mathbb{R}^n$): $t^k\to0$ in $L^1$, $L^2$, not uniformly.
Completeness depends on the norm. Banach and Hilbert spaces are the complete normed and inner product spaces; their closed subspaces are again complete.
Completion: a dense, norm-preserving linear map $\iota:X\to Y$ into a Banach (Hilbert) space; it exists and is unique up to isometric isomorphism.
Closures are completions: ${\mathbb{Q}\subseteq\mathbb{R}}$, polynomials in $C([0,1])$,${C([0,1])\subseteq L^2}$.
Next: inner products on $\mathbb{R}^n$ and projections onto subspaces (Lecture 5).