Ole Christensen
Ole Christensen
Ole Christensen
Ole Christensen
Technical University of Denmark
Department of Mathematics
Building 303, 2800 Lyngby
Denmark
Email: Ole.Christensen@mat.dtu.dk
1
1 Goal and scope
2
Part I: Expansions in general Hilbert spaces
• Bases;
• Shortcomings of bases;
• Frames;
• Central themes: tight frames, pairs of dual
frames.
Part II: Expansions in L2(R) of the
(i) Gabor type:
ek ∼ e2πimbxg(x − na), m, n ∈ Z,
for some g ∈ L2(R), a, b > 0;
(i) Wavelet type:
ek ∼ 2j/2ψ(2j x − k), j, k ∈ Z,
for some ψ ∈ L2(R).
Central themes:
• Why are frames needed?
• Explicit construction of tight frames and dual
frame pairs.
3
Operators on L2(R):
Translation by a ∈ R:
Ta : L2(R) → L2(R), (Taf )(x) = f (x − a).
Modulation by b ∈ R
Eb : L2(R) → L2(R), (Ebf )(x) = e2πibxf (x).
Dilation by a 6= 0:
1 x
Da : L2(R) → L2(R), (Daf )(x) = p f ( ).
|a| a
With this notation, the Gabor system can be
written
4
1.1 The Fourier transform
Plancherel’s equation:
hfˆ, ĝi = hf, gi, ∀f, g ∈ L2(R), and ||fˆ|| = ||f ||.
5
2 Bessel sequences
6
Pre-frame operator associated to a Bessel se-
quence:
∞
X
T : `2(N) → H, T {ck }∞
k=1 = ck f k
k=1
7
3 Various bases
8
3.1 Orthonormal bases
9
Theorem 3.4 Let {ek }∞ k=1 be an orthonor-
mal basis for H. Then the orthonormal bases
for H are precisely the sets {U ek }∞
k=1 , where
U : H → H is a unitary operator.
Then {ek }∞
k=1 is an orthonormal basis for H.
10
3.2 Riesz bases
{gk }∞
k=1 is called the dual Riesz basis.
11
From the proof:
{gk }∞
k=1 = {(U −1 ∗
) e k } ∞
k=1 .
Dual of {gk }∞
k=1 :
n ∗ o ∞
−1
(U −1)∗ ek = {U ek }∞ ∞
k=1 = {fk }k=1 .
k=1
∞
So {fk }∞
k=1 and {g k } k=1 are duals of each other:
they are called a pair of dual Riesz bases.
12
Definition 3.8 Two sequences {fk }∞ k=1 and
{gk }∞
k=1 in a Hilbert space are biorthogonal if
hfk , gj i = δk,j .
13
Theorem 3.11 For a sequence {fk }∞ k=1 in
H, the following conditions are equivalent:
(i) {fk }∞
k=1 is a Riesz basis for H.
(ii) {fk }∞
k=1 is complete in H, and there exist
constants A, B > 0 such that for every
finite scalar sequence {ck } one has
X X 2 X
2
A |ck | ≤ ck f k ≤ B |ck |2.
14
4 The expansion property for a non-basis:
Since
2
X
f − hf, ek iek → 0 as n → ∞,
|k|≤n 2
L (I)
15
we also have
X
f= hf, ek iek in L2(I). (2)
k∈Z
That is, the (restrictions to I of the) functions
{ek }k∈Z also have the expansion property in
L2(I). However, they are not a basis for L2(I)!
To see this, define the function
f (x) if x ∈ I,
f˜(x) =
1 if x ∈
/ I.
Then f˜ ∈ L2(0, 1) and we have the representa-
tion
X
f˜ = hf˜, ek iek in L2(0, 1). (3)
k∈Z
By restricting to I, the expansion (3) is also
valid in L2(I); since f = f˜ on I, this shows
that
X
f= hf˜, ek iek in L2(I). (4)
k∈Z
Thus, (2) and (4) are both expansions of f in
L2(I), and they are non-identical; the argument
16
is that since f 6= f˜ in L2(0, 1), the expansions
(1) and (3) show that
{hf, ek i}k∈Z 6= {hf˜, ek i}k∈Z.
17
5 Frames in Hilbert spaces
18
Definition 5.3 A sequence {fk }∞ k=1 in H is
a tight frame if there exist a number A > 0
such that
X∞
|hf, fk i|2 = A ||f ||2, ∀f ∈ H.
k=1
The (exact) number A is called the frame
bound.
{fk }∞
k=1 is a Bessel sequence, so the series defin-
ing S converges unconditionally for all f ∈ H
by Corollary 2.3.
19
Some important properties of S:
Lemma 5.4 Let {fk }∞ k=1 be a frame with frame
operator S and frame bounds A, B. Then the
following holds:
(i) S is bounded, invertible, self-adjoint, and
positive.
(ii) {S −1fk }∞
k=1 is a frame with frame opera-
tor S −1 and frame bounds B −1, A−1.
(iii) If A, B are the optimal frame bounds for
{fk }∞
k=1 , then the bounds B −1
, A −1
are op-
timal for {S −1fk }∞ k=1 .
{S −1fk }∞
k=1 is called the canonical dual frame
of {fk }∞
k=1 .
20
Frame decomposition:
Theorem 5.5 Let {fk }∞ k=1 be a frame with
frame operator S. Then
X∞
f= hf, S −1fk ifk , ∀f ∈ H,
k=1
and
∞
X
f= hf, fk iS −1fk , ∀f ∈ H. (5)
k=1
Both series converge unconditionally for all
f ∈ H.
Proof. Let f ∈ H. Via Lemma 5.4,
∞
X ∞
X
f = SS −1f = hS −1f, fk ifk = hf, S −1fk ifk .
k=1 k=1
Since {fk }∞
k=1 is a Bessel sequence and
{hf, S −1fk i}∞
k=1 ∈ ` 2
(N),
the series converges unconditionally by Corol-
lary 2.3. The expansion (5) follows from
f = S −1Sf.
21
Corollary 5.6 If {fk }∞
k=1 is a tight frame with
frame bound A, then the canonical dual frame
is {A−1fk }∞
k=1 , and
∞
1X
f= hf, fk ifk , ∀f ∈ H. (6)
A
k=1
22
Other advantages of tight frames:
• If {fk }∞
k=1 consists of functions with com-
pact support or fast decay, the same is the
case for the functions in the canonical dual
frame.
• If {fk }∞
k=1 consists of functions with a spe-
cial structure (Gabor structure or wavelet
structure) the same is the case for the func-
tions in the canonical dual frame.
23
To each frame {fk }∞
k=1 one can associate a tight
frame:
Theorem 5.7 Let {fk }∞ k=1 be a frame for H
with frame operator S. Denote the positive
square root of S −1 by S −1/2. Then {S −1/2fk }∞k=1
is a tight frame with frame bound equal to 1,
and
X∞
f= hf, S −1/2fk iS −1/2fk , ∀f ∈ H.
k=1
Problems:
• Not easy to find {S −1/2fk }∞
k=1 ;
24
5.1 Dual frames
for which
∞
X
f= hf, gk ifk , ∀f ∈ H.
k=1
{gk }∞ ∞
k=1 is called a dual frame of {fk }k=1 .
25
∞
Lemma 5.9 Assume that {fk }∞ k=1 and {g k } k=1
are Bessel sequences in H. Then the follow-
ing are equivalent:
P∞
(i) f = k=1hf, gk ifk , ∀f ∈ H.
P∞
(ii) f = k=1hf, fk igk , ∀f ∈ H.
P∞
(iii) hf, gi = k=1hf, fk ihgk , gi, ∀f, g ∈ H.
In case the conditions are satisfied, {fk }∞
k=1
∞
and {gk }k=1 are dual frames for H.
26
5.2 Frames and Riesz bases
27
5.3 Characterizations of frames
28
5.4 A frame where no subsequence is a basis
29
Part II: Constructions in L2(R).
Final goal:
Convenient means:
• fk , gk are given explicitly;
• fk , gk have compact support (no truncation
necessary in numerical calculations);
• fk , gk decay fast in the Fourier domain;
• If fk has a certain structure (e.g., Gabor
structure), gk has the same structure.
In concrete applications, other requirements might
be relevant (differentiability, zero-means, van-
ishing moments, approximation order etc.)
30
6 Special functions
Typical generators:
B-splines: The B-splines Nn, n ∈ N, are
given inductively by
N1 = χ[0,1], Nn+1(x) = Nn ∗ N1(x)
Z 1
= Nn(x − t) dt.
0
The functions Nn are called B-splines, and n
is the order.
Fundamental properties:
Theorem 6.1 Given n ∈ N, the B-spline
Nn has the following properties:
(i) supp Nn = [0, n] and Nn > 0 on ]0, n[.
R∞
(ii) −∞ Nn(x)dx = 1.
P
(iii) k∈Z Nn(x − k) = 1
31
(iv) For any n ∈ N,
−2πiγ
n
cn(γ) = 1−e
N .
2πiγ
.
32
33
6.1 Symmetric B-splines:
For n ∈ N, let
n
Bn(x) := T − n2 Nn(x) = Nn(x + ).
2
34
35
7 Gabor systems
36
Problem: The function χ[0,1] is discontinuous
and has very slow decay in the Fourier domain:
Z 1
sin πγ
b[0,1](γ) =
χ e−2πixγ dx = e−πiγ .
0 πγ
37
A related short coming - the Balian–Low The-
orem:
Theorem 7.2 Assume that {EmbTnag}m,n∈Z
is
a ZRiesz basis. Then
Z
|xg(x)|2dx |γ ĝ(γ)|2dγ = ∞.
R R
In words:
A function g generating a Gabor
Riesz basis
can not be well localized
in both time and frequency.
2 2
Problem: S −1/2e−x and S −1e−x are not given
explicitly.
39
Solution: Don’t construct a nice frame and
expect the canonical dual to be nice.
40
7.1 Sufficient and necessary conditions
42
Lemma 7.6 Suppose that f is a bounded mea-
surable function with compact support and
that the function
X
G(x) = |g(x − na)|2, x ∈ R
n∈Z
is bounded. Then
X
|hf, EmbTnagi|2
m,n∈Z
Z ∞ X
1 2
= |f (x)| |g(x − na)|2 dx
b −∞ n∈Z
1 XZ ∞
+ f (x)f (x − k/b)
b −∞
k6=0
X
× g(x − na)g(x − na − k/b) dx.
n∈Z
43
Theorem 7.7 Let g ∈ L2(R), a, b > 0 and
suppose that
1
X X
B := sup g(x − na)g(x − na − k/b) < ∞.
b x∈[0,a]
k∈Z n∈Z
A := "
1 X
inf |g(x − na)|2
b x∈[0,a]
n∈Z
X X
− g(x − na)g(x − na − k/b) > 0,
k6=0 n∈Z
44
Corollary 7.8 Let g ∈ L2(R) be bounded and
compactly supported. Then {EmbTnag}m,n∈Z
is a Bessel sequence for any a, b > 0.
Recall:
X
G(x) = |g(x − na)|2, x ∈ R.
n∈Z
45
Corollary 7.10 Suppose that g ∈ L2(R) is a
continuous function with support on an in-
terval I with length |I| and that g(x) > 0 on
the interior of I. Then {EmbTnag}m,n∈Z is a
1
frame for all (a, b) ∈]0, |I|[×]0, |I| [.
Corollary 7.11 For n ∈ N, the B-splines
Bn and Nn generate Gabor frames for all
(a, b) ∈]0, n[×]0, 1/n[.
47
Via a scaling, assume that b = 1.
48
Theorem 7.13 Let g ∈ L2(R) and a, b > 0
be given. Then the following holds:
(i) If ab > 1, then {EmbTnag}m,n∈Z can not
be a frame for L2(R).
(ii) If {EmbTnag}m,n∈Z is a frame, then
ab = 1 ⇔ {EmbTnag}m,n∈Z is a Riesz basis.
49
Duality principle: [Janssen], [Daubechies,
Landau and Landau], [Ron and Shen].
50
7.2 Time-frequency localization of Gabor expansions
51
Given a number T > 0, define the operator
QT : L2(R) → L2(R), (QT f )(x) = χ[−T,T ](x)f (x).
53
Theorem 7.15 Assume that the Gabor sys-
tems {EmbTnag}m,n∈Z and {EmbTnah}m,n∈Z form
a pair of dual frames for L2(R) with upper
frame bounds B and D respectively, and that
for some constants C > 0, α > 1/2, the de-
cay conditions
|h(x)| ≤ C(1 + x2)−α, |ĥ(ν)| ≤ C(1 + ν 2)−α
hold. Then, for any > 0 there exist num-
bers Λ, Γ > 0 such that for all T, Ω > 0,
X
f − hf, EmbTnahiEmbTnag
{(m,n)∈B(T +Λ,Ω+Γ)}
√
≤ BD (||I − QT )f || + ||(I − PΩ)f || + ||f ||)
for all f ∈ L2(R).
54
7.3 Tight Gabor frames
55
Corollary 7.17 Let a, b > 0 be given. As-
sume that ϕ ∈ L2(R) is a real-valued non-
negative function with support in an interval
of length 1/b, and that
X
ϕ(x + na) = 1, a.e. x ∈ R.
n∈Z
56
7.4 The duals of a Gabor frame
57
Theorem 7.20 Let g ∈ L2(R) and a, b > 0
be given, and assume that {EmbTnag}m,n∈Z is
a Gabor frame. Then the following holds:
(i) The canonical dual frame also has the Ga-
bor structure and is given by {EmbTnaS −1g}m,n∈Z.
(ii) The canonical tight frame associated with
{EmbTnag}m,n∈Z is given by {EmbTnaS −1/2g}m,n∈Z.
Theoretically perfect!
2
Can be applied to the Gaussian g(x) = e−x /2
– but the resulting generators are not given ex-
plicitly.
58
7.5 Characterizations of pairs of dual Gabor frames
59
Janssen proved the following:
60
7.6 Explicit construction of dual pairs of Gabor frames
61
Also, g and h have compact support, so {EmbTng}m,n∈Z
and {EmbTnh}m,n∈Z are Bessel sequences.
We check the condition in Lemma 7.24. For
x ∈ [0, 1],
N −1
!2
X
1 = g(x + k)
k=0
= (g(x) + g(x + 1) + · · · + g(x + N − 1)) ×
(g(x) + g(x + 1) + · · · + g(x + N − 1))
= g(x) ×
[g(x) + 2g(x + 1) + 2g(x + 2) + · · · + 2g(x + N − 1)]
+g(x + 1) ×
[g(x + 1) + 2g(x + 2) + 2g(x + 3) + · · · + 2g(x + N − 1)]
+g(x + 2) ×
[g(x + 2) + 2g(x + 3) + 2g(x + 4) + · · · + 2g(x + N − 1)]
+···
+···
+g(x + N − 2) [g(x + N − 2) + 2g(x + N − 1)]
+g(x + N − 1) [g(x + N − 1)]
N −1
1X
= g(x + k)h(x + k).
b
k=0
63
Example 7.27 For the B-spline
x x ∈ [0, 1[,
N2(x) = 2 − x x ∈ [1, 2[,
0 x∈ / [0, 2[,
we can use Corollary 7.26 for b ∈]0, 1/3]. For
b = 1/3 we obtain the dual generator
1 2
h(x) = N2(x) + N2(x + 1)
3
3
2
3 (x + 1) x ∈ [−1, 0[,
= 31 (2 − x) x ∈ [0, 2[,
0 x∈/ [−1, 2[.
64
!
65
Dual Gabor frames with general a > 0:
66
Other choices?
Yes!
Theorem 7.29 (C., Kim, 2007) Let N ∈
N. Let g ∈ L2(R) be a real-valued bounded
function with supp g ⊆ [0, N ], for which
X
g(x − n) = 1.
n∈Z
where
a0 = b, an + a−n = 2b, n = 1, 2, · · · , N − 1.
Then g and h generate dual frames {EmbTng}m,n∈Z
and {EmbTnh}m,n∈Z for L2(R).
67
Example 7.30
1) Take
a0 = b,
an = 0 for n = −N + 1, . . . , −1
a = 2b, n = 1, . . . N − 1
n
2) Take
a−N +1 = a−N +2 = · · · = aN −1 = b :
if g is symmetric, this leads to a symmetric dual
generator
N
X −1
h(x) = b g(x + n).
n=−N +1
68
1
0.8
0.6
0.4
0.2
0
-2 -1 0 1 2 3 4
x
0.7
0.6
0.5
0.4
0.3
0.2
0.1
0
-2 0 2 4 6
x
69
8 Polynomial generators and duals [C., Kim]
70
The condition on the relationship between the
support size and the degree of the polynomial
is necessary in Proposition 8.1:
Example 8.2 Let
g(x) = (x − 1/2)(x − 3/2)χ[0,2](x)
= (x2 − 2x + 3/4)χ[0,2](x).
Then {EmbTng}m,n∈Z is not a Gabor frame for
any b > 0. In fact, for x ∈ [0, 1],
X
|g(x − k)|2 = |g(x)|2 + |g(x + 1)|2,
k∈Z
so
X
|g(1/2 − k)|2 = 0.
k∈Z
71
In applications of frames: crucial that the frame
generator as well as the dual frame generator
have a convenient form. The polynomials are
very convenient - but no pair of dual generators
of this form exists:
Theorem 8.3 Two compactly supported poly-
nomials
N
!
X 1
and
N2
!
X
h(x) = b k xk χI2 (x)
k=0
72
Remark: The proof shows that even finite lin-
ear combinations of the type
X X
g̃(x) = ck Tk g, h̃(x) = d k Tk h
with g and h as in Theorem 8.3 can’t gen-
erate dual Gabor frames {EmbTng̃}m,n∈Z and
{EmbTnh̃}m,n∈Z
73
P −1
Theorem 8.4 Let N ∈ N and g(x) := N k=0 ck x
k
74
P 0
Theorem 8.5 Let N ∈ N and g(x) := N k=0 ck x
k
75
P −1
Corollary 8.6 Let N ∈ N and g(x) := N k=0 ck x
k
76
Conclusion: polynomial generators on suffi-
ciently large intervals almost always generate
Gabor frames with B-spline duals for sufficiently
small modulation parameters.
77
Example 8.7 Let g(x) = (x − 1)χI (x). First,
let I = [0, 2]. A direct calculation shows that
c2(0) = 1,
N c2(0) = −2πi.
DN
Thus
1
X c2(0)
Dk N
κ= ck k
= 0.
(−2πi)
k=0
One can prove that
X
g(x − k)N2(x − k) = 0.
k∈Z
78
Example 8.8 Let
g(x) = x2(5 − x)2χ[0,5](x)
2 3 4
= 25x − 10x + x χ[0,5](x)
4
!
X
=: ck xk χ[0,5](x).
k=0
79
30
20
10
0
-1 0 1 2 3 4 5 6
x
0.0035
0.003
0.0025
0.002
0.0015
0.001
0.0005
0
-1 0 1 2 3 4 5 6
x
80
Example 8.9 Let
g(x) = x3(6 − x)2χ[0,6](x)
3 4 5
= 36x − 12x + x χ[0,6](x)
5
!
X
= ck xk χ[0,6](x).
k=0
81
250
200
150
100
50
0
0 2 4 6
x
0.0004
0.0003
0.0002
0.0001
0
0 2 4 6
x
82
Extensions:
1) Higher dimensions: (C., R. Y. Kim)
83
Theorem 8.10 Let N ∈ N and assume that
g ∈ L2(Rd) has supp g ⊆ [0, N ]d, and that
X
g(x − n) = 1.
n∈Zd
84
2) Tight frames (C., R.Y. Kim):
Theorem 8.11 Let N ∈ N. Let g ∈ L2(Rd)
be a non-negative function with supp g ⊆
[0, N ]d, for which
X
g(x − n) > 0, a.e. x ∈ Rd.
n∈Zd
Assume that the d × d matrix B is invertible
and ||B|| ≤ √d1 N . Define h ∈ L2(Rd) by
s
g(x)
h(x) := | det B| P .
n∈Zd g(x − n)
Then the function h generates a Parseval
frame {EBmTnh}m,n∈Zd for L2(Rd).
85
3) Irregular B-splines (C., Wenchang
Sun):
Theorem 8.13 Let {xn : n ∈ Z} ⊂ R be a
sequence such that
lim xn = ±∞, xn−1 ≤ xn,
n→±∞
and
xn+2N −1 − xn ≤ M, n ∈ Z,
for some constants N ∈ N and M > 0.
Let gn be the N -th order normalized B-spline
with knots (xn, xn+1, · · · , xn+N ) and
N
X −1
hn(x) = bgn(x) + 2b gn−k (x).
k=1
86
9 Wavelet frames
87
An MRA can be used to construct an ONB for
L2(R):
88
We will now explain how to find a suitable func-
tion ψ. The condition φ ∈ V0 ⊂ V1 implies by
(iii) that
1
√ D−1φ ∈ V0.
2
Since {T−k φ}k∈Z is an orthonormal basis for V0,
there exist coefficients {ck }k∈Z ∈ `2(Z) such
that
1 −1 X
√ D φ= ck T−k φ. (7)
2 k∈Z
We will now rewrite (7) in terms of the Fourier
transform of φ. Let
Ek (x) = e2πikx, x ∈ R.
Now, applying the Fourier transform on both
sides of (7),
1 X
√ Dφ̂ = ck Ek φ̂.
2 k∈Z
P
Defining the 1-periodic function H0 := k∈Z ck Ek ,
this can be written as
φ̂(2γ) = H0(γ)φ̂(γ), a.e. γ ∈ R. (8)
89
The equation (8) is called a scaling equation
or refinement equation. Now, a certain choice
of a 1-periodic function H1, implies that the
function ψ defined via
ψ̂(2γ) = H1(γ)φ̂(γ) (9)
generates a wavelet orthonormal basis {D j Tk ψ}j,k∈Z.
One choice of H1 is to take
1 −2πiγ
H1(γ) = H0(γ + )e .
2
90
Lemma 9.2 Assume that
ψ̂(2γ) = H1(γ)φ̂(γ)
holds for a 1-periodic and bounded
P function
H1 with Fourier expansion H1 = k∈Z ck Ek .
Then
√ X
ψ(x) = 2 ck DT−k φ(x)
k∈Z
X
= 2 ck φ(2x + k), a.e. x ∈ R.
k∈Z
In particular, if H
P1 Nis2 a trigonometric poly-
nomial, H1(x) = k=N1 ck e2πikx, then
N2
√ X
ψ(x) = 2 ck DT−k φ(x)
k=N1
N2
X
= 2 ck φ(2x + k), ∀x ∈ R.
k=N1
91
The Haar basis can be constructed via the mul-
tiresolution analysis defined by φ = χ[0,1[ and
Vj = {f : f is const. on [2−j k, 2−j (k + 1)[, ∀k ∈ Z}.
In terms of the function φ, the Haar function is
1 1
ψ= √ φ1,0 − √ φ1,1.
2 2
93
Lemma 9.4 Assume that φ ∈ L2(R) and that
{Tk φ}k∈Z is a Bessel sequence. Define the
spaces Vj by
Vj = span{Dj Tk φ}k∈Z.
Then the following holds:
(i) If ψ ∈ L2(R) and there exists a bounded
1-periodic function H1 such that
ψ̂(2γ) = H1(γ)φ̂(γ),
then ψ ∈ V1.
(ii) If there exists a bounded 1-periodic func-
tion H0 such that
φ̂(2γ) = H0(γ)φ̂(γ),
then Vj ⊆ Vj+1 for all j ∈ Z.
94
Via Lemma 9.3 and Lemma 9.4 we obtain the
following:
Theorem 9.5 Let φ ∈ L2(R), and assume
that |φ̂| > 0 on a neighborhood of 0. Assume
further that
φ̂(2γ) = H0(γ)φ̂(γ),
is satisfied for a bounded 1-periodic function
H0. Define the spaces Vj by
Vj = span{Dj Tk φ}k∈Z.
Then the following holds:
(i) If {Tk φ}k∈Z is an orthonormal system,
then φ and the spaces Vj form a multires-
olution analysis.
(i) If {Tk φ}k∈Z is a Bessel sequence, then the
spaces Vj satisfy the conditions (i)–(iv) in
Definition 9.1.
95
Important properties for wavelet bases
{ψj,k }j,k∈Z:
• that ψ has a computationally convenient form,
for example that ψ is a piecewise polynomial
(a spline);
• regularity of ψ;
• symmetry (or anti-symmetry) of ψ, i.e., that
ψ(x) = ψ(−x) or ψ(x) = −ψ(−x), x ∈ R;
96
Short description of the role of these
conditions:
• Vanishing moments: needed if we want smooth
wavelets. If ψ is an m times differentiable
function with bounded derivatives with rea-
sonable decay and {ψj,k }j,k∈Z is an orthonor-
mal system, then ψ has m − 1 vanishing
moments.
• Vanishing moments are essential in the con-
text of compression. Assuming that {ψj,k }j,k∈Z
is an orthonormal basis for L2(R), every
f ∈ L2(R) has the representation
X
f= hf, ψj,k iψj,k . (10)
j,k∈Z
98
Further relevant properties:
99
One can not combine the classical multiresolu-
tion analysis with the desire of having a sym-
metric wavelet ψ:
Proposition 9.7 Assume that φ ∈ L2(R) is
real-valued and compactly supported, and let
Vj = span{Dj Tk φ}k∈Z, j ∈ Z.
Assume that (φ, {Vj }) constitute a multireso-
lution analysis. Then, if the associated wavelet
ψ is real-valued and compactly supported and
has either a symmetry axis or an antisym-
metry axis, then ψ is necessarily the Haar
wavelet.
Thus, under the above assumptions we are
back at the function we want to avoid!
100
Definition 9.8 Let ψ ∈ L2(R). A frame for
L2(R) of the form {D j Tk ψ}j,k∈Z is called a
dyadic wavelet frame.
101
Improvement: can show that
S −1Dj Tk ψ = Dj S −1Tk ψ.
Unfortunately, in general
Dj S −1Tk ψ 6= Dj Tk S −1ψ.
102
Example 9.9 Let {ψj,k }j,k∈Z be a wavelet ONB
for L2(R). Given ∈]0, 1[, let
θ = ψ + Dψ.
Then {θj,k }j,k∈Z is a Riesz basis and the canon-
ical dual frame is given by
104
Fom general frame theory:
105
The popular wavelet bases are based on mul-
tiresolution analysis, which leads to a very con-
venient algorithmic structure. This implies a
special form for the function ψ generating the
wavelet basis:
X
ψ= ck DTk φ
k∈Z
106
Therefore, it is natural to require the generator
ψ for a tight frame {D j Tk ψ}j,k∈Z to have the
form
X
ψ= ck DTk φ
k∈Z
108
Definition 9.11 Consider two sequences of
functions
ψ1, . . . , ψn ∈ L2(R) and ψ̃1, . . . , ψ̃n ∈ L2(R).
We say that {D j Tk ψ`}j,k∈Z,`=1,...,n and
{Dj Tk ψ̃`}j,k∈Z,`=1,...,n are a pair of dual mul-
tiwavelet frames if both are Bessel sequences
and
Xn X
f= hf, D j Tk ψ`iDj Tk ψ̃`, ∀f ∈ L2(R).
`=1 j,k∈Z
109
Characterization of all dual wavelet frame pairs:
110
Characterization of tight wavelet frames gener-
ated by one generator ψ:
111
10 The unitary extension principle
Terminology:
112
Standing assumptions and conventions:
Let ψ0 ∈ L2(R) and assume that
(i) There exists a function H0 ∈ L∞(T) such
that
ψb0(2γ) = H0(γ)ψb0(γ).
(ii) limγ→0 ψb0(γ) = 1.
113
We want to find conditions on the functions
H1, . . . , Hn such that ψ1, . . . , ψn generate a mul-
tiwavelet frame for L2(R).
we have
√ X
ψ`(x) = 2 ck,`DT−k ψ0(x)
k∈Z
X
= 2 ck,`ψ0(2x + k).
k∈Z
114
The general setup presented here preserves the
algorithmic structure of a multiresolution anal-
ysis: by Theorem 9.5, the spaces
Vj := span{D j Tk ψ0}k∈Z, j ∈ Z,
satisfy the conditions for a multiresolution anal-
ysis in Definition 9.1, except (v). Also,
ψ1 , . . . , ψ n ∈ V 1 .
115
The matrix H(γ)∗H(γ) has four entries, but
it is enough to verify two sets of equations:
116
Example 10.3 For any m = 1, 2, . . . , we con-
sider the B-spline
ψ0 := B2m
of order 2m. Then
2m
sin(πγ)
ψb0(γ) = .
πγ
It is clear that limγ→0 ψb0(γ) = 1, and by direct
calculation,
2m
sin(2πγ)
ψb0(2γ) =
2πγ
2m
2 sin(πγ) cos(πγ)
=
2πγ
= cos2m(πγ)ψb0(γ).
Thus ψ0 satisfies a refinement equation with
two-scale symbol
H0(γ) = cos2m(πγ).
117
Now, consider the binomial coefficient
2m (2m)!
:= ,
` (2m − `)!`!
and define the functions H1, . . . , H2m ∈ L∞(T)
by
s
2m
H`(γ) = sin`(πγ) cos2m−`(πγ).
`
Using that cos(π(γ − 1/2)) = sin(πγ) and
sin(π(γ − 1/2)) = − cos(πγ),
s
2m
T1/2H`(γ) = (−1)` cos`(πγ) sin2m−`(πγ).
`
118
Thus, the matrix H is given by
H0(γ) T1/2H0(γ)
H1(γ) T1/2H1(γ)
H(γ) = · · =
· ·
H2m(γ) T1/2H2m(γ)
s cos2m (πγ) s sin2m (πγ)
2m 2m
sin(πγ) cos2m−1 (πγ) − cos(πγ) sin2m−1 (πγ)
1 1
s s
2m 2 2m
sin (πγ) cos 2m−2 (πγ) cos2 (πγ) sin2m−2 (πγ)
2 2 .
· ·
· ·
s s
2m 2m
sin2m (πγ) cos2m (πγ)
2m 2m
119
We now verify the conditions in Corollary 10.2.
Using the binomial formula
X2m
2m
(x + y)2m = x`y 2m−`,
`
`=0
2m
X 2m
X
2m
|H`(γ)|2 = sin2`(πγ) cos2(2m−`)(πγ)
`
`=0 `=0
2 2
2m
= sin (πγ) + cos (πγ)
= 1, γ ∈ T.
Using the binomial formula with x = −1, y =
1,
2m
X
H`(γ)T1/2H`(γ)
`=0
2m
X
2m
= sin2m(πγ) cos2m(πγ) (−1)`
`
`=0
= sin2m(πγ) cos2m(πγ)(1 − 1)2m
= 0.
120
Now Corollary 10.2 implies that the 2m func-
tions ψ1, . . . , ψ2m defined by
ψb`(γ) = H`(γ/2)ψ0(γ/2)
s 2m+`
2m sin (πγ/2) cos2m−`(πγ/2)
=
` (πγ/2)2m
121
A small modification:
Example 10.4 We continue Example 10.3, but
now we define
s
2m
H`(γ) = i` sin`(πγ) cos2m−`(πγ).
`
122
Via the binomial formula we see that H`(γ) is
a finite linear combination of terms
e−2πimγ , e−2πi(m−1)γ , . . . , e2πi(m−1)γ , e2πimγ .
All coefficients in the linear combination are
real. Writing
m
X
H`(γ) = ck,`e2πikγ ,
k=−m
123
Explicitly, in the case m = 1:
Example 10.5 In the case m = 1, the con-
struction in Example 10.4 leads to two genera-
tors ψ1 and ψ2. Via the expression for H1,
s
1 2m
H1(γ) = (eπiγ − e−πiγ )(eπiγ + e−πiγ )
4 1
1
= √ (e2πiγ − e−2πiγ ).
2 2
By Lemma 9.2 we conclude that
1
ψ1(x) = √ (B2(2x + 1) − B2(2x − 1)).
2
Similarly,
1
ψ2(x) = (B2(2x + 1) − 2B2(2x) + B2(2x − 1)) .
2
124
$
" # " $ % $ #
" $
& (
125
Example 10.6 Can also construct spline frames
with support on [0, 2m]. Letting ψ0 := N2m,
one can prove that
c c0(γ)
ψ0(2γ) = H0(γ)ψ
with
−2πiγ
2m
1+e
H0(γ) = = e−2πimγ cos2m(πγ).
2
Since H0 appears from the corresponding func-
tion for B2m simply by multiplication with e−2πimγ ,
the functions
s
2m
H`(γ) = e−2πimγ sin`(πγ) cos2m−`(πγ)
`
satisfy the conditions in the unitary extension
principle. We prefer to consider
s
2m
H`(γ) = i`e−2πimγ sin`(πγ) cos2m−`(πγ);
`
with this choice, the functions ψ1, . . . , ψ2m
126
defined by
ψb`(γ)
= H`(γ/2)ψ0(γ/2)
s 2m+`
` −2πimγ 2m sin (πγ/2) cos2m−`(πγ/2)
= ie
` (πγ/2)2m
127
Shortcomings for the unitary extension
principle:
• The computational effort increases with the
order of the B-spline B2m: For higher orders,
we need more generators, and more non-zero
coefficients appear in ψ`.
• There is a limitation on the possible number
of vanishing moments ψ` can have.
and
c0(0) = 1.
ψ
Thus, the number of vanishing moments for the
function ψ` is equal to the order of zero for H`
at γ = 0.
128
Example 10.7 Consider B2m; it satisfies a re-
finement equation with two-scale symbol
H0(γ) = cos2m(πγ).
If we want to construct a frame via the unitary
extension principle, then
n
X
1= |H`(γ)|2,
`=0
i.e.,
n
X
|H`(γ)|2 = 1 − cos4m(πγ). (11)
`=1
129
11 The oblique extension principle
131
Via the definition,
Xn Xn 2
f`(γ)| =
2 θ(2γ) 2 |H ` (γ)|
|H |H0(γ)| +
θ(γ) θ(γ)
`=0 `=1
= 1, a.e. γ ∈ T.
f0, . . . , H
Thus, H fn ∈ L∞(T). Similarly,
n
X
f`(γ + 1 ) = 0, a.e. γ ∈ T.
f`(γ)H
H
2
`=0
f1, . . . , ψ
Defining the functions ψ fn by
b c
f0(γ), ` = 1, . . . , n,
ψe`(2γ) = H̃`(γ)ψ
it follows from Theorem 10.1 that the functions
{Dj Tk ψe`}j,k∈Z,`=1,...,n constitute a tight frame
for L2(R) with frame bound equal to 1. Now,
ψb`(2γ) = H`(γ)ψc0(γ)
p
= θ(γ)H f`(γ) p 1 ψ c
f0(γ)
θ(γ)
b
= ψe`(2γ),
which shows that ψ` = ψe`.
132
The UEP and the OEP are equivalent:
Suppose that
• ψ0 is a compactly supported function such
that for some function H0 ∈ L∞(R),
ψb0(2γ) = H0(γ)ψb0(γ);
• the functions θ, H` are trigonometric poly-
nomials satisfying the conditions in the OEP
Then the generators ψ` for the frame {D j Tk ψ`}
have the form
X
ψ`(x) = ck,`ψ0(2x − k)
(finite sum) and thus compact support.
133
The same frame can be constructed via the UEP:
f0 by
if we define ψ
c p
f
ψ0(γ) = θ(γ)ψ c0(γ),
134
In practice: desirable to have as few
generators as possible.
135
Corollary 11.2 Let ψ0 and H0 be as in the
general setup. Let θ ∈ L∞(T) be a strictly
positive function for which limγ→0 θ(γ) = 1,
chosen such that the function
1
η(γ) := θ(γ) − θ(2γ) |H0(γ)|2 + |H0(γ + )|2
2
is positive as well. Fix an integer n ≥ 2
and let {G`}n`=2 be 1-periodic trigonometric
polynomials for which
X n X n
2 1
|G`(γ)| = 1, and G`(γ)G`(γ + ) = 0.
2
`=2 `=2
Let ρ, σ be 1-periodic functions such that
|ρ(γ)|2 = θ(γ), |σ(γ)|2 = η(γ), (12)
and define the 1-periodic functions {H`}n`=1
by
1
H1(γ) = e2πiγ ρ(2γ)H0(γ + ), H`(γ) = G`(γ)σ(γ).
2
Then the functions {ψ`}n`=1 in the general
setup generate a tight frame {D j Tk ψ`}j,k∈Z,`=1,...,n.
136
If the condition on η is satisfied, Corollary 11.2
makes it easy to obtain frames with for example
three generators.
137
Corollary 11.3 Let ψ0 and H0 be as in the
general setup. Let θ ∈ L∞(T) be a strictly
positive function for which limγ→0 θ(γ) = 1,
chosen such that the function
1
η(γ) := θ(γ) − θ(2γ) |H0(γ)|2 + |H0(γ + )|2
2
is positive as well. Define the functions ρ, σ
by
|ρ(γ)|2 = θ(γ), |σ(γ)|2 = η(γ),
and let
2πiγ 1
H1(γ) = e ρ(2γ)H0(γ + ),
2
H2(γ) = H0(γ)σ(2γ).
Then the functions {ψ`}2`=1 generate a tight
frame {Dj Tk ψ`}j,k∈Z,`=1,2 for L2(R).
138
The assumption that θ and η are positive im-
plies that we can choose ρ, σ in (12) to be trigono-
metric polynomials.
139
The conditions for reduction of the num-
ber of generators are satisfied for B-
splines:
141
Example 11.5 Consider the B-spline B2m and
M = 2. Note that
4m
X ∞
1 + (2j − 1)! j
y
j=1
(2j)! (2j + 1)
4m
1 1
= 1 + y + y2 + · · ·
6 20
2m
= 1+ y + O(|y|2).
3
This proves that for M = 2, the condition is
satisfied with c1 = 2m/3. Thus, the desired
trigonometric polynomial is
2m 2
θ(γ) = 1 + sin (πγ)
3
2m 1 − cos 2πγ
= 1+
3 2
3+m m
= − cos 2πγ.
3 3
142
Conclusion:
• We can construct multiwavelet frames with
two generators based on any B-spline B2m.
• If we choose ρ, σ in (12) to be trigonometric
polynomials, then H1, H2 in Theorem 11.3
are trigonometric polynomials, and the as-
sociated frame generators ψ1, ψ2 are finite
linear combinations of functions
B2m(2x − k), k ∈ Z.
143
Frame constructions via the UEP and the OEP:
Example 11.6 Let ψ0 = N2. Then
c2(2γ) = H0(γ)N
N c2(γ),
where
(1 + e−2πiγ )2
H0(γ) = = e−2πiγ cos2(πγ).
4
We first revisit Example 10.6 and then give con-
structions via the oblique extension principle
and its corollaries.
(i) Defining H1 and H2 by
−2πiγ
√
H1(γ) = ie 2 sin(πγ) cos(πγ)
√
2
= (1 − e−4πiγ ),
4
−2πiγ 2 (1 − e−2πiγ )2
H2(γ) = −e sin (πγ) = ,
4
it follows from Example 10.6 that the associated
(i)
functions ψ1 := ψ1 and ψ2 generate a tight
144
frame for L2(R). They are given by
(i) 1
ψ1 (x) = √ (N2(2x) − N2(2x − 2)),
2
1
ψ2(x) = (N2(2x) − 2N2(2x − 1) + N2(2x − 2)) .
2
See Figures 9-10.
(ii) An alternative construction can be ob-
tained via the oblique extension principle. Let
4 − cos(2πγ)
θ(γ) := .
3
In this example we keep the choice of H2 in (i).
Thus, if we want to use the oblique extension
principle, we have to choose H1 such that
|H1(γ)|2 = θ(γ) − |H0(γ)|2θ(2γ) − |H2(γ)|2,
and
1
H1(γ)H1(γ + )
2
1 1
= −H0(γ)H0(γ + )θ(2γ) − H2(γ)H2(γ + ).
2 2
145
One can take
(ii) 1
ψ1 (γ) = √ (N2(2γ − 4) + 2N2(2γ − 3))
2 6
6
− N2(2γ − 2)
2
1
+ √ (2N2(2γ − 1) + N2(2γ)) ,
2 6
(ii)
which has support on [0, 3]. The function ψ1
is shown in Figure 11.
* + , + - .
* +
(i)
Figure 12: The function ψ1 .
146
0
/ 0 1 0 2 3
/ 0
4 5 6 5 7 8
4 5
(ii)
Figure 14: The function ψ1 .
147
12 Approximation orders
148
We say that ψ0 provides approximation order
s if for all f in the Sobolev space H s(R),
dist(f, Vj ) = O(2−js),
i.e., if there exists a constant C > 0 such that
dist(f, Vj ) ≤ C2−js, ∀j ∈ Z.
For the tight frame {D j Tk ψ`}j,k∈Z,`=1,...,n, we
know that for all f ∈ L2(R),
n XX
X
f= hf, D j Tk ψ`iDj Tk ψ`.
`=1 j∈Z k∈Z
149
We know that ψ1, . . . , ψn ∈ V1, so QJ f ∈ VJ
for all J ∈ Z; thus, the approximation order
of the frame {D j Tk ψ`}j,k∈Z,`=1,...,n can not ex-
ceed the approximation order of the underlying
refinable function ψ0.
150
13 Construction of pairs of dual wavelet frames
c c
f C
|ψ0(γ)|, |ψ0(γ)| ≤ ρ , a.e.
|γ|
Assume that there exists a function θ ∈ L∞(T)
such that limγ→0 θ(γ) = 1 and
n
X
H0(γ)K0(γ + ν)θ(2γ) + H`(γ)K`(γ + ν)
`=1
θ(γ) if ν = 0,
=
0 if ν = 21 .
Then {Dj Tk ψ`}j,k∈Z,`=1,...,n and {Dj Tk ψe`}j,k∈Z,`=1,...,n
are a pair of dual multiwavelet frames.
151
Easier to find a pair of dual frames via
Theorem 13.1 than to construct tight
frames via the OEP:
• The function θ is not required to be positive.
• We have freedom to chose two sets of trigono-
metric polynomials H` and K`: in fact, the
condition in the OEP corresponds exactly
to the condition in Theorem 13.1 with H` =
K`, and is more complicated to satisfy.
152
Setup for construction of pairs of dual
wavelet frames:
153
In the construction of tight multiwavelet frames:
we had to perform a spectral factorization of the
functions θ and η.
154
Corollary 13.2 Assume the setup on page
153 and define {H`}3`=1 and {K`}3`=1 by
2πiγ 1
H1(γ) = e θ1(γ)K0(γ + ),
2
H2(γ) = η1(γ),
H3(γ) = e2πiγ η1(γ),
1
K1(γ) = e2πiγ θ2(γ)H0(γ + ),
2
K2(γ) = η2(γ),
K3(γ) = e2πiγ η2(γ).
Define the associated functions {ψ`}3`=1 and
{ψe`}3`=1 as in the general setup on page 113.
Then {Dj Tk ψ`}j,k∈Z,`=1,2,3 and {Dj Tk ψe`}j,k∈Z,`=1,2,3
constitute a pair of dual multiwavelet frames.
155
The number of generators can be reduced to
two:
Corollary 13.3 Assume the setup on page
153 and let
2πiγ 1
H1(γ) = e θ1(γ)K0(γ + ),
2
H2(γ) = η1(2γ)H0(γ),
1
K1(γ) = e2πiγ θ2(γ)H0(γ + ),
2
K2(γ) = η2(2γ)K0(γ).
Then {Dj Tk ψ`}j,k∈Z,`=1,2 and {Dj Tk ψe`}j,k∈Z,`=1,2
constitute a pair of dual multiwavelet frames.
If θ, H0 and K0 are trigonometric polynomi-
als and η1, η2 and θ1, θ2 are real-valued trigono-
metric polynomials, then the frame generators
{ψ`}3`=1 and {ψe`}3`=1 are symmetric if the re-
finable functions ψ0 and ψ f0 are symmetric real-
valued functions. Thus, the above process will
lead to symmetric dual wavelet pairs when ap-
plied to even-order B-splines.
156
Example 13.4 Frame construction with two
f0 = N2; the associ-
generators, based on ψ0 = ψ
ated two-scale symbol is
(1 + e−2πiγ )2
H0(γ) = = e−2πiγ cos2(πγ).
4
We again take
4 − cos(2πγ)
θ(γ) = ;
3
as proved in Example 11.6 this leads to
η(γ)
2
= (8 cos4(πγ) + 1)(cos(πγ) − 1)2(cos(πγ) + 1)2.
3
If we want to apply Corollary 13.3, we need to
find functions η1, η2, θ1, θ2 such that
η(γ) = 2η1(γ)η2(γ), and η1(0) = η2(0) = 0,
θ(2γ) = θ1(γ)θ2(γ)
Easy!
157
For example, we can take
η1(γ)
1
= (8 cos4(πγ) + 1)(cos(πγ) − 1)(cos(πγ) + 1)2,
3
η2(γ) = (cos(πγ) − 1),
4 − cos(4πγ)
θ1(γ) = 1, θ2(γ) = θ(2γ) = .
3
158
The functions in Corollary 13.3 are now
1
H1(γ) = e2πiγ θ1(γ)K0(γ + )
2
2πiγ 2
(1 − e )
= e2πiγ ,
4
2πiγ 1
K1(γ) = e θ2(γ)H0(γ + )
2
4πiγ −4πiγ
2πiγ 4 e +e (1 − e2πiγ )2
= e − ,
3 6 4
H2(γ) = η1(2γ)H0(γ) !
2πiγ 4
1 e + e−2πiγ
= 8 +1
3 2
2πiγ −2πiγ
e +e
× −1
2
2πiγ 2
e + e−2πiγ (1 + e−2πiγ )2
× +1 ,
2 4
K2(γ) = η2(2γ)K0(γ)
2πiγ −2πiγ
e +e (1 + e−2πiγ )2
= −1 .
2 4
159
With these choices, {D j Tk ψ`}j,k∈Z,`=1,2 and
{Dj Tk ψe`}j,k∈Z,`=1,2 constitute a pair of dual mul-
tiwavelet frames.
160
14 The signal processing perspective
161
Consider the 1-periodic functions H`, ` = 0, . . . , n,
in the general setup. Write H` in terms of
Fourier series, with Fourier coefficients hk,`:
X
H`(γ) = hk,`e2πikγ .
k∈Z
In terms of the Z-transform, this means that
X
−2πiγ −k f`(e−2πiγ ).
H`(γ) = hk,` e =H
k∈Z
Reformulation of the UEP:
Theorem 14.1 Assume that the functions H`, ` =
0, . . . , n, have real Fourier coefficients hk,`, k ∈
Z. Then the UEP-conditions hold if and only
if the equations
n
X
f`(z)H
H f`(z −1) = 1,
`=0
n
X
f`(z)H
H f`(−z −1) = 0
`=0
hold for a.e. z ∈ C for which |z| = 1.
162
The polyphase decomposition
163
Thus, the Z-transformation has the polyphase
decomposition
f0(z 2) + z −1H
H̃(z) = H f1(z 2).
164
The UEP in terms of the polyphase matrix:
Theorem 14.2 Assume that the functions H`,
` = 0, . . . , n, have real Fourier coefficients
hk,`, k ∈ Z. Then the UEP condition is sat-
isfied if and only if
1
HpT (z −1)Hp(z) = I (13)
2
for almost all z ∈ C with |z| = 1.
165
An analysis filter bank is a “black box”, which
performs operations on an incoming signal (i.e.,
a sequence of numbers).
166
The filter banks considered here will contain
three operations on the incoming sequence {xk }k∈Z:
• Convolution with a sequence {hk }k∈Z:
The outcome is a new sequence,
P whose k-th
coordinate is given by n∈Z hnxk−n.
• Downsampling: The outcome is the se-
quence
↓ {xk }k∈Z := (· · · x−2, x0, x2, · · · }.
Thus, downsampling removes each second
element in the sequence.
• Upsampling: The outcome is the sequence
↑ {xk }k∈Z := (· · · x−1, 0, x0, 0, x1, · · · }.
Thus, upsampling inserts zeroes between the
elements in the sequence.
167
Description of particular filter bank:
168
Figure 15:
171