Discrete Orthogonal Transforms and Its Applications: Dr. J. Sheeba Rani
Discrete Orthogonal Transforms and Its Applications: Dr. J. Sheeba Rani
Discrete Orthogonal Transforms and Its Applications: Dr. J. Sheeba Rani
applications
Presented by
Dr. J. Sheeba Rani
Asst Professor/Avionics
fi gi
f ( x) g ( x)dx 0
a
Indian Institute of Space Science and Technology
Linear Transform posses…
• A linear transformation R from Rn to Rn is orthogonal if and only if the
vectors form an orthonormal basis of Rn
• An nxn matrix A is orthogonal if and only if its columns form an
orthonormal bases of Rn
• A linear transformation T from Rn to Rn is called orthogonal if it
preserves the lengths of vectors.
•
||T(x)|| = ||x||
•
• If T(x) is an orthogonal transformation then we say that A is an
orthonormal matrix.
Example
Let x be a one dimensional vector of length2 x1. A is the orthogonal matrix.
I T(x) is the transformed output.
The transformed output be of length 2 x1.
T(x)=Ax; is orthogonal if AAT=I
Type I DFT
Sub-Optimal
SINUSOIDAL
Discrete
(DCT)
Orthogonal
Transform Type II
Optimal (KLT)
NON
SINUSOIDAL
Dat =
1.0e+004 *
vec =
-0.0000 0 0 0 0 0
-0.0348 0.6520 0.6324 0.3361 0.0233 0.2455 0 -0.0000 0 0 0 0
0.0778 -0.0759 0.2047 -0.1809 0.9429 -0.1566 0 0 0.0000 0 0 0
0.1842 -0.5932 0.5293 0.4373 -0.1514 -0.3461 0 0 0 0.1062 0 0
0.0756 -0.4318 0.1321 -0.0541 0.0669 0.8849 0 0 0 0 0.5634 0
-0.8405 -0.1580 0.3437 -0.3678 -0.1005 -0.0715 0 0 0 0 0 1.4548
-0.4967 -0.0758 -0.3774 0.7245 0.2700 0.0856
Tcentre =
Tcoef=Vect'*Tcentre'
Tcoef =
69.0110
-46.8159
-127.5451
a(u,n) and b(u,n) are the Orthogonal Basis function. For a Discrete Fourier Transform
The Orthogonal Basis function is defined as
04/27/2020
Indian Institute of Space Science and Technology
Indian Institute of Space Science and Technology
Indian Institute of Space Science and Technology
Discrete Cosine Transform
04/27/2020
Indian Institute of Space Science and Technology
The DCT is a widely used frequency transform because it
Discrete Cosine
Stationary Signal
Signals with frequency content unchanged
in time
All frequency components exist at all times
Non-stationary Signal
Frequency changes in time
One example: the “Chirp Signal”
04/27/2020
Indian Institute of Space Science and Technology
STATIONARITY OF SIGNAL
2 Hz + 10 Hz + 20Hz 3 600
2 500
Magnitud
Magnitud
1 400
Stationary 0 300
e
-1 200
-2 100
-3 0
0 0.2 0.4 0.6 0.8 1 0 5 10 15 20 25
Time Frequency (Hz)
0.0-0.4: 2 Hz + 1 250
0.8
0.4-0.7: 10 Hz + 0.6 200
Magnitud
Magnitud
0.7-1.0: 20Hz 0.4
0.2 150
Non- 0
e
e
Stationary -0.2
-0.4
100
-0.6 50
-0.8
-1 0
0 0.5 1 0 5 10 15 20 25
Time Frequency (Hz)
04/27/2020
Indian Institute of Space Science and Technology
CHIRP SIGNALS
Frequency: 2 Hz to 20 Hz Different in Time Domain Frequency: 20 Hz to 2 Hz
1 150 1 150
0.8 0.8
0.6 0.6
0.4 0.4
Magnitud
Magnitud
100 100
Magnitud
Magnitud
0.2 0.2
0 0
e
e
e
e
-0.2 -0.2
50 50
-0.4 -0.4
-0.6 -0.6
-0.8 -0.8
-1 0 -1 0
0 0.5 1 0 5 10 15 20 25 0 0.5 1 0 5 10 15 20 25
Time Frequency (Hz) Time Frequency (Hz)
Atwhat
At whattime
timethe
thefrequency
frequencycomponents
componentsoccur?
occur? FT
FTcan
cannot
nottell!
tell!
04/27/2020
Indian Institute of Space Science and Technology
Limitation of FT for Non Stationary
Signals
• FT Only Gives what Frequency Components Exist in the
Signal
• The Time and Frequency Information can not be Seen at
the Same Time
• Time-frequency Representation of the Signal is Needed
04/27/2020
Indian Institute of Space Science and Technology
SFORT TIME FOURIER TRANSFORM
(STFT)
• Dennis Gabor (1946) Used STFT
– To analyze only a small section of the signal at a time -- a
technique called Windowing the Signal.
• The Segment of Signal is Assumed Stationary
• A 3D transform
STFTX t , f x t * t t e j 2 ft dt
t
t : the window function
A function of time
and frequency
04/27/2020
Indian Institute of Space Science and Technology
Limitation of STFT
• Unchanged Window
• Dilemma of Resolution
– Narrow window -> poor frequency resolution
– Wide window -> poor time resolution
• Heisenberg Uncertainty Principle
– Cannot know what frequency exists at what time intervals
04/27/2020
Indian Institute of Space Science and Technology
MULTIRESOLUTION ANALYSIS (MRA)
• Wavelet Transform
– An alternative approach to the short time Fourier transform to
overcome the resolution problem
– Similar to STFT: signal is multiplied with a function
• Multiresolution Analysis
– Analyze the signal at different frequencies with different
resolutions
– Good time resolution and poor frequency resolution at high
frequencies
– Good frequency resolution and poor time resolution at low
frequencies
– More suitable for short duration of higher frequency; and longer
duration of lower frequency components
04/27/2020
Indian Institute of Space Science and Technology
What are Wavelets? (cont’d)
Like sines and cosines in FT, wavelets are used as basis functions ψk(t) in representing
other functions f(t):
Span of ψk(t): vector space S containing all functions f(t) that can be represented by
ψk(t).
f (t ) ak k (t )
k
jk (t )
(dyadic/octave grid)
Indian Institute of Space Science and Technology 04/27/2020
What are Wavelets? (cont’d)
jk (t ) 2 j/2
2 t k
j
j
scale/frequency
localization
time localization
Indian Institute of Space Science and Technology 04/27/2020
Continuous Wavelet Transform
(CWT)
Translation parameter, Scale parameter Normalization
measure of time (measure of frequency) constant
1 * t
CWTx , s x , s x t dt
Forward
s s
CWT:
Translation
(The location of Scale
the window)
Mother Wavelet
04/27/2020
Indian Institute of Space Science and Technology
CWT: Main Steps
1. Take a wavelet and compare it to a section at the start of
the original signal.
04/27/2020
Indian Institute of Space Science and Technology
CWT: Main Steps (cont’d)
3. Shift the wavelet to the right and repeat steps 1 and 2 until
you've covered the whole signal.
04/27/2020
Indian Institute of Space Science and Technology
CWT: Main Steps (cont’d)
04/27/2020
Indian Institute of Space Science and Technology
Coefficients of CTW Transform
• Wavelet analysis produces a time-scale view of the input signal or image.
1 t
C ( , s ) f t
dt
s t s
04/27/2020
Indian Institute of Space Science and Technology
RESOLUTION OF TIME & FREQUENCY
Better time
resolution;
Poor
frequency
resolution
Frequenc
y
Better
frequency
resolution;
Poor time Time
resolution • Each box represents a equal portion
• Resolution in STFT is selected once for entire
analysis
04/27/2020
Indian Institute of Space Science and Technology
Comparison with other Transformations
04/27/2020
Indian Institute of Space Science and Technology
FT vs WT
weighted by F(u)
weighted by C(τ,s)
04/27/2020
Indian Institute of Space Science and Technology
Discrete Wavelet Transform (DWT)
• Provides sufficient information both for analysis and synthesis
• Reduce the computation time sufficiently
• Easier to implement
• Analyze the signal at different frequency bands with different
resolutions
• Decompose the signal into a coarse approximation and detail
information
where jk (t ) 2 j / 2 2 j t k
04/27/2020
Indian Institute of Space Science and Technology
DFT vs DWT
FT expansion: one parameter basis
or f (t ) a l l (t )
WT expansion l
f (t ) a jk jk (t )
k j
f (t )
fine
details
narrower, small translations
f (t ) a jk jk (t )
k j j
coarse
Indian Institute of Space Science and Technology details
04/27/2020
Multiresolution
Representation using jk (t )
f (t )
fine
details
f (t ) a jk (t )
jk j
k j
coarse
Indian Institute of Space Science and Technology details
04/27/2020
Multiresolution
Representation using jk (t )
f (t )
fine
details
wider, large translations
f (t ) a jk jk (t ) j
k j
coarse
Indian Institute of Space Science and Technology details
04/27/2020
Multiresolution
Representation using jk (t )
high resolution
f (t )
(more details)
fˆ1 (t )
j
fˆ2 (t )
…
low resolution
fˆs (t ) (less details)
f (t ) a jk jk (t )
k j
k k j
Note: in Fourier analysis, there are only two possible values of k ( i.e., 0 and
π/2); the values j correspond to different scales (i.e., frequencies).
04/27/2020
Indian Institute of Space Science and Technology
1D Haar Wavelets
φ(t) ψ(t)
04/27/2020
Indian Institute of Space Science and Technology
Wavelet Transforms in Two Dimension
04/27/2020
Indian Institute of Space Science and Technology
Wavelet Transforms in Two Dimension
W ( j , m, n) WH ( j , m, n)
W ( j 1, m, n)
WV ( j , m, n) WD ( j , m, n)
two-dimensional decomposition
W ( j, m, n) WH ( j , m, n )
W ( j 1, m, n)
WV ( j , m, n) WD ( j , m, n)
04/27/2020
Indian Institute of Space Science and Technology
Wavelet Transform using Haar Wavelet
04/27/2020
Indian Institute of Space Science and Technology
Application- Image Compression
Wavelet Entropy
image Quantization bitstream
coding coding
W j (m, n)
• Quantization q j (m, n) sign( y j ( m, n))
j
– uniform scalar quantization
– separate quantization step-sizes for each subband
• Entropy coding
– Huffman coding
– Arithmetic coding
04/27/2020
Indian Institute of Space Science and Technology
Simulation Result
DCT-based Wavelet-based
Original image image compression image compression
CR = 11.2460 CR = 10.3565
RMS = 4.1316 RMS = 4.0104
04/27/2020
Indian Institute of Space Science and Technology
7 Simulation Result
DCT-based Wavelet-based
Original image image compression image compression
CR = 27.7401 CR = 26.4098
RMS = 6.9763 RMS = 6.8480
04/27/2020
Indian Institute of Space Science and Technology
7 Simulation Result
DCT-based Wavelet-based
Original image image compression image compression
CR = 53.4333 CR = 51.3806
RMS = 10.9662 RMS = 9.6947
04/27/2020
Indian Institute of Space Science and Technology
Research Scope
LocalpolynomialFouriertransform:Areviewonre
cent developmentsandapplications Xiumei Li a,
GuoanBi b, , SrdjanStankovic c,
AbdelhakM.Zoubir d Signal processing