Signal Processing
BNS SHAHEED MOAZZAM, LEC-2024
Instructor: Prof. Dr. Ashoke Kumar Sen Gupta, EEE, CUET
Historical background
“To understand a science it is necessary to
know its history”
—Auguste Comte (1798–1857)
The telegraph was perfected by Samuel Morse, a painter. With the words “What hath
God wrought,” transmitted by Morse’s electric telegraph between Washington, D.C., and
Baltimore, Maryland, in 1844, a completely revolutionary means of real-time, long-distance
communications was triggered.
In 1875, the telephone was invented by Alexander Graham Bell, a teacher of the deaf.
The telephone made real-time transmission of speech by electrical encoding and replication
of sound a practical reality.
2
On December 12, 1901, Guglielmo Marconi received a radio signal at Signal
Hill in Newfoundland; the radio signal had originated in Cornwall, England, 1700 miles
away across the Atlantic.
In 1904, John Ambrose Fleming invented the vacuum-tube diode, which paved the
way for the modern electronics.
The first all-electronic television system was demonstrated by Philo T. Farnsworth in
1928.
3
Optical communication
Satellite
communication
Computer networks
Digital communication
4
Why this course important?
5
Typical Signal Processing Systems
6
Typical Communication Systems
Figure: The elements of Signal, System, and Communication
7
Typical Control Systems Systems
8
What will we learn?
9
Underlying Questions are…….
What is a signal?
What is signal processing?
What is a system?
10
What is a signal?
A signal describes how some physical quantity varies over
time and/or space.
11
In mathematical sense, any physical quantity carrying
information that varies with one or more independent
variables. For instance:
12
Some examples of signals include:
Speech
A voltage or current in an electronic circuit
A position, velocity, or acceleration of an object (e.g.
RADAR pulse )
Electrocardiogram (ECG), EEG…
DNA sequence
A force or torque in a mechanical system
A flow rate of a liquid or gas in a chemical process
Image
Video
Stock price 13
Fig. Speech signal Fig. ECG signal
14
What is signal processing?
Manipulating a signal to change its characteristics
or extract information
Performed by-
Computer
Special purpose integrated circuits
Analog electrical circuits
15
Signal Processing Applications
16
Typical SP Problems-I
17
Typical SP Problems-II
18
Typical SP Problems-III
19
Signal Processing Philosophy
20
Modeling Issues
21
Language of Signal Processing
22
Summary
23
Notations and Basic Signal Properties
Recall that, in mathematical sense, any physical quantity
carrying information that varies with one or more
independent variables.
24
Five methods of classifying signals, based on different
features, are common:
Continuous-time and discrete-time signals
Even and odd signals
Periodic signals, non-periodic signals
Deterministic signals, random signals
Energy signals, power signals
25
Continuous-time (independent variable) and discrete-
time (independent variable) signals
Continuous: take any value
Discrete: limited set of values,
typically integers
Notations
• continuous independent variable
• discrete independent variable
26
Often we obtain a discrete-time signal by sampling
a continuous-time signal
27
Signals stored in a computer must be discrete!
Common to connect samples with straight lines
• Visual clarity with large number of samples
• Use continuous-time axis labels to visualize as
continuous-time signal
Important: Discrete-time signals are
not digital signals!!!
28
29
Periodic signals, non-periodic signals
A periodic signal x(t) is a function of time that satisfies the condition
x(t) = x(t + T) for all t
where T is a positive constant. For smallest value of T, the frequency is
called the “fundamental frequency”
30
In case of discrete-time signals, a discrete-time signal x[n] is said to be
periodic if :
x[n] = x[n + N] for integer n,
where N is a positive integer.
The smallest integer N for which Eq. is satisfied is called the fundamental
period of the discrete-time signal x[n].
31
► Determine the fundamental frequency of the discrete-time square wave shown in
Fig. 1.16.
32
Even and odd signals
A continuous-time signal x(t) is said to be an even signal if :
x(-t) = x(t) for all t
A continuous-time signal x(t) is said to be an odd signal if :
x(-t) = -x(t) for all t.
Even signals are symmetric about the vertical axis, or time origin.
Odd signals are antisymmetric about the time origin.
Similar remarks apply to discrete-time signals.
Examples(1.1,1.2) @ Simon Haykin
33
In the case of a complex-valued signal, we may speak of conjugate
symmetry. A complex-valued signal is said to be conjugate
symmetric if :
If, , then its conjugate,
34
Example
What is the fundamental frequency of this wave? Express
the fundamental frequency in units of Hz and rad/s.
35
36
Deterministic signals, random signals
37
38
39
40
41
42
43
Basic Signal Operations
44
45
46
Elementary Signals of interests
Exponentials-represents decay or growth
Continuous-time Exponentials
Discrete-time Exponentials
Exponentially-damped sinusoids
Steps- represents sudden changes, as switch
Impulses- represents perturbation, “kick the tires”
47
Fig: Continuous-time Exponentials
48
Fig: Discrete-time Exponentials
49
Fig: Exponentially-damped Sinusoids
50
Examples:
Pluck guitar string
Envelope of decay
Exponentially damped sinusoid approximation
51
52
53
Continuous-time Elementary Signals
Unit Impulse Signal (Dirac Delta Function),
The unit impulse signal, has the value zero everywhere except
at , where its value is infinitely large in such a way that its total
integral is 1.
54
We may consider as the building block of any continuous-time
signal, described by the shifting property:
This is very important equation in deriving convolution concept for LTI system!!! 55
Unit Step Signal,
The unit step function has the form of:
As there is a sudden change from 0 to 1 at is not well defined.
56
can be expressed in terms of as:
Conversely, we can use to represent :
57
Sinusoid
58
59
For the complex-valued case, can be written as:
Using the Euler’s identity we can write:
A complex-sinusoid is also periodic with radian frequency .
60
From the Euler’s formula, we can write:
61
Basic Discrete-time Signals
Unit Impulse (or sample)
Unit Step
Sinusoid
62
63
serves as the building block of any discrete-time signal :
can be expressed in terms of as:
can be expressed in terms of as:
64
Let’s explore more:
bounded/unbounded signal?
power/energy signal?
bounded/unbounded signal?
power/energy signal?
Let us construct some signal .
65
What is a system?
Fig.
66
System
(H or T)
A System is an operator H (or T)
which maps input into output.
67
68
Fig.
Fig.
69
70
Fig. Hardware system of resistor-capacitor circuit
Fig. Pop-art production using an algorithm 71
System properties
Linearity, Time Invariance and Causality are
properties that systems may possess and
systems which possess these properties are
particularly powerful for processing signals.
So it is important to look at these properties of
systems.
72
A system is linear if the principle of superposition applies
73
Examples: Check the linearity
74
75
76
Time-invariance (Characteristics do not change over time)
A system is time-invariant if a time-shift of input causes a
corresponding shift in output.
77
More explanations
78
79
Example: Check the TI
80
Causality (Present output does not depends on future input)
81
82
Stability
83
Introduction to LTI System
Actually what does a system do?
1. Model a physical phenomenon
2. Implement desired characteristic
84
)
Fig: In order to retrieve the
Fig: A physical phenomenon
original signal then we have
maps into a system model
to process signals
Let us design a system with the following function,
Four LTI System Descriptions
Computation Intuition
Difference
Equation ***** *
Impulse
Response *** ***
Frequency
Response * *****
System Function
(poles/zeros) * ****
87
Difference Equation description for LTI system
This is an important class of LTI systems. It can be used to:
Model physical system
Design filters
Implement (compute) filters
𝑵 𝑴
𝒌 𝒌
𝒌 𝟎 𝒌 𝟎
88
Suppose,
Impulse response input, and
It can be solved as:
…………………………
89
Impulse Response description for LTI system
Why it is important?
The Impulse Response completely describes an important class of
systems- the output depends only on the input and impulse
response.
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104