0% found this document useful (0 votes)

17 views

Lecture-1 - Digital Image Processing

Uploaded by

Lohit

Available Formats

Download as PDF, TXT or read online on Scribd

0% found this document useful (0 votes)

17 views

Lecture-1 - Digital Image Processing

Uploaded by

Lohit

Available Formats

Download as PDF, TXT or read online on Scribd

You are on page 1/ 53

Digital Image Processing

(Code: 455)

Instructor: Dr. M.K Singh

National Institute of Technology Delhi
References (Books)
• Rafael C. Gonzales, Richard E. Woods, “Digital Image
Processing”, Third Edition, Pearson Education, 2010.
• Anil Jain K. “Fundamentals of Digital Image Processing”,
PHI Learning Pvt. Ltd., 2011.
• Willliam K Pratt, “Digital Image Processing”, John Willey,
2002.
• Al Bovik, “the essential guide to image processing”
OBJECTIVES:
What is a Digital Image?
• Two-dimensional light intensity function of visual information,
f x y ( x, y), where x and y are spatial (plane) coordinates, and the
amplitude of f at any pair of coordinates (x, y), x, y is called the
intensity or gray level of the image at that point.
• A digital image: When x, y, and the intensity values of f are all finite,
discrete quantities.
What is a Digital Image?
• Digital Image
— a two-dimensional function
x and y are spatial coordinates
The amplitude of f is called intensity or gray level at the point (x, y)

Digital Image Processing

— process digital images by means of computer, it covers low-, mid-, and high-level
processes
low-level: inputs and outputs are images
mid-level: outputs are attributes extracted from input images
high-level: an ensemble of recognition of individual objects

Pixel
— the elements of a digital image
What is a Digital Image?
• Pixel values typically represent gray levels, colours, heights, opacities
etc.
• Remember digitization implies that a digital image is an
approximation of a real scene.

1 pixel
What is a Digital Image?
Common image formats include:
• 1 sample per point (B&W or Grayscale)
• 3 samples per point (Red, Green, and Blue)
• 4 samples per point (Red, Green, Blue, and “Alpha”, a.k.a. Opacity)

• For most of this course we will focus on grey-scale images

What is a Digital Image?
• Panchromatic image: a 2D light intensity function, f(x, y), where x and
y are spatial coordinates and the value of f at (x, y) is proportional to
the brightness of the scene at that point.
• Multispectral image: f(x, y) is a vector, each component of which
indicates the brightness of the scene at point (x, y) at the
corresponding spectral band.
Gray Scale Image
• The range of monochromic (gray) shades, ranging from pure white on the
one-end to pure black on the opposite end.
• Grayscale only contains luminance (brightness) information and no color
information; that is why maximum luminance is white and zero luminance
is black; everything in between is a shade of gray.
• A digital image usually contains both color information and luminance or
grayscale.
• If you remove the color information, you are left with grayscale, resulting in
a black and white image.
• A `gray' color is one in which the red, green and blue components all have
equal intensity in RGB space, and so it is only necessary to specify a single
intensity value for each pixel
Importance of gray-scaling
• Dimension reduction: For example, In RGB images there are three
color channels and three dimensions while grayscale images are
single-dimensional.
• Reduces model complexity: Consider training neural articles on RGB
images of 10x10x3 pixels. The input layer will have 300 input nodes.
On the other hand, the same neural network will need only 100 input
nodes for grayscale images.
• For other algorithms to work: Many algorithms are customized to
work only on grayscale images e.g. Canny edge detection function
pre-implemented in the OpenCV library works on Grayscale images
only.
Why do we process images?

• Picture digitization and coding to facilitate transmission, printing and

storage of pictures;
• Picture enhancement and restoration in order, for example, to
interpret more easily pictures of the surface of other planets taken
by various probes;
• Picture segmentation and description as an early stage to Machine
Vision.
• Processing of image data for storage, transmission and representation
for autonomous machine perception
A Simple Image Formation Model
f ( x, y ) = i ( x, y ) r ( x, y )

f ( x, y ) : intensity at the point (x, y )

i ( x, y ) : illumination at the point (x, y )
(the amount of source illumination incident on the scene)
r ( x, y ) : reflectance/transmissivity at the point (x, y )
(the amount of illumination reflected/transmitted by the object)
where 0 < i ( x, y ) <  and 0 < r ( x, y ) < 1
Some Typical Ranges of Reflectance
• Reflectance

• 0.01 for black velvet

• 0.65 for stainless steel

• 0.80 for flat-white wall paint

• 0.90 for silver-plated metal

• 0.93 for snow

What is DIP? (cont…)

• The continuum from image processing to computer vision can be

broken up into low-, mid- and high-level processes

Low Level Process Mid Level Process High Level Process

Input: Image Input: Image Input: Attributes
Output: Image Output: Attributes Output: Understanding
Examples: Noise Examples: Object Examples: Scene
removal, image recognition, understanding,
sharpening segmentation autonomous navigation
The Origins of Digital Image Processing

• Early 1920s: One of the first applications of

digital images was in the newspaper industry,
when pictures were first sent by submarine
cable between London and New York.
History of DIP (cont…)

Mid to late 1920s: Improvements to the Bartlane system resulted in

higher quality images
• New reproduction
processes based
on photographic
techniques
• Increased number
of tones in
reproduced images
Improved
digital image Early 15 tone digital
image
History of DIP (cont…)

1960s: Improvements in computing technology and the onset of the

space race led to a surge of work in digital image processing
• 1964: Computers used to
improve the quality of
images of the moon taken
by the Ranger 7 probe
• Such techniques were used
in other space missions
including the Apollo landings

A picture of the moon taken

by the Ranger 7 probe
minutes before landing
History of DIP (cont…)

1970s: Digital image processing begins to be used in medical

applications
• 1979: Sir Godfrey N.
Hounsfield & Prof. Allan M.
Cormack share the Nobel
Prize in medicine for the
invention of tomography,
the technology behind
Computerised Axial
Tomography (CAT) scans
Typical head slice CAT
image
History of DIP (cont…)

1980s - Today: The use of digital image processing techniques has

exploded and they are now used for all kinds of tasks in all kinds of
areas
• Image enhancement/restoration
• Artistic effects
• Medical visualisation
• Industrial inspection
• Law enforcement
• Human computer interfaces
Applications – Imaging modalities
Applications: Image Enhancement

One of the most common uses of DIP techniques: improve quality,

remove noise etc
Applications: The Hubble Telescope

Launched in 1990 the Hubble

telescope can take images of
very distant objects
However, an incorrect mirror
made many of Hubble’s
images useless
Image processing
techniques were
used to fix this
Applications: Artistic Effects
Artistic effects are used
to make images more
visually appealing, to
add special effects and
to make composite
images
Applications: Medicine

X-ray imaging
Applications: Medicine (cont...)

• Gamma-ray imaging
• Nuclear Medicine: Inject
radio active isotope to
patient.
• Astronomical
Observation
Applications: Medicine (cont...)
•Radio frequencies
•Magnetic Resonance Imaging (MRI)
Applications: Medicine (cont...)
Ultrasound
Applications: Medicine (cont...)
3D tomography and rendering with transparencies (1)
Applications: Medicine (cont...)
3D tomography and rendering with transparencies (2)
Applications: Medicine (cont...)
3D tomography and rendering with transparencies (3)

Human brain Cancer cell Ice Block

(128 cross-sections) (256 cross-sections) (Human brain)
(128 cryo-sections)
Applications: Medicine (cont...)

Take slice from MRI scan of canine heart, and find boundaries between
types of tissue
• Image with gray levels representing tissue density
• Use a suitable filter to highlight edges

Original MRI Image of a Dog Heart Edge Detection Image

Applications: GIS

Geographic Information Systems

• Satellite imagery
• Terrain classification (LANDSAT)
• Meteorology (NOAA)
Applications: GIS (cont…)
Night-Time Lights of the
World data set
(infra red)
• Global inventory of human
settlement
• Not hard to imagine the
kind of analysis that might
be done using this data
Applications: Industrial Inspection
Human operators are
expensive, slow and
unreliable
Make machines do the
job instead
Industrial vision systems
are used in all kinds of
industries
Can we trust them?
Applications: PCB Inspection

Printed Circuit Board (PCB) inspection

• Machine inspection is used to determine that all components are present and
that all solder joints are acceptable
• Both conventional imaging and x-ray imaging are used
Applications: Law Enforcement
Image processing techniques
are used extensively by law
enforcers
• Number plate recognition for
speed cameras/automated
toll systems
• Fingerprint recognition
• Enhancement of CCTV images
Applications: HCI
Try to make human computer
interfaces more natural
• Face recognition
• Gesture recognition
Does anyone remember the
user interface from “Minority
Report”?
These tasks can be extremely
difficult
Key Stages in Digital Image Processing

Image Morphological
Restoration Processing

Image
Segmentation
Enhancement