Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Scribd
Upload
432 views

803 (A) Image Processing and Computer Vision#: Subject In-Charge: Prof Shilpa Sharma

CS-8Sem_RGPV_OE_Computer vision and Image processing

Uploaded by

Shilpa Sharma
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
432 views

803 (A) Image Processing and Computer Vision#: Subject In-Charge: Prof Shilpa Sharma

CS-8Sem_RGPV_OE_Computer vision and Image processing

Uploaded by

Shilpa Sharma
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 44

CS-803

803(A) Image Processing and Computer Vision#

Subject In-charge :
Prof Shilpa Sharma
Asst. Prof. CSE / IT Department
MITM, Ujjain (M.P.)
 Understand practice and theory of computer vision.

 Elaborate computer vision algorithms, methods and


concepts

 Implement computer vision systems with emphasis


on applications and problem solving
 Apply skills for automatic analysis of digital images
to construct representations of physical objects and
scenes.

 Design and implement real-life problems using


Image processing and computer vision.
 Reference Text
 1. Robert Haralick and Linda Shapiro, "Computer
and Robot Vision", Vol I, II, Addison-
Wesley, 1993
 2. David A. Forsyth, Jean Ponce, "Computer Vision:
A Modern Approach" Pearson
 3. Milan Sonka,VaclavHlavac, Roger Boyle, "Image
Processing, Analysis, and Machine Vision" Thomson
Learning.
 Introduction to computer vision and Image
processing (CVIP): Basics of CVIP, History of CVIP,
 Evolution of CVIP, CV Models, Image Filtering,
Image Representations, Image StatisticsRecognition
Methodology: Conditioning, Labeling, Grouping,
Extracting, and Matching,
 Morphological Image Processing: Introduction,
Dilation, Erosion, Opening, Closing,
 Hit-or-Miss transformation, Morphological algorithm
operations on binary images,

 Morphological algorithm operations on gray-scale


images, Thinning, Thickening,

 Region growing, region shrinking.


 Computer vision is concerned with modeling and
replicating human vision using computer software
and hardware.

 Formally if we define computer vision then its


definition would be that computer vision is a
discipline that studies how to reconstruct, interrupt
and understand a 3d scene from its 2d images in
terms of the properties of the structure present in
scene.
Computer Vision
Make computers understand images and video.

What kind of
scene?

Where are the cars?

How far is the


building?
Vision is really hard

• Vision is an amazing feat of natural intelligence


– Visual cortex occupies about 50% of Macaque brain
– More human brain devoted to vision than anything
else

Is that a
queen or a
bishop?
Why computer vision matters

Safety Health Security

Comfort Fun Access


brief history of computer vision
• 1966: Minsky assigns computer
vision as an undergrad summer
project
Guzman ‘68

• 1960’s: interpretation of synthetic


worlds

• 1970’s: some progress on


Ohta Kanade ‘78
interpreting selected images

Turk and Pentland ‘91


• 1980’s: ANNs come and go; shift toward
geometry and increased mathematical rigor

• 1990’s: face recognition; statistical analysis in


vogue

• 2000’s: broader recognition; large annotated


datasets available; video processing starts
 It needs knowledge from the following fields in order to
understand and stimulate the operation of human vision
system.
 Computer Science
 Electrical Engineering
 Mathematics
 Physiology
 Biology
 Cognitive Science
 Computer vision is divided into three basic categories
that are as following:
 Low-level vision: includes process image for feature
extraction.

 Intermediate-level vision: includes object recognition


and 3D scene Interpretation

 High-level vision: includes conceptual description of


a scene like activity, intention and behavior.
 Computer Vision overlaps significantly with the
following fields:

 Image Processing: it focuses on image manipulation.

 Pattern Recognition: it studies various techniques to


classify patterns.

 Photogrammetry: it is concerned with obtaining


accurate measurements from images.
 Image processing studies image to image
transformation. The input and output of image
processing are both images.

 Computer vision is the construction of explicit,


meaningful descriptions of physical objects from
their image. The output of computer vision is a
description or an interpretation of structures in 3D
scene.
Computer Vision and Nearby
Fields
• Computer Graphics: Models to Images
• Comp. Photography: Images to Images
• Computer Vision: Images to Models
 1) Robotics

 2) Medicine

 3) Security

 4) Transportation

 5) Industrial Automation
 Localization-determine robot location automatically

 Navigation

 Obstacles avoidance

 Assembly (peg-in-hole, welding, painting)


 Manipulation (e.g. PUMA robot manipulator)

 Human Robot Interaction (HRI): Intelligent robotics


to interact with and serve people
 Classification and detection (e.g. lesion or cells
classification and tumor detection)

 2D/3D segmentation

 3D human organ reconstruction (MRI or ultrasound)

 Vision-guided robotics surgery


 Biometrics (iris, finger print, face recognition)

 Surveillance-detecting certain suspicious activities or


behaviors
 Autonomous vehicle

 Safety, e.g., driver vigilance monitoring


 Industrial inspection (defect detection)

 Assembly

 Barcode and package label reading

 Object sorting

 Document understanding (e.g. OCR)


How vision is used now
• Examples of state-of-the-art
Optical character recognition (OCR)
Technology to convert scanned docs to text
• If you have a scanner, it probably came with OCR software

Digit recognition, AT&T labs License plate readers


http://www.research.att.com/~yann/ http://en.wikipedia.org/wiki/Automatic_number_plate_recognition
Face detection

• Many new digital cameras now detect


faces
– Canon, Sony, Fuji, …
Smile detection

Sony Cyber-shot® T70 Digital Still Camera


3D from thousands of images
Object recognition (in
supermarkets)

LaneHawk by EvolutionRobotics
“A smart camera is flush-mounted in the checkout lane, continuously
watching for items. When an item is detected and recognized, the
cashier verifies the quantity of items that were found under the basket,
and continues to close the transaction. The item can remain under the
basket, and with LaneHawk,you are assured to get paid for it… “
Vision-based biometrics

“How the Afghan Girl was Identified by Her Iris Patterns” Read the story
wikipedia
Login without a password…

Face recognition systems now


Fingerprint scanners on
beginning to appear more widely
many new laptops, http://www.sensiblevision.com/
other devices
Object recognition (in mobile
phones)

Point & Find, Nokia


Google Goggles
Special effects: shape capture

The Matrix movies, ESC Entertainment, XYZRGB, NRC


Special effects: motion capture

Pirates of the Carribean, Industrial Light and Magic


Sports

Sportvision first down line


Nice explanation on www.howstuffworks.com

http://www.sportvision.com/video.html
Smart cars Slide content courtesy of Amnon Shashua

• Mobileye
– Vision systems currently in high-end BMW,
GM, Volvo models
– By 2010: 70% of car manufacturers.
Google cars

http://www.nytimes.com/2010/10/10/science/10google.html?ref=artificialintelligence
Interactive Games: Kinect
• Object Recognition:
http://www.youtube.com/watch?feature=iv&v=fQ59dXOo
63o
• Mario: http://www.youtube.com/watch?v=8CTJL5lUjHg
• 3D: http://www.youtube.com/watch?v=7QrnwoO1-8A
• Robot:
http://www.youtube.com/watch?v=w8BmgtMKFbY
Vision in space

NASA'S Mars Exploration Rover Spirit captured this westward view from atop
a low plateau where Spirit spent the closing months of 2007.

Vision systems (JPL) used for several tasks


• Panorama stitching
• 3D terrain modeling
• Obstacle detection, position tracking
• For more, read “Computer Vision on Mars” by Matthies et al.
Industrial robots

Vision-guided robots position nut runners on wheels


Mobile robots

NASA’s Mars Spirit Rover


http://en.wikipedia.org/wiki/Spirit_rover http://www.robocup.org/

Saxena et al. 2008


STAIR at Stanford
Medical imaging

Image guided surgery


3D imaging
Grimson et al., MIT
MRI, CT

You might also like