Introduction to
Digital Image Processing
Textbook
Required:
Digital Image Processing, Rafael C.
Gonzalez and Richard E. Woods, 4th
Edition, Pearson
We will cover many topics in this text
book
We will also include special topics on
recent progresses on image
processing
Major Topics Covered in Class
Image acquisition and digital image representation
Image enhancement
Image restoration
Color image processing
Image compression
Image segmentation
Morphological image processing
Special topics on recent progresses on digital image
processing
Human Perception VS Machine Vision
• Limited vs entire EM spectrum
http://www.kollewin.com/blog/electromagnetic-spectrum/
Image Processing Image Analysis
Image acquisition
Low level Image enhancement
Image processing
Image compression
Image segmentation
Mid level
Object recognition
Image analysis
Scene understanding
(Computer vision,
High level
Semantics Pattern recognition, etc.)
Image Acquisition and Representation
Examples
1. Brain MRI 2. Cardiac CT 3. Fetus Ultrasound
4. Satellite image 5. IR image
1 and 3. http://en.wikipedia.org 4. http://emap-int.com
2. http://radiology.rsna.org 5. http://www.imaging1.com
Image Acquisition
Camera + Scanner Digital Camera: Get images into computer
lensaperture shutter film
Image Representation
Discrete representation of images
• we’ll carve up image into a rectangular grid of pixels P[x,y]
• each pixel p will store an intensity value in [0 1]
• 0 black; 1 white; in-between gray
• Image size mxn (mn) pixels
Color Image
Red Green Blue
(1,0,0) (0,1,0) (0,0,1)
0.6
0.0
+
0.8
0 Colors along Red axis 1
RGB
channels
Video: Frame by Frame
30 frames/second
Image Enhancement
Image Restoration
Image Compression
Video compression
Image Processing Image Analysis
Image acquisition
Low level Image enhancement
Image processing
Image compression
Image segmentation
Mid level
Object recognition
Image analysis
Scene understanding
(Computer vision,
High level
Semantics Pattern recognition, etc.)
Image Segmentation
Microsoft multiclass segmentation data set
Image Completion
Interactively select objects. Remove them and automatically
fill with similar background (from the same image)
I. Drori, D. Cohen-Or, H. Yeshurun, SIGGRPAH’03
More Examples
Morphological Image Processing
Object Detection / Recognition
Content-Based Image Retrieval
Biometrics
Super-Resolution
Applications of Digital Image Processing
Digital camera
Photoshop
Human computer interaction
Medical imaging for diagnosis and treatment
Surveillance
Automatic driving
…
Fast-growing market!
Basic Concepts in Digital
Image Processing
Now,
Introducing some basic concepts in digital image processing
• Human vision system
• Basics of image acquisition
Reading: Chapter 2.
Elements of Human Visual Perception
Human visual perception plays a
key role in selecting a technique
Lens and Cornea: focusing on the
objects
Visual axis
Two receptors in the retina:
• Cones and rods
• Cones located in fovea and are
highly sensitive to color
• Rods give a general overall
picture of view, are insensitive http://www.mydr.com.au/eye-health/eye-anatomy
to color and are sensitive to low
level of illumination
Distribution of Rods and Cones in the Retina
Brightness Adaptation: Subjective Brightness
Scotopic:
• Vision under low illumination
• rod cells are dominant
Photopic:
• Vision under good illumination
• cone cells are dominant
The total range of distinct
intensity levels the eye can
discriminate simultaneously
is rather small
Brightness adaptation level
Lambert
Brightness Discrimination
Weber Ratio/Fraction
Additional
I c light source
I
I
Short-duration flash
Small ratio: good brightness
discrimination An opaque glass
Large ratio: poor brightness
discrimination
Brightness Discrimination at Different
Intensity Levels
rod
cone
Perceived Intensity is Not a Simple Function
of the Actual Intensity (1)
Perceived Intensity is Not a Simple Function of
the Actual Intensity – Simultaneous Contrast
Optical Illusions: Complexity of Human Vision
More Optical Illusions
http://www.123opticalillusions.com/ http://brainden.com/optical-illusions.htm
How do we perceive Scenes
separate features,
objects, scenes, etc. in
Objects
the environment?
Perception of a scene
involves multiple levels Groups of
of perceptual analysis. Features
Features
What Do We Do With All Of This Visual
Information??
“Bottom up processing”
Scenes
• Data-driven
Top-down
• Sensation reaches brain,
and then brain makes
sense of it Objects
“Top down processing”
• Cognitive functions informs Groups of
our sensation Features
• E.g., walking to refrigerator
in middle of night
Bottom-upFeatures
