Digital Image Processing
Chapter 1: Introduction
Text book
Textbook:
Rafael C. Gonzalez and Richard E. Woods, "Digital
rd
Image Processing, 3 edition", Prentice Hall.
2
Course Content
Chapter 1: Introduction
Chapter 2: Digital Image Fundamentals
Chapter 3: Image Enhancement in the Spatial Domain
Chapter 4: Image Enhancement in the Frequency Domain
Chapter 6: Color image processing
Chapter 8: Image Compression (introduction)
Chapter 9: Morphological Image Processing
Chapter 11: Representation and Description
Chapter 12: Object Recognition (introduction)
Grading System
First Exam
20% (first 4 chapter
Second Exam
20% (the rest)
Assignment/Quiz/Report 20%
Final Exam
40%
4
Overview
Early days of computing, data was
numerical and textual.
Today, many other forms of data: voice,
music, speech, images, computer graphics,
etc.
Each of these types of data are signals.
Loosely defined, a signal is a function that
conveys information.
5
Relationship of Signal
Processing to other fields
As long as people have tried to send or
receive through electronic media :
telegraphs, telephones, television, radar,
etc. there has been the realization that
these signals may be affected by the
system used to acquire, transmit, or
process them.
Sometimes, these systems are imperfect
and introduce noise, distortion, or other
artifacts. 6
Understanding the effects of these
systems and finding ways to correct them is
the fundamental of signal processing.
Sometimes, these signals are specific
messages that we create and send to
someone else (e.g., telegraph, telephone,
television, digital networking, etc.).
That is, we specifically introduce the
information content into the signal and
hope to extract it out later.
Sometimes, these man-made signals are
encoding of natural phenomena (audio
signal, acquired image, etc.),
but sometimes we can create them from
scratch (speech generation, computer
generated music, computer graphics).
Finally, we can sometimes merge these
technologies together by acquiring a
natural signal, processing it, and then
transmitting it in some fashion.
Acquire Encode and
Enhance the Compress for
natural picture transmit over
transmission
image digital network
Transmitted
codes of Decoded Decompressed
image
received by eyes Displayed to
create another
signal (visible
light of the
Interpreted in some fashion by our brain display)
Concerned fields:
Digital Communication
Compression
Speech Synthesis and Recognition
Computer Graphics
Image Processing
Computer Vision
10
What is Image Processing?
Image processing is a subclass of signal
processing concerned specifically with
pictures.
Improve image quality for human
perception and/or computer
interpretation.
Image Image Better
Processing
Image
11
Several fields deal with images
Computer Graphics : the creation of
images.
Image Processing : the enhancement or
other manipulation of the image – the
result of which is usually another images.
Computer Vision: the analysis of image
content.
12
Several fields deal with images
Input/Output Image Description
Image Computer
Image
Processing Vision
Computer
Description AI
Graphics
13
2 Principal application areas
Improvement of pictorial information for
human interpretation
Processing of image data for storage,
transmission, and representation for
autonomous machine perception
14
Ex. of fields that use DIP
Categorize by image sources
Radiation from the Electromagnetic spectrum
Acoustic
Ultrasonic
Electronic (in the form of electron beams
used in electron microscopy)
Computer (synthetic images used for modeling
and visualization)
15
Radiation from EM spectrum
Spectral bands are grouped by energy per photon
Gamma rays, X-rays, Ultraviolet, Visible, Infrared,
Microwaves, Radio waves
16
a b
Gamma-Ray Imaging c d
Nuclear Image
(a) Bone scan
(b) PET (Positron emission
tomography) image
(c) Astronomical
Observations.
Nuclear Reaction
(d) Gamma radiation from
a reactor valve
17
a
d
b
X-ray Imaging c e
Medical diagnostics
(a) chest X-ray
(familiar)
(b) aortic angiogram
(c) head CT
Industrial imaging
(d) Circuit board
(e) Astronomy
18
a b
c
Imaging in Ultraviolet Band
Industrial inspection
Microscopy
(fluorescence)
(a) Normal corn
(b) Smut corn
Lasers
Biological imaging
(c) Astronomical
observations
(
19
Imaging in Visible and a b c
Infrared Bands d e f
Astronomy
Light microscopy
pharmaceuticals
(a). taxol (anticancer agent)
(b). cholesterol
Microinspection to
materials characterization
(c). Microprocessor
(d). Nickel oxide thin film
(e). Surface of audio CD
(f). Organic superconductor
20
Remote sensing Thematic bands in visual and infrared regions
To monitor the
environmental
conditions on
the planet
NASA’s LANDSAT: Washington DC
Remote sensing : Weather observation and prediction
Multispectral image
from satellites using
sensors in the visible
and infrared bands
Remote sensing : Nighttime Lights of the World
(provides a global inventory of human settlements)
Infrared satellite images of
Infrared satellite images of the remaining populated part
the Americas. of the world
a d
Industry : visual spectrum
b e
(automated visual inspection of manufactured goods)
c f
(a). A circuit board: inspect them
for missing parts
(b). Pill container: look for missing
pills
(c). Bottles : look for bottles that
are not filled up to an acceptable
level
(d). Bubbles in clear-plastic
product : detect unacceptable
number of air pockets
(e). Cereal : inspection for color
and the presence of anomalies
such as burned flake.
(f). Inspection of damaged
or incorrectly manufactured
implants
a
Law enforcement : visual spectrum
b
c
(a). Thumb print:
automated search of a
database for a potential
matches
(b). Paper currency :
automated counting /
reading of the serial
number for tracking
and identifying bills
(c) and (d) Automated
license plate reading
Imaging in Microwave Band
Imaging radar : the only
way to explore
inaccessible regions of
the Earth’s surface
Radar image of
mountains in southeast
Tibet
Note the clarity and
detail of the image,
unencumbered by clouds
or other atmospheric
conditions that normally
interfere with images in
the visual band. 26
Imaging in Radio Band
Medicine
Magnetic resonance
image (MRI) : 2D
picture of a section of
the patient (any plane)
(a) knee
(b) spine
Astronomy
27
Acoustic Imaging
Geological applications : use sound in the low
end of the sound spectrum (hundred of Hz)
Mineral and oil exploration
Cross-sectional image of a seismic model.
The arrow points to a hydrocarbon (oil and/or gas) trap
(bright spots) 28
a b
Ultrasound Imaging c d
Manufacturing
Medicine
(a) Baby
(b) Another view of baby
(c) Thyroids
(d) Muscle layers
showing lesion
29
Generated images by a b
computer c d
Fractals : an iterative
reproduction of a basic
pattern according to
some mathematical rules
(a) and (b)
3-D computer modeling
(c) and (d)
30
3 types of computerized
process
Low-level : input, output are images
Primitive operations such as image preprocessing to
reduce noise, contrast enhancement, and image
sharpening
Mid-level : inputs may be images, outputs are
attributes extracted from those images
Segmentation
Description of objects
Classification of individual objects
High-level :
Image analysis
31
Fundamental steps
Output of these processes generally are images
Output of these processes generally are image attributes
Chapter66 Chapter 7 Chapter 8 Chapter 9
Chapter Chapter 7 Chapter 8 Chapter 9
Wavelet and
Wavelet and
ColorImage
Image Multiresolution Compression Morphological
Color Multiresolution Compression Morphological
Processing Processing
Processing Processing Processing
Processing
Chapter55 Chapter 10
Chapter Chapter 10
Segmentation
Image Segmentation
Image
Restoration
Restoration
Chapter 11
Chapter 3&4 Chapter 11
Chapter 3&4
Knowledge base Representation
Image Representation
Image &Segmentation
Enhancement &Segmentation
Enhancement
Chapter22 Chapter12
12
Chapter Chapter
Problem Image
Image
Object
Object
Acquisition Recognition
domain Acquisition Recognition
32
Image Acquisition:
An image is captured by a sensor (such as
a monochrome or color TV camera) and
digitized.
If the output of the camera or sensor is
not already in digital form, an analog-to-
digital converter digitizes it.
33
Camera
Camera consists of 2
parts
A lens that collects the
appropriate type of
radiation emitted from the
object of interest and
that forms an image of the
real object
a semiconductor device –
so called charged coupled
device or CCD which
converts the image into an
electrical signal.
34
Frame Grabber
Frame grabber only
needs circuits to
digitize the electrical
signal from the
imaging sensor to
store the image in
the memory (RAM) of
the computer.
35
Image Enhancement
To highlight certain features of interest
in an image.
Example:
36
Image Restoration
Improving the appearance of an image
Tend to be based on mathematical or
probabilistic models of image degradation
Example:
Distorted image Restored image
37
Color Image Processing
Gaining in importance because of the
significant increase in the use of digital
images over the Internet
38
Wavelets
Foundation for representing images in
various degrees of resolution.
Used in image data compression and
pyramidal representation.
39
Compression
Reducing the storage required to save an
image or the bandwidth required to
transmit it.
Ex. JPEG (Joint Photographic Experts
Group) image compression standard.
40
Morphological processing
Tools for extracting image components
that are useful in the representation and
description of shape.
41
Image Segmentation
computer tries to separate objects
from the image background.
background
It is one of the most difficult tasks
in DIP.
Output of the segmentation stage
is raw pixel data, constituting
either the boundary of a region or
all the points in the region itself.
42
Representation & Description
Representation D make a decision
whether the data should be represented
as a boundary or as a complete region.
Boundary representation D focus on external
shape characteristics, such as corners and
inflections.
Region representation D focus on internal
properties, such as texture or skeleton
shape.
43
Representation & Description
1 connected component, 1 hole
Representation + Description
transform raw data
a form suitable for
the Recognition
processing
1 connected component, 2 holes
44
Recognition & Interpretation
Recognition D the process that assigns a
label to an object based on the
information provided by its descriptors.
Interpretation D assigning meaning to an
ensemble of recognized objects.
45
Knowledge base
a problem domain D detailing regions of
an image where the information of
interest is known to be located.
Help to limit the search
46
Not all the processes are
needed. Ex. Postal Code Problem
Representation
Segmentation
and description
Preprocessing
Recognition
Problem Knowledge Result
domain Image and
acquisition base Interpretation
Pieces of
mail
Desired output = alphanumeric characters
47
Digital Image Processing (DIP)
“A picture is worth a thousand words”.
What Is A Digital Image?
• Is composed of a finite number of elements each of which has
a particular location and value (pixels, pels, picture elements).
y 100
Gray level
x
50 pixel
Original picture Digital image
f(x, y) I[r, c] or I[x, y]
1
Image Processing: What Is It?
• Processing images by means of a digital computer.
• Image acquisition.
• Representing, storing and displaying images.
• Image transformations.
• Image filtering, enhancement and restoration.
• Image compression.
Related Computations
• Image/Video processing: Improving or changing images/video.
• Image/Video analysis (computer vision).
• Image/Video indexing: Finding images and video (databases).
• Acting based on visual information (image understanding).
• Graphics and animation: Generating images and video.
2
Image Processing vs. Computer Vision
• Low-level processing: Involves primitive operations.
Input: Image
Output: Image
• Mid-level processing: Involves tasks such as partitioning an
image into regions or objects, object description, and
classification.
Input: Image
Output: Attributes
• High-level processing: Involves “making sense” of an ensembele
of recognized objects (image analysis to computer vision).
Input: …
Output: …
History
- Newspaper industry: 1921
- Space imaging: 1960
- Computer axial tomography (CAT): 1970
3
DIP: Fundamentals
DIP: Components
