PENGOLAHAN CITRA DIGITAL
(TIK414)
Pertemuan 1
INTRODUCTION TO DIGITAL IMAGE
PROCESSING
Endina Putri Purwandari, ST., [Link].
Teknik Informatika
Universitas Bengkulu
1
Topics
1. Digital Image Processing
2. Image Transformation
3. Image Enhancement
4. Image Restoration
5. Image Compression
6. Image Segmentation
7. Image Classification
2
Marking Components
WorkGroup : 15 %
Mid Test (UTS) : 20 %
Final Test (UAS) : 25 %
Practicum : 20 %
Literature Review (Individual) : 15 %
Absent, Attitude, & Participation :5 %
3
Assignments
Workgroup
◦ Collaborate in team not tend to work
individually
◦ Each member have responsibility
◦ Group processing and reflection
Minimum attendance in class : 75%
No second Mid Test (UTS) & Final Test (UAS)
4
Rules
No plagiarism and Copy paste answer
Work Group:
◦ One group : 5-6 member
◦ No plagiarism from other group
◦ Everyone contribute in exercise, NO sucker
and NO free-reader
◦ Sanction: grades reduction
5
References
Gonzalez, Rafael C. and Woods. R.E. 2007.
Digital Image Processing, 3rd edition. Prentice
Hall. ISBN 0-13-168728-8
Gonzalez R. C., Woods, R. E. 2009. Digital
Image Processing with Matlab, 2nd edition.
Gatesmark Publishing. ISBN 0-98-208540-0
Eko Prasetyo. 2012. Pengolahan Citra
Digital dan Aplikasinya Menggunakan Matlab.
Andi Yogyakarta. ISBN 978-979-29-2703-0
6
Introduction
“One picture is worth more than
ten thousand words”
Anonymous
7
Digital Cameras
8
Traditional Photography
A chemical process, little
changed from 1826
Taken in France on a pewter
plate
… with 8-hour exposure
The world's first photograph
9
History of Digital Image Processing
Early 1920s: One of the first applications of
digital imaging was in the news-
paper industry
◦ The Bartlane cable picture
transmission service Early digital image
◦ Images were transferred by submarine cable
between London and New York
◦ Pictures were coded for cable transfer and
reconstructed at the receiving end on a
telegraph printer
10
Image Formation in a Pinhole Camera
Light enters a darkened chamber through
pinhole opening and forms an image on the
further surface
11
Aperture
Hole or opening where light enters
◦ Or, the diameter of that hole or opening
Pupil of the human eye
◦ Bright light: 1.5 mm diameter
◦ Average light: 3-4 mm diameter
◦ Dim light: 8 mm diameter
Camera
◦ Wider aperture admits more light
◦ Though leads to blurriness in the
objects away from point of focus
12
Aperture and Light
Aperture: The size of the hole that
lets light into a device controlled
by shutter
- This is not made to be controlled
so it is important to know the
range of the shutter when
choosing
- The more light coming into a
sensor, the brighter the image can
be
13
[Link]
From Light to Charge
- Light from the lens falls onto a sensor
array
- Light at a specific point on the array
passes through red, green, or blue filter
on photodiode.
[Link]
14
Shutter Speed
Time for light to enter camera
◦ Longer times lead to more light
◦ … though blurs moving subjects
• Exposure
–Total light entering
the camera
–Depends on aperture
and shutter speed
15
CCD: Charge Coupled Device
CCD sensor
Common sensor array used in digital cameras
◦ Each capacitor accumulates charge in response to
light
Responds to about 70% of the incident light
◦ In contrast, photographic film captures only about 2%
Also widely used in astronomy telescopes
16
Separate Sensors Per Color
Expensive cameras
◦ A prism to split the light into three colors
◦ Three CCD arrays, one per RGB color
17
Practical Color Sensing: Bayer Grid
Place a small color filter
over each sensor
Each cell captures intensity
of a single color
More green pixels, since
human eye is better at
resolving green
18
Practical Color Sensing: Interpolating
Challenge: inferring what we can’t see
◦ Estimating pixels we do not know
Solution: estimate based on neighboring
pixels
◦ E.g., red for non-red cell averaged from red
neighbors
◦ E.g., blue for non-blue cell averaged from blue
neighbors
Estimate “R” and “B” at the
“G” cells from neighboring
values
19
DIGITAL IMAGE PROCESSING
20
What is a Digital Image?
A digital image is a representation of a two-
dimensional image as a finite set of digital values,
called picture elements or pixels
21
What is a Digital Image? (cont…)
Pixelvalues typically represent gray levels,
colours, heights, opacities etc
Remember digitization implies that a digital
image is an approximation of a real scene
1 pixel
22
Sensor Array: Image Sampling
Pixel (Picture Element): single point in a graphic image
23
More Pixels Mean More Detail
1600 x 1400 1280 x 960
2.1 megapixels 1.1 megapixels
640 x 480
0.3 megapixels
24
The The
2272 x 1704 320 x 240
hand hand
25
Representing Color
Light receptors in the human eye
◦ Rods: sensitive in low light, mostly at periphery of eye
◦ Cones: only at higher light levels, provide color vision
◦ Different types of cones for red, green, and blue
RGB color model
◦ A color is some combination of red, green, and blue
◦ Intensity value for each color
0 for no intensity
1 for high intensity
◦ Examples
Red: 1, 0, 0
Green: 0, 1, 0
Yellow: 1, 1, 0
26
Representing Image as a 3D Matrix
In the lab this week…
◦ Matlab experiments with digital images
Matrix storing color intensities per pixel
◦ Row: from top to bottom 1
2
◦ Column: from left to right 3
◦ Color: red, green, blue
Examples 1 2
◦ M(3,2,1): third row, second column, red intensity
◦ M(4,3,2): fourth row, third column, green
intensity
27
Limited Granularity of Color
Three intensities, one per color
◦ Any value between 0 and 1
Storing all possible values take a lot of bits
◦ E.g., storing 0.368491029692069439604504560106
◦ Can a person really differentiate from 0.36849?
Limiting the number of intensity settings
◦ Eight bits for each color
◦ From 00000000 to 11111111
◦ With 28 = 256 values
Leading to 24 bits per pixel
Red: 255, 0, 0
Green: 0, 255, 0
Yellow: 255, 255, 0
28
Number of Bits Per Pixel
Number of bits per pixel
◦ More bits can represent a wider range of colors
◦ 24 bits can capture 224 = 16,777,216 colors
◦ Most humans can distinguish around 10 million colors
8 bits / pixel / color 4 bits
29 / pixel / color
What is a Digital Image? (cont…)
Common image formats include:
◦ 1 sample per point (B&W or Grayscale)
◦ 3 samples per point (Red, Green, and Blue)
◦ 4 samples per point (Red, Green, Blue, and “Alpha”, a.k.a.
Opacity)
For most of this course we will focus on grey-scale
images 30
Are More Pixels Always Better?
Generally more is better
◦ Better resolution of the picture
◦ Though at some point humans can’t tell the
difference
But, other factors matter as well
◦ Sensor size
◦ Lens quality
◦ Whether Bayer grid is used
Problem with too many pixels
◦ Very small sensors catch fewer photons
◦ Much higher signal-to-noise ratio
Plus, more pixels means more storage…
31
Digital Images Require a Lot of Storage
Three dimensional object
◦ Width (e.g., 640 pixels)
◦ Height (e.g., 480 pixels)
◦ Bits per pixel (e.g., 24-bit color)
Storage is the product
◦ Pixel width * pixel height * bits/pixel
◦ Divided by 8 to convert from bits to bytes
Example sizes
◦ 640 x 480: 1 Megabyte
◦ 800 x 600: 1.5 Megabytes
◦ 1600 x 1200: 6 Megabytes
32
Questions?
33
[Link]
What is Digital Image Processing?
Digitalimage processing focuses on two
major tasks
◦ Improvement of pictorial information for human
interpretation
◦ Processing of image data for storage,
transmission and representation for autonomous
machine perception
Some argument about where image
processing ends and fields such as image
analysis and computer vision start
34
Digital Image Processing:
ApplicationsDigital Applications
Biomedical (Kedokteran);
Remote Sensing (PenginderaanJarakJauh);
Industry;
Gesture Language (BahasaIsyarat);
Character Recognition
(PengenalanKarakter);
Digital Signature & Biometric Data (for e-
Commerce, Banking etc.)
Security (Watermarking, Forgery)
35
Visual Scene Understanding
36
3D object insertion into video
37
Figure-ground segmentation
38
Machine Learning: Object recognition
• General object class recognition
• Learned visual dictionary
- underlies image/video search
- object sensitive image editing
39
Specific 3D Object Recognition
40
High-Fidelity Image-Based Modeling
41
Naming people in videos: A Buffy
example
42
Category-Level Object and Scene
Recognition
43
Flexible Models for 3D Object Detection
44
Change Detection for Environmental
Sciences
45
Computer Graphics
46
Graphics of heart phantom
Image guidance for robotic minimally
invasive coronary artery bypass
47
Image Processing and Pattern Recognition
48
Image Retrieval System
Berdasarkan metadata atau indexing
Berdasarkan content
49
50
Content-Based Image Retrieval System
An image is represented by a set of features
We have a database of images with their
representation based on set of features, and
information about the image
We have a query image, and would like to
know the characteristic of the image
The query image features are compared to the
features of images in the database based on a
similarity measure
Similar images are provided to the user with
their characteristic
51
Content-Based Image Retrieval System
52
Key Stages in Digital Image Processing
Image Morphological
Restoration Processing
Image
Segmentation
Enhancement
Image Object
Acquisition Recognition
Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
53
Key Stages in Digital Image Processing:
Image Aquisition
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
Image Morphological
Restoration Processing
Image
Segmentation
Enhancement
Image Object
Acquisition Recognition
Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
54
Data Aquisition
Gamma Ray and X-Ray : Nuclear, Medical,
Astronomy
Microwave band: Radar
55
Data Acquisition
56
Key Stages in Digital Image Processing:
Image Enhancement
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
Image Morphological
Restoration Processing
Image
Segmentation
Enhancement
Image Object
Acquisition Recognition
Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
57
Image Enhancement
58
Key Stages in Digital Image Processing:
Image Restoration
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
Image Morphological
Restoration Processing
Image
Segmentation
Enhancement
Image Object
Acquisition Recognition
Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
59
Image Restoration (Cloud Removal)
60
Key Stages in Digital Image Processing:
Morphological Processing
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
Image Morphological
Restoration Processing
Image
Segmentation
Enhancement
Image Object
Acquisition Recognition
Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
61
Key Stages in Digital Image Processing:
Segmentation
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
Image Morphological
Restoration Processing
Image
Segmentation
Enhancement
Image Object
Acquisition Recognition
Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
62
Image Segmentation
Segmentasi citra: membagi suatu citra menjadi
wilayah-wilayah yang homogen
63
Key Stages in Digital Image Processing:
Object Recognition
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
Image Morphological
Restoration Processing
Image
Segmentation
Enhancement
Image Object
Acquisition Recognition
Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
64
Key Stages in Digital Image Processing:
Representation & Description
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
Image Morphological
Restoration Processing
Image
Segmentation
Enhancement
Image Object
Acquisition Recognition
Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
65
Edge Detection
66
Key Stages in Digital Image Processing:
Image Compression
Image Morphological
Restoration Processing
Image
Segmentation
Enhancement
Image Object
Acquisition Recognition
Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
67
Key Stages in Digital Image Processing:
Colour Image Processing
Image Morphological
Restoration Processing
Image
Segmentation
Enhancement
Image Object
Acquisition Recognition
Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
68
WorkGroup Discussion
Tugas setiap kelompok menyusun makalah mengenai
Kelompok 1 : Image Enhancement in Spatial
Domain (gray level transformation, histogram
processing, arithmetic/logic operation, point and
mask processing), Convolution and Correlation
Kelompok 2 : Image Enhancement in Spatial
Processing (Smoothing, and Sharpening, Median
Filter) and Frequency Domain Filter, High and Low
Pass Filter
Kelompok 3 : Image Transformation, Fourier
Image Transformation, Discrete Cosine
Transformation, Hadamard-Walsh transformation,
Wavelet Transformation
69
Kelompok Praktikum
1 kelompok : 4 – 5 orang
Setiap kelompok membuat program aplikasi
pengolahan citra dengan MATLAB dan GUI
MATLAB
Topik aplikasi bebas dari buku atau dari
[Link]
Laporan kelompok dikumpul di akhir
perkuliahan 31 Desember 2015
Laporan program: jelaskan baris coding, dan
algoritma citra yang digunakan
70
WorkGroup Discussion
Tugas dikumpulkan tanggal 18 September
2014, 2 Oktober 2014, 16 Oktober
Setiap kelompok
1. membuat paper/makalah tentang topik
tersebut
2. Menyusun slide presentasi
3. Paper dilengkapi dengan contoh aplikasinya
71
Literature Review (Individual)
Tugas Individu, memilih salah satu topik
Topics:
1. CBIR (Content Based Image Retrieval)
2. Image Forensic (Pemalsuan Citra, Copy Move/Image
Splicing)
3. Image Classification/ Clustering
4. Image Object/Pattern Recognition
5. Remote Sensing Application
6. 3D Image Modelling
7. Image Restoration
8. Image Clustering
9. Image Compression
10. Image Watermarking
72
Literature Review (Individual)
Cari sejumlah jurnal/conference
paper/skripsi dengan topik yang sama dan
saling berkaitan agar dapat
dianalisis/bandingkan
2 paper internasional, bahasa inggris, dengan
topik yang sama
1 paper nasional atau skripsi dengan topik
yang sama
Dikumpulkan Sebelum UAS
End of Year (31 Desember 2014)
73
How to Review Literatures?
Compare: try to find the similarities among
literatures
◦ Explain how each article similar to the others.
Contrast: try to find the differences among
literatures
◦ Explain how each article differ to the others
Criticize: put your own opinion on what is written in
the literatures
◦ Criticize the strength and weakness of the research
Synthesize: combine several literatures into an idea
Summarize: restate the articles with your own
words in a concise way
74
